-- Logs begin at Tue 2022-08-30 02:39:47 UTC, end at Tue 2022-08-30 05:12:20 UTC. -- Aug 30 03:13:20.184846 n-d-854924-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 03:13:20.195242 n-d-854924-5 devstack@n-api.service[106311]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 03:13:20 2022] *** Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: nodename: n-d-854924-5 Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: machine: x86_64 Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: clock source: unix Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: pcre jit disabled Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: detected number of CPU cores: 4 Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: current working directory: / Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: detected binary path: /usr/bin/uwsgi-core Aug 30 03:13:20.197263 n-d-854924-5 devstack@n-api.service[106311]: your processes number limit is 47680 Aug 30 03:13:20.198589 n-d-854924-5 devstack@n-api.service[106311]: your memory page size is 4096 bytes Aug 30 03:13:20.198589 n-d-854924-5 devstack@n-api.service[106311]: detected max file descriptor number: 2048 Aug 30 03:13:20.198589 n-d-854924-5 devstack@n-api.service[106311]: lock engine: pthread robust mutexes Aug 30 03:13:20.198589 n-d-854924-5 devstack@n-api.service[106311]: thunder lock: enabled Aug 30 03:13:20.198589 n-d-854924-5 devstack@n-api.service[106311]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 03:13:20.198589 n-d-854924-5 devstack@n-api.service[106311]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 03:13:20.236812 n-d-854924-5 devstack@n-api.service[106311]: Python main interpreter initialized at 0x5646f99d99c0 Aug 30 03:13:20.236812 n-d-854924-5 devstack@n-api.service[106311]: python threads support enabled Aug 30 03:13:20.236812 n-d-854924-5 devstack@n-api.service[106311]: your server socket listen backlog is limited to 100 connections Aug 30 03:13:20.236812 n-d-854924-5 devstack@n-api.service[106311]: your mercy for graceful operations on workers is 90 seconds Aug 30 03:13:20.237201 n-d-854924-5 devstack@n-api.service[106311]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 03:13:20.237201 n-d-854924-5 devstack@n-api.service[106311]: *** Operational MODE: preforking *** Aug 30 03:13:20.237496 n-d-854924-5 devstack@n-api.service[106311]: *** uWSGI is running in multiple interpreter mode *** Aug 30 03:13:20.237496 n-d-854924-5 devstack@n-api.service[106311]: spawned uWSGI master process (pid: 106311) Aug 30 03:13:20.237703 n-d-854924-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 03:13:20.241406 n-d-854924-5 devstack@n-api.service[106311]: spawned uWSGI worker 1 (pid: 106323, cores: 1) Aug 30 03:13:20.241406 n-d-854924-5 devstack@n-api.service[106311]: spawned uWSGI worker 2 (pid: 106324, cores: 1) Aug 30 03:13:20.241406 n-d-854924-5 devstack@n-api.service[106311]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 03:13:20.919631 n-d-854924-5 devstack@n-api.service[106324]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 03:13:20.924429 n-d-854924-5 devstack@n-api.service[106323]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 03:13:22.000452 n-d-854924-5 devstack@n-api.service[106324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:13:22.000452 n-d-854924-5 devstack@n-api.service[106324]: from cryptography.utils import int_from_bytes Aug 30 03:13:22.001062 n-d-854924-5 devstack@n-api.service[106324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:13:22.001062 n-d-854924-5 devstack@n-api.service[106324]: from cryptography.utils import int_from_bytes Aug 30 03:13:22.007702 n-d-854924-5 devstack@n-api.service[106323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:13:22.007702 n-d-854924-5 devstack@n-api.service[106323]: from cryptography.utils import int_from_bytes Aug 30 03:13:22.008125 n-d-854924-5 devstack@n-api.service[106323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:13:22.008125 n-d-854924-5 devstack@n-api.service[106323]: from cryptography.utils import int_from_bytes Aug 30 03:13:24.484185 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:13:24.484737 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:13:24.485102 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:13:24.485201 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:13:24.485286 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:13:24.485405 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:13:24.485499 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:13:24.485599 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:13:24.485690 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:13:24.485771 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:13:24.485946 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486085 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486279 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486388 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486596 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486686 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486910 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.486999 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.487232 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.487355 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.487540 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.487661 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.488119 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.488229 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.488432 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.488522 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.488753 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.488841 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489011 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489114 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489322 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489427 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489669 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854924-5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489768 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854924-5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.489987 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.490075 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.490291 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.490385 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.490598 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.490705 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.490912 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491010 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491211 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491298 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491527 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491626 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491829 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.491924 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.492318 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.492430 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493503 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493622 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493696 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493770 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493840 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493906 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.493988 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494064 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494145 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494215 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494282 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494355 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494582 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494694 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494905 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.494992 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.495224 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.495309 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.495534 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.495644 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.495917 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854924-5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496046 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854924-5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496231 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496331 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496535 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496622 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496847 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.496964 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.497253 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.497388 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.497587 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.497679 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.497892 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.497981 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.498207 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.498310 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.498524 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.498620 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.498830 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.498926 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.499149 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.499246 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.499462 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.499558 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.499781 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.499877 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500086 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500189 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500384 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500474 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500690 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500778 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.500997 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.501097 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.501315 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.501482 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.501648 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.501744 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.501952 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502042 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502204 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502348 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502512 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502599 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502828 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.502925 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503144 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503276 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503459 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503549 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503710 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503801 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.503958 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504051 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504270 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504368 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504585 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504678 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504888 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.504976 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.505192 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.505288 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.505518 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.505612 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.505821 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.505954 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.506126 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.506215 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.506443 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.506542 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.506728 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.506825 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507029 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507118 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507342 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507431 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507650 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507738 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.507966 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.508055 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.508269 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.508368 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.508582 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.508679 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.508966 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509054 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509214 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509309 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509543 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509660 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509877 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.509964 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.510188 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.510275 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511001 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511108 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511316 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511404 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511629 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511729 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.511933 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512031 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512235 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512322 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512536 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512628 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512850 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.512950 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.513179 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.513276 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.513509 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.513601 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.513761 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.513861 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514056 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514144 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514357 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514444 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514667 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514768 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.514969 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515057 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515271 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515359 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515573 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515663 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515866 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.515953 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.516167 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.516266 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.516468 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.516557 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.516771 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.516867 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517069 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517164 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517397 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517490 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517687 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517774 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.517996 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.518094 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.518286 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.518373 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.518586 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.518674 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.518896 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519000 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519208 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519296 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519510 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519597 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519808 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.519904 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.520109 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.520197 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.520408 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.520495 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.520719 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.520815 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521018 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521105 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521318 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521468 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521658 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521759 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.521958 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522054 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522258 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522345 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522568 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522663 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522870 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.522960 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.523171 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.523258 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.523485 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.523587 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.523777 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.523873 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524079 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524167 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524388 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524477 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524687 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524775 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.524987 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.525073 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.525286 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.525398 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.525610 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.525698 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.525927 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.526661 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.526760 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.526843 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527063 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527153 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527365 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527454 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527663 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527759 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.527975 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.528061 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.528289 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.528390 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.528594 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.528683 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.528901 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.529205 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.529305 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.529543 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.529634 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.529861 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:13:24.529949 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.530192 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.530281 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.530519 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.530609 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.530833 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.530919 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.531158 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.531244 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.531486 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.531576 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.531801 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.531889 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.532112 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.532208 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.532417 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.532503 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.532727 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.532827 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533034 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533140 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533382 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533475 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533675 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533766 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.533981 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.534078 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.534295 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.534382 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.534606 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.534704 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.534924 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535022 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535234 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535321 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535544 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535632 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535849 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.535952 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.536152 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.536241 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.536465 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.536553 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.536783 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.536881 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.537095 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.537182 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.537423 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.537514 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.537760 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.537851 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.538096 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.538189 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.538402 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.538489 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.538723 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.538820 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539034 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539122 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539337 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539434 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539645 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539735 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.539951 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540040 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540268 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540372 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540580 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540667 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540897 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.540984 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.541210 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.541308 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.541554 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.542368 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.542457 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.542679 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.542769 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.542986 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.543077 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.543295 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.543383 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.543606 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.543746 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.543911 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.544001 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.544243 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.544331 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.544554 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.544641 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.544873 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545007 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545188 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545275 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545522 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545627 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545840 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.545931 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.546152 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.546240 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.546460 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.546560 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.546772 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.546868 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547073 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547160 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547376 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547473 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547677 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547764 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.547984 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.548072 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.548285 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.548451 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.548604 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.548693 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.548925 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549012 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549227 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549324 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549577 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549667 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549880 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.549967 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.550187 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.550275 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.550495 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.550582 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.550798 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.550887 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.551102 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.551191 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.551407 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.551494 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.551714 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.551809 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552013 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552102 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552332 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552427 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552637 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552780 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.552939 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553026 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553252 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553363 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553581 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553696 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553886 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.553985 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.554198 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.554285 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.554503 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.554605 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.554812 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.554901 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.555119 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.555273 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.555424 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.555525 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.555741 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.555830 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.556050 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.556140 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.556357 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.556453 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.556684 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.556772 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.557012 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.557101 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558047 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558150 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558247 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558331 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558518 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558606 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558833 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.558923 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.559133 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.559230 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.559437 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.559527 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.559740 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.559829 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560037 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560134 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560338 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560436 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560641 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560738 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.560942 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561029 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561242 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561337 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561565 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561666 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561865 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.561953 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.562163 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.562261 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.562479 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.562577 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.562782 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.562871 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.563081 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.563178 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.563382 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.563471 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.563679 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.563767 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564015 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564106 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564317 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564406 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564652 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564741 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.564981 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.565070 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.565297 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.565443 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.565637 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.565733 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.565948 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566037 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566257 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566343 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566563 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566651 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566869 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.566958 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.567176 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.567264 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.567484 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.567570 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.567797 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.567885 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.568102 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.568191 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.568417 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.568514 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.568721 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.568810 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.569039 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.569126 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.569387 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.569492 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.569710 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.569811 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570013 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570110 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570324 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570423 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570659 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570748 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.570985 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.571073 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.571295 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.571393 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.571615 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.571703 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.571919 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572008 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572229 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572318 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572534 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572622 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572865 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.572965 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.573171 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.573260 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.573502 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.573593 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.573821 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.573920 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.574125 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.574214 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.574439 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.574528 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.574744 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.574840 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575061 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575150 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575365 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575455 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575678 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575764 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.575975 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.576064 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.576285 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.576374 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.576607 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.576703 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.576934 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577024 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577238 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577326 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577569 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577739 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577887 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.577986 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.578195 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.578284 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.578499 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.578601 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.578807 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.578895 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.579107 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.579195 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.579407 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.579509 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.579717 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.579843 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580033 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580166 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580344 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580476 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580653 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580783 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.580961 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.581086 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.581276 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.581420 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.581614 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.581730 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.581920 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582021 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582226 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582318 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582539 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582627 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582862 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.582999 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.583179 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.583270 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.583505 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.583601 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.583828 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.583972 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.584129 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.584216 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.584429 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.584530 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.584749 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.584845 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585053 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585149 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585385 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585479 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585676 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585776 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.585978 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.586069 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.586314 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.586406 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.586622 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.586726 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.586925 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587012 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587234 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587349 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587551 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587647 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587857 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.587953 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.588167 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.588256 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.588499 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.588600 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.588813 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.588902 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.589136 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.589226 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.589474 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.589567 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.589785 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.589916 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.590095 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.590187 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.590403 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.590500 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.590717 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.590866 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591012 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591168 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591326 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591471 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591610 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591774 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.591916 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592074 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592218 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592352 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592496 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592587 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592812 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.592977 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.593120 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.593263 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.593706 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.593884 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594091 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594256 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594405 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594567 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594711 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594861 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.594979 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.595063 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.595259 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.595359 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.595585 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.595685 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.595935 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.596089 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.596238 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.596394 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.596561 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.596719 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.596865 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597042 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597186 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597287 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597416 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597508 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597728 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.597817 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598041 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598133 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598344 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598431 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598646 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598733 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.598951 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599040 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599251 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599337 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599547 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599634 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599847 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.599942 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.600147 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.600235 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.600457 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.600551 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.600756 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.600845 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.601064 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.601151 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.601383 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.601557 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.601769 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.601911 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602078 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602166 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602381 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602480 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602680 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602768 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.602985 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.603083 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.603319 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.603418 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.603624 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.603721 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.603953 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.604520 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.604801 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.604900 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.605139 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.605227 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.605466 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.605620 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.605771 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.605861 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606088 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606183 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606390 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606478 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606689 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606778 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.606990 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607078 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607292 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607379 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607595 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607683 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607890 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.607985 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.608197 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.608287 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.608501 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.608592 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.608806 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.608893 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.609111 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.609207 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.609435 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.609539 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.609742 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.609832 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610044 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610141 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610351 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610439 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610656 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610744 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.610955 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.611052 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.611253 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.611349 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.611559 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.611647 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.611862 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.612001 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.612161 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.612253 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.612464 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.612553 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.612763 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.613140 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.613383 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.613475 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.613683 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.613783 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.613985 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614074 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614282 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614370 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614589 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614717 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614894 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.614985 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.615191 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.615278 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.615509 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.615598 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.615816 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.615905 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.616116 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.616204 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.616416 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.616515 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.616723 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.616812 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617020 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617107 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617321 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617494 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617650 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617737 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.617968 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618067 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618282 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618381 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618584 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618674 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618891 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.618978 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.619193 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.619289 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.619493 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.619582 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.620342 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.620445 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.620650 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.620739 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.620950 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.621039 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.621255 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.621444 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.621576 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.621667 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.621879 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622042 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622188 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622334 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622494 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622641 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622780 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.622922 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623065 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623209 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623373 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623503 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623631 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623737 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.623977 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.624146 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.624295 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.624437 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.624617 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.624779 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.624914 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.625077 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.625199 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.625366 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.625549 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.625701 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.625849 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626006 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626133 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626225 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626445 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626552 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626746 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.626852 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.627063 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.627223 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.627383 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.627536 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.627701 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.627854 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628007 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628098 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628254 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628350 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628574 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628665 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628885 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.628974 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.629193 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.629280 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.629538 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.629631 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.629859 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.629946 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.630176 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.630273 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.630479 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.630569 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.630783 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.630871 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.631092 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.631179 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.631395 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.631484 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.631700 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.631797 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632006 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632103 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632315 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632402 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632622 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632710 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.632929 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633026 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633238 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633445 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633557 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633645 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633859 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.633960 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.634170 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.634267 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.634477 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.634569 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.634780 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.634877 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.635101 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.635200 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.635432 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.635521 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.635735 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.635820 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636039 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636127 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636344 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636431 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636649 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636746 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.636951 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.637046 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.637397 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.637491 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.637713 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.637802 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638024 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638119 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638328 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638425 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638635 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638723 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.638944 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639030 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639258 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639358 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639570 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639658 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639871 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.639960 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.640280 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.640384 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.640589 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.640679 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.640897 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.640985 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.641205 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.641301 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.641534 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.641623 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.641839 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.641929 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.642147 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.642242 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.642469 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.642567 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.642769 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.642864 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643072 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643161 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643370 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643457 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643690 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643786 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.643995 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.644084 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.644312 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.644413 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.644721 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.644809 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.645032 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.645132 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.645334 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.645470 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.645763 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.645865 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.646072 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.646165 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.646377 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.646473 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.646694 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.646807 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647011 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647108 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647329 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647419 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647630 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647726 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.647942 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648045 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648246 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648342 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648563 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648651 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648881 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.648978 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.649186 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.649274 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.649521 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.649612 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.649825 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.649930 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.650142 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.650231 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.650459 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.650547 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.650766 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.650863 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.651606 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.651705 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652016 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652105 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652335 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652425 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652644 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652731 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.652960 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.653057 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.653284 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.653391 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.653615 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.653705 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.653916 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654013 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654225 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654324 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654529 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654621 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654827 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.654924 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.655145 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.655275 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.655445 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.655540 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.655752 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.655859 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656061 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656156 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656366 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656454 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656665 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656762 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.656965 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.657061 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.657282 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.657430 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.657610 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.657710 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.657930 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658020 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658237 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658325 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658555 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658653 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658871 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.658960 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.659182 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.659297 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.659489 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.659585 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.659794 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.659896 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.660092 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.660188 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.660393 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.660484 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.660693 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.660790 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661029 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661126 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661331 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661441 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661670 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661759 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.661996 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.662087 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.662320 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.662411 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.662630 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.662718 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.662960 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.663069 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.663282 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.663372 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.663598 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.663689 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.663906 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664007 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664216 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664304 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664537 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664625 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664836 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.664933 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.665136 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.665267 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.665469 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.665559 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.665772 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.665863 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.666074 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.666207 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.666375 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.666463 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.667240 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.667343 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.667539 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.667636 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.667843 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.667932 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.668145 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.668244 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.668464 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.668555 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.668766 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.668855 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.669085 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.669175 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.669409 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.669513 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.669714 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.669813 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670015 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670108 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670314 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670411 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670654 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670753 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.670954 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671043 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671279 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671374 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671583 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671720 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671902 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.671991 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.672217 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.672305 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.672526 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.672624 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.672839 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.672929 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.673149 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.673247 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.673484 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.673582 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.673798 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.673891 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.674109 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.674207 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.674417 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.674507 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.674727 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.674817 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.675038 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.675127 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.675353 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.675443 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.675866 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.675954 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.676193 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.676328 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.676507 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.676596 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.676814 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.676901 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.677122 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.677221 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.677461 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.677552 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.677773 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.677877 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.678081 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.678186 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.678387 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.678477 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.678694 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.678784 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679000 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679163 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679328 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679425 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679644 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679732 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.679965 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.680056 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.680295 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.680383 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.680608 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.680705 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.680922 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.681020 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.681230 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.681318 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.681569 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.681670 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.681920 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682012 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682254 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682347 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682561 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682699 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682869 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.682957 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.683182 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.683271 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.683491 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.683592 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.683799 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.683889 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.684107 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.684195 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.684422 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.684512 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.684733 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.684822 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685041 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685139 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685389 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685529 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685680 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685770 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.685991 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.686079 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.686324 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.686424 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.686636 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.686727 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.686955 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687055 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687276 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687373 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687572 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687661 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687885 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.687997 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.688394 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.688482 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.688705 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.688795 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.689036 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.689133 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.689375 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.689469 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.689696 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.689785 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690010 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690141 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690323 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690411 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690645 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690741 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.690947 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691039 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691252 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691341 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691554 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691642 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691858 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.691952 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.692159 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.692248 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.692478 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.692568 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.692787 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.692876 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.693085 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.693173 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.693427 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.693532 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.693736 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.693825 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.694264 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.694361 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.694609 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.694707 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.694922 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695011 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695244 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695343 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695566 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695670 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695879 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.695976 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.696183 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.696283 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.696503 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.696600 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.696805 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.696895 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.697107 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.697197 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.697444 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.697536 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.697754 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.697861 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698077 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698169 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698380 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698470 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698686 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698782 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.698990 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699080 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699292 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699391 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699597 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699686 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699898 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.699993 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.700221 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.700312 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.700522 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.700621 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.700823 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.700911 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.701185 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.701287 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.701452 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.701543 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.701757 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.701865 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702058 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702147 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702361 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702451 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702669 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702767 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.702983 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703073 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703288 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703376 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703597 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703706 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703902 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.703993 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.704210 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.704302 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.704516 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.704606 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.704864 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.704957 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.705167 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.705257 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.705512 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.705606 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.705819 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.705909 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.706119 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.706209 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.706435 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.706524 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.706740 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.706827 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.707060 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.707147 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.707367 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.707464 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.707676 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.707766 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.708017 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.708113 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.708330 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.708421 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.708857 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.708948 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.709190 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.709290 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.709534 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.709625 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.709864 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.709953 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.710192 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.710294 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.710501 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.710589 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.710803 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.710898 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.711107 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.711205 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.711428 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.711517 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.711739 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.711828 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712048 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712144 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712358 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712447 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712667 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712764 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.712974 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.713063 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.713282 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.713935 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.714127 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.714217 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.714438 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.714529 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.714746 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.714833 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715052 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715159 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715360 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715449 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715666 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715796 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.715975 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.716140 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.716280 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.716369 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.716592 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.716727 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.716927 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717026 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717243 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717331 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717584 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717684 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717899 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.717989 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.718214 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.718314 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.718522 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.718612 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.718829 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.718920 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.719137 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.719227 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.719442 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.719530 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.719756 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.719846 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.720079 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.720169 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.720389 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.720487 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.720695 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.720787 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.721103 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.721192 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.721437 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.721548 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.721756 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.721845 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.722077 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.722165 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.722382 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.722484 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.722699 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.722789 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723019 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723153 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723328 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723419 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723644 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723735 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.723951 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.724084 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.724278 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.724368 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.724612 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.724709 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.724935 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725025 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725256 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725364 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725583 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725672 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725885 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.725974 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.726189 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.726279 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.726491 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.726582 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.726807 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.726909 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.727113 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.727203 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.727414 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.727502 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.727714 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.727815 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728019 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728116 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728322 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728414 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728623 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728723 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.728924 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.729039 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.729795 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.729955 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.730111 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.730269 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.730417 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.730571 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.730723 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.730873 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731028 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731176 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731332 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731478 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731637 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731768 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.731941 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732068 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732250 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732373 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732553 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732674 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732859 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.732975 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.733162 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.733276 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.733496 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.733600 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.733801 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.733900 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.734132 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.734265 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.734464 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.734569 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.734779 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.734870 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.735100 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.735190 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.735410 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.735512 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.735724 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.735822 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736030 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736119 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736347 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736449 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736661 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736751 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.736972 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.737062 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.737279 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.737400 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.737632 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.737721 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.738203 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.738307 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.738511 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.738602 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.738819 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.738922 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.739126 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.739215 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.739429 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.739527 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.739735 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.739824 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740053 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740141 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740372 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740462 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740671 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740759 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.740991 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.741091 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.741309 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.741451 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.741648 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.741738 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.741959 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.742056 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.742266 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.742355 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.742590 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.742680 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.742897 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743001 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743205 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743344 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743510 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743607 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743818 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.743916 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.744127 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.744215 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.744443 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.744532 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.744776 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.744868 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.745082 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.745172 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.745419 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.745511 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.745731 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.745822 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.746054 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.746152 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.746375 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.746473 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.746680 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.746769 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747002 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747103 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747324 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747422 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747666 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747757 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.747978 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.748074 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.748315 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.748412 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.748641 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.748738 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.748953 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.749050 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.749263 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.749369 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.749591 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.749681 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:13:24.749834 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:13:24.749926 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:13:24.902496 n-d-854924-5 devstack@n-api.service[106323]: INFO dbcounter [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Registered counter for database nova_api Aug 30 03:13:24.902693 n-d-854924-5 devstack@n-api.service[106324]: INFO dbcounter [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Registered counter for database nova_api Aug 30 03:13:24.923462 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_db.sqlalchemy.engines [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:24.924693 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_db.sqlalchemy.engines [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:24.929974 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writer thread running {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:24.931054 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writer thread running {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:24.988349 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.context [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=106324) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 03:13:24.992152 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:13:24.992633 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:13:24.994221 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:13:24.995607 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:13:24.996054 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:13:24.997508 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.context [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=106323) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 03:13:24.998058 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:13:25.000038 n-d-854924-5 devstack@n-api.service[106324]: INFO dbcounter [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Registered counter for database nova_cell0 Aug 30 03:13:25.001436 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_concurrency.lockutils [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:13:25.001906 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_concurrency.lockutils [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:13:25.003474 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_concurrency.lockutils [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:13:25.004078 n-d-854924-5 devstack@n-api.service[106324]: INFO dbcounter [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Registered counter for database nova_cell1 Aug 30 03:13:25.004221 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_concurrency.lockutils [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:13:25.004668 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_concurrency.lockutils [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:13:25.006791 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_concurrency.lockutils [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:13:25.008745 n-d-854924-5 devstack@n-api.service[106323]: INFO dbcounter [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Registered counter for database nova_cell0 Aug 30 03:13:25.011205 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_db.sqlalchemy.engines [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:25.013761 n-d-854924-5 devstack@n-api.service[106323]: INFO dbcounter [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Registered counter for database nova_cell1 Aug 30 03:13:25.013887 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_db.sqlalchemy.engines [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:25.018135 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writer thread running {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:25.020924 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_db.sqlalchemy.engines [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:25.024371 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_db.sqlalchemy.engines [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:25.026453 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writer thread running {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:25.154296 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writer thread running {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:25.164109 n-d-854924-5 devstack@n-api.service[106324]: INFO dbcounter [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Registered counter for database nova_cell0 Aug 30 03:13:25.164234 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writer thread running {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:25.171276 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_db.sqlalchemy.engines [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:25.173817 n-d-854924-5 devstack@n-api.service[106323]: INFO dbcounter [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Registered counter for database nova_cell0 Aug 30 03:13:25.175552 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writer thread running {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:25.181570 n-d-854924-5 devstack@n-api.service[106323]: DEBUG oslo_db.sqlalchemy.engines [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:13:25.186702 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writer thread running {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:13:25.519727 n-d-854924-5 devstack@n-api.service[106324]: WARNING keystonemiddleware.auth_token [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:13:25.527007 n-d-854924-5 devstack@n-api.service[106324]: WARNING keystonemiddleware.auth_token [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:13:25.536529 n-d-854924-5 devstack@n-api.service[106323]: WARNING keystonemiddleware.auth_token [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:13:25.543706 n-d-854924-5 devstack@n-api.service[106323]: WARNING keystonemiddleware.auth_token [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:13:25.869117 n-d-854924-5 devstack@n-api.service[106324]: WARNING keystonemiddleware.auth_token [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:13:25.875566 n-d-854924-5 devstack@n-api.service[106324]: WARNING keystonemiddleware.auth_token [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:13:25.880804 n-d-854924-5 devstack@n-api.service[106324]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646f99d99c0 pid: 106324 (default app) Aug 30 03:13:25.882901 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:13:25.884097 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Aug 30 03:13:25.884509 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Aug 30 03:13:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:13:25.896043 n-d-854924-5 devstack@n-api.service[106323]: WARNING keystonemiddleware.auth_token [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:13:25.902014 n-d-854924-5 devstack@n-api.service[106323]: WARNING keystonemiddleware.auth_token [None req-2b983850-4da2-4225-b384-9812f12fe9cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:13:25.907247 n-d-854924-5 devstack@n-api.service[106323]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646f99d99c0 pid: 106323 (default app) Aug 30 03:14:43.387093 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:43.388111 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 30 03:14:43.388526 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:14:43.400451 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_api:SELECT=3 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:43.401612 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_cell0:SELECT=3 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:43.402346 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_cell1:SELECT=3 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:43.403794 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:44.270060 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-341449cb-4053-4428-bcf5-7895a75af046 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:44.301206 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-341449cb-4053-4428-bcf5-7895a75af046 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905825 Aug 30 03:14:44.302154 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:14:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:14:46.626305 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:46.627317 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-bc9a794f-55d4-41a5-a62e-9e51179e86e3 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 30 03:14:46.627905 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:14:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:14:47.053753 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-2d3aaa30-9bbb-4b81-8c70-ef1a48c7b4e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "disk": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:47.101101 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-2d3aaa30-9bbb-4b81-8c70-ef1a48c7b4e6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.467122 Aug 30 03:14:47.101736 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:14:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:14:47.330581 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-84b43eba-fd9c-4fda-9b79-728e448a94ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:47.336907 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_api:SELECT=3 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:47.338009 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_cell0:SELECT=3 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:47.339387 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_cell1:SELECT=3 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:47.340132 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:14:47.402380 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-84b43eba-fd9c-4fda-9b79-728e448a94ad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290917 Aug 30 03:14:47.403297 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 03:14:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:14:49.806171 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-2d3aaa30-9bbb-4b81-8c70-ef1a48c7b4e6 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:49.808817 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-2d3aaa30-9bbb-4b81-8c70-ef1a48c7b4e6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003149 Aug 30 03:14:49.809712 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:14:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:14:50.543121 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-bc810754-2fb4-4dbf-bef4-d3884b390e62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:50.580953 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-bc810754-2fb4-4dbf-bef4-d3884b390e62 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763796 Aug 30 03:14:50.581577 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:14:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:14:50.594066 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-c1637a7b-c6f1-44da-b825-a12a52cafbfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:50.630815 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-c1637a7b-c6f1-44da-b825-a12a52cafbfe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040603 Aug 30 03:14:50.631741 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 03:14:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:14:53.346907 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-bc810754-2fb4-4dbf-bef4-d3884b390e62 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:53.348592 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-bc810754-2fb4-4dbf-bef4-d3884b390e62 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Aug 30 03:14:53.349440 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:14:53.777808 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-bd625907-c6ec-490d-9a05-a969508388f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:53.801967 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-bd625907-c6ec-490d-9a05-a969508388f5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446005 Aug 30 03:14:53.810507 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:14:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:14:53.817193 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-2922d7e0-5cf0-4398-a6de-aa9c27c42e64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:53.854903 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-2922d7e0-5cf0-4398-a6de-aa9c27c42e64 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042055 Aug 30 03:14:53.863361 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 03:14:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:14:56.353075 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-bd625907-c6ec-490d-9a05-a969508388f5 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:56.354710 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-bd625907-c6ec-490d-9a05-a969508388f5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 Aug 30 03:14:56.355256 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:14:56.802223 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-6db461bb-d509-4b03-a887-fb34b729c12f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "vcpus": 2, "ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:56.836851 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-6db461bb-d509-4b03-a887-fb34b729c12f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475609 Aug 30 03:14:56.837927 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:14:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:14:56.851220 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-09c55cfe-4239-4e08-82ad-2d8ea62e4b46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:56.884001 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-09c55cfe-4239-4e08-82ad-2d8ea62e4b46 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037513 Aug 30 03:14:56.884643 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 03:14:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:14:59.295072 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-6db461bb-d509-4b03-a887-fb34b729c12f admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:14:59.295969 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-6db461bb-d509-4b03-a887-fb34b729c12f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 30 03:14:59.296389 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:14:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:14:59.775905 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-8636eb47-1ec3-41ad-8f11-fb5dea7e58a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "disk": 20, "swap": 0}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:59.800429 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-8636eb47-1ec3-41ad-8f11-fb5dea7e58a8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493835 Aug 30 03:14:59.801903 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:14:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:14:59.815478 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-7f947bb1-617b-448b-96a2-a4cb736f98ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:14:59.846969 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-7f947bb1-617b-448b-96a2-a4cb736f98ce admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034551 Aug 30 03:14:59.853435 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 03:14:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:15:02.284901 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-8636eb47-1ec3-41ad-8f11-fb5dea7e58a8 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:02.285932 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-8636eb47-1ec3-41ad-8f11-fb5dea7e58a8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 03:15:02.292942 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:02.738822 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-74a94512-b6b8-4ccd-bd49-a8833a64d878 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:02.768398 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-74a94512-b6b8-4ccd-bd49-a8833a64d878 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473356 Aug 30 03:15:02.769697 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:15:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:05.557507 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-8636eb47-1ec3-41ad-8f11-fb5dea7e58a8 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:05.558431 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-8636eb47-1ec3-41ad-8f11-fb5dea7e58a8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 30 03:15:05.558836 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:05.983350 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-e8871c94-a53b-4aca-b61a-5d6d09c22032 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:06.002575 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-e8871c94-a53b-4aca-b61a-5d6d09c22032 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.436922 Aug 30 03:15:06.003167 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:15:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:06.017935 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7c511893-0e37-43ce-abcc-9a0b821b6450 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:06.046201 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7c511893-0e37-43ce-abcc-9a0b821b6450 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033280 Aug 30 03:15:06.046840 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 03:15:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:15:08.391147 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-e8871c94-a53b-4aca-b61a-5d6d09c22032 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:08.392126 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-e8871c94-a53b-4aca-b61a-5d6d09c22032 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 30 03:15:08.392581 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:08.817805 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-a5950010-bf76-45d1-8d89-c93f6bc74f09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "id": "2", "vcpus": 1}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:08.836676 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-a5950010-bf76-45d1-8d89-c93f6bc74f09 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.438207 Aug 30 03:15:08.837248 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:15:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:08.850409 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-deff47f1-0842-41b3-a4ed-ad9633265546 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:08.882447 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-deff47f1-0842-41b3-a4ed-ad9633265546 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036043 Aug 30 03:15:08.883063 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 03:15:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:15:11.224348 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-a5950010-bf76-45d1-8d89-c93f6bc74f09 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:11.225395 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-a5950010-bf76-45d1-8d89-c93f6bc74f09 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 30 03:15:11.225810 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:11.623358 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-0f98b552-724d-4ba8-a2b5-1d0ebc580766 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "name": "m1.medium", "disk": 40}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:11.642233 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-0f98b552-724d-4ba8-a2b5-1d0ebc580766 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.410088 Aug 30 03:15:11.643063 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:15:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:15:11.654896 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-a06ae8d0-ce61-4e05-9f6a-43de6f591051 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:11.678373 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-a06ae8d0-ce61-4e05-9f6a-43de6f591051 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027351 Aug 30 03:15:11.678927 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 03:15:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:15:14.075186 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-0f98b552-724d-4ba8-a2b5-1d0ebc580766 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:14.076867 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-0f98b552-724d-4ba8-a2b5-1d0ebc580766 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Aug 30 03:15:14.077377 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:14.493553 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7507d168-c40f-4d4d-a706-b4e4c2c8ff91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "id": "4", "disk": 80}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:14.499485 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:15:14.513987 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7507d168-c40f-4d4d-a706-b4e4c2c8ff91 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430665 Aug 30 03:15:14.514725 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:15:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:14.527408 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-a6f1e621-68b2-4440-a3f4-cdc04bccfbd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:14.554130 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-a6f1e621-68b2-4440-a3f4-cdc04bccfbd2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031036 Aug 30 03:15:14.555008 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 03:15:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:15:16.921559 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7507d168-c40f-4d4d-a706-b4e4c2c8ff91 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:16.923139 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7507d168-c40f-4d4d-a706-b4e4c2c8ff91 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Aug 30 03:15:16.923969 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:17.368676 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-71fef40f-918c-45b6-987e-0c1e0c547ae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:17.375952 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:15:17.396649 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-71fef40f-918c-45b6-987e-0c1e0c547ae9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466697 Aug 30 03:15:17.401478 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 03:15:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:17.409871 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7391c73b-fba1-43e4-855c-3532e77b7316 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:17.437094 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7391c73b-fba1-43e4-855c-3532e77b7316 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030799 Aug 30 03:15:17.441401 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 03:15:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:15:39.908017 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-71fef40f-918c-45b6-987e-0c1e0c547ae9 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:39.909065 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-71fef40f-918c-45b6-987e-0c1e0c547ae9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 30 03:15:39.909502 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:39.919945 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:15:40.298458 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-2e3d68c8-f585-44a2-9c56-bcbf2d6ce53b admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:40.318787 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-2e3d68c8-f585-44a2-9c56-bcbf2d6ce53b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403120 Aug 30 03:15:40.319391 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:15:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:41.375631 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-71fef40f-918c-45b6-987e-0c1e0c547ae9 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:41.376635 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-71fef40f-918c-45b6-987e-0c1e0c547ae9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 30 03:15:41.377026 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:41.910723 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-5862339c-909f-4e8a-a1f6-32f11c00b766 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:41.916709 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.wsgi [None req-5862339c-909f-4e8a-a1f6-32f11c00b766 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-5862339c-909f-4e8a-a1f6-32f11c00b766 admin admin] Request method failure captured: Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Accept: application/json Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Accept-Encoding: gzip, deflate Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Connection: keep-alive Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Content-Length: 0 Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Host: 10.222.0.30 Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Openstack-Api-Version: compute 2.90 Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: Openstack-System-Scope: None Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: User-Agent: python-novaclient Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Auth-Token: gAAAAABjDYDdzL4Ui8OODnkLkAH7PofjACz-to023Cun7E2zdJFIbolgu6gmbQjgy-inv26_dDG2yN53LUU5S3W040VLjS7fq_br2DqI5ynMFZ6kyid-YJY668Y0AStl9bkOGlVpUnwaV_GBQPMGNOLgUOBCIi84PShduHpqa3UkyHCqTMY16Ao Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Domain-Id: None Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Domain-Name: None Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Identity-Status: Confirmed Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Is-Admin-Project: True Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Domain-Id: default Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Domain-Name: Default Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Name: admin Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Role: admin,member,reader Aug 30 03:15:41.919923 n-d-854924-5 devstack@n-api.service[106323]: X-Roles: admin,member,reader Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed88ca5572c8475d922469b05bcc664e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}] Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant: admin Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant-Name: admin Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-User: admin Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-User-Domain-Id: default Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-User-Domain-Name: Default Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-User-Id: 0f24150c5dd74c388ad50c8142acd694 Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: X-User-Name: admin Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: method: > Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: exception: Flavor 42 could not be found. Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: action_args: {'id': '42'} Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:15:41.921501 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:41.922721 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:41.924222 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-5862339c-909f-4e8a-a1f6-32f11c00b766 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:15:41.925595 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-5862339c-909f-4e8a-a1f6-32f11c00b766 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388521 Aug 30 03:15:41.925595 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 03:15:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:15:41.931540 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-fd376e73-0cd6-444c-9488-499b17373adf admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:41.935572 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=2 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:15:41.956519 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-fd376e73-0cd6-444c-9488-499b17373adf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029135 Aug 30 03:15:41.957065 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 03:15:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:41.967004 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-99603b17-64e3-46b2-8f95-723d8b750f91 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:41.989156 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-99603b17-64e3-46b2-8f95-723d8b750f91 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025654 Aug 30 03:15:41.989705 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 03:15:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:41.999702 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-a5163d08-3d35-4ae3-bb68-15d6d2f67f6a admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:42.005278 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.wsgi [None req-a5163d08-3d35-4ae3-bb68-15d6d2f67f6a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-a5163d08-3d35-4ae3-bb68-15d6d2f67f6a admin admin] Request method failure captured: Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Accept: application/json Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Accept-Encoding: gzip, deflate Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Connection: keep-alive Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Content-Length: 0 Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Host: 10.222.0.30 Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Openstack-Api-Version: compute 2.90 Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: Openstack-System-Scope: None Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: User-Agent: python-novaclient Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Auth-Token: gAAAAABjDYDdzL4Ui8OODnkLkAH7PofjACz-to023Cun7E2zdJFIbolgu6gmbQjgy-inv26_dDG2yN53LUU5S3W040VLjS7fq_br2DqI5ynMFZ6kyid-YJY668Y0AStl9bkOGlVpUnwaV_GBQPMGNOLgUOBCIi84PShduHpqa3UkyHCqTMY16Ao Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Domain-Id: None Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Domain-Name: None Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Identity-Status: Confirmed Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Is-Admin-Project: True Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Domain-Id: default Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Domain-Name: Default Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Name: admin Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Role: admin,member,reader Aug 30 03:15:42.008603 n-d-854924-5 devstack@n-api.service[106324]: X-Roles: admin,member,reader Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed88ca5572c8475d922469b05bcc664e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}] Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant: admin Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant-Name: admin Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-User: admin Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-User-Domain-Id: default Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-User-Domain-Name: Default Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-User-Id: 0f24150c5dd74c388ad50c8142acd694 Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: X-User-Name: admin Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: method: > Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: exception: Flavor 42 could not be found. Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: action_args: {'id': '42'} Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:15:42.010043 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:42.010990 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:42.012080 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-a5163d08-3d35-4ae3-bb68-15d6d2f67f6a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:15:42.013113 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-a5163d08-3d35-4ae3-bb68-15d6d2f67f6a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013780 Aug 30 03:15:42.013113 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 03:15:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:15:42.971659 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-99603b17-64e3-46b2-8f95-723d8b750f91 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:42.972675 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-99603b17-64e3-46b2-8f95-723d8b750f91 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 30 03:15:42.973073 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:43.500404 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-928bac8f-0706-49d8-962c-1ad6a49a0760 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:43.506512 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.wsgi [None req-928bac8f-0706-49d8-962c-1ad6a49a0760 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-928bac8f-0706-49d8-962c-1ad6a49a0760 admin admin] Request method failure captured: Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Accept: application/json Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Accept-Encoding: gzip, deflate Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Connection: keep-alive Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Content-Length: 0 Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Host: 10.222.0.30 Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Openstack-Api-Version: compute 2.90 Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: Openstack-System-Scope: None Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: User-Agent: python-novaclient Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Auth-Token: gAAAAABjDYDeKLi-9Gdm5EKa7OyGx5fSMD7ET3Gv8pbhUU672HVEd55ClA5-6Ziuxgc8SMKORa_UFgxMQFPkCPX_rDfN4qLPJn8EiEUTdOYsZw5ovY9EZQTVratM3nEbAU6HdfR_g9o0zs7m0eleTQOQodDrAFig-HBYzb09n4PgdF6FqWAfiQY Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Domain-Id: None Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Domain-Name: None Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Identity-Status: Confirmed Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Is-Admin-Project: True Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Domain-Id: default Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Domain-Name: Default Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Name: admin Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Role: admin,member,reader Aug 30 03:15:43.508075 n-d-854924-5 devstack@n-api.service[106324]: X-Roles: admin,member,reader Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed88ca5572c8475d922469b05bcc664e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}] Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant: admin Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant-Name: admin Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-User: admin Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-User-Domain-Id: default Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-User-Domain-Name: Default Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-User-Id: 0f24150c5dd74c388ad50c8142acd694 Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: X-User-Name: admin Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: method: > Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: exception: Flavor 84 could not be found. Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: action_args: {'id': '84'} Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:15:43.510211 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:43.511149 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.512477 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-928bac8f-0706-49d8-962c-1ad6a49a0760 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:15:43.513853 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-928bac8f-0706-49d8-962c-1ad6a49a0760 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393280 Aug 30 03:15:43.513853 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 03:15:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:15:43.519795 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-38eb0869-1b6e-433c-9cf3-57dd9d7cb9e0 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:43.535098 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-38eb0869-1b6e-433c-9cf3-57dd9d7cb9e0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018844 Aug 30 03:15:43.535620 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 03:15:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:43.544857 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-0b782691-99ce-4e96-9325-f70f328fcb15 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:43.559793 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-0b782691-99ce-4e96-9325-f70f328fcb15 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018535 Aug 30 03:15:43.560340 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 03:15:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:43.569314 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-63ae0e8c-b65d-4608-a2dc-362eefeb66bf admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:43.575037 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.wsgi [None req-63ae0e8c-b65d-4608-a2dc-362eefeb66bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-63ae0e8c-b65d-4608-a2dc-362eefeb66bf admin admin] Request method failure captured: Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Accept: application/json Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Accept-Encoding: gzip, deflate Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Connection: keep-alive Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Content-Length: 0 Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Host: 10.222.0.30 Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Openstack-Api-Version: compute 2.90 Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: Openstack-System-Scope: None Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: User-Agent: python-novaclient Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Auth-Token: gAAAAABjDYDeKLi-9Gdm5EKa7OyGx5fSMD7ET3Gv8pbhUU672HVEd55ClA5-6Ziuxgc8SMKORa_UFgxMQFPkCPX_rDfN4qLPJn8EiEUTdOYsZw5ovY9EZQTVratM3nEbAU6HdfR_g9o0zs7m0eleTQOQodDrAFig-HBYzb09n4PgdF6FqWAfiQY Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Domain-Id: None Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Domain-Name: None Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Identity-Status: Confirmed Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Is-Admin-Project: True Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Domain-Id: default Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Domain-Name: Default Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Name: admin Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Role: admin,member,reader Aug 30 03:15:43.576499 n-d-854924-5 devstack@n-api.service[106323]: X-Roles: admin,member,reader Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed88ca5572c8475d922469b05bcc664e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}] Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant: admin Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant-Name: admin Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-User: admin Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-User-Domain-Id: default Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-User-Domain-Name: Default Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-User-Id: 0f24150c5dd74c388ad50c8142acd694 Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: X-User-Name: admin Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: method: > Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: exception: Flavor 84 could not be found. Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: action_args: {'id': '84'} Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:15:43.578103 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:43.578963 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:43.580106 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-63ae0e8c-b65d-4608-a2dc-362eefeb66bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:15:43.581161 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-63ae0e8c-b65d-4608-a2dc-362eefeb66bf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011972 Aug 30 03:15:43.581161 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 03:15:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:15:44.551372 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-0b782691-99ce-4e96-9325-f70f328fcb15 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:44.552380 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-0b782691-99ce-4e96-9325-f70f328fcb15 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 30 03:15:44.552778 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:45.095116 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-0d1c32ba-05a3-4d58-8c63-05af42ba4706 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:45.100965 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.wsgi [None req-0d1c32ba-05a3-4d58-8c63-05af42ba4706 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-0d1c32ba-05a3-4d58-8c63-05af42ba4706 admin admin] Request method failure captured: Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Accept: application/json Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Accept-Encoding: gzip, deflate Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Connection: keep-alive Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Content-Length: 0 Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Host: 10.222.0.30 Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Openstack-Api-Version: compute 2.90 Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: Openstack-System-Scope: None Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: User-Agent: python-novaclient Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Auth-Token: gAAAAABjDYDgsM2TjEY1QGsF4v5CK-poKZcii5rnO4nCjInTGbk_jR_n4_LDPGXod75GqfhnpKCBCP94uVKgtkD84fGqY50Sfu_qYu3RUbyULqZ_jA7zo1OSRCPqLuJI07Gx_sz3xuWVCl3wxqaCTi9DQzVcBpFGGvp0gGOIBwuVPdAOV339faE Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Domain-Id: None Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Domain-Name: None Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Identity-Status: Confirmed Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Is-Admin-Project: True Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Domain-Id: default Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Domain-Name: Default Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Project-Name: admin Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Role: admin,member,reader Aug 30 03:15:45.102993 n-d-854924-5 devstack@n-api.service[106323]: X-Roles: admin,member,reader Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed88ca5572c8475d922469b05bcc664e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}] Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant: admin Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-Tenant-Name: admin Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-User: admin Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-User-Domain-Id: default Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-User-Domain-Name: Default Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-User-Id: 0f24150c5dd74c388ad50c8142acd694 Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: X-User-Name: admin Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: method: > Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: exception: Flavor 451 could not be found. Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: action_args: {'id': '451'} Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:15:45.104583 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:45.105684 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.107147 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-0d1c32ba-05a3-4d58-8c63-05af42ba4706 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:15:45.108429 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-0d1c32ba-05a3-4d58-8c63-05af42ba4706 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.415226 Aug 30 03:15:45.108429 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:15:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:15:45.113857 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-6a68216a-49a0-4853-b621-2747fdfaa382 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:45.129306 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-6a68216a-49a0-4853-b621-2747fdfaa382 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018980 Aug 30 03:15:45.129842 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 03:15:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:15:45.139070 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:45.153649 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017968 Aug 30 03:15:45.154169 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 03:15:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:15:45.163191 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-b2d09dce-758e-4355-bdcc-a1643ad9ed16 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:45.169013 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.wsgi [None req-b2d09dce-758e-4355-bdcc-a1643ad9ed16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-b2d09dce-758e-4355-bdcc-a1643ad9ed16 admin admin] Request method failure captured: Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Accept: application/json Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Accept-Encoding: gzip, deflate Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Connection: keep-alive Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Content-Length: 0 Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Host: 10.222.0.30 Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Openstack-Api-Version: compute 2.90 Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: Openstack-System-Scope: None Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: User-Agent: python-novaclient Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Auth-Token: gAAAAABjDYDgsM2TjEY1QGsF4v5CK-poKZcii5rnO4nCjInTGbk_jR_n4_LDPGXod75GqfhnpKCBCP94uVKgtkD84fGqY50Sfu_qYu3RUbyULqZ_jA7zo1OSRCPqLuJI07Gx_sz3xuWVCl3wxqaCTi9DQzVcBpFGGvp0gGOIBwuVPdAOV339faE Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Domain-Id: None Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Domain-Name: None Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Identity-Status: Confirmed Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Is-Admin-Project: True Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Domain-Id: default Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Domain-Name: Default Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Project-Name: admin Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Role: admin,member,reader Aug 30 03:15:45.170537 n-d-854924-5 devstack@n-api.service[106324]: X-Roles: admin,member,reader Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed88ca5572c8475d922469b05bcc664e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed88ca5572c8475d922469b05bcc664e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed88ca5572c8475d922469b05bcc664e"}]}] Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant: admin Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant-Id: ed88ca5572c8475d922469b05bcc664e Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-Tenant-Name: admin Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-User: admin Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-User-Domain-Id: default Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-User-Domain-Name: Default Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-User-Id: 0f24150c5dd74c388ad50c8142acd694 Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: X-User-Name: admin Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: method: > Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: exception: Flavor 451 could not be found. Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: action_args: {'id': '451'} Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:15:45.172140 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:45.173148 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: ERROR nova.api.openstack.wsgi Aug 30 03:15:45.174392 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-b2d09dce-758e-4355-bdcc-a1643ad9ed16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:15:45.175477 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-b2d09dce-758e-4355-bdcc-a1643ad9ed16 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012246 Aug 30 03:15:45.175477 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:15:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:15:46.128735 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:46.129767 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 30 03:15:46.130159 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:46.654873 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-baf6f31e-0e88-4859-83ed-4a3ae2d35059 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:46.675144 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-baf6f31e-0e88-4859-83ed-4a3ae2d35059 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406371 Aug 30 03:15:46.675674 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 03:15:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:47.643982 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:47.645016 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 30 03:15:47.645437 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:48.165123 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-87991ea7-9b76-4a09-8eeb-0d1a0ebbb823 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:48.184019 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-87991ea7-9b76-4a09-8eeb-0d1a0ebbb823 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403025 Aug 30 03:15:48.184562 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 03:15:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:49.161712 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:49.162845 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Aug 30 03:15:49.163322 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:49.683571 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-cfcf5292-6b7b-4ff6-a554-08685212cdde admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:49.702519 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-cfcf5292-6b7b-4ff6-a554-08685212cdde admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401394 Aug 30 03:15:49.703061 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 03:15:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:50.669390 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:50.670403 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 30 03:15:50.670804 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:51.189123 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-3a35be77-c349-4aab-86cb-3230caca20d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:15:51.207154 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-3a35be77-c349-4aab-86cb-3230caca20d6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.397123 Aug 30 03:15:51.207906 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 03:15:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:15:52.164861 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:52.165894 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 30 03:15:52.166295 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:15:52.684588 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-c36d5b4d-788f-4fff-85f8-4acc3c9952e2 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:15:52.704585 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-c36d5b4d-788f-4fff-85f8-4acc3c9952e2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402923 Aug 30 03:15:52.705181 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Aug 30 03:15:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:16:46.140668 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:16:46.141716 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-b494e35f-8345-4953-8d62-77299555b5b3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 30 03:16:46.142121 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 03:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:16:46.152873 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:16:46.539934 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-6e96dc54-7ed6-448e-bb98-5d3a299e37fb admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:16:46.560284 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-6e96dc54-7ed6-448e-bb98-5d3a299e37fb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411778 Aug 30 03:16:46.560749 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:16:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:16:46.582110 n-d-854924-5 devstack@n-api.service[106323]: DEBUG dbcounter [-] [106323] Writing DB stats nova_api:SELECT=14 {{(pid=106323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:16:46.586032 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-2fed553c-c91d-48f9-a1b3-2734d8a59aff admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:16:46.593778 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-2fed553c-c91d-48f9-a1b3-2734d8a59aff admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013142 Aug 30 03:16:46.594300 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Aug 30 03:16:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:16:46.606101 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-ee601ec6-52ca-452f-8a8d-f8791c71ec55 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:16:46.613646 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-ee601ec6-52ca-452f-8a8d-f8791c71ec55 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011355 Aug 30 03:16:46.614150 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Aug 30 03:16:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:16:46.625849 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7aefef7f-7211-4fee-b7d2-773984201f3c admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:16:46.633784 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7aefef7f-7211-4fee-b7d2-773984201f3c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011345 Aug 30 03:16:46.634307 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Aug 30 03:16:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:16:46.651605 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-8022d100-c7c8-4503-9685-f02b398f6235 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:16:46.660592 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-8022d100-c7c8-4503-9685-f02b398f6235 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018453 Aug 30 03:16:46.661285 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Aug 30 03:16:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:22:04.243088 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7aefef7f-7211-4fee-b7d2-773984201f3c admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:22:04.244093 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7aefef7f-7211-4fee-b7d2-773984201f3c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 30 03:22:04.244595 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:22:04.383388 n-d-854924-5 devstack@n-api.service[106324]: DEBUG dbcounter [-] [106324] Writing DB stats nova_api:SELECT=6 {{(pid=106324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:22:04.526197 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:22:04.529590 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:04.530065 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:04.530488 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:04.531243 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:04.531683 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:04.532095 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:04.572089 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-eb1929ee-5e8c-42a5-a47f-9235d4cabcca admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.190141 Aug 30 03:22:04.572669 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:22:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:22:05.407616 n-d-854924-5 devstack@n-api.service[106323]: DEBUG nova.api.openstack.wsgi [None req-7aefef7f-7211-4fee-b7d2-773984201f3c admin admin] Calling method '>' {{(pid=106323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:22:05.408609 n-d-854924-5 devstack@n-api.service[106323]: INFO nova.api.openstack.requestlog [None req-7aefef7f-7211-4fee-b7d2-773984201f3c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 30 03:22:05.409006 n-d-854924-5 devstack@n-api.service[106323]: [pid: 106323|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 03:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:22:05.606473 n-d-854924-5 devstack@n-api.service[106324]: DEBUG nova.api.openstack.wsgi [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Calling method '>' {{(pid=106324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:22:05.609859 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:05.610336 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:05.610766 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:05.612037 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:05.612484 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:05.612904 n-d-854924-5 devstack@n-api.service[106324]: DEBUG oslo_concurrency.lockutils [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:05.635587 n-d-854924-5 devstack@n-api.service[106324]: INFO nova.api.openstack.requestlog [None req-c629593e-a94d-411e-8d8d-81a2d140c2a0 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.087917 Aug 30 03:22:05.636080 n-d-854924-5 devstack@n-api.service[106324]: [pid: 106324|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:22:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:22:50.552424 n-d-854924-5 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 03:22:50.553007 n-d-854924-5 devstack@n-api.service[106311]: Tue Aug 30 03:22:50 2022 - graceful shutdown triggered... Aug 30 03:22:50.553500 n-d-854924-5 devstack@n-api.service[106323]: Gracefully killing worker 1 (pid: 106323)... Aug 30 03:22:50.553861 n-d-854924-5 devstack@n-api.service[106324]: Gracefully killing worker 2 (pid: 106324)... Aug 30 03:22:51.553487 n-d-854924-5 devstack@n-api.service[106311]: worker 1 buried after 1 seconds Aug 30 03:22:51.553487 n-d-854924-5 devstack@n-api.service[106311]: worker 2 buried after 1 seconds Aug 30 03:22:51.553487 n-d-854924-5 devstack@n-api.service[106311]: goodbye to uWSGI. Aug 30 03:22:51.555123 n-d-854924-5 systemd[1]: devstack@n-api.service: Succeeded. Aug 30 03:22:51.555699 n-d-854924-5 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 03:22:51.558487 n-d-854924-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 03:22:51.573776 n-d-854924-5 devstack@n-api.service[122152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 03:22:51.610718 n-d-854924-5 devstack@n-api.service[122152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 03:22:51 2022] *** Aug 30 03:22:51.611062 n-d-854924-5 devstack@n-api.service[122152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 03:22:51.611300 n-d-854924-5 devstack@n-api.service[122152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 03:22:51.611534 n-d-854924-5 devstack@n-api.service[122152]: nodename: n-d-854924-5 Aug 30 03:22:51.611776 n-d-854924-5 devstack@n-api.service[122152]: machine: x86_64 Aug 30 03:22:51.611997 n-d-854924-5 devstack@n-api.service[122152]: clock source: unix Aug 30 03:22:51.612191 n-d-854924-5 devstack@n-api.service[122152]: pcre jit disabled Aug 30 03:22:51.612401 n-d-854924-5 devstack@n-api.service[122152]: detected number of CPU cores: 4 Aug 30 03:22:51.612569 n-d-854924-5 devstack@n-api.service[122152]: current working directory: / Aug 30 03:22:51.612761 n-d-854924-5 devstack@n-api.service[122152]: detected binary path: /usr/bin/uwsgi-core Aug 30 03:22:51.612956 n-d-854924-5 devstack@n-api.service[122152]: your processes number limit is 47680 Aug 30 03:22:51.613136 n-d-854924-5 devstack@n-api.service[122152]: your memory page size is 4096 bytes Aug 30 03:22:51.613363 n-d-854924-5 devstack@n-api.service[122152]: detected max file descriptor number: 2048 Aug 30 03:22:51.613543 n-d-854924-5 devstack@n-api.service[122152]: lock engine: pthread robust mutexes Aug 30 03:22:51.614022 n-d-854924-5 devstack@n-api.service[122152]: thunder lock: enabled Aug 30 03:22:51.614315 n-d-854924-5 devstack@n-api.service[122152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 03:22:51.614421 n-d-854924-5 devstack@n-api.service[122152]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 03:22:51.655465 n-d-854924-5 devstack@n-api.service[122152]: Python main interpreter initialized at 0x557f3630b9c0 Aug 30 03:22:51.655465 n-d-854924-5 devstack@n-api.service[122152]: python threads support enabled Aug 30 03:22:51.655465 n-d-854924-5 devstack@n-api.service[122152]: your server socket listen backlog is limited to 100 connections Aug 30 03:22:51.655465 n-d-854924-5 devstack@n-api.service[122152]: your mercy for graceful operations on workers is 90 seconds Aug 30 03:22:51.655961 n-d-854924-5 devstack@n-api.service[122152]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 03:22:51.655961 n-d-854924-5 devstack@n-api.service[122152]: *** Operational MODE: preforking *** Aug 30 03:22:51.656182 n-d-854924-5 devstack@n-api.service[122152]: *** uWSGI is running in multiple interpreter mode *** Aug 30 03:22:51.656182 n-d-854924-5 devstack@n-api.service[122152]: spawned uWSGI master process (pid: 122152) Aug 30 03:22:51.656396 n-d-854924-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 03:22:51.656998 n-d-854924-5 devstack@n-api.service[122152]: spawned uWSGI worker 1 (pid: 122167, cores: 1) Aug 30 03:22:51.657579 n-d-854924-5 devstack@n-api.service[122152]: spawned uWSGI worker 2 (pid: 122168, cores: 1) Aug 30 03:22:51.657912 n-d-854924-5 devstack@n-api.service[122152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 03:22:52.351294 n-d-854924-5 devstack@n-api.service[122167]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 03:22:52.404472 n-d-854924-5 devstack@n-api.service[122168]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 03:22:53.531380 n-d-854924-5 devstack@n-api.service[122167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:22:53.531380 n-d-854924-5 devstack@n-api.service[122167]: from cryptography.utils import int_from_bytes Aug 30 03:22:53.532047 n-d-854924-5 devstack@n-api.service[122167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:22:53.532047 n-d-854924-5 devstack@n-api.service[122167]: from cryptography.utils import int_from_bytes Aug 30 03:22:53.593238 n-d-854924-5 devstack@n-api.service[122168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:22:53.593238 n-d-854924-5 devstack@n-api.service[122168]: from cryptography.utils import int_from_bytes Aug 30 03:22:53.594073 n-d-854924-5 devstack@n-api.service[122168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:22:53.594073 n-d-854924-5 devstack@n-api.service[122168]: from cryptography.utils import int_from_bytes Aug 30 03:22:55.976705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:22:55.977268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:22:55.977622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:22:55.978057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:22:55.978348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:22:55.978750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.979080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.979403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.979726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.980059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.980374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.980697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.981014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.981401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.981627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.982130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.982623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854924-5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.983111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.983598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.983945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.984276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.984563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.984980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.985292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.985825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.986277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.986587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.987009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.987243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.987585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.988025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.988215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.988522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.988845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.989153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.989582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854924-5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.989898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.990210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.990524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.990942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.991252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.991587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.991875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.992191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.992752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.993072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.993414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.993738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.994789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.994930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.995198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.995688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.995888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.996199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.996506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.996760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.997067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.997524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.997806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.998062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.998293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.998545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.998857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.999177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.999490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:55.999816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.000138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.000447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.000751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.001051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.001374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.001676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.002003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.002318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.002641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.002947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.003264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.003665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.003913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.004219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.004559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.004873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.005179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.005528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.005849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.006151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.006456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.006766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.007099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.007431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.007735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.007980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.008278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.008580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.008897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.009199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.009584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.010738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.010738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.011010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.011333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.011612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.011914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.012217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.012522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.012823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.013127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.013447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.013766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.014084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.014389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.014690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.014991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.015294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.015612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.015915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.016218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.016539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.016847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.017148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.017486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.017794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.018097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.018415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.018714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.019016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.019332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.019638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.019944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.020245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.020547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.020849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.021155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.021474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.021776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.022073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.022389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.022709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.023017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.023319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.023621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.023940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.024385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.024718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.025062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.025472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.025845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.026181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.026499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.026815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.027127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.027454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.027773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.028082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.028391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.028708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.029060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.029409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.029730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.030045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.030358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.030663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.030980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.031304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.031626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.031935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.032274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.032618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.032933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.033256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.033601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.033910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.034219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.034526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.034846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.035176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.035483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.035799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.036107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.036428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.036739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.037047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.037379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.037691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.037998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.038334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.038649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.038971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.039282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.039592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.039910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.040218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.040525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.040830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.041169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.041625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.041934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.042240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.042543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.042862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.043193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.043495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.043826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.044129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.044438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.044744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.045049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.045382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.045697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.046005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.046306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.046630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.046948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.047251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.047355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:22:56.047772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.047861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:22:56.047952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.048130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:22:56.048234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.048457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.048557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:22:56.048738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:22:56.048839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.049063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.049167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.049386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.049497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.049697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.049798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.050017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.050116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.050335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.050427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.050641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.050747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.050976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.051075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.051305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.051403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.051612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.051795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.051962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.052107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.052252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.052412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.052563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854924-5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.052708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.052861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.053004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.053158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.053333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.053646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.053755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.053845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.053972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.054071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.054160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.054322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.054421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.054621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.054714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.054924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.055131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.055244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.055576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.055778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.055981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.056284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.056429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.056570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.057215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.057329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.057465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.057559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.057559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.057704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.057838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.057925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.058179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.058284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.058484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.058577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.058801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.058894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.059145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.059249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854924-5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.059477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.059630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.059779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.059888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.060090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.060196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.060403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.060502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.060712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.060816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.061020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.061125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.061325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.061440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.061679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.061901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.062052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.062225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.062364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.062531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.062660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.062823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.062967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.063134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.063295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.063457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.063631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.063767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.063911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.064020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.064122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.064206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.064636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.064752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.064838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.064921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.065014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.065089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.065265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.065396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.065597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.065701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.065925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.066081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.066220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.066380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.066516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.066659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.066817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.066959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.067073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.067223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.067352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.067492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.067634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.067771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.067927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.068080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.068217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.068366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.068512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.068649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.068781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.068926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.069058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.069186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.069380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.069553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.069723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.069879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.070010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.070148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.070298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.070444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.070596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.070742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.070895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.071038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.071177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.071328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.071485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.071629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.071864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.072008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.072148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.072304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.073019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.073160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.073306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.073498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.073640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.073796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.073951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.074090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.074226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.074367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.074539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.074726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.074865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.074968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.075136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.075230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.075440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.075548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.075757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.075847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.076058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.076158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.076359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.076452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.076626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.076726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.076927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.077020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.077231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.077334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.077575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.077679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.077880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.077974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.078187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.078279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.078489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.078582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.078787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.078887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.079092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.079183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.079392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.079493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.079693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.079869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.079993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.080086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.080293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.080384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.080595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.080697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.080902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.081003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.081206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.081306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.081541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.081656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.081854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.081951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.082171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.082274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.082475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.082582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.082780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.082890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.083083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.083183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.083390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.083517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.083697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.083795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.083999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.084133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.084302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.084397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.084608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.084760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.084912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.085014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.085216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.085317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.085544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.085648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.085851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.085980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.086226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.086361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.086474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.086608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.086756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.086884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.087050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.087265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.087593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.087802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.087998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.088125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.088237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.088358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.088485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.088606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.088718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.088912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.089032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.089252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.089423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.089608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.089738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.089933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.090070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.090239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.090434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.090616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.090795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.091041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.091233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.091505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.091694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.091871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.092048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.092251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.092455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.092639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.092762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:22:56.092885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.093007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.093131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.093263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.093503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.093779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.094981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.095997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.096973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.097104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.097277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.097433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.097640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.097794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.097967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.098101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.098280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.098463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.098686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.098916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.099130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.099349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.099552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.099760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.099967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.100196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.100401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.100569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.100787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.101008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.101961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.102979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.103972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.104918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.105987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.106086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.106172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.106401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.106495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.106709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.106811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.107957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.108964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.109177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.109271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.109516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.109632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.109820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.109954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.110123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.110229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.110428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.110531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.110729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.110820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.111972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.112970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.113181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.113282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.113505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.113600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.113812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.113903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.114111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.114228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.114413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.114518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.114713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.114807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.115932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.116930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.117157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.117515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.117750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.117857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.118064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.118157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.118395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.118496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.118709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.118855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.119021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.119122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.119851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.119983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.120163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.120322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.120474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.120568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.120775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.120876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.121088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.121173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.121428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.121518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.121730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.121822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.122970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.123109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.123388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.123565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.123565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.123845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.123998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.124866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.125079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.125179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.125398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.125505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.125708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.125808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.126945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.127977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.128185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.128308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.128490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.128578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.128797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.128935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.129101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.129197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.129428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.129529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.129735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.129907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.130071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.130474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.130692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.130904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.131956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.132197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.132290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.132515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.132618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.132824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.132924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.133136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.133230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.133470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.133585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.134609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.134727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.134727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.135725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.135827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.135915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.136950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.137898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.138104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.138295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.138464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.138653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.138864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.139045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.139228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.139417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.139594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.139769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.140048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.140233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.140638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.140827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.140827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.141179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.141330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.141508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.141650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.141875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.142978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.143119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.143262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.143394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.143530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.143670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.143838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.144046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.144241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.144446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.144650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.144851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.145016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.145213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.145438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.145579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.145732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.145887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.146920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.147065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.147211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.147359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.147509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.147748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.147927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.148982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.149855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.150004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.150174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.150323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.150514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.150727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.150896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.151973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.152973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.153194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.153289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.153533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.153638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.153845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.153999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.154155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.154249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.154495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.154638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.154804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.154922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.155110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.155392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.155504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.155733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.155835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.156039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.156139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.156369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.156464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.156693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.156785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.157993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.158088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.158298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.158418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.158601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.158701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.158908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.159984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.160136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.160284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.160432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.160589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.160736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.160884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.161061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.161226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.161432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.161584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.161767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.161905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.162949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.163963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.164127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.164277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.164419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.164557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.164755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.164911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.165974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.166998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.167913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.168009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.168306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.168467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.168616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.168793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.168922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.169104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.169234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.169475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.169628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.169810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.169962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.170069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.170180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.170347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.171004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.171256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.171499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.171716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.171932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.172972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.173114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.173249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.173478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.173653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.173793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.173927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.174065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.174237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.174383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.174638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.174859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.175852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.176136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.176291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.176442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.176600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.176743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.176880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.177968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.178945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.179105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.179200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.179414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.179510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.179719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.179811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.180026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.180118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.180333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.180562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.180692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.180881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.181041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.181194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.181500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.182235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.182446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.182606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.182779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.182951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.183947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.184893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.185092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.185244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.185438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.185579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.185729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.185903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.186969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.187190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.187353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.187496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.187598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.187820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.187916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.188141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.188289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.188462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.188556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.188766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.188871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.189085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.189194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.189403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.189516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.189720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.189812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.190947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.191964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.192167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.192262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.192502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.192624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.192790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.192882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.193091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.193186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.193413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.193529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.193729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.193836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.194947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.195967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.196166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.196248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.196468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.196584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.196770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.196872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.197070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.197173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.197447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.198046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.198298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.198401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.198623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.198723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.198926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.199964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.200174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.200277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.200484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.200578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.200788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.200880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.201137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.201292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.201471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.201616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.201837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.202019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.202149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.202353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.202455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.202674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.202780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.203957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.204993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.205199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.205291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.205537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.205636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.205848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.205943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.206159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.206251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.206469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.206641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.206779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.206953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.207088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.207264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.207397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.207585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.207690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.207908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.208961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.209177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.209305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.209522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.209627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.209841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.209935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.210153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.210245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.210465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.210560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.210770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.210870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.211993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.212185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.212372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.212528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.212685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.212837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.213968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.214128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.214276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.214426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.214586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.214744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.214910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.215068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.215224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.215383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.215540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.215746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.215916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.216129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.216280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.216417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.216573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.216734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.216895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.217042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.217042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.217335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.217567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.217732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.217899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.218052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.218194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.218362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.218575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.218748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.218982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.219135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.219309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.219458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.219606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.219764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.219923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.220985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.221126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.221271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.221494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.221662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.221816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.221963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.222183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.222382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.222549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.222691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.222838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.222979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.223125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.223275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.223427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.223578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.223745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.223888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.224949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.225108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.225397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.225565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.225716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.225864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.226015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.226245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.226398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.226602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.226768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.226918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.227936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.228230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.228387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.228530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.229183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.229334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.229535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.229689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.229840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.229987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.230146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.230309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.230472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.230628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.230829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.230982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.231126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.231292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.231450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.231601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.231762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.231925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.232919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.233974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.234119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.234209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.234303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.234400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.234487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.256301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.261161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.264291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.264483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.266032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.266484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.266734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.267255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.267390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.267518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.267518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.267822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.267905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.268940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.269110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.269255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.269425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.269638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.269843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.269991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.270778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.271955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.272833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.273862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.274553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.275956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.277826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.278748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.279108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.279339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.279655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.279969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.280284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.280598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.280915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.281235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.281570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.281921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.282246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.282568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.282913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.283209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.283524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.283842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.284155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.284470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.284786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.285118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.285460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.285775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.286209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.286530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.286852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.287191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.287495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.287820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.288146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.288465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.288790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.289103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.289460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.289951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.290150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.290463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.290770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.293394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.294160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.294160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.294342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.294616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.294924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.295238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.295547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.295854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.296165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.296472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.296779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.297087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.297420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.297729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.298038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.298343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.298650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.298958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.299292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.299627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.299944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.300268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.300618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.300902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.301215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.301566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.302030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.302215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.302528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.302863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.303176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.303492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.303807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.304119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.304432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.304744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.305070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.305429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.305743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.306074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.306395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.306774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.307688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.307905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.308246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.308553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.308865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.309176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.309526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.309845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.310205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.310469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.310759 n-d-854924-5 devstack@n-api.service[122167]: INFO dbcounter [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Registered counter for database nova_api Aug 30 03:22:56.310853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.311084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.311404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.311735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.312061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.312373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.312700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.313028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.313404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.313727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.314077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.314409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.314730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.315045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.315351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:22:56.315596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:22:56.331277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_db.sqlalchemy.engines [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.337919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writer thread running {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.400704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.context [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=122167) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 03:22:56.402894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:56.403386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:56.405044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:56.405865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:56.406327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:56.408591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:56.410998 n-d-854924-5 devstack@n-api.service[122167]: INFO dbcounter [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Registered counter for database nova_cell0 Aug 30 03:22:56.415782 n-d-854924-5 devstack@n-api.service[122167]: INFO dbcounter [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Registered counter for database nova_cell1 Aug 30 03:22:56.428260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_db.sqlalchemy.engines [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.430596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_db.sqlalchemy.engines [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.437413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writer thread running {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.439417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writer thread running {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.470893 n-d-854924-5 devstack@n-api.service[122168]: INFO dbcounter [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Registered counter for database nova_api Aug 30 03:22:56.491767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_db.sqlalchemy.engines [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.504205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writer thread running {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.563485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.context [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=122168) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 03:22:56.567714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:56.568388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:56.570304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:56.571188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:22:56.571850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:22:56.574108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:22:56.576373 n-d-854924-5 devstack@n-api.service[122168]: INFO dbcounter [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Registered counter for database nova_cell0 Aug 30 03:22:56.580799 n-d-854924-5 devstack@n-api.service[122168]: INFO dbcounter [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Registered counter for database nova_cell1 Aug 30 03:22:56.589652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_db.sqlalchemy.engines [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.593247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_db.sqlalchemy.engines [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.597021 n-d-854924-5 devstack@n-api.service[122167]: INFO dbcounter [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Registered counter for database nova_cell0 Aug 30 03:22:56.603060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writer thread running {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.603410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writer thread running {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.606420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_db.sqlalchemy.engines [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.611691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writer thread running {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.767077 n-d-854924-5 devstack@n-api.service[122168]: INFO dbcounter [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Registered counter for database nova_cell0 Aug 30 03:22:56.776538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_db.sqlalchemy.engines [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:22:56.781556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writer thread running {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:22:56.965858 n-d-854924-5 devstack@n-api.service[122167]: WARNING keystonemiddleware.auth_token [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:22:56.973491 n-d-854924-5 devstack@n-api.service[122167]: WARNING keystonemiddleware.auth_token [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:22:57.122379 n-d-854924-5 devstack@n-api.service[122168]: WARNING keystonemiddleware.auth_token [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:22:57.129974 n-d-854924-5 devstack@n-api.service[122168]: WARNING keystonemiddleware.auth_token [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:22:57.349812 n-d-854924-5 devstack@n-api.service[122167]: WARNING keystonemiddleware.auth_token [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:22:57.362420 n-d-854924-5 devstack@n-api.service[122167]: WARNING keystonemiddleware.auth_token [None req-395bfb63-1e8c-40c8-9340-cbefa61f4299 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:22:57.374624 n-d-854924-5 devstack@n-api.service[122167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f3630b9c0 pid: 122167 (default app) Aug 30 03:22:57.495737 n-d-854924-5 devstack@n-api.service[122168]: WARNING keystonemiddleware.auth_token [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:22:57.502319 n-d-854924-5 devstack@n-api.service[122168]: WARNING keystonemiddleware.auth_token [None req-bc4c3ec6-2613-4828-9023-076fbabcd49f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:22:57.507600 n-d-854924-5 devstack@n-api.service[122168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557f3630b9c0 pid: 122168 (default app) Aug 30 03:23:39.222532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:39.224283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:39.226158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:39.227272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:40.348845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:40.349794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:40.351232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:40.352110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:40.610680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-250263094", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:41.162787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:23:41.313906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac5c7b1c-dd4e-4369-92ca-1244547d2034 tempest-AZAdminNegativeTestJSON-653420464 tempest-AZAdminNegativeTestJSON-653420464-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:41.315582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac5c7b1c-dd4e-4369-92ca-1244547d2034 tempest-AZAdminNegativeTestJSON-653420464 tempest-AZAdminNegativeTestJSON-653420464-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c15ce382adde42b4ad045cfa7c14a0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3adeab9b99a42479b56b1cf652d5e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac5c7b1c-dd4e-4369-92ca-1244547d2034 tempest-AZAdminNegativeTestJSON-653420464 tempest-AZAdminNegativeTestJSON-653420464-project] Request method failure captured: Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK57Zf_TzAjIAymTRBmD_gJytEOzk7w0duTou0WKTH-g8XiXrgNYT-65Ovp0-f8sJl7-WoAHVN83hzTaqcVQapHixAFFE9jCutOlLfXe71hSs_K914e5FwyMa_yoUNebEYg4cpf_iw7Ai8IDumDKl5kr4ak0oi4q5mHRGUe-XJOMrI Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a3adeab9b99a42479b56b1cf652d5e8a Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AZAdminNegativeTestJSON-653420464 Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:23:41.318835 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a3adeab9b99a42479b56b1cf652d5e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a3adeab9b99a42479b56b1cf652d5e8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a3adeab9b99a42479b56b1cf652d5e8a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a3adeab9b99a42479b56b1cf652d5e8a"}]}] Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AZAdminNegativeTestJSON-653420464 Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a3adeab9b99a42479b56b1cf652d5e8a Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-653420464 Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AZAdminNegativeTestJSON-653420464-project Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c15ce382adde42b4ad045cfa7c14a0d6 Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AZAdminNegativeTestJSON-653420464-project Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 03:23:41.319939 n-d-854924-5 devstack@n-api.service[122168]: action_args: {} Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:23:41.320585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:41.322229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac5c7b1c-dd4e-4369-92ca-1244547d2034 tempest-AZAdminNegativeTestJSON-653420464 tempest-AZAdminNegativeTestJSON-653420464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:41.323911 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac5c7b1c-dd4e-4369-92ca-1244547d2034 tempest-AZAdminNegativeTestJSON-653420464 tempest-AZAdminNegativeTestJSON-653420464-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.978185 Aug 30 03:23:41.323911 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:23:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 980 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:23:41.439734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '.version_select at 0x7f8981320a60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:41.448142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=122168) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 03:23:41.449007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.449703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:41.450102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:41.481158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.481694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:41.482138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:41.486356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:23:41.486888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:23:41.487612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:23:41.488111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:23:41.488730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:23:41.495536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.496031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:41.496469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:41.502487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.502617 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d61accff-5e49-430a-87be-eadba30576cf tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.179853 Aug 30 03:23:41.503138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:41.503436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:23:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:41.517121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:41.518139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.518602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:41.519173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:41.554460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Getting quotas for project 46bc04aff43d4a2c9eef1712856befba. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:23:41.561463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Getting quotas for user badc8bf36b3e4fb794c07c8c487d8007 and project 46bc04aff43d4a2c9eef1712856befba. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:23:41.575015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:23:41.578060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:23:41.649678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e11a5f9f-297b-48b9-a02c-a53183f6f323 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.439656 Aug 30 03:23:41.650633 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:23:41.721790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39ad4aa2-e267-4711-92a4-e3649be5db09 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-481469994", "id": 1069872400, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:41.800839 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39ad4aa2-e267-4711-92a4-e3649be5db09 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.295760 Aug 30 03:23:41.809985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3/4] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:41 2022] POST /compute/v2.1/flavors => generated 430 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:41.856257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1bbd344-e2ed-42c1-a5c6-db058ad5f794 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-119247331", "id": 970536167, "os-flavor-access:is_public": "True"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:41.891602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1bbd344-e2ed-42c1-a5c6-db058ad5f794 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.239507 Aug 30 03:23:41.901206 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2/5] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:41 2022] POST /compute/v2.1/flavors => generated 426 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:41.991426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:41.996470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.997213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:41.997884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:41.999174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:41.999745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:42.000353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:42.044590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:42.046356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:42.047240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:42.047878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:42.048825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:42.049520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:42.050144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:42.052443 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6a099fc0-5792-4cc1-b960-6de671bee218 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.249521 Aug 30 03:23:42.061860 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:23:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:42.114835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6452af2-286f-4daa-9306-47add6f99a9e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.212030 Aug 30 03:23:42.115602 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Aug 30 03:23:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:42.121335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ff87291-af59-4d20-b986-16331759c7e7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1893947239", "name": "tempest-test_aggregate-400519745"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:42.144616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-8ff87291-af59-4d20-b986-16331759c7e7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid 2d10953e-eb17-462e-8ed5-07b82ccba833 for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:23:42.221799 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ff87291-af59-4d20-b986-16331759c7e7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.104917 Aug 30 03:23:42.222961 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 4/8] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Aug 30 03:23:42 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:42.230723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4adc1fa-4913-48a3-8dc5-1d196b370cff tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:42.232042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4adc1fa-4913-48a3-8dc5-1d196b370cff tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:42.253741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e442528-c41a-4037-9f8f-c9a423478006 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1802205614", "id": 758720871, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:42.282916 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e442528-c41a-4037-9f8f-c9a423478006 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.228014 Aug 30 03:23:42.283736 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 5/9] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:42 2022] POST /compute/v2.1/flavors => generated 436 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:42.288667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-767f1ccd-4ec9-4a83-97b0-0aebd4f226fc tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "46369ceb484344feba8db8cbc249ad0c"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:42.369803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4adc1fa-4913-48a3-8dc5-1d196b370cff tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:42.386260 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4adc1fa-4913-48a3-8dc5-1d196b370cff tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1219 microversion: 2.1 time: 0.161848 Aug 30 03:23:42.401214 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:42 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:42.407295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dce2eb62-c64a-4f8b-b642-e1e502408b72 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:42.434316 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dce2eb62-c64a-4f8b-b642-e1e502408b72 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/970536167" status: 202 len: 0 microversion: 2.1 time: 0.031639 Aug 30 03:23:42.434896 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:42 2022] DELETE /compute/v2.1/flavors/970536167 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:42.443723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:42.446256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:42.446979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:42.447418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:42.448150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:42.448601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:42.449022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:42.474637 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32c28d63-08af-4580-b99e-2dd2b8b9b99e tempest-AZAdminV2TestJSON-2068964482 tempest-AZAdminV2TestJSON-2068964482-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.038497 Aug 30 03:23:42.475549 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:23:42 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:42.480693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f5e9a00c-75e2-4ae3-ba16-d646d38e5265 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:42.497580 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f5e9a00c-75e2-4ae3-ba16-d646d38e5265 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.020955 Aug 30 03:23:42.511289 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 8/13] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:23:42 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:42.520522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0fbc6296-ad72-4d0b-81aa-924f07f6a2ed tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:42.595136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-767f1ccd-4ec9-4a83-97b0-0aebd4f226fc tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1069872400/action" status: 200 len: 97 microversion: 2.1 time: 0.310304 Aug 30 03:23:42.596427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 6/14] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Aug 30 03:23:42 2022] POST /compute/v2.1/flavors/1069872400/action => generated 97 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:42.601254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3308a7c8-8ec8-4b74-9482-1aa1b202de6d tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:42.643380 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3308a7c8-8ec8-4b74-9482-1aa1b202de6d tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045321 Aug 30 03:23:42.644111 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 7/15] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:42.649171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2203fd7f-bf5d-4fea-b7bc-7e7082179a12 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:42.709888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2203fd7f-bf5d-4fea-b7bc-7e7082179a12 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:42.713876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2203fd7f-bf5d-4fea-b7bc-7e7082179a12 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:42.715596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2203fd7f-bf5d-4fea-b7bc-7e7082179a12 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:43.221422 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0fbc6296-ad72-4d0b-81aa-924f07f6a2ed tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/758720871/action" status: 200 len: 96 microversion: 2.1 time: 0.705628 Aug 30 03:23:43.228858 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 9/16] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:42 2022] POST /compute/v2.1/flavors/758720871/action => generated 96 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:43.726039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5a4f6aa7-6236-4493-a477-3c4eb51b6349 tempest-FlavorsAccessTestJSON-43597007 tempest-FlavorsAccessTestJSON-43597007-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:43.726039 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5a4f6aa7-6236-4493-a477-3c4eb51b6349 tempest-FlavorsAccessTestJSON-43597007 tempest-FlavorsAccessTestJSON-43597007-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.417894 Aug 30 03:23:43.726039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 10/17] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:43 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:43.726039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b90a9ae4-a364-4872-98ce-48937018f65a tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-35877811", "id": 1462503348, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:43.741190 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b90a9ae4-a364-4872-98ce-48937018f65a tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.090418 Aug 30 03:23:43.741844 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 11/18] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:43 2022] POST /compute/v2.1/flavors => generated 415 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:43.756968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-332840a7-5670-49d0-8ebd-d94e7ce28bc6 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:43.800092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2203fd7f-bf5d-4fea-b7bc-7e7082179a12 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.154674 Aug 30 03:23:43.823879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 8/19] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:23:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:43.832229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:43.833138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:43.881841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:43.882666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:43.883134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:43.883949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:43.889599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:43.889599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:44.101210 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-332840a7-5670-49d0-8ebd-d94e7ce28bc6 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 907de618877a41d48b8e779da3061120 combination. Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-332840a7-5670-49d0-8ebd-d94e7ce28bc6 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Request method failure captured: Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/flavors/758720871/action HTTP/1.1 Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 67 Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK7ZCIwV7b0lm449SWMqO27ZVNeg1mEf8MeZN5bHK9LY5TioSORoWrr5omuIqS3qcbV-a_tE-3Ky6eqg4SNsx8vmzr8a3rndDTOq6ESU6fqghpWMpsFuumsI3DQZGt5wCK_j76AItNIHPSWdDEe-4RtbvlrMGDRiHJSu3nJutLZ-9E Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 1c4e713d2cb94845973ed9249b22b06f Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:23:44.115639 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1c4e713d2cb94845973ed9249b22b06f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1c4e713d2cb94845973ed9249b22b06f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1c4e713d2cb94845973ed9249b22b06f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1c4e713d2cb94845973ed9249b22b06f"}]}] Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 1c4e713d2cb94845973ed9249b22b06f Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 1fb9cb92882a4f3dbd86764ac8077314 Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: {"addTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} Aug 30 03:23:44.117495 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: exception: Flavor access already exists for flavor 17 and project 907de618877a41d48b8e779da3061120 combination. Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '758720871', 'body': {'addTenantAccess': {'tenant': '907de618877a41d48b8e779da3061120'}}} Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result.read() Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:23:44.118797 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-907de618877a41d48b8e779da3061120' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 03:23:44.121253 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 03:23:44.124731 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:23:44.127758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result.read() Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-907de618877a41d48b8e779da3061120' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 3, 23, 44, 78639), 'updated_at': None, 'flavor_id': 17, 'project_id': '907de618877a41d48b8e779da3061120'}] Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:44.131801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 907de618877a41d48b8e779da3061120 combination. Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:44.133390 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 907de618877a41d48b8e779da3061120 combination. Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:23:44.136013 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:23:44.138712 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 907de618877a41d48b8e779da3061120 combination. Aug 30 03:23:44.138712 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:44.138712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-332840a7-5670-49d0-8ebd-d94e7ce28bc6 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 907de618877a41d48b8e779da3061120 combination. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:44.138712 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-332840a7-5670-49d0-8ebd-d94e7ce28bc6 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/758720871/action" status: 409 len: 152 microversion: 2.1 time: 0.372939 Aug 30 03:23:44.138712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 12/20] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:43 2022] POST /compute/v2.1/flavors/758720871/action => generated 152 bytes in 376 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:23:44.138712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fa63a836-8b70-4218-ac5e-d57b214586f4 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "46369ceb484344feba8db8cbc249ad0c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:44.416719 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fa63a836-8b70-4218-ac5e-d57b214586f4 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1069872400/action" status: 200 len: 21 microversion: 2.1 time: 0.295840 Aug 30 03:23:44.425953 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 13/21] 10.222.0.30 () {60 vars in 1200 bytes} [Tue Aug 30 03:23:44 2022] POST /compute/v2.1/flavors/1069872400/action => generated 21 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:44.442833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:44.447379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f7ad43d-d1b0-4838-a61e-2a8502698ed3 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:44.463063 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc345a5d-cf5e-4dd1-8e34-903fa0a5f24a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1293 microversion: 2.1 time: 0.636812 Aug 30 03:23:44.464206 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 9/22] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:43 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1293 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:44.506671 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f7ad43d-d1b0-4838-a61e-2a8502698ed3 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.078377 Aug 30 03:23:44.517387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 14/23] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:44 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:44.536212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba9c860c-dd25-4a8c-9e3d-d14b20342215 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:44.872525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-492110335", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "availability_zone": "tempest-test_az-1893947239"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:44.909717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:44.910422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:44.910935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:44.911867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:44.912407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:44.912894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:45.009585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:23:45.287210 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba9c860c-dd25-4a8c-9e3d-d14b20342215 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/758720871/action" status: 200 len: 21 microversion: 2.1 time: 0.772011 Aug 30 03:23:45.289479 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 15/24] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:44 2022] POST /compute/v2.1/flavors/758720871/action => generated 21 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:45.297731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7b55249-c36b-406a-a0f3-406154baf8d2 tempest-FlavorsAccessTestJSON-43597007 tempest-FlavorsAccessTestJSON-43597007-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.330189 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7b55249-c36b-406a-a0f3-406154baf8d2 tempest-FlavorsAccessTestJSON-43597007 tempest-FlavorsAccessTestJSON-43597007-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.038942 Aug 30 03:23:45.331444 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 16/25] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:45 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:45.338462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b9c23953-4624-4e8d-8907-cb9a13a23d14 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.366249 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b9c23953-4624-4e8d-8907-cb9a13a23d14 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1462503348" status: 202 len: 0 microversion: 2.1 time: 0.033260 Aug 30 03:23:45.372242 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 17/26] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:45 2022] DELETE /compute/v2.1/flavors/1462503348 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:45.389428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a7b5d9a-52f3-4ed4-919b-6334a5a5de13 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.418986 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a7b5d9a-52f3-4ed4-919b-6334a5a5de13 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/758720871" status: 202 len: 0 microversion: 2.1 time: 0.043972 Aug 30 03:23:45.420892 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 18/27] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:45 2022] DELETE /compute/v2.1/flavors/758720871 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:45.427929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4cd6d11-3f41-4030-8f3e-f8c3b808648e tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.453277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:DELETE=13 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:45.471184 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4cd6d11-3f41-4030-8f3e-f8c3b808648e tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1069872400" status: 202 len: 0 microversion: 2.1 time: 0.048109 Aug 30 03:23:45.475556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 19/28] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:45 2022] DELETE /compute/v2.1/flavors/1069872400 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:45.484816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df0ff7a0-471a-4d42-bf71-f509e081f78a tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.487031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:23:45.487755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:23:45.488545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:23:45.488814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:23:45.489248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:23:45.514563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:45.518853 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df0ff7a0-471a-4d42-bf71-f509e081f78a tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041512 Aug 30 03:23:45.520143 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 20/29] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:45.520641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:45.521321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:45.522080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:45.522559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:45.523001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:45.527357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9886fdb2-1f73-486a-846a-ee7131792cfb tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.572194 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9886fdb2-1f73-486a-846a-ee7131792cfb tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050413 Aug 30 03:23:45.590358 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 21/30] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:45.611496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab58e761-4251-4b4d-806d-f1a75dbb2a15 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.616147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Getting quotas for project ec228a39d1ea4733824aec784a590d8e. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:23:45.631673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Getting quotas for user 9248961ff84b44b9ae37817650f35f18 and project ec228a39d1ea4733824aec784a590d8e. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:23:45.663560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:23:45.669943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:23:45.713614 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab58e761-4251-4b4d-806d-f1a75dbb2a15 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.118421 Aug 30 03:23:45.714699 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 22/31] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:45.778103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:45.778717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:45.789594 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ebb058e0-3087-42fa-a8ed-a5fcc56d62c4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322972 Aug 30 03:23:45.791146 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 10/32] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:23:45.797119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:45.799248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:45.799849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:45.800867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:45.801952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:45.802568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:45.812935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48e77487-5571-40e0-bd5e-2b7e80ce3fdb tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-498758374", "id": 649570879, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:45.873516 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48e77487-5571-40e0-bd5e-2b7e80ce3fdb tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.080977 Aug 30 03:23:45.886169 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 11/33] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:45 2022] POST /compute/v2.1/flavors => generated 425 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:45.896319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-974a75ce-ca22-472f-925e-ae7e8c525ac1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-743685698", "id": 678613438, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:45.938267 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-974a75ce-ca22-472f-925e-ae7e8c525ac1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.050363 Aug 30 03:23:45.941505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 12/34] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:45 2022] POST /compute/v2.1/flavors => generated 434 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:45.957296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b4b52964-b17d-4312-b6a5-ff31a08c8a97 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1572730492", "id": 978165990, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:45.988473 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b4b52964-b17d-4312-b6a5-ff31a08c8a97 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.044986 Aug 30 03:23:46.004707 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 13/35] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:45 2022] POST /compute/v2.1/flavors => generated 428 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:46.014942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4fb35df0-2629-4e73-ab9b-ec4feeb88ae4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.016490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4fb35df0-2629-4e73-ab9b-ec4feeb88ae4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:46.127181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4fb35df0-2629-4e73-ab9b-ec4feeb88ae4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:46.157318 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4fb35df0-2629-4e73-ab9b-ec4feeb88ae4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1242 microversion: 2.1 time: 0.150472 Aug 30 03:23:46.158959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 14/36] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:46.165068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be92d6d3-3ab4-41c1-afcf-ceb2645ddb8f tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.233253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be92d6d3-3ab4-41c1-afcf-ceb2645ddb8f tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/649570879" status: 202 len: 0 microversion: 2.1 time: 0.072195 Aug 30 03:23:46.239732 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 15/37] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:46 2022] DELETE /compute/v2.1/flavors/649570879 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:46.252426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-806898e1-6634-40cb-86de-88f1867669d1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.261108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:46.269951 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-806898e1-6634-40cb-86de-88f1867669d1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-806898e1-6634-40cb-86de-88f1867669d1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Request method failure captured: Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/flavors/678613438/os-flavor-access HTTP/1.1 Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK7ZCIwV7b0lm449SWMqO27ZVNeg1mEf8MeZN5bHK9LY5TioSORoWrr5omuIqS3qcbV-a_tE-3Ky6eqg4SNsx8vmzr8a3rndDTOq6ESU6fqghpWMpsFuumsI3DQZGt5wCK_j76AItNIHPSWdDEe-4RtbvlrMGDRiHJSu3nJutLZ-9E Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1c4e713d2cb94845973ed9249b22b06f Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:23:46.271088 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1c4e713d2cb94845973ed9249b22b06f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1c4e713d2cb94845973ed9249b22b06f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1c4e713d2cb94845973ed9249b22b06f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1c4e713d2cb94845973ed9249b22b06f"}]}] Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1c4e713d2cb94845973ed9249b22b06f Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 1fb9cb92882a4f3dbd86764ac8077314 Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: exception: Access list not available for public flavors. Aug 30 03:23:46.272161 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '678613438'} Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 30 03:23:46.272876 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:46.273956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-806898e1-6634-40cb-86de-88f1867669d1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:46.273956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-806898e1-6634-40cb-86de-88f1867669d1 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/678613438/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026841 Aug 30 03:23:46.275402 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 16/38] 10.222.0.30 () {58 vars in 1206 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/678613438/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:23:46.288931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cfb1ddfa-e945-4e5d-853e-78a54f9b260f tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.303848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f82fa10e-451c-4c54-ac72-bed9d5f5a649 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1299 microversion: 2.1 time: 0.587680 Aug 30 03:23:46.308503 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 23/39] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:45 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1299 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:46.318897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a8b8311-e1be-4d12-a14f-32bfde15da13 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.319895 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cfb1ddfa-e945-4e5d-853e-78a54f9b260f tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/978165990/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036798 Aug 30 03:23:46.329551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 17/40] 10.222.0.30 () {58 vars in 1206 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/978165990/os-flavor-access => generated 21 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:46.338904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6515e8be-24f9-4eaa-8806-c11d7b9bd79f tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.388075 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a8b8311-e1be-4d12-a14f-32bfde15da13 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5415 microversion: 2.1 time: 0.077661 Aug 30 03:23:46.405242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6515e8be-24f9-4eaa-8806-c11d7b9bd79f tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/678613438" status: 202 len: 0 microversion: 2.1 time: 0.059728 Aug 30 03:23:46.405242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 18/41] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:46 2022] DELETE /compute/v2.1/flavors/678613438 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:46.405242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51612ea4-a9de-4611-81ae-76738768edc4 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.407063 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 24/42] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/detail => generated 5415 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:46.413477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93ff3a21-9054-47d4-8d65-173c70b6c8b3 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.443338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:46.451695 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51612ea4-a9de-4611-81ae-76738768edc4 tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/978165990" status: 202 len: 0 microversion: 2.1 time: 0.054988 Aug 30 03:23:46.459570 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 19/43] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:46 2022] DELETE /compute/v2.1/flavors/978165990 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:46.475300 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93ff3a21-9054-47d4-8d65-173c70b6c8b3 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066431 Aug 30 03:23:46.482910 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 25/44] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:46.483271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-383e5639-16c7-45c2-a329-767d821bcefa tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-426015120", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:46.489470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fbd4d173-efba-459a-aeee-2eb18129ebeb tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.529765 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fbd4d173-efba-459a-aeee-2eb18129ebeb tempest-FlavorsAccessTestJSON-1480171544 tempest-FlavorsAccessTestJSON-1480171544-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044745 Aug 30 03:23:46.531506 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 26/45] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:46.538204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea6ec180-d59d-4154-a28f-c5aa994cae82 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1054135399", "id": 684165990, "os-flavor-access:is_public": "False"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:46.565270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-383e5639-16c7-45c2-a329-767d821bcefa tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.096312 Aug 30 03:23:46.570546 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 20/46] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:46 2022] POST /compute/v2.1/flavors => generated 506 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:46.604183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-070d6515-4797-4961-a604-9ac7164e347d tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.608169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea6ec180-d59d-4154-a28f-c5aa994cae82 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.075114 Aug 30 03:23:46.616862 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 27/47] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:46 2022] POST /compute/v2.1/flavors => generated 436 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:46.652062 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-070d6515-4797-4961-a604-9ac7164e347d tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/a497bc6f-65af-47fa-9b04-57e45e538acc" status: 202 len: 0 microversion: 2.1 time: 0.070407 Aug 30 03:23:46.653757 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 21/48] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:23:46 2022] DELETE /compute/v2.1/flavors/a497bc6f-65af-47fa-9b04-57e45e538acc => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:46.663414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ff82473-c08e-4dd5-bfb8-c04c7dc824e2 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.718965 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ff82473-c08e-4dd5-bfb8-c04c7dc824e2 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060318 Aug 30 03:23:46.746114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 22/49] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:46.751439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fefe1106-ce7c-4400-a607-2e6ab46ddd25 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1624720404", "id": "106bfac1-296f-49d0-9ec1-a72701f2defb", "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:46.843387 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fefe1106-ce7c-4400-a607-2e6ab46ddd25 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.090213 Aug 30 03:23:46.845804 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 23/50] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:46.868426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8f259601-897a-423f-8c16-1c2e996c3068 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:46.905127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8f259601-897a-423f-8c16-1c2e996c3068 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/106bfac1-296f-49d0-9ec1-a72701f2defb" status: 202 len: 0 microversion: 2.1 time: 0.044196 Aug 30 03:23:46.908454 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 24/51] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:23:46 2022] DELETE /compute/v2.1/flavors/106bfac1-296f-49d0-9ec1-a72701f2defb => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:46.944228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d3502cc-9bc5-4ee8-930c-592ea0eb7e2d tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:47.002181 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d3502cc-9bc5-4ee8-930c-592ea0eb7e2d tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088632 Aug 30 03:23:47.003625 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 25/52] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:47.032323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4b96f6c-9ac5-4561-87a0-d66d2619ab39 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-677904668", "id": 1038743750, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:47.108900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4b96f6c-9ac5-4561-87a0-d66d2619ab39 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.089561 Aug 30 03:23:47.118592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 26/53] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:47 2022] POST /compute/v2.1/flavors => generated 413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:47.129849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29090302-4368-4ff0-98f0-2336210b1623 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:47.147878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29090302-4368-4ff0-98f0-2336210b1623 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1038743750" status: 200 len: 413 microversion: 2.1 time: 0.024730 Aug 30 03:23:47.158938 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 27/54] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:47 2022] GET /compute/v2.1/flavors/1038743750 => generated 413 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:47.650257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ced47daa-5e5a-46e7-91ed-2eee69e4eead tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:47.654064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ced47daa-5e5a-46e7-91ed-2eee69e4eead tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e739538b5c944e909de4a669085b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907de618877a41d48b8e779da3061120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ced47daa-5e5a-46e7-91ed-2eee69e4eead tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Request method failure captured: Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/flavors/684165990/action HTTP/1.1 Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 67 Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK4Yab5U6dgOpsuMqSMlkQ_f0YlMu3pcTCievllkJ3cnV6lqiaLXlXp2H9_Us-CjY29qruhrEPl03fvcHAZFEb6tvLfS0sQE8Cc_cgHhizfx8Y6LqRR1gRI4KdiBdkJ8yC1buOqdPVA2NXhGnU3LVFZwwj1Cj-x0xqtM1L0kuTJECI Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 907de618877a41d48b8e779da3061120 Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-106274093 Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:23:47.668916 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/907de618877a41d48b8e779da3061120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/907de618877a41d48b8e779da3061120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_907de618877a41d48b8e779da3061120", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/907de618877a41d48b8e779da3061120"}]}] Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-106274093 Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 907de618877a41d48b8e779da3061120 Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-106274093 Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FlavorsAccessNegativeTestJSON-106274093-project Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: e739538b5c944e909de4a669085b3753 Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-106274093-project Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: {"addTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} Aug 30 03:23:47.670492 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '684165990', 'body': {'addTenantAccess': {'tenant': '907de618877a41d48b8e779da3061120'}}} Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:23:47.671302 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 03:23:47.672628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:47.673994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ced47daa-5e5a-46e7-91ed-2eee69e4eead tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:47.675207 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ced47daa-5e5a-46e7-91ed-2eee69e4eead tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] 10.222.0.30 "POST /compute/v2.1/flavors/684165990/action" status: 403 len: 130 microversion: 2.1 time: 1.041082 Aug 30 03:23:47.678166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 28/55] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:46 2022] POST /compute/v2.1/flavors/684165990/action => generated 130 bytes in 1047 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:23:47.692793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:47.698616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:47.718861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:47.719368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:47.719840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:47.720725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:47.721025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:47.721600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:47.884919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:47.911734 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-28b099a3-90a1-483c-8853-cfe627147ebe tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1242 microversion: 2.1 time: 0.229560 Aug 30 03:23:47.914461 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 29/56] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:47 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:47.932352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:47.933612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:47.943456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:47.944387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:47.945235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:47.960861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:47.962566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:47.965045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:47.977751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-de5b977f-a7aa-47c6-baef-ac1744df3382 tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:48.075951 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-de5b977f-a7aa-47c6-baef-ac1744df3382 tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.915756 Aug 30 03:23:48.077415 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 28/57] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:47 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:48.105222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17e21092-6ec3-4cc7-8d96-e8c8d8f8e503 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:48.181044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17e21092-6ec3-4cc7-8d96-e8c8d8f8e503 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/684165990" status: 202 len: 0 microversion: 2.1 time: 0.098909 Aug 30 03:23:48.183267 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 29/58] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:48 2022] DELETE /compute/v2.1/flavors/684165990 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:48.201868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67f323a7-74cb-44d0-9c65-6268d807f018 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:48.250635 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67f323a7-74cb-44d0-9c65-6268d807f018 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1038743750" status: 202 len: 0 microversion: 2.1 time: 0.064124 Aug 30 03:23:48.251487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 30/59] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:48 2022] DELETE /compute/v2.1/flavors/1038743750 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:48.256561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-817e071e-83fc-4d16-a273-16de8923c30d tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:48.308960 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-817e071e-83fc-4d16-a273-16de8923c30d tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055797 Aug 30 03:23:48.309619 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 31/60] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:48.333863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cdb5f66a-102c-4305-9881-c6237bcd22d9 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:48.396221 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cdb5f66a-102c-4305-9881-c6237bcd22d9 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078984 Aug 30 03:23:48.398296 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 32/61] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:48.411601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-538f7844-f536-4fc7-86bd-6e6b8943e6b7 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-299039517", "id": 293167370, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:48.467913 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-538f7844-f536-4fc7-86bd-6e6b8943e6b7 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.068254 Aug 30 03:23:48.469558 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 33/62] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:48 2022] POST /compute/v2.1/flavors => generated 435 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:48.480895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d514b3f-0b4e-4333-8256-6a82980d60db tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-291702034", "id": 1454863430, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:48.523602 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d514b3f-0b4e-4333-8256-6a82980d60db tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.051342 Aug 30 03:23:48.524942 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 34/63] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:48 2022] POST /compute/v2.1/flavors => generated 429 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:48.532209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9aba294-8d13-4967-8a83-e186cfec7bfc tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:48.673660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:48.683340 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78cf099a-4f17-41dc-845c-c5da8b529a3a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.765245 Aug 30 03:23:48.700993 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 30/64] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:47 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:48.713224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e35d79df-3f29-4c95-94a0-fb96234f165a tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "1454863430"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:48.732758 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e35d79df-3f29-4c95-94a0-fb96234f165a tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] HTTP exception thrown: Flavor 1454863430 could not be found. Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e35d79df-3f29-4c95-94a0-fb96234f165a tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] Request method failure captured: Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 107 Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK56vcypmDdWRzG83XcksZIN3_fVhnySJBuEa4tbtg5Ta1jB_LH8hVJxjYvhBAKEMujQfkmUmZGH9ypjjhuWjZhEOgQyNRJoOxqDqoLhzyf6v2R5ipEaJYLe1YgzEPwDjAtCK4L9xgYOdX1cfnfHyiM22G1jOV-8fWFfnH8allx7Mo Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 28874b0d0bc34da88735970a6ebd6985 Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FlavorsAdminTestJSON-1906158042 Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:23:48.756049 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28874b0d0bc34da88735970a6ebd6985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28874b0d0bc34da88735970a6ebd6985"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28874b0d0bc34da88735970a6ebd6985", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28874b0d0bc34da88735970a6ebd6985"}]}] Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FlavorsAdminTestJSON-1906158042 Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 28874b0d0bc34da88735970a6ebd6985 Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1906158042 Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FlavorsAdminTestJSON-1906158042-project Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d7fc59660f3a46da9d6936e818984d79 Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FlavorsAdminTestJSON-1906158042-project Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "test", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "1454863430"}} Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:23:48.757478 n-d-854924-5 devstack@n-api.service[122167]: exception: Flavor 1454863430 could not be found. Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '1454863430'}}} Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1454863430 could not be found. Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:48.758369 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1454863430 could not be found. Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:48.759691 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:48.761047 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:48.761047 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:23:48.761047 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:23:48.761047 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1454863430 could not be found. Aug 30 03:23:48.761047 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:23:48.766759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e35d79df-3f29-4c95-94a0-fb96234f165a tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] Returning 400 to user: Flavor 1454863430 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:48.771716 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e35d79df-3f29-4c95-94a0-fb96234f165a tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.069294 Aug 30 03:23:48.775133 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 31/65] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:48 2022] POST /compute/v2.1/servers => generated 81 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:23:48.797276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d9535a5-ad7e-463a-906c-a5795ed4c99a tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:48.871482 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d9535a5-ad7e-463a-906c-a5795ed4c99a tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1454863430" status: 202 len: 0 microversion: 2.1 time: 0.092172 Aug 30 03:23:48.874373 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 32/66] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:48 2022] DELETE /compute/v2.1/flavors/1454863430 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:49.620186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a427b200-2cc7-4814-9afc-3d2cebc7e457 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1604926959", "ram": 512, "vcpus": 1, "disk": 10, "id": 1692336829, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:49.724931 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a427b200-2cc7-4814-9afc-3d2cebc7e457 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.838486 Aug 30 03:23:49.726099 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:48 2022] POST /compute/v2.1/flavors => generated 416 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:49.731646 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9aba294-8d13-4967-8a83-e186cfec7bfc tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/293167370/action" status: 200 len: 96 microversion: 2.1 time: 1.205586 Aug 30 03:23:49.739129 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:48 2022] POST /compute/v2.1/flavors/293167370/action => generated 96 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:49.754490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23a25559-7c55-4ca1-8894-88d644a56711 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:49.755464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:49.757603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:49.788640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:49.789653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:49.791672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:49.796947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:49.798136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:49.802280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:49.839251 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23a25559-7c55-4ca1-8894-88d644a56711 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.095566 Aug 30 03:23:49.839251 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:49 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:49.855495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:49.857301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:49.878374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:49.879209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:49.879845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:49.880762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:49.890142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:49.890990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:49.981668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:50.000357 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3152b7e9-3c7f-4be6-976c-b2201d3eacab tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1290 microversion: 2.1 time: 0.247980 Aug 30 03:23:50.001485 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 36/70] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:49 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1290 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:50.006661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c668f26-e4e3-4976-b56b-4367b70bae74 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:50.159504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c668f26-e4e3-4976-b56b-4367b70bae74 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.142124 Aug 30 03:23:50.168354 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 37/71] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Aug 30 03:23:50 2022] POST /compute/v2.1/flavors/1692336829/os-extra_specs => generated 66 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:50.195773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aaca8409-c06e-4f9f-9a0b-7be7d03b15c2 tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:50.206171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aaca8409-c06e-4f9f-9a0b-7be7d03b15c2 tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'e739538b5c944e909de4a669085b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907de618877a41d48b8e779da3061120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aaca8409-c06e-4f9f-9a0b-7be7d03b15c2 tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Request method failure captured: Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/flavors/293167370/action HTTP/1.1 Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 70 Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK4Yab5U6dgOpsuMqSMlkQ_f0YlMu3pcTCievllkJ3cnV6lqiaLXlXp2H9_Us-CjY29qruhrEPl03fvcHAZFEb6tvLfS0sQE8Cc_cgHhizfx8Y6LqRR1gRI4KdiBdkJ8yC1buOqdPVA2NXhGnU3LVFZwwj1Cj-x0xqtM1L0kuTJECI Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 907de618877a41d48b8e779da3061120 Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-106274093 Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:23:50.209791 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/907de618877a41d48b8e779da3061120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/907de618877a41d48b8e779da3061120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_907de618877a41d48b8e779da3061120", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/907de618877a41d48b8e779da3061120"}]}] Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-106274093 Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 907de618877a41d48b8e779da3061120 Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-106274093 Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsAccessNegativeTestJSON-106274093-project Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: e739538b5c944e909de4a669085b3753 Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-106274093-project Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: {"removeTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} Aug 30 03:23:50.211209 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '293167370', 'body': {'removeTenantAccess': {'tenant': '907de618877a41d48b8e779da3061120'}}} Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can( Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:23:50.213184 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 03:23:50.219077 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:50.226418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aaca8409-c06e-4f9f-9a0b-7be7d03b15c2 tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:50.228442 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aaca8409-c06e-4f9f-9a0b-7be7d03b15c2 tempest-FlavorsAccessNegativeTestJSON-106274093 tempest-FlavorsAccessNegativeTestJSON-106274093-project] 10.222.0.30 "POST /compute/v2.1/flavors/293167370/action" status: 403 len: 133 microversion: 2.1 time: 0.055879 Aug 30 03:23:50.233830 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 38/72] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:50 2022] POST /compute/v2.1/flavors/293167370/action => generated 133 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:23:50.240789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cf97ab00-65d1-4b9b-b345-70d8535ccd5c tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1762277992", "id": 698249548, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:50.275583 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cf97ab00-65d1-4b9b-b345-70d8535ccd5c tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.039303 Aug 30 03:23:50.276816 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 39/73] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:50 2022] POST /compute/v2.1/flavors => generated 412 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:50.392285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:50.405799 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5baf771a-44dd-48e3-aa62-ac3233cff8b1 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.567168 Aug 30 03:23:50.407123 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 35/74] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:49 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:50.416647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d41230f-9d1a-43d6-9a01-e371b03bff16 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "907de618877a41d48b8e779da3061120"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:50.859572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa9994b8-5cd4-4ad0-b16a-57139a84aec3 tempest-FlavorsExtraSpecsTestJSON-868335690 tempest-FlavorsExtraSpecsTestJSON-868335690-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:50.915548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa9994b8-5cd4-4ad0-b16a-57139a84aec3 tempest-FlavorsExtraSpecsTestJSON-868335690 tempest-FlavorsExtraSpecsTestJSON-868335690-project] 10.222.0.30 "GET /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.636413 Aug 30 03:23:50.916459 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 40/75] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Aug 30 03:23:50 2022] GET /compute/v2.1/flavors/1692336829/os-extra_specs => generated 66 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:50.934899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-caece61d-1aff-487d-b6cf-2ac631173f66 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1981417455", "id": 221768586, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:50.981052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-caece61d-1aff-487d-b6cf-2ac631173f66 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.061013 Aug 30 03:23:50.993813 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 41/76] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:50 2022] POST /compute/v2.1/flavors => generated 411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:51.026610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-453a7c81-53b4-41aa-93d3-d7ede35fd2d4 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:51.044640 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d41230f-9d1a-43d6-9a01-e371b03bff16 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/293167370/action" status: 200 len: 21 microversion: 2.1 time: 0.635683 Aug 30 03:23:51.054144 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 36/77] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:50 2022] POST /compute/v2.1/flavors/293167370/action => generated 21 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:51.061500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=70,nova_api:INSERT=10,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:51.084861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21844cc6-0513-4133-a56b-35a01cc426fa tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.092586 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-453a7c81-53b4-41aa-93d3-d7ede35fd2d4 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074191 Aug 30 03:23:51.101537 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 42/78] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Aug 30 03:23:50 2022] POST /compute/v2.1/flavors/1692336829/os-extra_specs => generated 66 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:51.126599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.127702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:51.134801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:51.135544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:51.136529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:51.142493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:51.143125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:51.143722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:51.147797 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21844cc6-0513-4133-a56b-35a01cc426fa tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 840 microversion: 2.1 time: 0.085395 Aug 30 03:23:51.149664 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 37/79] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 840 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:51.169576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ff425a2f-0f54-4bf3-ab6d-de4f7377ea4e tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.230514 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ff425a2f-0f54-4bf3-ab6d-de4f7377ea4e tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/293167370" status: 202 len: 0 microversion: 2.1 time: 0.074609 Aug 30 03:23:51.231382 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 38/80] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:51 2022] DELETE /compute/v2.1/flavors/293167370 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:51.244219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a36d3ab4-e9d7-414d-b703-f62010182010 tempest-FlavorsExtraSpecsTestJSON-868335690 tempest-FlavorsExtraSpecsTestJSON-868335690-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.270100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a36d3ab4-e9d7-414d-b703-f62010182010 tempest-FlavorsExtraSpecsTestJSON-868335690 tempest-FlavorsExtraSpecsTestJSON-868335690-project] 10.222.0.30 "GET /compute/v2.1/flavors/1692336829/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.036758 Aug 30 03:23:51.281046 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 39/81] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/1692336829/os-extra_specs/hw:numa_nodes => generated 22 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:51.293543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88a8949d-0c25-469d-ab50-0bba516758a6 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.313815 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-88a8949d-0c25-469d-ab50-0bba516758a6 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.039300 Aug 30 03:23:51.323409 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 40/82] 10.222.0.30 () {58 vars in 1177 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:51.331686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1359ecde-2989-4e9f-a1f2-2ebda75a1acc tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.360554 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1359ecde-2989-4e9f-a1f2-2ebda75a1acc tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.035808 Aug 30 03:23:51.382355 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 41/83] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:51.391267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98acf791-ab92-493a-a4f6-51dfb4b6858d tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:51.439379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98acf791-ab92-493a-a4f6-51dfb4b6858d tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055445 Aug 30 03:23:51.444969 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 42/84] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Aug 30 03:23:51 2022] POST /compute/v2.1/flavors/1692336829/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:51.449364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3889bd48-0631-46a9-a514-371b4e975ce6 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.462743 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3889bd48-0631-46a9-a514-371b4e975ce6 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.020712 Aug 30 03:23:51.465695 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 43/85] 10.222.0.30 () {58 vars in 1171 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:51.472464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be885300-5825-443e-9c12-91318796e0ca tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1686222565", "id": 629694556, "os-flavor-access:is_public": "False"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:51.502074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be885300-5825-443e-9c12-91318796e0ca tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.034686 Aug 30 03:23:51.510213 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 44/86] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:51.510642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.511292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:51.522541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:51.523350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:51.524059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:51.526569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:51.527426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:51.528251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:51.543320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:51.551757 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-552ad1b2-ce59-4275-9620-cee9e9068c3f tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1308 microversion: 2.1 time: 0.447723 Aug 30 03:23:51.552362 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 43/87] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:51.570483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d501e44c-98d3-463f-bbbb-8c9b641c5fbe tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.589819 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d501e44c-98d3-463f-bbbb-8c9b641c5fbe tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036300 Aug 30 03:23:51.590422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 44/88] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/1692336829/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:51.600963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6c15937-6b2d-4fdf-84ce-907802223952 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.636571 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6c15937-6b2d-4fdf-84ce-907802223952 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 841 microversion: 2.1 time: 0.044905 Aug 30 03:23:51.647502 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 45/89] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 841 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:51.654049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7591899-dd48-42f5-a1bf-c2ed7b67fca0 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99ebdc66a6b34adba73db1046022dc1e"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:51.814703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c7591899-dd48-42f5-a1bf-c2ed7b67fca0 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] HTTP exception thrown: Flavor access not found for 31 / 99ebdc66a6b34adba73db1046022dc1e combination. Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7591899-dd48-42f5-a1bf-c2ed7b67fca0 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Request method failure captured: Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/flavors/629694556/action HTTP/1.1 Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 70 Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK7ZCIwV7b0lm449SWMqO27ZVNeg1mEf8MeZN5bHK9LY5TioSORoWrr5omuIqS3qcbV-a_tE-3Ky6eqg4SNsx8vmzr8a3rndDTOq6ESU6fqghpWMpsFuumsI3DQZGt5wCK_j76AItNIHPSWdDEe-4RtbvlrMGDRiHJSu3nJutLZ-9E Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1c4e713d2cb94845973ed9249b22b06f Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:23:51.818091 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1c4e713d2cb94845973ed9249b22b06f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1c4e713d2cb94845973ed9249b22b06f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1c4e713d2cb94845973ed9249b22b06f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1c4e713d2cb94845973ed9249b22b06f"}]}] Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1c4e713d2cb94845973ed9249b22b06f Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-297926338 Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 1fb9cb92882a4f3dbd86764ac8077314 Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: {"removeTenantAccess": {"tenant": "99ebdc66a6b34adba73db1046022dc1e"}} Aug 30 03:23:51.819980 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: exception: Flavor access not found for 31 / 99ebdc66a6b34adba73db1046022dc1e combination. Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '629694556', 'body': {'removeTenantAccess': {'tenant': '99ebdc66a6b34adba73db1046022dc1e'}}} Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 30 03:23:51.821938 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 99ebdc66a6b34adba73db1046022dc1e combination. Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 99ebdc66a6b34adba73db1046022dc1e combination. Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:51.824035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 99ebdc66a6b34adba73db1046022dc1e combination. Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7591899-dd48-42f5-a1bf-c2ed7b67fca0 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Returning 404 to user: Flavor access not found for 31 / 99ebdc66a6b34adba73db1046022dc1e combination. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:23:51.827051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7591899-dd48-42f5-a1bf-c2ed7b67fca0 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/629694556/action" status: 404 len: 124 microversion: 2.1 time: 0.181545 Aug 30 03:23:51.833500 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 46/90] 10.222.0.30 () {60 vars in 1197 bytes} [Tue Aug 30 03:23:51 2022] POST /compute/v2.1/flavors/629694556/action => generated 124 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:23:51.838363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6afbbc79-42c8-43b0-8c56-c56e0efa3f7f tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:51.906432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6afbbc79-42c8-43b0-8c56-c56e0efa3f7f tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1692336829/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.072958 Aug 30 03:23:51.907654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 47/91] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Aug 30 03:23:51 2022] PUT /compute/v2.1/flavors/1692336829/os-extra_specs/hw:numa_nodes => generated 22 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:51.912479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fe38028-2541-4270-9eb5-d7fd7aaba2ff tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:51.939198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8fe38028-2541-4270-9eb5-d7fd7aaba2ff tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5798 microversion: 2.1 time: 0.029737 Aug 30 03:23:51.940275 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 48/92] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5798 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:51.964580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6602ef9-6b98-4086-ac87-c546e5e31b52 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.038078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c6602ef9-6b98-4086-ac87-c546e5e31b52 tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/629694556" status: 202 len: 0 microversion: 2.1 time: 0.095977 Aug 30 03:23:52.042896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 49/93] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:51 2022] DELETE /compute/v2.1/flavors/629694556 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:52.076872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4891ba23-7071-41f3-a528-4bb42a56bafa tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.096943 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4891ba23-7071-41f3-a528-4bb42a56bafa tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052089 Aug 30 03:23:52.103133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 50/94] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/1692336829/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:52.113563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06d4f259-1479-4d89-96ca-bdfbfe1fa554 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.171318 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06d4f259-1479-4d89-96ca-bdfbfe1fa554 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5798 microversion: 2.1 time: 0.064760 Aug 30 03:23:52.187063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 51/95] 10.222.0.30 () {58 vars in 1175 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5798 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:52.209506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1599f3e-5976-4a88-ad45-8e900ef71efd tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.297440 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1599f3e-5976-4a88-ad45-8e900ef71efd tempest-FlavorsAccessNegativeTestJSON-297926338 tempest-FlavorsAccessNegativeTestJSON-297926338-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.105535 Aug 30 03:23:52.302659 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 52/96] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:52.332896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a829a27-b455-4a6f-b5a2-3c6e6285f97d tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.380563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:52.436715 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a829a27-b455-4a6f-b5a2-3c6e6285f97d tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1692336829/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.130929 Aug 30 03:23:52.439557 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 53/97] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:23:52 2022] DELETE /compute/v2.1/flavors/1692336829/os-extra_specs/hw:numa_nodes => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:23:52.449285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01f76a92-4fdf-4d45-b431-6d1e51a33244 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.455165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:52.500754 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01f76a92-4fdf-4d45-b431-6d1e51a33244 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5798 microversion: 2.1 time: 0.060091 Aug 30 03:23:52.516569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 54/98] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5798 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:52.522523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9af71b1f-05a2-4140-a08c-ee40f753c579 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.557918 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9af71b1f-05a2-4140-a08c-ee40f753c579 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1692336829/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036853 Aug 30 03:23:52.559536 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 55/99] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:23:52 2022] DELETE /compute/v2.1/flavors/1692336829/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:23:52.571129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12fbc7eb-22a3-4190-8de2-196c29e4613e tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.639635 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12fbc7eb-22a3-4190-8de2-196c29e4613e tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5798 microversion: 2.1 time: 0.077365 Aug 30 03:23:52.641795 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 56/100] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5798 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:52.652144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08b9df8c-e4ff-4b6d-8992-8c0f49a19003 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.688772 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08b9df8c-e4ff-4b6d-8992-8c0f49a19003 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1692336829/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043476 Aug 30 03:23:52.692752 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 57/101] 10.222.0.30 () {58 vars in 1203 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/1692336829/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:23:52.711636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.712943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:52.729601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:52.730178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:52.730691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:52.732557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:52.733981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:52.734486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:52.825361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:52.843353 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f93fbb29-b397-4688-bfcb-f18f761d0a9d tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 1.338267 Aug 30 03:23:52.846568 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 45/102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:51 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:52.898666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b963dea-88f9-41df-805a-42b757ea0f38 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.934909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:52.943361 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a21b321-3a14-42f1-bc6c-f508ce317c74 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1296 microversion: 2.1 time: 0.248629 Aug 30 03:23:52.951019 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 58/103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:52.954923 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b963dea-88f9-41df-805a-42b757ea0f38 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/221768586" status: 202 len: 0 microversion: 2.1 time: 0.105087 Aug 30 03:23:52.962735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-abe52d33-47b0-4962-bdfe-8fd8b2adc5b0 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:52.963967 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 46/104] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:52 2022] DELETE /compute/v2.1/flavors/221768586 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:52.970022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00bfc9ce-5991-4ba9-a9a7-c6d2349ba34c tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.032552 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00bfc9ce-5991-4ba9-a9a7-c6d2349ba34c tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.066229 Aug 30 03:23:53.033515 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-abe52d33-47b0-4962-bdfe-8fd8b2adc5b0 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1692336829" status: 202 len: 0 microversion: 2.1 time: 0.080711 Aug 30 03:23:53.035013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 59/105] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:52 2022] DELETE /compute/v2.1/flavors/1692336829 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:53.046858 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 47/106] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:52 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.054943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5254902-7ec8-4ca6-a83d-c11cd23f1f05 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.059016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-718df5b1-7119-4895-95c9-9a968d29dda1 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.078244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:53.138212 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-718df5b1-7119-4895-95c9-9a968d29dda1 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/698249548" status: 202 len: 0 microversion: 2.1 time: 0.087989 Aug 30 03:23:53.139137 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 48/107] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:23:53 2022] DELETE /compute/v2.1/flavors/698249548 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:53.141332 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5254902-7ec8-4ca6-a83d-c11cd23f1f05 tempest-FlavorsExtraSpecsTestJSON-623978188 tempest-FlavorsExtraSpecsTestJSON-623978188-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099030 Aug 30 03:23:53.158292 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 60/108] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.165421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d004381-585e-4d20-bd40-44b6eb262ff4 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.206321 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d004381-585e-4d20-bd40-44b6eb262ff4 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045611 Aug 30 03:23:53.208244 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 49/109] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:23:53.229485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a1b391c-b59c-4e0d-b92b-382f8ae175f5 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1346160999", "id": 2143552792, "os-flavor-access:is_public": "False"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:53.264477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a1b391c-b59c-4e0d-b92b-382f8ae175f5 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.036318 Aug 30 03:23:53.266670 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 61/110] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:53 2022] POST /compute/v2.1/flavors => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:53.281145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98cb3204-1cf6-419f-ae62-10387b4deb40 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.330917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98cb3204-1cf6-419f-ae62-10387b4deb40 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052320 Aug 30 03:23:53.350738 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 50/111] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.357261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9d517fd-c5cc-40a1-a1b6-489b3da0fea3 tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.400237 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9d517fd-c5cc-40a1-a1b6-489b3da0fea3 tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049365 Aug 30 03:23:53.415644 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 62/112] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.429583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e52f98b-0a40-4d8c-bc68-10b4e623bd35 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.537863 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e52f98b-0a40-4d8c-bc68-10b4e623bd35 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2143552792" status: 202 len: 0 microversion: 2.1 time: 0.116507 Aug 30 03:23:53.544220 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 51/113] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:53 2022] DELETE /compute/v2.1/flavors/2143552792 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:53.551415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23a712b7-8d88-440a-821a-e5308479f50b tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.611111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23a712b7-8d88-440a-821a-e5308479f50b tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064531 Aug 30 03:23:53.614594 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 63/114] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.652667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a08fc771-bf4b-40ca-98f6-ad2f3ab6325e tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-216997508", "id": 1334293043, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:53.707437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a08fc771-bf4b-40ca-98f6-ad2f3ab6325e tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.073168 Aug 30 03:23:53.719533 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 64/115] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:23:53 2022] POST /compute/v2.1/flavors => generated 413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:53.727080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fa32937b-6789-48c2-8560-b465851a90f2 tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.762073 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fa32937b-6789-48c2-8560-b465851a90f2 tempest-FlavorsAdminTestJSON-1906158042 tempest-FlavorsAdminTestJSON-1906158042-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.039653 Aug 30 03:23:53.778986 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 65/116] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.785476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e24762c-2794-456f-a880-517e21c680f3 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.810716 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e24762c-2794-456f-a880-517e21c680f3 tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1334293043" status: 202 len: 0 microversion: 2.1 time: 0.029697 Aug 30 03:23:53.816272 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 66/117] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:23:53 2022] DELETE /compute/v2.1/flavors/1334293043 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:23:53.824308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1e6b80d-b8f5-4073-ad2b-e2ec4733cd0c tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.852852 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1e6b80d-b8f5-4073-ad2b-e2ec4733cd0c tempest-FlavorsAdminTestJSON-1260038193 tempest-FlavorsAdminTestJSON-1260038193-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034133 Aug 30 03:23:53.868958 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 67/118] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:53.880644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:53.881808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:53.900016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:53.901005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:53.901899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:53.903279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:53.904446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:53.905499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:54.030591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:SELECT=77,nova_api:DELETE=12,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:54.227497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2", "tag": "a30c53e5-3c7c-40ad-8a40-e6cd2dc76759"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:23:54.284910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:54.286158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:54.291450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:54.330199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Creating event network-changed:a30c53e5-3c7c-40ad-8a40-e6cd2dc76759 for instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 on n-h2-854924-5 Aug 30 03:23:54.331080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:23:54.331667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1be4b8be-697f-4529-9aa6-595e5f93dff0 req-442e57d4-3a65-4dba-b964-094fdc8ad30a service nova] Acquired lock "compute-rpcapi-router" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:23:54.333946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:54.335382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:54.336363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:54.338707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:54.339521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:54.342693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:54.371116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.rpcapi [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 03:23:54.373278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] Releasing lock "compute-rpcapi-router" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:23:54.406979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35ebdbc9-034c-4f13-b028-cb63625d6ea6 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.824808 Aug 30 03:23:54.408955 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 52/119] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:54.423417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:54.425099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:54.438847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:54.441681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:54.442848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:54.444158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:54.445638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:54.446331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:54.928722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:54.946480 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-098b06ef-e427-447e-a4a7-bc531f7eb121 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1296 microversion: 2.1 time: 0.527188 Aug 30 03:23:54.947563 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 53/120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:54 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1296 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:55.580395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:55.867312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:55.900908 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-00af2c8a-48cb-436c-9426-23c8d46bb05e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 2.029932 Aug 30 03:23:55.919535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 68/121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:53 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:55.982597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:55.983219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:56.001704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:56.002386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:56.002837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:56.003582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:56.013512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:56.014328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:56.257532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:56.280037 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb05fb7c-5f20-4888-b2af-83602ee97aaf tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1296 microversion: 2.1 time: 0.315146 Aug 30 03:23:56.313553 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 54/122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:55 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1296 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:56.700075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:23:56.934021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:56.934842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:56.948273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:56.963571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:56.964852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:56.968145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:56.972367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:56.974917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:57.210737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f89807c1d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:57.217507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:57.218288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:57.220437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:57.223801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:57.224493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:57.227016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:57.331230 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-759fefaa-e057-4e3e-a795-b5c32792fd9b tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.635564 Aug 30 03:23:57.343644 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 69/123] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Aug 30 03:23:56 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:57.364878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:57.370111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:57.402421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:57.406502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:57.409894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:57.413176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:57.413660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:57.414100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:58.068189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:58.091864 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e89c05f5-fd76-4388-843c-d065cf42a8ce tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 1.169837 Aug 30 03:23:58.141803 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 55/124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:56 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:58.150496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f898069ff70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:58.157963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:58.158754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:58.160112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:58.162751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:58.164329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:58.164997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:58.275620 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6ec46be-b252-4440-8e62-75fed3ec5b60 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.132026 Aug 30 03:23:58.288905 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 56/125] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Aug 30 03:23:58 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:23:58.302673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f8980640160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:58.307763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:58.308251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:58.308715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:58.309500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:58.330201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:58.330612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:58.442031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-331d6aa2-8bbc-4895-b597-8ff3e0dbe09f tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.143448 Aug 30 03:23:58.442648 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 57/126] 10.222.0.30 () {58 vars in 1145 bytes} [Tue Aug 30 03:23:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:23:59.081148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:59.106698 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-301c7897-6eed-4dec-a335-e5c9f3076d91 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 1.760973 Aug 30 03:23:59.107940 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 70/127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:57 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:23:59.129182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:23:59.130288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:23:59.145897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:59.146642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:59.147212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:59.149301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:23:59.150839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:23:59.155609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:23:59.478984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:23:59.489691 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f716041d-2522-4acd-926b-10dc61328b54 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.364043 Aug 30 03:23:59.490781 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 58/128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:23:59 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:00.130401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:00.130401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:00.139389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.139889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.141280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.142488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.142865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.143288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.458563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1802a7f2-0dfb-4a3d-849c-9e675fbcdab9", "tag": "22d98faa-e5c5-43a1-bf5b-4b1c2f570944"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:00.484688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.485664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.486887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.523189 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Creating event network-changed:22d98faa-e5c5-43a1-bf5b-4b1c2f570944 for instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 on n-h2-854924-5 Aug 30 03:24:00.524601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:24:00.525374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-74a62f98-c280-422a-9f56-5ca85799680a req-48b82539-201d-40cb-b79d-adc2c0b5ffd5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:24:00.527637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.528401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.529324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.530289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.530967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.532120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.550093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.compute.rpcapi [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 03:24:00.551419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] Releasing lock "compute-rpcapi-router" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:24:00.577184 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bd9abbc9-8abf-480e-a6b1-4986bb5e585d None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.612853 Aug 30 03:24:00.579387 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 71/129] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:00.589079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:00.590631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:00.599511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.600286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.601106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.602325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:00.603192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:00.604034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:00.655132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:00.684175 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a84cbe4-0a3b-4478-8f9f-f1d10e7d5e95 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.558714 Aug 30 03:24:00.688061 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 59/130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:00 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:01.214934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:01.226252 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02472a8c-ee63-4268-ac89-c39b62f9f75f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.642994 Aug 30 03:24:01.228585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 72/131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:00 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:01.707827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:01.708438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:01.721990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:01.722827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:01.724054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:01.724965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:01.725602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:01.726362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:02.248492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:02.249330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:02.258823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:02.261996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:02.262642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:02.265064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:02.267587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:02.269446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:02.372500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:02.399769 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5316f62b-0ea7-47a0-b9fc-fdd604ebf945 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.693032 Aug 30 03:24:02.403440 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 60/132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:01 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:03.008210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:03.032320 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d09f5b76-fb54-48cf-b133-e68500087548 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.787637 Aug 30 03:24:03.032914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 73/133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:02 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:03.422670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:03.423285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:03.439296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.439296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.439296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.439296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.439654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.439654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.529920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Calling method '.version_select at 0x7f89806400d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:03.543141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=122167) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 03:24:03.543883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.544417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.544784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.590656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.591455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.592564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.618629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.619374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.620434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.643827 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8cd1099b-2faa-47fd-811f-ea5bc516536d tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.595021 Aug 30 03:24:03.645509 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 61/134] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:03.670028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Calling method '.version_select at 0x7f898069fe50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:03.673881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.674381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.676262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.735467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.736066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.736382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.789548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:03.799563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.800053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.800335 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b65a88d-dc4c-4971-848f-1b6d774e4a1d tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.382097 Aug 30 03:24:03.800489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.807359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5e40ac87-01b1-4c5e-9809-090d914a7bc4 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h2-854924-5/servers" status: 200 len: 275 microversion: 2.1 time: 0.146774 Aug 30 03:24:03.808698 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 62/135] 10.222.0.30 () {58 vars in 1212 bytes} [Tue Aug 30 03:24:03 2022] GET /compute/v2.1/os-hypervisors/n-h2-854924-5/servers => generated 275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:03.811574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 74/136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:03 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:03.820514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Calling method '.version_select at 0x7f89807e4700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:03.823899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.824394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.824815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.844872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.845818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.846669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.862449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.863696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.864463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.874535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9b68040-ea23-434b-b36d-169726e1938c tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058558 Aug 30 03:24:03.875705 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 75/137] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:03.889017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Calling method '.version_select at 0x7f89807da940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:03.892515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.893551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.894610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.934780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:03.936601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:03.937051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:03.951074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eeec75cc-2d44-4f0d-8beb-f3d258aa1dd6 tempest-HypervisorAdminUnderV252Test-1337724217 tempest-HypervisorAdminUnderV252Test-1337724217-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h2-854924-5/search" status: 200 len: 104 microversion: 2.1 time: 0.068262 Aug 30 03:24:03.954334 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 76/138] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Aug 30 03:24:03 2022] GET /compute/v2.1/os-hypervisors/n-h2-854924-5/search => generated 104 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:04.055774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:04.056449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:04.067179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.067691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.068160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.068882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.070031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.072110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.185701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Calling method '.version_select at 0x7f89804cbd30>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:04.193041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.193907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.194640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.225404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.226036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.226644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.248595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:04.263723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.264214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.264779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.286660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.286955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.287573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.302025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.302521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.302956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.311254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7724cf56-ec61-49b8-83e8-2cecff53cf94 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.501321 Aug 30 03:24:04.325604 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 63/139] 10.222.0.30 () {60 vars in 1243 bytes} [Tue Aug 30 03:24:03 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:04.331402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Calling method '.version_select at 0x7f89804cbdc0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:04.335972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.336682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.337308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.359380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.360251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.360746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.394217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.395773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.398516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.418953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.419605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.420283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.439797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:04.458234 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50572094-7dcc-42c4-909e-1fd49304fb1f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.406952 Aug 30 03:24:04.461848 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 77/140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:04 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:04.470256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.471000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.472305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.482569 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a14b1b2f-a05e-455a-a5ea-d89eee0c7d77 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.154325 Aug 30 03:24:04.496093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Calling method '.version_select at 0x7f89807daca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:04.500494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.500952 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 64/141] 10.222.0.30 () {60 vars in 1222 bytes} [Tue Aug 30 03:24:04 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:04.501708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.502323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.525057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.525664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.526104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.535230 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae05ea25-153e-43aa-9424-d896a8bbedb5 tempest-HypervisorAdminV253TestBase-1165804942 tempest-HypervisorAdminV253TestBase-1165804942-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/ea7f5ec5-d6f8-463a-8c34-acecdc56dcfc" status: 200 len: 792 microversion: 2.53 time: 0.043981 Aug 30 03:24:04.543658 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 78/142] 10.222.0.30 () {60 vars in 1298 bytes} [Tue Aug 30 03:24:04 2022] GET /compute/v2.1/os-hypervisors/ea7f5ec5-d6f8-463a-8c34-acecdc56dcfc => generated 792 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:04.825511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:04.827739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:04.858643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.859541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.860479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:04.862068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:04.863111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:04.863776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:05.075435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:05.084206 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0613df87-3099-4af1-a982-edb82e125638 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.265599 Aug 30 03:24:05.103243 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 65/143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:04 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:05.481793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:05.483445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:05.498412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:05.499686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:05.501000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:05.502247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:05.503037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:05.503950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:05.570316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1421a168-50c1-4a36-a54a-8cd4c12ad6de tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-771684761", "id": 1375037085, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:05.616978 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1421a168-50c1-4a36-a54a-8cd4c12ad6de tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.408755 Aug 30 03:24:05.623838 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 79/144] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:24:05 2022] POST /compute/v2.1/flavors => generated 470 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:05.747484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ef74136e-8783-4154-9333-e092592b7ec2 req-a9515879-e2e8-4206-8822-33d7c73661db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2", "name": "network-vif-plugged", "status": "completed", "tag": "a30c53e5-3c7c-40ad-8a40-e6cd2dc76759"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:05.766480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ef74136e-8783-4154-9333-e092592b7ec2 req-a9515879-e2e8-4206-8822-33d7c73661db service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:05.768580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ef74136e-8783-4154-9333-e092592b7ec2 req-a9515879-e2e8-4206-8822-33d7c73661db service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:05.771367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ef74136e-8783-4154-9333-e092592b7ec2 req-a9515879-e2e8-4206-8822-33d7c73661db service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:05.811093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ef74136e-8783-4154-9333-e092592b7ec2 req-a9515879-e2e8-4206-8822-33d7c73661db service nova] Creating event network-vif-plugged:a30c53e5-3c7c-40ad-8a40-e6cd2dc76759 for instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 on n-h2-854924-5 Aug 30 03:24:05.824160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:05.826865 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ef74136e-8783-4154-9333-e092592b7ec2 req-a9515879-e2e8-4206-8822-33d7c73661db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195822 Aug 30 03:24:05.830324 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 80/145] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:05.840404 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e92261a1-cc92-4ff1-b9ed-cd535d9a885b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.358737 Aug 30 03:24:05.862404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2687ea33-f682-4ff5-a396-ba4dff4e7442 tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:05.862726 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 66/146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:05 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:06.076043 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2687ea33-f682-4ff5-a396-ba4dff4e7442 tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1375037085/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.244351 Aug 30 03:24:06.076640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 81/147] 10.222.0.30 () {62 vars in 1265 bytes} [Tue Aug 30 03:24:05 2022] POST /compute/v2.1/flavors/1375037085/os-extra_specs => generated 62 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:06.087204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2d9e6e47-be30-4323-912d-002e7f3d71b6 tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:06.127449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:06.129054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2d9e6e47-be30-4323-912d-002e7f3d71b6 tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1375037085" status: 202 len: 0 microversion: 2.86 time: 0.045882 Aug 30 03:24:06.129198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:06.131137 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 67/148] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Aug 30 03:24:06 2022] DELETE /compute/v2.1/flavors/1375037085 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:24:06.144487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b98806a8-86c9-40c5-8145-3e08fce0571f tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:06.145310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:06.145842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:06.147633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:06.150496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:06.150967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:06.153267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:06.172978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:06.198169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b98806a8-86c9-40c5-8145-3e08fce0571f tempest-FlavorMetadataValidation-340236828 tempest-FlavorMetadataValidation-340236828-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.056555 Aug 30 03:24:06.200025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 68/149] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:06.482651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:06.492420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-462ee643-431b-4b2b-91df-f98c243f22d7 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.370762 Aug 30 03:24:06.494721 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 82/150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:06 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:06.881638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:06.884618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:06.902475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:06.903793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:06.906580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:06.907834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:06.909734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:06.910801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:07.434199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:07.455710 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f947a23a-2704-4306-8a1d-e1a246de178e tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.578927 Aug 30 03:24:07.458426 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 69/151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:06 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:07.516290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:07.518110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:07.526215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:07.526718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:07.527201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:07.528154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:07.528865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:07.529381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:07.878929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:07.887116 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f602c454-f8a3-42cb-b1ff-d37c84344a7b tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.375896 Aug 30 03:24:07.906555 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 83/152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:07 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:08.484137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:08.486324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:08.491842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:08.515256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:08.515793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:08.516243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:08.517960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:08.518549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:08.518980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:08.922139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:08.926448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:08.954141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:08.955195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:08.959396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:08.965600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:08.967569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:08.969334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:09.237747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:09.252926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc40ec83-8bbc-4c02-b9b5-0792eab23927 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1341 microversion: 2.1 time: 0.770519 Aug 30 03:24:09.270808 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 70/153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:08 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1341 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:09.390403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:09.416037 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-66688606-0aed-478b-9d77-08cc1df79a92 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.496628 Aug 30 03:24:09.416873 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 84/154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:08 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:09.582446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3776f7e1-51c3-4d7e-9b46-a23485092180 req-ec6ebdfe-80c9-4f98-8a28-fae5ef5c2e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1802a7f2-0dfb-4a3d-849c-9e675fbcdab9", "name": "network-vif-plugged", "status": "completed", "tag": "22d98faa-e5c5-43a1-bf5b-4b1c2f570944"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:09.603966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3776f7e1-51c3-4d7e-9b46-a23485092180 req-ec6ebdfe-80c9-4f98-8a28-fae5ef5c2e8f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:09.611003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3776f7e1-51c3-4d7e-9b46-a23485092180 req-ec6ebdfe-80c9-4f98-8a28-fae5ef5c2e8f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:09.611841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3776f7e1-51c3-4d7e-9b46-a23485092180 req-ec6ebdfe-80c9-4f98-8a28-fae5ef5c2e8f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:09.657101 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3776f7e1-51c3-4d7e-9b46-a23485092180 req-ec6ebdfe-80c9-4f98-8a28-fae5ef5c2e8f service nova] Creating event network-vif-plugged:22d98faa-e5c5-43a1-bf5b-4b1c2f570944 for instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 on n-h2-854924-5 Aug 30 03:24:09.673429 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3776f7e1-51c3-4d7e-9b46-a23485092180 req-ec6ebdfe-80c9-4f98-8a28-fae5ef5c2e8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096133 Aug 30 03:24:09.675512 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 71/155] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:10.257467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Calling method '.version_select at 0x7f8980704790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:10.260033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.260519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.260975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.282368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:10.283058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:10.294023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.299718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.300471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.301475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.302345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.302949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.313893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.317743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.319871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.356087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.356825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.357387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.380345 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3d932bc-4bbd-400d-b4d1-628d5ce447c4 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.381961 Aug 30 03:24:10.384573 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 85/156] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:10.396964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Calling method '.version_select at 0x7f898069f160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:10.409653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.410464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.411129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.454475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.455027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.455465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.472093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f2b1a82-cd5e-4487-8d51-d4d863918ce0 tempest-HypervisorAdminV228Test-530285752 tempest-HypervisorAdminV228Test-530285752-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.081058 Aug 30 03:24:10.473482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 86/157] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:24:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:10.506642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:10.507968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:10.520333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.521021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.521631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.522780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:10.523533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:10.524442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:10.577286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:10.809444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:10.829282 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1314e68e-f607-4e33-a88a-be900973b48b tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1491 microversion: 2.1 time: 0.546097 Aug 30 03:24:10.831013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 72/158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:10 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1491 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:10.832389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:10.844382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-394585b7-cffa-482d-9ec8-eb2a6a907214 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1338 microversion: 2.1 time: 0.367238 Aug 30 03:24:10.845202 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 87/159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:10 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1338 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:11.399622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:11.400720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:11.412503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:11.414199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:11.416003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:11.419989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:11.420500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:11.421717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:11.529255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:24:11.832973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=92 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:11.863627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c2daed5a-e9f3-45f1-a064-25cac7a2fe1b tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 204 len: 0 microversion: 2.1 time: 1.000771 Aug 30 03:24:11.869534 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 73/160] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:24:10 2022] DELETE /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:24:11.880018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:11.883933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:11.891422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:11.892252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:11.894799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:11.895896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:11.897209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:11.899488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:11.901033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:11.901916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:12.320020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:12.331168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:12.331850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:12.333920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:12.334474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:12.336741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:12.337428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:12.350363 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a095982-176b-4d96-9dbd-d68262da7961 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1497 microversion: 2.1 time: 0.476888 Aug 30 03:24:12.351001 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 88/161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:11 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1497 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:12.672098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:12.687564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78f4d4c1-4322-4190-bef7-16647e6bf980 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1488 microversion: 2.1 time: 0.808640 Aug 30 03:24:12.689067 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 74/162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:11 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1488 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:12.726277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:12.728299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:12.740129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:12.740615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:12.741047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:12.741810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:12.742275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:12.743490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:13.583509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-614f2480-4e4a-4e96-9acb-9601ee70c857 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Action: 'create', calling method: .version_select at 0x7f898049b790>, body: {"keypair": {"name": "tempest-keypair-556665662", "type": "ssh", "user_id": "b0b10296759840f0b3c473121e9a0475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqehDIwsrynzWOjryn3kKKpV973jZcscm4iMcgqTrINaoKTvMvEvaF30D6Qyzo2U9aVHHBIYIsLeibn7KSXMZT0Ja14xmyBvEHOTvp/5i/q/6/QiQD4dTOwYi8k0WTO3A=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:13.722798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-614f2480-4e4a-4e96-9acb-9601ee70c857 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Getting quotas for project 3a23c93963644fe8809919dbf0e7976e. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:13.746628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-614f2480-4e4a-4e96-9acb-9601ee70c857 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Getting quotas for user b92759610697410c90e953c03a56474f and project 3a23c93963644fe8809919dbf0e7976e. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:13.822541 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-276b4845-85f6-4bfd-8d5c-508a7c2425b1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1639 microversion: 2.1 time: 1.099439 Aug 30 03:24:13.823550 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 89/163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:12 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1639 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:13.852792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:13.857692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-614f2480-4e4a-4e96-9acb-9601ee70c857 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 1.029544 Aug 30 03:24:13.858724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:13.878675 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 75/164] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:24:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1057 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 03:24:13.894751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:13.897259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:13.904691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:13.909246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:13.911379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:13.917367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:13.918411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:13.919464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:13.931018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:13.937186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:13.942557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:13.946285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:13.947025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:13.947754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:14.041409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:24:14.345409 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94c81ec9-103d-432b-b8a0-7a984729cace tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 204 len: 0 microversion: 2.1 time: 0.464674 Aug 30 03:24:14.350162 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 76/165] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:24:13 2022] DELETE /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:24:14.356823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0bf9a50b-8252-4387-bd13-220fd2f7bfdf tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Action: 'create', calling method: .version_select at 0x7f89804cb160>, body: {"keypair": {"name": "tempest-keypair-1647937302", "type": "ssh", "user_id": "b0b10296759840f0b3c473121e9a0475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxXNZgZmPtiNO4ifAIm66FK1Zce6IU8Y56CdFTUw79FpXYBL2JZYu5O+nkqO560JXOHnroZrxDd387u31Y4Set5mExPmNsjAA5iixjUPaKWwxqYzs0SGb0A5iLXeMqIRA=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:14.377071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0bf9a50b-8252-4387-bd13-220fd2f7bfdf tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Getting quotas for project 3a23c93963644fe8809919dbf0e7976e. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:14.383044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0bf9a50b-8252-4387-bd13-220fd2f7bfdf tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Getting quotas for user b92759610697410c90e953c03a56474f and project 3a23c93963644fe8809919dbf0e7976e. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:14.416687 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0bf9a50b-8252-4387-bd13-220fd2f7bfdf tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.064857 Aug 30 03:24:14.423691 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 77/166] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:24:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:24:14.599568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:14.620763 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33ff7c78-b4a7-46bf-93a8-0fe302d1eda8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1497 microversion: 2.1 time: 0.789040 Aug 30 03:24:14.624168 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 90/167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:13 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1497 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:14.639889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:14.640976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:14.654976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:14.657870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:14.659501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:14.661660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:14.663944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:14.664644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:14.674913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Calling method '.version_select at 0x7f89805ca4c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:14.678101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:14.684974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:14.685729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:14.688492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:14.689168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:14.692149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:14.741893 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-22b0016a-70f8-4633-9690-55851d3619fb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.316557 Aug 30 03:24:14.751305 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 78/168] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Aug 30 03:24:14 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:14.757579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05c72b0d-c849-434d-b454-232541cb85e0 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Calling method '.version_select at 0x7f8980488160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:14.771755 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05c72b0d-c849-434d-b454-232541cb85e0 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-556665662?user_id=b0b10296759840f0b3c473121e9a0475" status: 200 len: 511 microversion: 2.10 time: 0.018935 Aug 30 03:24:14.782364 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 79/169] 10.222.0.30 () {60 vars in 1337 bytes} [Tue Aug 30 03:24:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-556665662?user_id=b0b10296759840f0b3c473121e9a0475 => generated 511 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:14.939464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:14.950905 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ccb280f3-88da-420d-8c23-82cbe7773ca4 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1494 microversion: 2.1 time: 0.322606 Aug 30 03:24:14.951512 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 91/170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:14 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1494 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:14.961855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bb416998-17c0-4eaa-956a-8f70c20d638e tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Action: 'create', calling method: .version_select at 0x7f89807e0550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1236731179", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+ZfCA+WvSgWp6hasSTjJ9rlrGAAkUtwmpTAT+17EZdmkaZbW25ETUeCY3lebmFKsh+Y6PWjEcKySaQWTGXBcwwjOVs4jrCz6Nmw6czndkGgPUUlG3rpHmXh43kjogNMg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.017706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-bb416998-17c0-4eaa-956a-8f70c20d638e tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Getting quotas for project 3a23c93963644fe8809919dbf0e7976e. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:15.023655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-bb416998-17c0-4eaa-956a-8f70c20d638e tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Getting quotas for user b92759610697410c90e953c03a56474f and project 3a23c93963644fe8809919dbf0e7976e. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:15.061451 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bb416998-17c0-4eaa-956a-8f70c20d638e tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.108063 Aug 30 03:24:15.062965 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 92/171] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:24:14 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:24:15.077649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61d59a0b-e2fe-4ced-bfe9-99cdc175f75f tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Calling method '.version_select at 0x7f89806bdb80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.083800 n-d-854924-5 devstack@n-api.service[122168]: WARNING oslo_db.sqlalchemy.utils [None req-61d59a0b-e2fe-4ced-bfe9-99cdc175f75f tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 03:24:15.096044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61d59a0b-e2fe-4ced-bfe9-99cdc175f75f tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=b0b10296759840f0b3c473121e9a0475" status: 200 len: 725 microversion: 2.10 time: 0.023461 Aug 30 03:24:15.097625 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 93/172] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-keypairs?user_id=b0b10296759840f0b3c473121e9a0475 => generated 725 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:15.116779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d8719838-eca8-4c28-ad0e-0dc5f9d7138d tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Calling method '.version_select at 0x7f8980704820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.168151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13fdeb3e-654b-4419-9504-abb849edcaf6 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Calling method '.version_select at 0x7f89804d3b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.173788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-13fdeb3e-654b-4419-9504-abb849edcaf6 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '13d32a9d81d94521856566b5a1278595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d749f74cd74d909dea7b33359f4f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13fdeb3e-654b-4419-9504-abb849edcaf6 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Request method failure captured: Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLbbQiiLVjMsLNY_iWzYP1NIOz3h_1o60VKz2dASj_6pF41razbZzYY3nKV-39x6jJvbGFnexwaYFEajz5B6i4cc6px2AymMjZEvvOtxJ8aDkQNrXYF3WxqF8taFYLfrl4khuGFnQNfHXqwqomZr1TWHWs3PayTW4fRw2KdF1OyIz0 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:15.179149 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2d749f74cd74d909dea7b33359f4f08", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}] Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 13d32a9d81d94521856566b5a1278595 Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:24:15.181743 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.182672 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 03:24:15.184178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.187507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13fdeb3e-654b-4419-9504-abb849edcaf6 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.187507 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13fdeb3e-654b-4419-9504-abb849edcaf6 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.397954 Aug 30 03:24:15.187889 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d8719838-eca8-4c28-ad0e-0dc5f9d7138d tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1236731179" status: 204 len: 0 microversion: 2.10 time: 0.079631 Aug 30 03:24:15.188757 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 94/173] 10.222.0.30 () {60 vars in 1325 bytes} [Tue Aug 30 03:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1236731179 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:24:15.193017 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 80/174] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Aug 30 03:24:14 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 410 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:15.196865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ab59b94-6bd8-46df-a381-29e636ef0109 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Calling method '.version_select at 0x7f89805f53a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.200034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9ab59b94-6bd8-46df-a381-29e636ef0109 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '13d32a9d81d94521856566b5a1278595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d749f74cd74d909dea7b33359f4f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ab59b94-6bd8-46df-a381-29e636ef0109 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Request method failure captured: Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hosts/n-d-854924-5/reboot HTTP/1.1 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLbbQiiLVjMsLNY_iWzYP1NIOz3h_1o60VKz2dASj_6pF41razbZzYY3nKV-39x6jJvbGFnexwaYFEajz5B6i4cc6px2AymMjZEvvOtxJ8aDkQNrXYF3WxqF8taFYLfrl4khuGFnQNfHXqwqomZr1TWHWs3PayTW4fRw2KdF1OyIz0 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:15.205211 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2d749f74cd74d909dea7b33359f4f08", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}] Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 13d32a9d81d94521856566b5a1278595 Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'n-d-854924-5'} Aug 30 03:24:15.206450 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.207314 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 03:24:15.210826 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.213486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ab59b94-6bd8-46df-a381-29e636ef0109 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.214154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-133c9d67-dd46-4756-abb9-e7e57ebe0400 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Calling method '.version_select at 0x7f898075bf70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.214309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9ab59b94-6bd8-46df-a381-29e636ef0109 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854924-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017220 Aug 30 03:24:15.214309 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 95/175] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/n-d-854924-5/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:15.243678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9d980e6-fa91-4d4e-aa37-8826f399db18 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Calling method '.version_select at 0x7f89806b7af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.264542 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-133c9d67-dd46-4756-abb9-e7e57ebe0400 tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647937302?user_id=b0b10296759840f0b3c473121e9a0475" status: 204 len: 0 microversion: 2.10 time: 0.069718 Aug 30 03:24:15.265153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 81/176] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647937302?user_id=b0b10296759840f0b3c473121e9a0475 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:24:15.275224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f149ec02-b4db-4886-b6eb-a38207c7a2ae tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] Calling method '.version_select at 0x7f89804883a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.281713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f9d980e6-fa91-4d4e-aa37-8826f399db18 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9d980e6-fa91-4d4e-aa37-8826f399db18 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:15.286575 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'nonexistent_hostname'} Aug 30 03:24:15.288736 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:15.290406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 03:24:15.291566 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9d980e6-fa91-4d4e-aa37-8826f399db18 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.293420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9d980e6-fa91-4d4e-aa37-8826f399db18 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.069483 Aug 30 03:24:15.299610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 96/177] 10.222.0.30 () {58 vars in 1212 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:15.305989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57914ece-986f-4815-bd23-3dc7793d9766 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Calling method '.version_select at 0x7f89806b7310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.309814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-57914ece-986f-4815-bd23-3dc7793d9766 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '13d32a9d81d94521856566b5a1278595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d749f74cd74d909dea7b33359f4f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57914ece-986f-4815-bd23-3dc7793d9766 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Request method failure captured: Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hosts/n-d-854924-5 HTTP/1.1 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLbbQiiLVjMsLNY_iWzYP1NIOz3h_1o60VKz2dASj_6pF41razbZzYY3nKV-39x6jJvbGFnexwaYFEajz5B6i4cc6px2AymMjZEvvOtxJ8aDkQNrXYF3WxqF8taFYLfrl4khuGFnQNfHXqwqomZr1TWHWs3PayTW4fRw2KdF1OyIz0 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:15.315557 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2d749f74cd74d909dea7b33359f4f08", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}] Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 13d32a9d81d94521856566b5a1278595 Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'n-d-854924-5'} Aug 30 03:24:15.316939 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.317767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 03:24:15.318862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.321825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57914ece-986f-4815-bd23-3dc7793d9766 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.328666 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-57914ece-986f-4815-bd23-3dc7793d9766 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854924-5" status: 403 len: 109 microversion: 2.1 time: 0.021775 Aug 30 03:24:15.335159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f149ec02-b4db-4886-b6eb-a38207c7a2ae tempest-KeyPairsV210TestJSON-690112977 tempest-KeyPairsV210TestJSON-690112977-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-556665662?user_id=b0b10296759840f0b3c473121e9a0475" status: 204 len: 0 microversion: 2.10 time: 0.064929 Aug 30 03:24:15.335977 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 82/178] 10.222.0.30 () {60 vars in 1340 bytes} [Tue Aug 30 03:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-556665662?user_id=b0b10296759840f0b3c473121e9a0475 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:24:15.343436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 97/179] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/n-d-854924-5 => generated 109 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:15.347449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f979fef1-4efc-46fe-9c50-f0a60b2be6ea tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Calling method '.version_select at 0x7f89804881f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.356486 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f979fef1-4efc-46fe-9c50-f0a60b2be6ea tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f979fef1-4efc-46fe-9c50-f0a60b2be6ea tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:15.358771 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'nonexistent_hostname'} Aug 30 03:24:15.359965 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.360680 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.361710 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.364452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f979fef1-4efc-46fe-9c50-f0a60b2be6ea tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.370732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-14700579-df8d-4cd5-9233-9e026028108b req-f99a0d96-7ef8-4a65-86ab-c9f317e1b152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2", "name": "network-vif-deleted", "tag": "a30c53e5-3c7c-40ad-8a40-e6cd2dc76759"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.378257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f979fef1-4efc-46fe-9c50-f0a60b2be6ea tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035593 Aug 30 03:24:15.383748 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 83/180] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:15.395059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-14700579-df8d-4cd5-9233-9e026028108b req-f99a0d96-7ef8-4a65-86ab-c9f317e1b152 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:15.396675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-14700579-df8d-4cd5-9233-9e026028108b req-f99a0d96-7ef8-4a65-86ab-c9f317e1b152 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:15.397107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a421216-c0ed-4e84-a6ba-3f4c0b67679b tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Calling method '.version_select at 0x7f89803bbca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.399232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-14700579-df8d-4cd5-9233-9e026028108b req-f99a0d96-7ef8-4a65-86ab-c9f317e1b152 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:15.401863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a421216-c0ed-4e84-a6ba-3f4c0b67679b tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '13d32a9d81d94521856566b5a1278595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d749f74cd74d909dea7b33359f4f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a421216-c0ed-4e84-a6ba-3f4c0b67679b tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Request method failure captured: Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hosts/n-d-854924-5/shutdown HTTP/1.1 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLbbQiiLVjMsLNY_iWzYP1NIOz3h_1o60VKz2dASj_6pF41razbZzYY3nKV-39x6jJvbGFnexwaYFEajz5B6i4cc6px2AymMjZEvvOtxJ8aDkQNrXYF3WxqF8taFYLfrl4khuGFnQNfHXqwqomZr1TWHWs3PayTW4fRw2KdF1OyIz0 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:15.408723 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2d749f74cd74d909dea7b33359f4f08", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}] Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 13d32a9d81d94521856566b5a1278595 Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'n-d-854924-5'} Aug 30 03:24:15.410282 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.411058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 03:24:15.412041 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.415118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a421216-c0ed-4e84-a6ba-3f4c0b67679b tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.418721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a421216-c0ed-4e84-a6ba-3f4c0b67679b tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854924-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.033513 Aug 30 03:24:15.419593 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 84/181] 10.222.0.30 () {58 vars in 1194 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/n-d-854924-5/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:15.433731 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-14700579-df8d-4cd5-9233-9e026028108b req-f99a0d96-7ef8-4a65-86ab-c9f317e1b152 service nova] Creating event network-vif-deleted:a30c53e5-3c7c-40ad-8a40-e6cd2dc76759 for instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 on n-h2-854924-5 Aug 30 03:24:15.440842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-898a1c34-5bfa-4cce-b853-94691506eba3 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Calling method '.version_select at 0x7f89804d3940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.452297 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-14700579-df8d-4cd5-9233-9e026028108b req-f99a0d96-7ef8-4a65-86ab-c9f317e1b152 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085698 Aug 30 03:24:15.453715 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 98/182] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:15.486135 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-898a1c34-5bfa-4cce-b853-94691506eba3 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-898a1c34-5bfa-4cce-b853-94691506eba3 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:15.496577 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'nonexistent_hostname'} Aug 30 03:24:15.498091 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:15.498838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 03:24:15.499927 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.501066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.510279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-898a1c34-5bfa-4cce-b853-94691506eba3 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.511331 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-898a1c34-5bfa-4cce-b853-94691506eba3 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.076113 Aug 30 03:24:15.512440 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 85/183] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:15.529297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c15419f4-e659-4198-ac47-6a7252f0cca1 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Calling method '.version_select at 0x7f89805f5ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.532633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c15419f4-e659-4198-ac47-6a7252f0cca1 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '13d32a9d81d94521856566b5a1278595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d749f74cd74d909dea7b33359f4f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c15419f4-e659-4198-ac47-6a7252f0cca1 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Request method failure captured: Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hosts/n-d-854924-5/startup HTTP/1.1 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLbbQiiLVjMsLNY_iWzYP1NIOz3h_1o60VKz2dASj_6pF41razbZzYY3nKV-39x6jJvbGFnexwaYFEajz5B6i4cc6px2AymMjZEvvOtxJ8aDkQNrXYF3WxqF8taFYLfrl4khuGFnQNfHXqwqomZr1TWHWs3PayTW4fRw2KdF1OyIz0 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:15.535766 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2d749f74cd74d909dea7b33359f4f08", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}] Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 13d32a9d81d94521856566b5a1278595 Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'n-d-854924-5'} Aug 30 03:24:15.537890 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.539041 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 03:24:15.540425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.544127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c15419f4-e659-4198-ac47-6a7252f0cca1 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.545753 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c15419f4-e659-4198-ac47-6a7252f0cca1 tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854924-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.025493 Aug 30 03:24:15.562113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-415fbd0a-89d7-41aa-9c10-26bd98dfeddb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Calling method '.version_select at 0x7f89802f63a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.564355 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 99/184] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/n-d-854924-5/startup => generated 110 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:24:15.581628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-415fbd0a-89d7-41aa-9c10-26bd98dfeddb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-415fbd0a-89d7-41aa-9c10-26bd98dfeddb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:15.585321 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'nonexistent_hostname'} Aug 30 03:24:15.587786 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:15.588904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 03:24:15.591588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.595103 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.608979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-415fbd0a-89d7-41aa-9c10-26bd98dfeddb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.608979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-415fbd0a-89d7-41aa-9c10-26bd98dfeddb tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.043574 Aug 30 03:24:15.608979 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 86/185] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:15.613759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37799a81-fa8c-42c2-880f-115e7108fbfe tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Action: 'update', calling method: .version_select at 0x7f89806b7b80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37799a81-fa8c-42c2-880f-115e7108fbfe tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/os-hosts/n-d-854924-5 HTTP/1.1 Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 51 Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:15.631384 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: {"status": "enable", "maintenance_mode": "invalid"} Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:15.632673 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'n-d-854924-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance: Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.634028 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.639949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37799a81-fa8c-42c2-880f-115e7108fbfe tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37799a81-fa8c-42c2-880f-115e7108fbfe tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854924-5" status: 400 len: 199 microversion: 2.1 time: 0.028821 Aug 30 03:24:15.644030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 100/186] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:15 2022] PUT /compute/v2.1/os-hosts/n-d-854924-5 => generated 199 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:24:15.653493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4071246-e8a0-450c-835d-c01ff5f0035e tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Action: 'update', calling method: .version_select at 0x7f8980488430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4071246-e8a0-450c-835d-c01ff5f0035e tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-hosts/n-d-854924-5 HTTP/1.1 Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 51 Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:15.669568 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: {"status": "invalid", "maintenance_mode": "enable"} Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.671829 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'n-d-854924-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance: Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.672650 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.674553 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.676830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.676830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:24:15.676830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:24:15.676830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 03:24:15.676830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.680524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.682073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:15.684677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4071246-e8a0-450c-835d-c01ff5f0035e tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.689219 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a4071246-e8a0-450c-835d-c01ff5f0035e tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854924-5" status: 400 len: 189 microversion: 2.1 time: 0.043644 Aug 30 03:24:15.698585 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 87/187] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:15 2022] PUT /compute/v2.1/os-hosts/n-d-854924-5 => generated 189 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:24:15.714823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e80eea4c-9377-4ddc-b719-3f6e7b06275e tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Action: 'update', calling method: .version_select at 0x7f89802f6b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.717839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:15.724950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:15.725474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:15.726385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:15.732094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:15.732604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:15.741806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e80eea4c-9377-4ddc-b719-3f6e7b06275e tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '13d32a9d81d94521856566b5a1278595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d749f74cd74d909dea7b33359f4f08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e80eea4c-9377-4ddc-b719-3f6e7b06275e tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Request method failure captured: Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-hosts/n-d-854924-5 HTTP/1.1 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 50 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLbbQiiLVjMsLNY_iWzYP1NIOz3h_1o60VKz2dASj_6pF41razbZzYY3nKV-39x6jJvbGFnexwaYFEajz5B6i4cc6px2AymMjZEvvOtxJ8aDkQNrXYF3WxqF8taFYLfrl4khuGFnQNfHXqwqomZr1TWHWs3PayTW4fRw2KdF1OyIz0 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:15.743616 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2d749f74cd74d909dea7b33359f4f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2d749f74cd74d909dea7b33359f4f08", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2d749f74cd74d909dea7b33359f4f08"}]}] Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d2d749f74cd74d909dea7b33359f4f08 Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-250241824 Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 13d32a9d81d94521856566b5a1278595 Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-250241824-project Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 03:24:15.745570 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'n-d-854924-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.746933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 03:24:15.748595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.750301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e80eea4c-9377-4ddc-b719-3f6e7b06275e tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.750301 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e80eea4c-9377-4ddc-b719-3f6e7b06275e tempest-HostsAdminNegativeTestJSON-250241824 tempest-HostsAdminNegativeTestJSON-250241824-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854924-5" status: 403 len: 111 microversion: 2.1 time: 0.045406 Aug 30 03:24:15.761437 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 88/188] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:15 2022] PUT /compute/v2.1/os-hosts/n-d-854924-5 => generated 111 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:15.771606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-914fd654-0d56-4cc4-b760-471f27e0fb79 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Action: 'update', calling method: .version_select at 0x7f89803bb790>, body: {"status": null, "maintenance_mode": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-914fd654-0d56-4cc4-b760-471f27e0fb79 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-hosts/n-d-854924-5 HTTP/1.1 Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 42 Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:15.786550 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: {"status": null, "maintenance_mode": null} Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 03:24:15.788748 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'n-d-854924-5', 'body': {'status': None, 'maintenance_mode': None}} Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance: Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi None Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.790025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.791812 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-914fd654-0d56-4cc4-b760-471f27e0fb79 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-914fd654-0d56-4cc4-b760-471f27e0fb79 tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854924-5" status: 400 len: 127 microversion: 2.1 time: 0.020612 Aug 30 03:24:15.794212 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 89/189] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:15 2022] PUT /compute/v2.1/os-hosts/n-d-854924-5 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:24:15.828072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8a111c7-45e0-4d63-93dc-99d64efd24de tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Action: 'update', calling method: .version_select at 0x7f89802f6160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:15.845974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.hosts [None req-b8a111c7-45e0-4d63-93dc-99d64efd24de tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Enabling host nonexistent_hostname. Aug 30 03:24:15.868730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:15.888669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b8a111c7-45e0-4d63-93dc-99d64efd24de tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.898861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:15.899352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:15.900991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:15.902916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lazy-loading 'fault' on Instance uuid 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8a111c7-45e0-4d63-93dc-99d64efd24de tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Request method failure captured: Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 50 Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLeoZ4PYXhQ81FLM2eZinpogeXQ2V0cmXbEdd3PFi2CinHVtuXtfxQY6yuOglDvL3cns-d3QLmasRj40XdQellL1I-KWZj0Sg9wEElT3Y88ostNcicIBhvI7b4fiiMeL9Niuiq81NiVyjV8CcPlpC0j3pbx-xroDrPg99tTnSFJQCw Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:15.924675 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_855d7b7b9a8d4f20a2ac65f97eb1ec52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/855d7b7b9a8d4f20a2ac65f97eb1ec52"}]}] Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 855d7b7b9a8d4f20a2ac65f97eb1ec52 Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1413929079 Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 39ae1fa9f7174494be0fdae2fb121e2e Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1413929079-project-admin Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.925986 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:15.926768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:15.927752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 03:24:15.928856 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:15.934069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8a111c7-45e0-4d63-93dc-99d64efd24de tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:15.943744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8a111c7-45e0-4d63-93dc-99d64efd24de tempest-HostsAdminNegativeTestJSON-1413929079 tempest-HostsAdminNegativeTestJSON-1413929079-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.135024 Aug 30 03:24:15.945406 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 90/190] 10.222.0.30 () {60 vars in 1211 bytes} [Tue Aug 30 03:24:15 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:15.986295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:15.987121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:16.026189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:16.028974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:16.031979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:16.036274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:16.038200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:16.039091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:16.216860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:16.232996 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f21337f5-5653-4e40-9939-7dc4eb110dec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 200 len: 1331 microversion: 2.1 time: 0.576718 Aug 30 03:24:16.234146 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 101/191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 1331 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:16.815990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9248961ff84b44b9ae37817650f35f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec228a39d1ea4733824aec784a590d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:16.829277 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7a792d5-2232-4b4f-842d-e6d6d416b076 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 200 len: 1494 microversion: 2.1 time: 0.846905 Aug 30 03:24:16.837957 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 91/192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:15 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 1494 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:17.260221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:17.261903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:17.299144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:17.303576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:17.307196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:17.308274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:17.308879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:17.309605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:17.357410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] HTTP exception thrown: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Request method failure captured: Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 HTTP/1.1 Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK40M1zayntdQFJM--Jil05UH6yXf_ofidphSRbfFHXiTpFEFfl87fBPDR0MkKbgghfvBw6kxWiJ85f0saF178LO5gQ73dmUF2RvPgteHekyyw9CCdXhnWPTD-x5WkbJSZNHC4cSZ_cAiwvuM-wEf1w-A__XxrPnwJfBs1bO_7oFpo Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:17.371400 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46bc04aff43d4a2c9eef1712856befba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}] Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: badc8bf36b3e4fb794c07c8c487d8007 Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:17.373316 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2'} Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:17.374256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:17.376112 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:17.385718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Returning 404 to user: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:17.387530 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9033ec20-5c5a-4680-b4d9-3c310a610543 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 404 len: 111 microversion: 2.1 time: 0.134968 Aug 30 03:24:17.403655 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 102/193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:17 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:17.658688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-60cbd239-685c-4b4a-bce8-6fe50a2ad36a req-ea5d7d45-3ec5-4cbd-9471-36c68b2a00cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1802a7f2-0dfb-4a3d-849c-9e675fbcdab9", "name": "network-vif-deleted", "tag": "22d98faa-e5c5-43a1-bf5b-4b1c2f570944"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:17.708212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-60cbd239-685c-4b4a-bce8-6fe50a2ad36a req-ea5d7d45-3ec5-4cbd-9471-36c68b2a00cf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:17.713389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-60cbd239-685c-4b4a-bce8-6fe50a2ad36a req-ea5d7d45-3ec5-4cbd-9471-36c68b2a00cf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:17.713924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-60cbd239-685c-4b4a-bce8-6fe50a2ad36a req-ea5d7d45-3ec5-4cbd-9471-36c68b2a00cf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:17.751923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-60cbd239-685c-4b4a-bce8-6fe50a2ad36a req-ea5d7d45-3ec5-4cbd-9471-36c68b2a00cf service nova] Creating event network-vif-deleted:22d98faa-e5c5-43a1-bf5b-4b1c2f570944 for instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 on n-h2-854924-5 Aug 30 03:24:17.762992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-60cbd239-685c-4b4a-bce8-6fe50a2ad36a req-ea5d7d45-3ec5-4cbd-9471-36c68b2a00cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107472 Aug 30 03:24:17.765197 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 103/194] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:17.780277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2125828503", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:17.926393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:24:18.350263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:24:18.352068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:24:18.352952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:24:18.353797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:24:18.354361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:24:18.396227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:18.397826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:18.398778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:18.400185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:18.400827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:18.404770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:18.428138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Getting quotas for project 46bc04aff43d4a2c9eef1712856befba. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:18.451926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Getting quotas for user badc8bf36b3e4fb794c07c8c487d8007 and project 46bc04aff43d4a2c9eef1712856befba. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:18.454958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1960881-f572-4c5b-9c1b-2a0cc3709868 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:18.479962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:24:18.481024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1960881-f572-4c5b-9c1b-2a0cc3709868 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.900852 Aug 30 03:24:18.488741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:24:18.496747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 92/195] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:24:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:18.513170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:18.517284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:18.550482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:18.553487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:18.557549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:18.560787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:18.562229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:18.577605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:18.622254 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-66c29c1b-3b0a-4d24-b176-26da29a410fe tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855325 Aug 30 03:24:18.623247 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 104/196] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:24:18.647260 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] HTTP exception thrown: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Request method failure captured: Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 HTTP/1.1 Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK5OTbWpJ3pCnnttQLYR1xpSTDzmFRx2kXMokqdeoSxr8xxJfQR1S78OQMK05dP3MdH3EbSvsfiggfMxN-oqfVCaxR7GhFzqqYRMr7oHdhkkuIdT5A8QvkuCIK4BoRikEnRdtlDpy2nX8zO4GU2gCfspLqhRD1idwWr1TkszYOWL7Q Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ec228a39d1ea4733824aec784a590d8e Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:18.677865 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec228a39d1ea4733824aec784a590d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ec228a39d1ea4733824aec784a590d8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ec228a39d1ea4733824aec784a590d8e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec228a39d1ea4733824aec784a590d8e"}]}] Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ec228a39d1ea4733824aec784a590d8e Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminTestJSON-1265582273-project Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9248961ff84b44b9ae37817650f35f18 Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminTestJSON-1265582273-project Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:18.679117 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '1802a7f2-0dfb-4a3d-849c-9e675fbcdab9'} Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:18.679909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:18.681526 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:18.682479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Returning 404 to user: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:18.682479 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dafb5e5-4c24-440a-93db-223e3c78a935 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 404 len: 111 microversion: 2.1 time: 0.178627 Aug 30 03:24:18.682479 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 93/197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:18 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:18.702353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c2b3c2a5-9d97-4f38-85b6-77264ed50439 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:18.703028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c2b3c2a5-9d97-4f38-85b6-77264ed50439 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:18.804154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c2b3c2a5-9d97-4f38-85b6-77264ed50439 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:18.812709 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c2b3c2a5-9d97-4f38-85b6-77264ed50439 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1220 microversion: 2.1 time: 0.131096 Aug 30 03:24:18.813712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 94/198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:18 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:18.820191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d6e7f37-fff5-48c5-8ff2-cb723c3720e2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:18.850979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d6e7f37-fff5-48c5-8ff2-cb723c3720e2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:18.852784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d6e7f37-fff5-48c5-8ff2-cb723c3720e2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:18.853910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d6e7f37-fff5-48c5-8ff2-cb723c3720e2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:18.864068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:19.740104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fdc51b9f-52a6-4fd0-975d-5026cca9d924 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-142007479", "id": 1007162536, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:19.771083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fdc51b9f-52a6-4fd0-975d-5026cca9d924 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.144560 Aug 30 03:24:19.772427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 105/199] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:24:18 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:19.786180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-deb1fd08-9ae0-44c2-ab30-b114a42f1dfe tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:19.798343 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-deb1fd08-9ae0-44c2-ab30-b114a42f1dfe tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015760 Aug 30 03:24:19.799632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 106/200] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Aug 30 03:24:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:24:19.816589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0fc251c7-48ff-417e-a99e-84d74f4d3b9a tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-438965378", "id": 1943945915, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:19.847983 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0fc251c7-48ff-417e-a99e-84d74f4d3b9a tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.042006 Aug 30 03:24:19.854756 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 107/201] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:24:19 2022] POST /compute/v2.1/flavors => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:19.868251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:19.869536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:19.883203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:19.884222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:19.890213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:19.892694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:19.894274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:19.895454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:20.011918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:20.029815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2625423d-9081-4396-9609-59322290c0cf tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1294 microversion: 2.1 time: 0.173400 Aug 30 03:24:20.031149 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 108/202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:19 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1294 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:20.051086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-130b15a2-88b6-4a0a-9f8e-6151d38530c2 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:20.077551 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-130b15a2-88b6-4a0a-9f8e-6151d38530c2 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042801 Aug 30 03:24:20.080122 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 109/203] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Aug 30 03:24:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:24:20.102014 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d6e7f37-fff5-48c5-8ff2-cb723c3720e2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 1.286728 Aug 30 03:24:20.104292 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 95/204] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:20.106457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b4b7059b-dabf-4503-bef5-e1e185a75543 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Action: 'create', calling method: .version_select at 0x7f898048f5e0>, body: {"keypair": {"name": "tempest-keypair-806602623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIKcbs4BhM5m7ujPXyfXkXbEMBcMBmGbDlDo2ylIWS9fZtWWjIQH4ARPGRyEI3hpU5027zqnuXcirEY512UZKvdze/YpSowD8Hc7YNF5bsJGrI1aZO/UlmQtM99lK7CoA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:20.125291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b4b7059b-dabf-4503-bef5-e1e185a75543 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Getting quotas for project 6815ed26b67b481aa4213a7f99653625. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:20.127200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ee95472-b9ac-4f6f-a5b3-bb6d693288e1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:20.130462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b4b7059b-dabf-4503-bef5-e1e185a75543 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Getting quotas for user d5daf93738ce4ea2941438e615625fe6 and project 6815ed26b67b481aa4213a7f99653625. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:20.166630 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b4b7059b-dabf-4503-bef5-e1e185a75543 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070893 Aug 30 03:24:20.180288 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7ee95472-b9ac-4f6f-a5b3-bb6d693288e1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.058599 Aug 30 03:24:20.180888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 96/205] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:20 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:20.181371 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 110/206] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:24:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:20.204438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddd7661f-00c1-4f44-97d1-87826e9f6fc2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-222398665"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:20.213767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-ddd7661f-00c1-4f44-97d1-87826e9f6fc2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid deaa656a-622b-458a-8756-417a9f7b1787 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:20.285144 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddd7661f-00c1-4f44-97d1-87826e9f6fc2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.082604 Aug 30 03:24:20.291417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 111/207] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:20.302236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac95777a-7ff7-4a4c-ad29-3a10726f66a8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:20.327986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac95777a-7ff7-4a4c-ad29-3a10726f66a8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:20.329078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac95777a-7ff7-4a4c-ad29-3a10726f66a8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:20.338671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac95777a-7ff7-4a4c-ad29-3a10726f66a8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:20.613681 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac95777a-7ff7-4a4c-ad29-3a10726f66a8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.315203 Aug 30 03:24:20.624589 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 97/208] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:20.638651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-89024463-a92f-4948-af0e-a6a425ab2876 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:20.650208 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-89024463-a92f-4948-af0e-a6a425ab2876 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.018175 Aug 30 03:24:20.651078 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 98/209] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:24:20 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:20.663019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bff25a7-ce01-4075-b070-888ce99f3726 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:20.676672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bff25a7-ce01-4075-b070-888ce99f3726 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:20.678071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bff25a7-ce01-4075-b070-888ce99f3726 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:20.679472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bff25a7-ce01-4075-b070-888ce99f3726 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:20.869427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:20.889025 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bff25a7-ce01-4075-b070-888ce99f3726 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.229309 Aug 30 03:24:20.890014 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 99/210] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:20.902973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08512962-f071-4a55-9498-6ec50e51a51b tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:20.937157 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08512962-f071-4a55-9498-6ec50e51a51b tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.038085 Aug 30 03:24:20.945134 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 100/211] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:20 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:20.952411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d913024e-6b40-4480-b537-4167b5305918 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-642674310"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:20.958395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-d913024e-6b40-4480-b537-4167b5305918 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid 11533c44-81a1-4f7e-a407-2d9d23bb3a16 for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:21.004657 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d913024e-6b40-4480-b537-4167b5305918 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057481 Aug 30 03:24:21.006127 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 101/212] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:21.029801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9228f2ea-1586-4ad0-b6e5-b56e86e1caca tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:21.051476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9228f2ea-1586-4ad0-b6e5-b56e86e1caca tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:21.052315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9228f2ea-1586-4ad0-b6e5-b56e86e1caca tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:21.053007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9228f2ea-1586-4ad0-b6e5-b56e86e1caca tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:21.127110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91346eb3-cd04-423e-b1c3-03e861c3aff1 tempest-InstanceUsageAuditLogTestJSON-480507434 tempest-InstanceUsageAuditLogTestJSON-480507434-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:21.202121 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-91346eb3-cd04-423e-b1c3-03e861c3aff1 tempest-InstanceUsageAuditLogTestJSON-480507434 tempest-InstanceUsageAuditLogTestJSON-480507434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 03:24:20" status: 200 len: 318 microversion: 2.1 time: 0.802177 Aug 30 03:24:21.214928 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 112/213] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 03:24:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2003%3A24%3A20 => generated 318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:21.229204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:21.242375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:21.255541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:21.256027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:21.256456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:21.258920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:21.261742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:21.262190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:21.320974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9228f2ea-1586-4ad0-b6e5-b56e86e1caca tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.301013 Aug 30 03:24:21.329255 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 102/214] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:21.334164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b24a3b1-b650-4734-bee0-306f8fe65c9f tempest-InstanceUsageAuditLogTestJSON-480507434 tempest-InstanceUsageAuditLogTestJSON-480507434-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:21.388410 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b24a3b1-b650-4734-bee0-306f8fe65c9f tempest-InstanceUsageAuditLogTestJSON-480507434 tempest-InstanceUsageAuditLogTestJSON-480507434-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.057769 Aug 30 03:24:21.390544 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 103/215] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:24:21 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:21.416457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b837744-591e-4d0c-be02-9b83779470f4 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:21.425025 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b837744-591e-4d0c-be02-9b83779470f4 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.023661 Aug 30 03:24:21.433765 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 104/216] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:24:21 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:21.441245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d49dd600-0cc1-4d1d-9e07-38feaeff4b14 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:21.452117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49dd600-0cc1-4d1d-9e07-38feaeff4b14 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:21.452602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49dd600-0cc1-4d1d-9e07-38feaeff4b14 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:21.453028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49dd600-0cc1-4d1d-9e07-38feaeff4b14 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:21.569790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:21.595422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2fe2b1ea-4391-4415-b1de-05b3fa864103 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1278 microversion: 2.1 time: 0.369410 Aug 30 03:24:21.597775 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 113/217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:21 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:21.620722 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d49dd600-0cc1-4d1d-9e07-38feaeff4b14 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.185470 Aug 30 03:24:21.621763 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 105/218] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:21.637823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b35347df-07ff-4e22-96a0-a2895ea50f29 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:21.667098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b35347df-07ff-4e22-96a0-a2895ea50f29 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.034680 Aug 30 03:24:21.667571 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 114/219] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:21 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:21.682607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6761957f-f44a-47e2-8e5b-01ea269177fc tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1337394960"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:21.687434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-6761957f-f44a-47e2-8e5b-01ea269177fc tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid c28dce3f-db4d-43dc-9c10-753361a4483c for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:21.721074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6761957f-f44a-47e2-8e5b-01ea269177fc tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043559 Aug 30 03:24:21.722228 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 106/220] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:21.740745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcd922ec-4173-460a-9ee5-e094f19f2132 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:21.765687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd922ec-4173-460a-9ee5-e094f19f2132 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:21.766387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd922ec-4173-460a-9ee5-e094f19f2132 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:21.767241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd922ec-4173-460a-9ee5-e094f19f2132 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:22.130424 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bcd922ec-4173-460a-9ee5-e094f19f2132 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.396885 Aug 30 03:24:22.145055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6233e782-e077-4da3-a366-d5a7341472c1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:22.147832 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 115/221] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:22.163530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6233e782-e077-4da3-a366-d5a7341472c1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:22.166874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6233e782-e077-4da3-a366-d5a7341472c1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:22.168239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6233e782-e077-4da3-a366-d5a7341472c1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:22.467966 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6233e782-e077-4da3-a366-d5a7341472c1 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.327461 Aug 30 03:24:22.469567 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 107/222] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:22.495851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e3947c1-8d5c-4660-88f0-5c77e8e331d4 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:22.565100 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e3947c1-8d5c-4660-88f0-5c77e8e331d4 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.086716 Aug 30 03:24:22.566914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 116/223] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:22.577043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7aeeb00e-e3af-443c-a77d-790af4eb7195 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1396688554"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:22.580690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-7aeeb00e-e3af-443c-a77d-790af4eb7195 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid ca52624d-1de8-4ee0-b846-b0f5144d283d for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:22.613982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9093dc1-884c-423d-8b36-029c4d590598 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-881610641"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:22.617985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-e9093dc1-884c-423d-8b36-029c4d590598 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid 32457966-52ea-46d0-87c6-2482710d3cee for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:22.628902 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7aeeb00e-e3af-443c-a77d-790af4eb7195 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056284 Aug 30 03:24:22.632412 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 108/224] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:22.649068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:22.655966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:22.672953 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9093dc1-884c-423d-8b36-029c4d590598 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063013 Aug 30 03:24:22.673785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 117/225] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:22.682642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:22.687839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b810a1a8-f4ec-44c8-b847-3d367d02439b tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:22.689541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:22.690366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:22.691025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:22.691507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:22.691909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:22.736208 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b810a1a8-f4ec-44c8-b847-3d367d02439b tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.052156 Aug 30 03:24:22.739861 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 118/226] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:22 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:22.747927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee80f2aa-b4c9-42a1-8baf-aca3107e0c0c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:22.770421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee80f2aa-b4c9-42a1-8baf-aca3107e0c0c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:22.770914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee80f2aa-b4c9-42a1-8baf-aca3107e0c0c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:22.781550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee80f2aa-b4c9-42a1-8baf-aca3107e0c0c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:22.953135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee80f2aa-b4c9-42a1-8baf-aca3107e0c0c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.214654 Aug 30 03:24:22.954194 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 119/227] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:22 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:22.965958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48d27f77-a1e3-4afa-b118-02493851e4a3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:22.981192 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-48d27f77-a1e3-4afa-b118-02493851e4a3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48d27f77-a1e3-4afa-b118-02493851e4a3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Request method failure captured: Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8GIU-0hH9meItdwe8A-7Xng4INIewyhoEttUeskJA7NEXwl7_SpOKIu40dNJKyASKiL8e9U2-7SRB9zJVDALsqt5fJYnDNN4-vl9qXaJ48_6nLFIFH7OOPbpKS6iMgFlJEkaa8zLsJ1rlryidOTTrLROoPJpT1T6zzmJR1ttLDvY Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:22.987581 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f21be41ce87446119b5cbbc243e0a072", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}] Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 5dcb8696bb53436ab20ff1314f59014e Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: exception: Aggregate 5 could not be found. Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '5'} Aug 30 03:24:22.988983 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:22.989795 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 30 03:24:22.990799 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:22.994524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48d27f77-a1e3-4afa-b118-02493851e4a3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:22.996929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48d27f77-a1e3-4afa-b118-02493851e4a3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.040148 Aug 30 03:24:22.998846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 120/228] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:24:22 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:23.012270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:23.243710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:23.244882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:23.245533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:23.272308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=11,nova_api:DELETE=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:23.283881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-854924-5. Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 39 Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:23.311644 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: {"add_host": {"host": "n-h2-854924-5"}} Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:23.312927 n-d-854924-5 devstack@n-api.service[122168]: exception: Aggregate 6 already has host n-h2-854924-5. Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-854924-5'}}} Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result.read() Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:24:23.313687 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854924-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 03:24:23.314748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 03:24:23.315805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:24:23.316780 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result.read() Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854924-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 3, 24, 23, 271459), 'updated_at': None, 'host': 'n-h2-854924-5', 'aggregate_id': 6}] Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.318581 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-854924-5. Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.320867 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-854924-5. Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:23.322608 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:23.325859 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-854924-5. Aug 30 03:24:23.325859 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.327057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-854924-5. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:23.328470 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd739586-9fac-47d0-bd0e-0044bb433795 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.326016 Aug 30 03:24:23.329328 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 121/229] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:22 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 330 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 30 03:24:23.335338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2616b608-98da-424b-9360-192665f79ef3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:23.351189 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2616b608-98da-424b-9360-192665f79ef3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2616b608-98da-424b-9360-192665f79ef3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Request method failure captured: Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8GIU-0hH9meItdwe8A-7Xng4INIewyhoEttUeskJA7NEXwl7_SpOKIu40dNJKyASKiL8e9U2-7SRB9zJVDALsqt5fJYnDNN4-vl9qXaJ48_6nLFIFH7OOPbpKS6iMgFlJEkaa8zLsJ1rlryidOTTrLROoPJpT1T6zzmJR1ttLDvY Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:23.355608 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f21be41ce87446119b5cbbc243e0a072", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}] Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 5dcb8696bb53436ab20ff1314f59014e Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: exception: Aggregate 5 could not be found. Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '5'} Aug 30 03:24:23.356861 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:23.357776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.358789 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:23.359956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:23.359956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:23.359956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:23.359956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 30 03:24:23.359956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.362444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2616b608-98da-424b-9360-192665f79ef3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:23.363493 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2616b608-98da-424b-9360-192665f79ef3 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033006 Aug 30 03:24:23.364249 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 122/230] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:23.374179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4923d430-0c6a-4020-8467-246a87478aaf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:23.388208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4923d430-0c6a-4020-8467-246a87478aaf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:23.388854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4923d430-0c6a-4020-8467-246a87478aaf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:23.389474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4923d430-0c6a-4020-8467-246a87478aaf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:23.552029 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4923d430-0c6a-4020-8467-246a87478aaf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.186557 Aug 30 03:24:23.553316 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 123/231] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:23 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:23.562537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:23.564957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f52f16d-2a8c-4d73-b4f4-8b3a80985341 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1595580151", "name": "tempest-test_aggregate-488502067"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:23.573191 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd411b74-999c-4d82-8617-21e3486c5b70 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 0.938898 Aug 30 03:24:23.576918 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 109/232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:22 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:23.629472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-1f52f16d-2a8c-4d73-b4f4-8b3a80985341 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid 0f1c54f5-9a03-4e08-bf8f-5aa7d480771c for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:23.697937 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f52f16d-2a8c-4d73-b4f4-8b3a80985341 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.142642 Aug 30 03:24:23.710094 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 124/233] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Aug 30 03:24:23 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:23.723378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd5311f9-9a5e-4cac-8dd3-0d7bdbec2f90 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:23.768670 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd5311f9-9a5e-4cac-8dd3-0d7bdbec2f90 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053581 Aug 30 03:24:23.769285 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 125/234] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:23 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:23.780830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a795018-970f-4d4d-913b-e25fc7563358 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:23.830955 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a795018-970f-4d4d-913b-e25fc7563358 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.060595 Aug 30 03:24:23.831586 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 126/235] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:23 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:23.838855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-890c557b-73f5-4d73-a87c-de0cfeaf0734 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-520728402"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:23.847654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-890c557b-73f5-4d73-a87c-de0cfeaf0734 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid e0483eaa-8d13-4cd3-9b1f-e943ba2ae953 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:23.891615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-890c557b-73f5-4d73-a87c-de0cfeaf0734 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058785 Aug 30 03:24:23.892281 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 127/236] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:23.900968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f89801c5430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:23.903465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-962e37f2-a93b-47d6-aa30-8deae49fd3c8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:23.911879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-962e37f2-a93b-47d6-aa30-8deae49fd3c8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-962e37f2-a93b-47d6-aa30-8deae49fd3c8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Request method failure captured: Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8GIU-0hH9meItdwe8A-7Xng4INIewyhoEttUeskJA7NEXwl7_SpOKIu40dNJKyASKiL8e9U2-7SRB9zJVDALsqt5fJYnDNN4-vl9qXaJ48_6nLFIFH7OOPbpKS6iMgFlJEkaa8zLsJ1rlryidOTTrLROoPJpT1T6zzmJR1ttLDvY Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:23.915522 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f21be41ce87446119b5cbbc243e0a072", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}] Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 5dcb8696bb53436ab20ff1314f59014e Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: exception: Aggregate 7 could not be found. Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7'} Aug 30 03:24:23.917712 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.918514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 30 03:24:23.920628 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:23.922782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:23.922878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-962e37f2-a93b-47d6-aa30-8deae49fd3c8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:23.922965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:23.923064 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-962e37f2-a93b-47d6-aa30-8deae49fd3c8 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.025290 Aug 30 03:24:23.923064 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 128/237] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:24:23 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:23.923209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:23.927870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f8980278dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:23.932750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:23.933236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:23.933852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:23.934638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:23.935092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:23.935514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:23.941392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:23.971705 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1ed10b1-130c-411a-ae86-3cda902f3d2e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.048767 Aug 30 03:24:23.978274 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 129/238] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Aug 30 03:24:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.004629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.005747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.006701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.030867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.031823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.032567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.057742 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef6c1ce1-d61e-4dff-8a34-30bb1da7f9a8 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.478920 Aug 30 03:24:24.058387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 110/239] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.071420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-22ca019b-9323-4b49-9396-931e9830a33f tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.106784 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-22ca019b-9323-4b49-9396-931e9830a33f tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-22ca019b-9323-4b49-9396-931e9830a33f tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Request method failure captured: Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK8GIU-0hH9meItdwe8A-7Xng4INIewyhoEttUeskJA7NEXwl7_SpOKIu40dNJKyASKiL8e9U2-7SRB9zJVDALsqt5fJYnDNN4-vl9qXaJ48_6nLFIFH7OOPbpKS6iMgFlJEkaa8zLsJ1rlryidOTTrLROoPJpT1T6zzmJR1ttLDvY Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:24.111354 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f21be41ce87446119b5cbbc243e0a072"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f21be41ce87446119b5cbbc243e0a072", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f21be41ce87446119b5cbbc243e0a072"}]}] Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f21be41ce87446119b5cbbc243e0a072 Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-107715576 Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 5dcb8696bb53436ab20ff1314f59014e Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminTestJSON-107715576-project-admin Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: exception: Aggregate 7 could not be found. Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7'} Aug 30 03:24:24.112609 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:24.113366 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:24.115265 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-22ca019b-9323-4b49-9396-931e9830a33f tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:24.116440 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-22ca019b-9323-4b49-9396-931e9830a33f tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.054314 Aug 30 03:24:24.117449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 111/240] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:24 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:24.127418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f898029e700>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.142798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.147174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.147791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.149197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.149715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.150169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.247347 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2d5006f-0f4b-4517-aefc-45c55fa3ba2a tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.128103 Aug 30 03:24:24.253034 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 112/241] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.262251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f898029ef70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.265522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.267979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.275461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.292136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ddb4707-e6ea-4fee-8a11-7c77a94e5692 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:24.297441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ddb4707-e6ea-4fee-8a11-7c77a94e5692 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '16359362d2d7460593ad781fd042f605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb97e24cf4f442f0afb1cfa43113dd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ddb4707-e6ea-4fee-8a11-7c77a94e5692 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Request method failure captured: Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 39 Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK6bo4HlF8az73bV9oAUhKJOPGg2yGGgkJWlgrslbou50SBQM9hqcFbFUfrecgFiA8QyBLPk56AGy6xU6WstxoQX16G2gmdKJsJHJIXvcFA9N4WBQtckYvlrEdlG93_bm8dq34HmAzdKa1Dlw57kLZ6BAMOWsPhTBgRKrHyEVpO5SE Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:24.299257 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eb97e24cf4f442f0afb1cfa43113dd72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}] Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 16359362d2d7460593ad781fd042f605 Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: {"add_host": {"host": "n-h2-854924-5"}} Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:24.300529 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h2-854924-5'}}} Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:24.301238 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 03:24:24.302286 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:24.303955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ddb4707-e6ea-4fee-8a11-7c77a94e5692 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:24.304098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.304098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.304098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.305524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ddb4707-e6ea-4fee-8a11-7c77a94e5692 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.331066 Aug 30 03:24:24.306029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 130/242] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:23 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 333 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:24.319218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48f3a792-9a79-4afe-a383-ca681aaccd4e tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-633196589"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:24.325605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-48f3a792-9a79-4afe-a383-ca681aaccd4e tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid 0ff9f5af-5902-4d38-b81b-987a3ff04f33 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:24.331022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.331565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.332004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.341445 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe1fdf39-d7ce-44fd-94b8-443422aeded3 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.087100 Aug 30 03:24:24.342052 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 113/243] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:24.347534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f898029e940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.352464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.353250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.353977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.354924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.355573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.356514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.379808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48f3a792-9a79-4afe-a383-ca681aaccd4e tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072683 Aug 30 03:24:24.387158 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 131/244] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.394551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1219362018", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "1943945915", "adminPass": "***", "networks": [{"uuid": "b143f024-e525-45dd-a5b1-9ac46d78bbf7"}], "security_groups": [{"name": "tempest-securitygroup--2017497196"}], "key_name": "tempest-keypair-806602623", "user_data": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:24.407769 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bd8a4f3-8977-441e-b6c0-df1d21d1e032 tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.064481 Aug 30 03:24:24.409729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 114/245] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.429333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f84ea610-09b8-4038-be30-686582f4235f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.499014 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f84ea610-09b8-4038-be30-686582f4235f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078795 Aug 30 03:24:24.499637 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 115/246] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:24 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:24.514660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f89801c5d30>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.516927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.518845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.519452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.558497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.559005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.559414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.583091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.584393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.585032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.592680 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-60e695bd-9d0b-4452-8061-e57042771c3a tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089701 Aug 30 03:24:24.593621 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 116/247] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.600650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a67dbe0-4e5e-4184-a95c-dacd6ce7acd7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.609139 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a67dbe0-4e5e-4184-a95c-dacd6ce7acd7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.013876 Aug 30 03:24:24.610543 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 117/248] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.615330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f898029e5e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.625464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.626509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.627555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.652033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.652865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.653532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.691969 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2545e9f9-0161-4409-a488-23dc83cd692e tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-h2-854924-5" status: 200 len: 467 microversion: 2.1 time: 0.076568 Aug 30 03:24:24.693164 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 118/249] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/os-hosts/n-h2-854924-5 => generated 467 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.701924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0c81f54-e2c9-48ac-a1c0-ccf8ab7c3317 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-562110438"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:24.708351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-b0c81f54-e2c9-48ac-a1c0-ccf8ab7c3317 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid 180cce34-c3c9-43b3-ae80-978f65561439 for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:24.737532 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0c81f54-e2c9-48ac-a1c0-ccf8ab7c3317 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042907 Aug 30 03:24:24.745776 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 119/250] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:24.751654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:24.753127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:24.761770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.762274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.762704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.763547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:24.764050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:24.764469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:24.771045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] validate_networks() for [('b143f024-e525-45dd-a5b1-9ac46d78bbf7', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:24:25.306131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:25.316698 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c1ccd95c-615f-4882-aa88-46a3e6957c80 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 0.569712 Aug 30 03:24:25.317574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 120/251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:24 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:25.323461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f89801c5940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.325812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.326725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.327226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.348237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.348822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.349531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.356443 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-324dc475-f9e4-4fef-b0f7-7b5d27a0bdbc tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.037619 Aug 30 03:24:25.357373 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 121/252] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.374282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd2cc41f-1e81-4a08-a945-d54b67d884f9 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:25.402756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd2cc41f-1e81-4a08-a945-d54b67d884f9 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.032693 Aug 30 03:24:25.409186 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 122/253] 10.222.0.30 () {60 vars in 1191 bytes} [Tue Aug 30 03:24:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.412999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Calling method '.version_select at 0x7f8980201550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.426252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.427356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.427870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.443678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:25.449305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.449692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.450124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.464586 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd8ad403-4ba0-433b-80e7-81768c0300bc tempest-HostsAdminTestJSON-1967135100 tempest-HostsAdminTestJSON-1967135100-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-h1-854924-5" status: 200 len: 332 microversion: 2.1 time: 0.059460 Aug 30 03:24:25.473202 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 123/254] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:24:25 2022] GET /compute/v2.1/os-hosts/n-h1-854924-5 => generated 332 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.488707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1947716156"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:25.503922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.504416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.504990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.517633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.518342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.520756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.549531 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1947716156 could not be found. Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 58 Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:25.553638 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: {"add_host": {"host": "tempest-nonexist_host-1947716156"}} Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:25.554962 n-d-854924-5 devstack@n-api.service[122167]: exception: Compute host tempest-nonexist_host-1947716156 could not be found. Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '10', 'body': {'add_host': {'host': 'tempest-nonexist_host-1947716156'}}} Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1947716156' is not mapped to any cell Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.555678 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 30 03:24:25.556661 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1947716156 could not be found. Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1947716156 could not be found. Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:25.557772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1947716156 could not be found. Aug 30 03:24:25.558890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.565193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1947716156 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:25.566258 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67707556-90a3-4fc8-90f8-a86a3d3dd67f tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 111 microversion: 2.1 time: 0.091024 Aug 30 03:24:25.572161 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 124/255] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 03:24:25 2022] POST /compute/v2.1/os-aggregates/10/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:25.577024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5830c268-6727-424d-b492-015bad99afb9 req-959d1ef2-f7a5-4f42-a4a5-f8714d8c6566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b4a9775-2553-4f50-b30d-5da361bc5c52", "tag": "1b0b0379-e367-49f4-9f6a-55f973de6014"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:25.600485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5830c268-6727-424d-b492-015bad99afb9 req-959d1ef2-f7a5-4f42-a4a5-f8714d8c6566 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.601122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5830c268-6727-424d-b492-015bad99afb9 req-959d1ef2-f7a5-4f42-a4a5-f8714d8c6566 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.601462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5830c268-6727-424d-b492-015bad99afb9 req-959d1ef2-f7a5-4f42-a4a5-f8714d8c6566 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.637972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5830c268-6727-424d-b492-015bad99afb9 req-959d1ef2-f7a5-4f42-a4a5-f8714d8c6566 service nova] Creating event network-changed:1b0b0379-e367-49f4-9f6a-55f973de6014 for instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 on n-h2-854924-5 Aug 30 03:24:25.652592 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5830c268-6727-424d-b492-015bad99afb9 req-959d1ef2-f7a5-4f42-a4a5-f8714d8c6566 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079096 Aug 30 03:24:25.654925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 125/256] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.669287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34d0e90a-d162-4dc9-8049-ce345757066c tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f8980201820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.671567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34d0e90a-d162-4dc9-8049-ce345757066c tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.672391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34d0e90a-d162-4dc9-8049-ce345757066c tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.672962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34d0e90a-d162-4dc9-8049-ce345757066c tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.698771 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34d0e90a-d162-4dc9-8049-ce345757066c tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.039075 Aug 30 03:24:25.707565 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 126/257] 10.222.0.30 () {58 vars in 1179 bytes} [Tue Aug 30 03:24:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.714296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d8222c8-9c17-4374-bd87-85ac58bc828e tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.722964 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d8222c8-9c17-4374-bd87-85ac58bc828e tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.014126 Aug 30 03:24:25.723766 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 127/258] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:24:25 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.730419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ffc9d4ad-47c7-4c76-845f-20436d231d0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.778862 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ffc9d4ad-47c7-4c76-845f-20436d231d0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053790 Aug 30 03:24:25.788036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 128/259] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:25.802512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f89802018b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.807401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.818415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.819174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.846877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.847290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.847984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.872164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.872164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.872449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.888884 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b667e4bf-e48e-4cc3-a471-93f522e48566 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.095933 Aug 30 03:24:25.889601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 129/260] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:25.896674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d939c493-0528-47a8-b478-c9691beb1470 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.929325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d939c493-0528-47a8-b478-c9691beb1470 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.038634 Aug 30 03:24:25.936174 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 130/261] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:25 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:25.942332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3023cd66-e965-47e7-9840-05c707d18d7e tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3023cd66-e965-47e7-9840-05c707d18d7e tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 283 Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:25.953915 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:25.955282 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:24:25.955830 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:25.956406 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:25.957395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:25.959140 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:24:25.959140 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:24:25.959140 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:24:25.959140 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:25.959140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3023cd66-e965-47e7-9840-05c707d18d7e tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:25.959829 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3023cd66-e965-47e7-9840-05c707d18d7e tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.018653 Aug 30 03:24:25.959829 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 131/262] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Aug 30 03:24:25 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:24:25.965870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f89803bbca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:25.968561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.969064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.969579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:25.986958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:25.989612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:25.990405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.009479 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9cda5fd2-2028-4b60-a2dc-37f6dcdb921e tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.049333 Aug 30 03:24:26.010467 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 132/263] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:26.018937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc427592-aa56-4e1f-ba72-0c959b2e18b2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-31999821", "availability_zone": "tempest-test_az-308868129"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:26.028898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-cc427592-aa56-4e1f-ba72-0c959b2e18b2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid 57d42727-5219-4b3d-982f-eac7b7082cc6 for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:26.109090 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc427592-aa56-4e1f-ba72-0c959b2e18b2 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.097512 Aug 30 03:24:26.113586 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 133/264] 10.222.0.30 () {60 vars in 1165 bytes} [Tue Aug 30 03:24:26 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:26.142305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99a579f2-fbf2-4e3c-aa50-482c3626345d tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99a579f2-fbf2-4e3c-aa50-482c3626345d tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 27 Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:26.154058 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: {"aggregate": {"name": ""}} Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:26.155426 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi '' Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:26.156133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:24:26.157996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.162105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99a579f2-fbf2-4e3c-aa50-482c3626345d tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:26.163262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-99a579f2-fbf2-4e3c-aa50-482c3626345d tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.039223 Aug 30 03:24:26.178597 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 134/265] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:26 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:24:26.194083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f898029e3a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:26.214195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.214728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.215163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.262731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.263825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.264473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.275235 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7d24959-b9cb-4b95-a085-914d5525ca02 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.091687 Aug 30 03:24:26.310236 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 135/266] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:26 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:26.324505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c373b620-3a58-4695-ae5b-e8a9c2257705 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-31999821_new", "availability_zone": "tempest-test_az-308868129_new"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:26.501241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c373b620-3a58-4695-ae5b-e8a9c2257705 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.502653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c373b620-3a58-4695-ae5b-e8a9c2257705 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.504212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c373b620-3a58-4695-ae5b-e8a9c2257705 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.604062 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c373b620-3a58-4695-ae5b-e8a9c2257705 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 333 microversion: 2.1 time: 0.291624 Aug 30 03:24:26.609061 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 136/267] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Aug 30 03:24:26 2022] PUT /compute/v2.1/os-aggregates/11 => generated 333 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:26.619628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79b33655-26ab-495a-b678-c984063ffa0a tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2133150615"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:26.624686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-79b33655-26ab-495a-b678-c984063ffa0a tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '16359362d2d7460593ad781fd042f605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb97e24cf4f442f0afb1cfa43113dd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79b33655-26ab-495a-b678-c984063ffa0a tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Request method failure captured: Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 60 Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK6bo4HlF8az73bV9oAUhKJOPGg2yGGgkJWlgrslbou50SBQM9hqcFbFUfrecgFiA8QyBLPk56AGy6xU6WstxoQX16G2gmdKJsJHJIXvcFA9N4WBQtckYvlrEdlG93_bm8dq34HmAzdKa1Dlw57kLZ6BAMOWsPhTBgRKrHyEVpO5SE Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:26.628067 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eb97e24cf4f442f0afb1cfa43113dd72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}] Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 16359362d2d7460593ad781fd042f605 Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: {"aggregate": {"name": "tempest-test_aggregate-2133150615"}} Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:26.629626 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2133150615'}}} Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:26.630621 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:26.631861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 03:24:26.633242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:26.635539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79b33655-26ab-495a-b678-c984063ffa0a tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:26.636854 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79b33655-26ab-495a-b678-c984063ffa0a tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026219 Aug 30 03:24:26.638689 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 137/268] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:26 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:26.644695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Calling method '.version_select at 0x7f898017f040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:26.647683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.650041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.650682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.667112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.669697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.670325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.684049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.684601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:24:26.685129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:24:26.685728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:24:26.686203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.686320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:24:26.686842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:24:26.687032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.713518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.715966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.716718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.720007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.720813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.721529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.759436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Getting quotas for project 6815ed26b67b481aa4213a7f99653625. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:26.765286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Getting quotas for user d5daf93738ce4ea2941438e615625fe6 and project 6815ed26b67b481aa4213a7f99653625. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:26.785798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:24:26.796447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:24:26.873514 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-183754b9-d9b7-44fd-bcab-9422cc5aeb19 tempest-HypervisorAdminTestJSON-533450817 tempest-HypervisorAdminTestJSON-533450817-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.233329 Aug 30 03:24:26.874134 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 138/269] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Aug 30 03:24:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:26.890692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:26.891403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:26.913618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.914563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.915279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.916129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:26.916588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:26.917040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:26.923190 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-176a24b6-dc76-4b54-ae03-d976670c99db tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.529771 Aug 30 03:24:26.929154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:26.934996 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 132/270] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:24:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:24:26.965791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17f5e5ab-5848-450f-a5b4-80e9776d17d7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.002878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17f5e5ab-5848-450f-a5b4-80e9776d17d7 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.064507 Aug 30 03:24:27.010414 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 133/271] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:24:26 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:27.015117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-220f81be-ce25-4330-85d6-7c0d1f818e4a tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-629450885"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:27.025915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-220f81be-ce25-4330-85d6-7c0d1f818e4a tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid 5462ddad-b3d6-415e-b442-8c4a6c818a12 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:27.069562 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-220f81be-ce25-4330-85d6-7c0d1f818e4a tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057870 Aug 30 03:24:27.071319 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 134/272] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:27.082115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4adc2c55-4064-4447-99c6-bb30235b47eb tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.085091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4adc2c55-4064-4447-99c6-bb30235b47eb tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:27.296177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4adc2c55-4064-4447-99c6-bb30235b47eb tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:27.310695 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4adc2c55-4064-4447-99c6-bb30235b47eb tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1264 microversion: 2.1 time: 0.234550 Aug 30 03:24:27.311518 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 135/273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:27 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:27.324322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd6f253c-b41f-43ed-9870-d7b14316e763 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.399906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd6f253c-b41f-43ed-9870-d7b14316e763 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.086622 Aug 30 03:24:27.401747 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 136/274] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:27.411097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85117cfd-7e9f-4607-8839-f3f551b93bcc tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-629450885"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:27.423562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:27.434000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-85117cfd-7e9f-4607-8839-f3f551b93bcc tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid 5a75e266-e8f5-4745-9c3b-2bf5535da040 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:27.435113 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d5fa306-c8f8-4a24-af96-adfdfe9da35f tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 0.548683 Aug 30 03:24:27.435698 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 139/275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:26 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:27.449379 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-85117cfd-7e9f-4607-8839-f3f551b93bcc tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-629450885 already exists. Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85117cfd-7e9f-4607-8839-f3f551b93bcc tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 59 Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:27.451763 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: {"aggregate": {"name": "tempest-test_aggregate-629450885"}} Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:27.452953 n-d-854924-5 devstack@n-api.service[122168]: exception: Aggregate tempest-test_aggregate-629450885 already exists. Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-629450885'}}} Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 30 03:24:27.453732 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-629450885 already exists. Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:27.458142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-629450885 already exists. Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-629450885 already exists. Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85117cfd-7e9f-4607-8839-f3f551b93bcc tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-629450885 already exists. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:27.459287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85117cfd-7e9f-4607-8839-f3f551b93bcc tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.049888 Aug 30 03:24:27.460049 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 137/276] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:27 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:27.460049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2cb57f40-e089-4c07-8d34-f6924d190fcb tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1718216884"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:27.465663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-2cb57f40-e089-4c07-8d34-f6924d190fcb tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Generated uuid 5e65c7f1-3635-4a9e-b6de-aca6dd2850fe for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:27.477399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-835dcac4-cde9-4fe2-86c0-0e241d1a3fcf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.489424 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2cb57f40-e089-4c07-8d34-f6924d190fcb tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033528 Aug 30 03:24:27.493426 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 138/277] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:27.511438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c48467b-b41a-44b2-8c58-47eddb016f41 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.520762 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c48467b-b41a-44b2-8c58-47eddb016f41 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.012714 Aug 30 03:24:27.521825 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 139/278] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:24:27 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:27.535107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eecd11e1-aea1-426a-94cf-01a30b218773 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.554022 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-835dcac4-cde9-4fe2-86c0-0e241d1a3fcf tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.089673 Aug 30 03:24:27.568843 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 140/279] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:27.594555 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eecd11e1-aea1-426a-94cf-01a30b218773 tempest-AggregatesAdminTestJSON-107715576 tempest-AggregatesAdminTestJSON-107715576-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.064779 Aug 30 03:24:27.595677 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 140/280] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 03:24:27.596443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31e6b7e7-c96d-412a-88c9-1fab3c7bd89c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1488662394"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:27.611724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-31e6b7e7-c96d-412a-88c9-1fab3c7bd89c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid a2230e2b-91be-4e74-82fb-561ae0b9d02b for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:27.622109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.622954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:27.642553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:27.643057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:27.643494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:27.647923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:27.647923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:27.650195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:27.672564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31e6b7e7-c96d-412a-88c9-1fab3c7bd89c tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.099751 Aug 30 03:24:27.674972 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 141/281] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:27.685317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52cadf00-256b-4d6e-b627-46e6e2159fad tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.692117 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] HTTP exception thrown: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Request method failure captured: Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 HTTP/1.1 Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK5OTbWpJ3pCnnttQLYR1xpSTDzmFRx2kXMokqdeoSxr8xxJfQR1S78OQMK05dP3MdH3EbSvsfiggfMxN-oqfVCaxR7GhFzqqYRMr7oHdhkkuIdT5A8QvkuCIK4BoRikEnRdtlDpy2nX8zO4GU2gCfspLqhRD1idwWr1TkszYOWL7Q Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ec228a39d1ea4733824aec784a590d8e Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:27.694109 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec228a39d1ea4733824aec784a590d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ec228a39d1ea4733824aec784a590d8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ec228a39d1ea4733824aec784a590d8e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec228a39d1ea4733824aec784a590d8e"}]}] Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ec228a39d1ea4733824aec784a590d8e Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminTestJSON-1265582273-project Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9248961ff84b44b9ae37817650f35f18 Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminTestJSON-1265582273-project Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.695640 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1802a7f2-0dfb-4a3d-849c-9e675fbcdab9'} Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:27.696808 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.697900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.704666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Returning 404 to user: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:27.711105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a0523c7-eb85-4ba6-ac54-b33875d8aa93 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 404 len: 111 microversion: 2.1 time: 0.102799 Aug 30 03:24:27.712452 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 141/282] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:27.720692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-52cadf00-256b-4d6e-b627-46e6e2159fad tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '16359362d2d7460593ad781fd042f605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb97e24cf4f442f0afb1cfa43113dd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52cadf00-256b-4d6e-b627-46e6e2159fad tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Request method failure captured: Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK6bo4HlF8az73bV9oAUhKJOPGg2yGGgkJWlgrslbou50SBQM9hqcFbFUfrecgFiA8QyBLPk56AGy6xU6WstxoQX16G2gmdKJsJHJIXvcFA9N4WBQtckYvlrEdlG93_bm8dq34HmAzdKa1Dlw57kLZ6BAMOWsPhTBgRKrHyEVpO5SE Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:27.724125 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eb97e24cf4f442f0afb1cfa43113dd72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}] Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 16359362d2d7460593ad781fd042f605 Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 03:24:27.725694 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '14'} Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:27.727061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 03:24:27.728850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.732779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.732779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] [instance: 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:27.732971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52cadf00-256b-4d6e-b627-46e6e2159fad tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:27.733220 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52cadf00-256b-4d6e-b627-46e6e2159fad tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.051638 Aug 30 03:24:27.739841 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 142/283] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:27.745386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:27.746019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:27.746466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:27.747348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:27.747994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:27.748779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:27.750714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8e32f79-a420-4e26-b65e-4089124f1d3b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.797391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8e32f79-a420-4e26-b65e-4089124f1d3b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.052137 Aug 30 03:24:27.798523 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 143/284] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 03:24:27.809841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a007a0c1-7850-469d-808e-d08798c2ff37 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.836941 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a007a0c1-7850-469d-808e-d08798c2ff37 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 03:24:27.838894 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] HTTP exception thrown: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Request method failure captured: Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 HTTP/1.1 Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK5OTbWpJ3pCnnttQLYR1xpSTDzmFRx2kXMokqdeoSxr8xxJfQR1S78OQMK05dP3MdH3EbSvsfiggfMxN-oqfVCaxR7GhFzqqYRMr7oHdhkkuIdT5A8QvkuCIK4BoRikEnRdtlDpy2nX8zO4GU2gCfspLqhRD1idwWr1TkszYOWL7Q Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ec228a39d1ea4733824aec784a590d8e Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:27.841996 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec228a39d1ea4733824aec784a590d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ec228a39d1ea4733824aec784a590d8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ec228a39d1ea4733824aec784a590d8e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec228a39d1ea4733824aec784a590d8e"}]}] Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ec228a39d1ea4733824aec784a590d8e Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1265582273 Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminTestJSON-1265582273-project Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9248961ff84b44b9ae37817650f35f18 Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminTestJSON-1265582273-project Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.843558 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1802a7f2-0dfb-4a3d-849c-9e675fbcdab9'} Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:27.844379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. Aug 30 03:24:27.845939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a007a0c1-7850-469d-808e-d08798c2ff37 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:27.849431 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: exception: Aggregate -1 could not be found. Aug 30 03:24:27.851233 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '-1'} Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 03:24:27.852859 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.856170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a007a0c1-7850-469d-808e-d08798c2ff37 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:27.858752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a007a0c1-7850-469d-808e-d08798c2ff37 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046384 Aug 30 03:24:27.859968 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 144/285] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:27.861250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] Returning 404 to user: Instance 1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:27.862289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2963142a-9ec2-4f28-88c6-73042c0e3b20 tempest-AggregatesAdminTestJSON-1265582273 tempest-AggregatesAdminTestJSON-1265582273-project] 10.222.0.30 "GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9" status: 404 len: 111 microversion: 2.1 time: 0.146023 Aug 30 03:24:27.866139 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 142/286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:27 2022] GET /compute/v2.1/servers/1802a7f2-0dfb-4a3d-849c-9e675fbcdab9 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:24:27.869790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd7b31f3-e118-4d20-90db-b4de76cf10f6 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-39919176"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:27.879344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-fd7b31f3-e118-4d20-90db-b4de76cf10f6 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid 4bdec8b5-b1c6-4725-8456-9094e33a70be for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:27.924485 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd7b31f3-e118-4d20-90db-b4de76cf10f6 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063379 Aug 30 03:24:27.925068 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 145/287] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:27.936222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2833ad6-662b-4402-ba44-8677cd777177 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.938064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f2833ad6-662b-4402-ba44-8677cd777177 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '16359362d2d7460593ad781fd042f605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb97e24cf4f442f0afb1cfa43113dd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2833ad6-662b-4402-ba44-8677cd777177 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Request method failure captured: Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK6bo4HlF8az73bV9oAUhKJOPGg2yGGgkJWlgrslbou50SBQM9hqcFbFUfrecgFiA8QyBLPk56AGy6xU6WstxoQX16G2gmdKJsJHJIXvcFA9N4WBQtckYvlrEdlG93_bm8dq34HmAzdKa1Dlw57kLZ6BAMOWsPhTBgRKrHyEVpO5SE Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:27.939932 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eb97e24cf4f442f0afb1cfa43113dd72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}] Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 16359362d2d7460593ad781fd042f605 Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 03:24:27.941122 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '15'} Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:27.942091 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:27.943508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2833ad6-662b-4402-ba44-8677cd777177 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:27.944409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f2833ad6-662b-4402-ba44-8677cd777177 tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.009043 Aug 30 03:24:27.950902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad013c56-3062-4ce0-9fa4-3a587c5f02bd tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:27.952457 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 143/288] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:27 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:24:28.034324 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad013c56-3062-4ce0-9fa4-3a587c5f02bd tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.085862 Aug 30 03:24:28.035537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 146/289] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:28.045268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbeac1bc-a5a2-43dd-98cf-9346a3601f51 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:28.058111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-dbeac1bc-a5a2-43dd-98cf-9346a3601f51 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbeac1bc-a5a2-43dd-98cf-9346a3601f51 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:28.061796 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: exception: Aggregate -1 could not be found. Aug 30 03:24:28.063096 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '-1'} Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.063955 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 03:24:28.065194 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.067788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbeac1bc-a5a2-43dd-98cf-9346a3601f51 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:28.069005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dbeac1bc-a5a2-43dd-98cf-9346a3601f51 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027344 Aug 30 03:24:28.081163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2ceac80-aa97-4952-82d6-a928a815562b tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:28.083387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2ceac80-aa97-4952-82d6-a928a815562b tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '16359362d2d7460593ad781fd042f605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb97e24cf4f442f0afb1cfa43113dd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2ceac80-aa97-4952-82d6-a928a815562b tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Request method failure captured: Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK6bo4HlF8az73bV9oAUhKJOPGg2yGGgkJWlgrslbou50SBQM9hqcFbFUfrecgFiA8QyBLPk56AGy6xU6WstxoQX16G2gmdKJsJHJIXvcFA9N4WBQtckYvlrEdlG93_bm8dq34HmAzdKa1Dlw57kLZ6BAMOWsPhTBgRKrHyEVpO5SE Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:28.085237 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eb97e24cf4f442f0afb1cfa43113dd72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}] Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 16359362d2d7460593ad781fd042f605 Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 03:24:28.087260 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:28.088042 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 03:24:28.089398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.092314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2ceac80-aa97-4952-82d6-a928a815562b tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:28.094506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 144/290] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:28.095116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2ceac80-aa97-4952-82d6-a928a815562b tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016677 Aug 30 03:24:28.096079 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 147/291] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:24:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:28.112681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-705c3aed-6eb1-472d-b907-1e6407704c58 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-303203582"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:28.118956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-705c3aed-6eb1-472d-b907-1e6407704c58 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid ca522628-37c8-4d57-a4a6-0fc87c4b0488 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:28.141310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=9,nova_api:INSERT=10 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:28.172548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-705c3aed-6eb1-472d-b907-1e6407704c58 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063597 Aug 30 03:24:28.184196 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 145/292] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:28.186097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f60185c-574f-4a85-8b3d-ad76e7ee5582 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:28.210126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f60185c-574f-4a85-8b3d-ad76e7ee5582 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:28.213965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f60185c-574f-4a85-8b3d-ad76e7ee5582 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:28.216882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f60185c-574f-4a85-8b3d-ad76e7ee5582 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:28.333684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:28.334369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:28.354009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:28.354558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:28.355006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:28.372652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:28.373151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:28.373683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:28.479445 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f60185c-574f-4a85-8b3d-ad76e7ee5582 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 242 microversion: 2.1 time: 0.298386 Aug 30 03:24:28.480753 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 148/293] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 03:24:28 2022] POST /compute/v2.1/os-aggregates/16/action => generated 242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:28.492570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:28.501073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:28.520529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:28.521664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:28.522951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:28.524675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:28.526104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:28.528141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:28.867493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:28.906987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d9ddf3ab-de5c-4819-92a6-536bcfc5233e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1268 microversion: 2.1 time: 0.578160 Aug 30 03:24:28.921693 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 146/294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:28 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1268 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:28.954709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9eace91-e0ab-430e-9adf-6cbd85eae5ce tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:28.966315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9eace91-e0ab-430e-9adf-6cbd85eae5ce tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '16359362d2d7460593ad781fd042f605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb97e24cf4f442f0afb1cfa43113dd72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9eace91-e0ab-430e-9adf-6cbd85eae5ce tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Request method failure captured: Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 42 Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK6bo4HlF8az73bV9oAUhKJOPGg2yGGgkJWlgrslbou50SBQM9hqcFbFUfrecgFiA8QyBLPk56AGy6xU6WstxoQX16G2gmdKJsJHJIXvcFA9N4WBQtckYvlrEdlG93_bm8dq34HmAzdKa1Dlw57kLZ6BAMOWsPhTBgRKrHyEVpO5SE Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:28.970384 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/eb97e24cf4f442f0afb1cfa43113dd72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_eb97e24cf4f442f0afb1cfa43113dd72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/eb97e24cf4f442f0afb1cfa43113dd72"}]}] Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: eb97e24cf4f442f0afb1cfa43113dd72 Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-663646018 Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 16359362d2d7460593ad781fd042f605 Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-663646018-project Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: {"remove_host": {"host": "n-h2-854924-5"}} Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:28.972397 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h2-854924-5'}}} Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:28.973712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 03:24:28.975322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:28.979317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9eace91-e0ab-430e-9adf-6cbd85eae5ce tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:28.979317 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9eace91-e0ab-430e-9adf-6cbd85eae5ce tempest-AggregatesAdminNegativeTestJSON-663646018 tempest-AggregatesAdminNegativeTestJSON-663646018-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.052939 Aug 30 03:24:28.979317 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 147/295] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 03:24:28 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:28.993725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e2ea1d8-9a51-4e21-8350-aa7a339fc3e7 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:29.016649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea1d8-9a51-4e21-8350-aa7a339fc3e7 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:29.017147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea1d8-9a51-4e21-8350-aa7a339fc3e7 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:29.017634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea1d8-9a51-4e21-8350-aa7a339fc3e7 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:29.250389 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1e2ea1d8-9a51-4e21-8350-aa7a339fc3e7 tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 227 microversion: 2.1 time: 0.266511 Aug 30 03:24:29.256480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 148/296] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 03:24:28 2022] POST /compute/v2.1/os-aggregates/16/action => generated 227 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:29.284054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-071a3a1e-14db-4944-be4a-2e55ae427a4b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:29.338362 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-071a3a1e-14db-4944-be4a-2e55ae427a4b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.073738 Aug 30 03:24:29.346119 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 149/297] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:29 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:29.361474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a807e4d-34f0-47c3-ab14-041c2ca373ed tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-400068205"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:29.378951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-8a807e4d-34f0-47c3-ab14-041c2ca373ed tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Generated uuid 795e471a-78f7-46f7-8e64-2a68bc29e734 for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:29.442452 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a807e4d-34f0-47c3-ab14-041c2ca373ed tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094543 Aug 30 03:24:29.443960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 150/298] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 03:24:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:29.474555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:29.505384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:29.506602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:29.507836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:29.521399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:29.522253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:29.524021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:29.537765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.compute.aggregates [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 03:24:29.538676 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Request method failure captured: Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 42 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK8S5sHi4xGMoqJwhmVRlN4eDxc2RMjflfqM8QXHBNIU-5X21eTdGPhDjObwAm3V7SSNg1yeualps_VwlmCTcVeHRUt_JDC-TLwEiNLSL7sCDjhwMr94fEmYDUbDiS_IyTEMepSL4mI4FfX_ChCZnWBF2qYWkZasCVyzG8I3_ZoFrM Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:29.544293 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f6b8ef1f7684447796d0123ab3745fd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f6b8ef1f7684447796d0123ab3745fd6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f6b8ef1f7684447796d0123ab3745fd6"}]}] Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f6b8ef1f7684447796d0123ab3745fd6 Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-513407815 Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: aae7cabc15b742eab1b19456d50bbc12 Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: {"remove_host": {"host": "nonexist_host"}} Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:29.545966 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot remove host nonexist_host in aggregate 17 Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 03:24:29.546709 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 30 03:24:29.547873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.549023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:29.550598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:29.550598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:29.550598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:29.550598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:29.550598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Aug 30 03:24:29.550598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:29.561520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:29.563529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aea33e6a-4a38-44df-b3a5-d83c1a59de0b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.109719 Aug 30 03:24:29.564739 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 151/299] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 03:24:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:24:29.581208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b525a513-6542-48c0-a1e4-5c14a0ce487b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:29.615364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:29.627430 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b525a513-6542-48c0-a1e4-5c14a0ce487b tempest-AggregatesAdminNegativeTestJSON-513407815 tempest-AggregatesAdminNegativeTestJSON-513407815-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.056217 Aug 30 03:24:29.630782 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 152/300] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:24:29 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 03:24:29.651074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ccd045a-0e87-4607-8c3c-5d707fdfde27 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 1.167632 Aug 30 03:24:29.654477 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 149/301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:28 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:29.951893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:29.952524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:29.969654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:29.970484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:29.985475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:29.988214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:29.989255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:29.993734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:30.546149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:30.580889 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-718daccf-0868-46cd-961a-c0e7928d4b24 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.636220 Aug 30 03:24:30.597653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 153/302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:29 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:30.677422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:30.678708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:30.699405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:30.702566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:30.704370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:30.705314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:30.706687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:30.707684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:31.348801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:31.381057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b6d0574e-a6be-466f-aabc-13cd22264da4 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 0.705953 Aug 30 03:24:31.384836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 150/303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:30 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:31.604241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:31.605275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:31.610018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:31.629726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:31.630349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:31.630803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:31.631591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:31.635373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:31.636030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:31.890389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:31.917537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7078207d-6c1a-4cc9-801b-31387ef3fc04 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.315943 Aug 30 03:24:31.921967 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 151/304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:31 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:32.185047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Action: 'update', calling method: .version_select at 0x7f8980255430>, body: {"quota_set": {"ram": "5120"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:32.409253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:32.409919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:32.421897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:32.424836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:32.430150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:32.435821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:32.436326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:32.436779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:32.678987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:32.689471 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-720921fb-b930-4040-ac4e-2059061a1225 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 0.285864 Aug 30 03:24:32.691111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 152/305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:32 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:32.944773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:32.947289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:32.951765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:32.960018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:32.961617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:32.962421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:32.963541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:32.964486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:32.965082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:33.090730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:33.109729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ba6c856-7eed-45b9-b9a4-229fecfd231e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.170227 Aug 30 03:24:33.110912 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 153/306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:32 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:33.119403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6033f2a5-d3ca-44c3-ab1e-10bd2477d269 req-00e3ba68-43ca-4c96-9878-a0921b99545d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b4a9775-2553-4f50-b30d-5da361bc5c52", "name": "network-vif-plugged", "status": "completed", "tag": "1b0b0379-e367-49f4-9f6a-55f973de6014"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:33.143842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6033f2a5-d3ca-44c3-ab1e-10bd2477d269 req-00e3ba68-43ca-4c96-9878-a0921b99545d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:33.144600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6033f2a5-d3ca-44c3-ab1e-10bd2477d269 req-00e3ba68-43ca-4c96-9878-a0921b99545d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:33.145209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6033f2a5-d3ca-44c3-ab1e-10bd2477d269 req-00e3ba68-43ca-4c96-9878-a0921b99545d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:33.164754 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6033f2a5-d3ca-44c3-ab1e-10bd2477d269 req-00e3ba68-43ca-4c96-9878-a0921b99545d service nova] Creating event network-vif-plugged:1b0b0379-e367-49f4-9f6a-55f973de6014 for instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 on n-h2-854924-5 Aug 30 03:24:33.172297 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6033f2a5-d3ca-44c3-ab1e-10bd2477d269 req-00e3ba68-43ca-4c96-9878-a0921b99545d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059900 Aug 30 03:24:33.173206 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 154/307] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:33.509887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:33.511376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:33.512704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:33.514535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:33.516179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:33.517728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:33.702083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b579dfb-0054-4cf9-89d5-78d099bcb3a9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718" status: 200 len: 148 microversion: 2.57 time: 2.350951 Aug 30 03:24:33.702843 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 154/308] 10.222.0.30 () {62 vars in 1303 bytes} [Tue Aug 30 03:24:31 2022] PUT /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718 => generated 148 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:24:33.720453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:33.722389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:33.735120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Calling method '.version_select at 0x7f8980262b80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:33.735969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:33.736734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:33.738675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:33.739872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:33.754487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:33.755304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:34.175793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:34.189533 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7f31c02-fd98-41d0-92d9-affb63e2e6eb tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1320 microversion: 2.1 time: 0.480020 Aug 30 03:24:34.206680 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 155/309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:33 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:34.211998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:34.212892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:34.219515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:34.220003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:34.220613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:34.221547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:34.222164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:34.222621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:34.422476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:34.446967 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f63bb053-8b5d-4756-8641-98626a75b8da tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.226013 Aug 30 03:24:34.448474 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 156/310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:34 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:34.599772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:34.602057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:34.602666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:34.604354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:34.606066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:34.606690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:34.640296 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2020105d-1a77-43e0-b5ac-1c06f4113ab9 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718/detail" status: 200 len: 463 microversion: 2.57 time: 0.926213 Aug 30 03:24:34.641995 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 155/311] 10.222.0.30 () {60 vars in 1304 bytes} [Tue Aug 30 03:24:33 2022] GET /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718/detail => generated 463 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:35.212813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:35.213841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:35.231743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.233161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.238844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.240873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.241916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.242625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.469813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:35.470424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:35.481896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.482783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.483412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:35.484784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.485552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.486014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.486432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.495939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f467932b-72e1-48d5-acc9-5b0807541161 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1469 microversion: 2.1 time: 0.287659 Aug 30 03:24:35.497449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 157/312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:35 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:35.523873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:35.527345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:35.536678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:35.539055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.540147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.541005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.542319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.543064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.543640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.655586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:35.666132 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bedf97b1-48d8-4d28-96d6-a5990500baef tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.201698 Aug 30 03:24:35.681835 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 156/313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:35 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:35.687200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Action: 'update', calling method: .version_select at 0x7f898024a1f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:35.745319 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a4fddf7-9173-4fb5-99e8-39f8abe1dfed tempest-DeleteServersAdminTestJSON-351228912 tempest-DeleteServersAdminTestJSON-351228912-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52/action" status: 202 len: 0 microversion: 2.1 time: 0.229697 Aug 30 03:24:35.745980 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 158/314] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:24:35 2022] POST /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:24:35.754797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:35.755698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:35.768519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.769424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.770802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.775708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.778663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.779272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.860355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:35.861632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:35.862088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:35.862572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lazy-loading 'fault' on Instance uuid 0b4a9775-2553-4f50-b30d-5da361bc5c52 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:24:36.218590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:36.236337 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0e77f6d-d15f-4969-aa7c-184a2700e2ec tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1452 microversion: 2.1 time: 0.484134 Aug 30 03:24:36.255794 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 159/315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:35 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1452 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:36.263448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:36.264868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:36.275063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.275854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.276830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.277940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.278764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.280119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.330673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:24:36.510511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a62f03b5-455b-462a-a621-bf167ac2f2dc tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 204 len: 0 microversion: 2.1 time: 0.252576 Aug 30 03:24:36.514765 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 160/316] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:24:36 2022] DELETE /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:24:36.520208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:36.525017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:36.534186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.534770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.535227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.535969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.536448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.536875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.578663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:36.616329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.617459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.618033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.618551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lazy-loading 'fault' on Instance uuid 0b4a9775-2553-4f50-b30d-5da361bc5c52 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:24:36.634159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.635773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.639479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.643922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.644402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.644820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.690838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.692013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.692594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.693513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.694278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.694832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.801463 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-66a5a46d-4c3f-413c-ae07-e58ab31b0e91 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718?user_id=49c1725c23e94d269d227b5adde0a68c" status: 200 len: 148 microversion: 2.57 time: 1.126538 Aug 30 03:24:36.807277 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 157/317] 10.222.0.30 () {62 vars in 1384 bytes} [Tue Aug 30 03:24:35 2022] PUT /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718?user_id=49c1725c23e94d269d227b5adde0a68c => generated 148 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:36.819221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:36.822197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:36.834307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.834795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.835279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:36.836427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:36.836867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:36.837510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:37.308951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:37.323431 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98aefdab-e592-4513-9a1b-2389fe97a11b tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.513693 Aug 30 03:24:37.324016 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 158/318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:36 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:37.337839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-44d5f81b-233c-427c-a110-5de129180b12 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] Calling method '.version_select at 0x7f89801caca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:37.367482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:37.378828 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75a8d76e-f74e-4635-8b35-12a8c1ff4602 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1458 microversion: 2.1 time: 0.860465 Aug 30 03:24:37.389888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 161/319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:36 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1458 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:38.183880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=49 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:38.216350 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-44d5f81b-233c-427c-a110-5de129180b12 tempest-QuotasAdminTestV257-281945031 tempest-QuotasAdminTestV257-281945031-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718?user_id=49c1725c23e94d269d227b5adde0a68c" status: 200 len: 190 microversion: 2.57 time: 0.890825 Aug 30 03:24:38.218078 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 159/320] 10.222.0.30 () {60 vars in 1364 bytes} [Tue Aug 30 03:24:37 2022] GET /compute/v2.1/os-quota-sets/79c96ba6f8804f74a3082d3dd34d4718?user_id=49c1725c23e94d269d227b5adde0a68c => generated 190 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:38.345371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:38.345999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:38.356265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:38.357037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:38.357749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:38.358650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:38.359258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:38.360038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:38.405131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:38.405901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:38.412837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:38.413120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:38.416388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:38.417126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:38.417634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:38.418100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:38.496614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:38.499660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:38.500372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:38.501890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lazy-loading 'fault' on Instance uuid 0b4a9775-2553-4f50-b30d-5da361bc5c52 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:24:38.561978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:38.571178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba40a6d9-25f3-4fae-b0a7-548ec4e5fce3 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1322 microversion: 2.1 time: 0.230894 Aug 30 03:24:38.594483 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 162/321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:38 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:39.016817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badc8bf36b3e4fb794c07c8c487d8007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bc04aff43d4a2c9eef1712856befba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:39.025987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a95de230-bd63-4c1a-80ea-9d3018ab170a tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 200 len: 1458 microversion: 2.1 time: 0.624705 Aug 30 03:24:39.041604 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 160/322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:38 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 1458 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:39.160808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Calling method '.version_select at 0x7f898017f430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:39.163064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:39.163885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:39.164645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:39.199518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:39.200023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:39.200467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:39.234021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:39.237084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:39.237903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:39.262752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9601a96-e223-481b-a65b-6738f5dbb52a tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.637847 Aug 30 03:24:39.266828 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 163/323] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:40.248436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ab2a765-3810-4ff8-bd24-6c19b60d1295 tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Calling method '.version_select at 0x7f89800e7dc0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.253218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9ab2a765-3810-4ff8-bd24-6c19b60d1295 tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '6ba8d945ae8b4cd3885eee0a5335a2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477f7fe8d1004073aacb8a3b4e8de7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ab2a765-3810-4ff8-bd24-6c19b60d1295 tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Request method failure captured: Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hypervisors/n-h2-854924-5/search HTTP/1.1 Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYL0nlNcWEBOxyXmMSb1YbTmK-uYRPxX9555E-RMb2AT7BOE7dEjWi_bTR9l5sWgcSqo7wmr6UqqwGETLFrOn3M56nQ1S0-JOptpMS-eQEzmw3SAJW55CCn8ZVxoiuEU1IKURWHVtocGGO-gHixRsyxdgvkm5gGN1p58gKIVyK5bwWk Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 477f7fe8d1004073aacb8a3b4e8de7fb Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-523676253 Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:40.261481 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/477f7fe8d1004073aacb8a3b4e8de7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/477f7fe8d1004073aacb8a3b4e8de7fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_477f7fe8d1004073aacb8a3b4e8de7fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/477f7fe8d1004073aacb8a3b4e8de7fb"}]}] Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-523676253 Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 477f7fe8d1004073aacb8a3b4e8de7fb Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-523676253 Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-523676253-project Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 6ba8d945ae8b4cd3885eee0a5335a2d9 Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-523676253-project Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 03:24:40.262790 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'n-h2-854924-5'} Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:40.263473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 03:24:40.264602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.270075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ab2a765-3810-4ff8-bd24-6c19b60d1295 tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:40.280001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Calling method '.version_select at 0x7f8980255430>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.285434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.286150 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ab2a765-3810-4ff8-bd24-6c19b60d1295 tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h2-854924-5/search" status: 403 len: 117 microversion: 2.1 time: 0.996644 Aug 30 03:24:40.291202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.299498 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 164/324] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Aug 30 03:24:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-854924-5/search => generated 117 bytes in 1026 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:24:40.302079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.309962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.311709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:40.325113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.325830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.326291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.327866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.329033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.329518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.366841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.368934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.371575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.397604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.402622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.403396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.428238 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40ce6e9c-e10c-4d8d-8387-3e3a41a7b367 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1424 microversion: 2.41 time: 1.173536 Aug 30 03:24:40.431780 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 161/325] 10.222.0.30 () {60 vars in 1208 bytes} [Tue Aug 30 03:24:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1424 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:40.442293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-afd7a937-5513-4701-8bb7-c2bc4599a988 req-127c0ccb-213e-4e42-b006-7baf06b32fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b4a9775-2553-4f50-b30d-5da361bc5c52", "name": "network-vif-deleted", "tag": "1b0b0379-e367-49f4-9f6a-55f973de6014"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:40.471578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-afd7a937-5513-4701-8bb7-c2bc4599a988 req-127c0ccb-213e-4e42-b006-7baf06b32fb3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.475485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-afd7a937-5513-4701-8bb7-c2bc4599a988 req-127c0ccb-213e-4e42-b006-7baf06b32fb3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.476179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-afd7a937-5513-4701-8bb7-c2bc4599a988 req-127c0ccb-213e-4e42-b006-7baf06b32fb3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.501606 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-afd7a937-5513-4701-8bb7-c2bc4599a988 req-127c0ccb-213e-4e42-b006-7baf06b32fb3 service nova] Creating event network-vif-deleted:1b0b0379-e367-49f4-9f6a-55f973de6014 for instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 on n-h2-854924-5 Aug 30 03:24:40.515971 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-afd7a937-5513-4701-8bb7-c2bc4599a988 req-127c0ccb-213e-4e42-b006-7baf06b32fb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081898 Aug 30 03:24:40.522414 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 162/326] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:40.688032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9fa6b08f-d3b2-49b0-9a49-d62dd340baa5 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.688032 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9fa6b08f-d3b2-49b0-9a49-d62dd340baa5 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9fa6b08f-d3b2-49b0-9a49-d62dd340baa5 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin] Request method failure captured: Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL33YaR2WA7CSZe07_a5-70ULTridpf3RGeVLbazcmPPVlo6nHCgo6Ta_IPAvUEBIf7jEsUfBpCoYsTdfEu2bIbtV41GEWtCai1y6rI8ahisuPuzwOw-5TOdwW-JPlEHDllk4HgtZj74_-_phTi_bD0yIcjK-erKPKnrJB7h5A4eRo Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 14259ded31d24d8e9ebcdf7ebfd74760 Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:40.693687 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/14259ded31d24d8e9ebcdf7ebfd74760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/14259ded31d24d8e9ebcdf7ebfd74760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_14259ded31d24d8e9ebcdf7ebfd74760", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/14259ded31d24d8e9ebcdf7ebfd74760"}]}] Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 14259ded31d24d8e9ebcdf7ebfd74760 Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b2acecec2e614351a31f391f3e1fd264 Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:40.695840 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid timestamp for date invalid_time Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'invalid_time'} Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:40.696683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.698057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9fa6b08f-d3b2-49b0-9a49-d62dd340baa5 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:40.700645 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9fa6b08f-d3b2-49b0-9a49-d62dd340baa5 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411 tempest-InstanceUsageAuditLogNegativeTestJSON-1619849411-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.174073 Aug 30 03:24:40.701134 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 163/327] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Aug 30 03:24:40 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:24:40.714214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.715367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:40.724032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.730745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.731554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.733818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.735389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.736600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.753988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] HTTP exception thrown: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Request method failure captured: Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 HTTP/1.1 Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK40M1zayntdQFJM--Jil05UH6yXf_ofidphSRbfFHXiTpFEFfl87fBPDR0MkKbgghfvBw6kxWiJ85f0saF178LO5gQ73dmUF2RvPgteHekyyw9CCdXhnWPTD-x5WkbJSZNHC4cSZ_cAiwvuM-wEf1w-A__XxrPnwJfBs1bO_7oFpo Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:40.755908 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46bc04aff43d4a2c9eef1712856befba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}] Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: badc8bf36b3e4fb794c07c8c487d8007 Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.757096 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0b4a9775-2553-4f50-b30d-5da361bc5c52'} Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:40.758858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.761054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.766480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Returning 404 to user: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:40.767309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72ee04ef-42ef-4623-a81b-ade7c6780454 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 404 len: 111 microversion: 2.1 time: 0.064417 Aug 30 03:24:40.768045 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 164/328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:40 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:40.772630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Calling method '.version_select at 0x7f89801ea310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.774525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.775706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.776402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.784073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:40.784404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Request method failure captured: Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL2KpdfPf3LMYcoojHPVq95A4T85bHJGyIy-Em_zPcyB5shESpcUz6hQ4-tJYa0yJRKuHxA9idNixJUDA5mruOja__zDPRDJ6bm_06wVtWmViconWRzEpplTS7tXqCaVB8G4Rp2_3nxzvnWNw5G50jaCImZBk8pYDg987cB3Ks-KtI Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b2d99e1729424cbb80b841a3ba096dae Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-472554461 Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:40.786936 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2d99e1729424cbb80b841a3ba096dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2d99e1729424cbb80b841a3ba096dae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2d99e1729424cbb80b841a3ba096dae", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2d99e1729424cbb80b841a3ba096dae"}]}] Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-472554461 Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b2d99e1729424cbb80b841a3ba096dae Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-472554461 Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a94310d204ba401d82ddc13df890c6c0 Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 03:24:40.788469 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.789303 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.790807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.790807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:40.790807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:40.790807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 03:24:40.790807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.792178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:40.793637 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af068950-e0da-4d7c-b3e2-53004f651135 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024484 Aug 30 03:24:40.794357 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4c8f66ac-18c8-40ff-b772-6ff23e774a25 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.493232 Aug 30 03:24:40.795496 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 165/329] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 03:24:40 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:40.799924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 165/330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:40 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:40.802213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3ad4871-5502-40de-a7af-36eaa197bd9b tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1052625307"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:40.807213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.aggregate [None req-a3ad4871-5502-40de-a7af-36eaa197bd9b tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Generated uuid 739ce90a-0d44-44be-809b-7234c678924b for aggregate {{(pid=122168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 03:24:40.817243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:40.843832 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3ad4871-5502-40de-a7af-36eaa197bd9b tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.046443 Aug 30 03:24:40.844959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 166/331] 10.222.0.30 () {62 vars in 1205 bytes} [Tue Aug 30 03:24:40 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:40.860558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.861687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:40.875319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.876088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.876539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.880111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.880111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.880111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.917309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] HTTP exception thrown: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Request method failure captured: Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 HTTP/1.1 Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK40M1zayntdQFJM--Jil05UH6yXf_ofidphSRbfFHXiTpFEFfl87fBPDR0MkKbgghfvBw6kxWiJ85f0saF178LO5gQ73dmUF2RvPgteHekyyw9CCdXhnWPTD-x5WkbJSZNHC4cSZ_cAiwvuM-wEf1w-A__XxrPnwJfBs1bO_7oFpo Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:40.922169 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46bc04aff43d4a2c9eef1712856befba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}] Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: badc8bf36b3e4fb794c07c8c487d8007 Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.923409 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0b4a9775-2553-4f50-b30d-5da361bc5c52'} Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:40.924103 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:40.925180 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:40.926392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Returning 404 to user: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:40.926392 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-014b138d-8d28-4a5c-a174-b1feaf9fcbee tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 404 len: 111 microversion: 2.1 time: 0.077749 Aug 30 03:24:40.943844 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 167/332] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:24:40 2022] DELETE /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:40.954544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Calling method '.version_select at 0x7f8980262b80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:40.958012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.958392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.958831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:40.995717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:40.996216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:40.996655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.024283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab2ab22f-4cbe-4fd5-bc6e-1b310c61c10f tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.026938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab2ab22f-4cbe-4fd5-bc6e-1b310c61c10f tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '7f7f84bb76074141848d5c74a82622cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef67fdae026e4283b05be01d884fa311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:41.028566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab2ab22f-4cbe-4fd5-bc6e-1b310c61c10f tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Request method failure captured: Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYL0k8WpwMPIYmAwqg4CFvBQOIjGRn9Jp6j_y0BWXImXcCDoB_iYPiY9rS7LaS1EJ-T4z3i2Z9fSdP1qgkgqXSULR5Dzdd664_WHbb3-2ojhsAYIVzr5OPgGat2rhGzlazmVPCJG2yx6Mcdesx6wTNiJPHqc8e9fGBtsGZvRQ3AsQKY Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ef67fdae026e4283b05be01d884fa311 Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:41.029121 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef67fdae026e4283b05be01d884fa311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef67fdae026e4283b05be01d884fa311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef67fdae026e4283b05be01d884fa311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef67fdae026e4283b05be01d884fa311"}]}] Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ef67fdae026e4283b05be01d884fa311 Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f7f84bb76074141848d5c74a82622cd Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project Aug 30 03:24:41.030616 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:41.031347 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 03:24:41.032634 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.033763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.033763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.037405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab2ab22f-4cbe-4fd5-bc6e-1b310c61c10f tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.038363 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8d804a1-5a44-45ba-83ee-ff4e5a8d422b tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092639 Aug 30 03:24:41.039798 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab2ab22f-4cbe-4fd5-bc6e-1b310c61c10f tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.238494 Aug 30 03:24:41.040919 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 166/333] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:24:40 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.046735 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:41.052853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.053875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 0b4a9775-2553-4f50-b30d-5da361bc5c52] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:41.062078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.062600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.063148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.064277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.064759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.065297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.073665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a6c50d2-c254-4d8b-8166-dfc98277f9df tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1254124552"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:41.100308 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] HTTP exception thrown: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Request method failure captured: Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 HTTP/1.1 Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK40M1zayntdQFJM--Jil05UH6yXf_ofidphSRbfFHXiTpFEFfl87fBPDR0MkKbgghfvBw6kxWiJ85f0saF178LO5gQ73dmUF2RvPgteHekyyw9CCdXhnWPTD-x5WkbJSZNHC4cSZ_cAiwvuM-wEf1w-A__XxrPnwJfBs1bO_7oFpo Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:41.103981 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46bc04aff43d4a2c9eef1712856befba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}] Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: badc8bf36b3e4fb794c07c8c487d8007 Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:41.105435 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0b4a9775-2553-4f50-b30d-5da361bc5c52'} Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.106118 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. Aug 30 03:24:41.107369 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.110636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Returning 404 to user: Instance 0b4a9775-2553-4f50-b30d-5da361bc5c52 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.111798 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a6afb76-b6c6-43d2-8083-90b1557d8294 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52" status: 404 len: 111 microversion: 2.1 time: 0.063729 Aug 30 03:24:41.116548 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 169/335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/servers/0b4a9775-2553-4f50-b30d-5da361bc5c52 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.130064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f1b5158-01ff-4527-98d8-2240472f94fb tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.133836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f1b5158-01ff-4527-98d8-2240472f94fb tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '7f7f84bb76074141848d5c74a82622cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef67fdae026e4283b05be01d884fa311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f1b5158-01ff-4527-98d8-2240472f94fb tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Request method failure captured: Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2003:24:41 HTTP/1.1 Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL0k8WpwMPIYmAwqg4CFvBQOIjGRn9Jp6j_y0BWXImXcCDoB_iYPiY9rS7LaS1EJ-T4z3i2Z9fSdP1qgkgqXSULR5Dzdd664_WHbb3-2ojhsAYIVzr5OPgGat2rhGzlazmVPCJG2yx6Mcdesx6wTNiJPHqc8e9fGBtsGZvRQ3AsQKY Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ef67fdae026e4283b05be01d884fa311 Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:41.136345 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef67fdae026e4283b05be01d884fa311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef67fdae026e4283b05be01d884fa311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef67fdae026e4283b05be01d884fa311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef67fdae026e4283b05be01d884fa311"}]}] Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ef67fdae026e4283b05be01d884fa311 Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f7f84bb76074141848d5c74a82622cd Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project Aug 30 03:24:41.138034 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2022-08-30 03:24:41'} Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:41.138689 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 03:24:41.139778 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.143880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f1b5158-01ff-4527-98d8-2240472f94fb tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.145787 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f1b5158-01ff-4527-98d8-2240472f94fb tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445 tempest-InstanceUsageAuditLogNegativeTestJSON-1626929445-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 03:24:41" status: 403 len: 128 microversion: 2.1 time: 0.026192 Aug 30 03:24:41.145787 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 170/336] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2003%3A24%3A41 => generated 128 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.151540 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a6c50d2-c254-4d8b-8166-dfc98277f9df tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.109073 Aug 30 03:24:41.152936 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 167/337] 10.222.0.30 () {62 vars in 1213 bytes} [Tue Aug 30 03:24:41 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:41.154988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70e4aee9-f693-4835-bcef-2e3dd507c63e tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Calling method '.version_select at 0x7f89801ea700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.157280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70e4aee9-f693-4835-bcef-2e3dd507c63e tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '6ba8d945ae8b4cd3885eee0a5335a2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477f7fe8d1004073aacb8a3b4e8de7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:41.158917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.159749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70e4aee9-f693-4835-bcef-2e3dd507c63e tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Request method failure captured: Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL0nlNcWEBOxyXmMSb1YbTmK-uYRPxX9555E-RMb2AT7BOE7dEjWi_bTR9l5sWgcSqo7wmr6UqqwGETLFrOn3M56nQ1S0-JOptpMS-eQEzmw3SAJW55CCn8ZVxoiuEU1IKURWHVtocGGO-gHixRsyxdgvkm5gGN1p58gKIVyK5bwWk Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 477f7fe8d1004073aacb8a3b4e8de7fb Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-523676253 Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:41.160038 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/477f7fe8d1004073aacb8a3b4e8de7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/477f7fe8d1004073aacb8a3b4e8de7fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_477f7fe8d1004073aacb8a3b4e8de7fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/477f7fe8d1004073aacb8a3b4e8de7fb"}]}] Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-523676253 Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 477f7fe8d1004073aacb8a3b4e8de7fb Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-523676253 Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-523676253-project Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 6ba8d945ae8b4cd3885eee0a5335a2d9 Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-523676253-project Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 03:24:41.161333 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1'} Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:41.162052 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 03:24:41.163233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.165991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70e4aee9-f693-4835-bcef-2e3dd507c63e tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.165991 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70e4aee9-f693-4835-bcef-2e3dd507c63e tempest-HypervisorAdminNegativeUnderV252Test-523676253 tempest-HypervisorAdminNegativeUnderV252Test-523676253-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.012230 Aug 30 03:24:41.170493 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 171/338] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.177688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.178198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.178784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.180254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.180766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.181194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.189801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4bdb1a21-bdc9-4db4-a61a-68061a60465d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.199103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] HTTP exception thrown: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.201930 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4bdb1a21-bdc9-4db4-a61a-68061a60465d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.029529 Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Request method failure captured: Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 HTTP/1.1 Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYK40M1zayntdQFJM--Jil05UH6yXf_ofidphSRbfFHXiTpFEFfl87fBPDR0MkKbgghfvBw6kxWiJ85f0saF178LO5gQ73dmUF2RvPgteHekyyw9CCdXhnWPTD-x5WkbJSZNHC4cSZ_cAiwvuM-wEf1w-A__XxrPnwJfBs1bO_7oFpo Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:41.202066 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46bc04aff43d4a2c9eef1712856befba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}] Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: badc8bf36b3e4fb794c07c8c487d8007 Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.203276 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2'} Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.204463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.205764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.207132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Returning 404 to user: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.207132 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a7d6710-c3af-48df-9ce0-1e93d6b21221 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "DELETE /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 404 len: 111 microversion: 2.1 time: 0.049520 Aug 30 03:24:41.208427 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 168/339] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:24:41 2022] DELETE /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.209043 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 172/340] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:41.213515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Calling method '.version_select at 0x7f8980131d30>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.214614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.215263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.215809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.216027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] [instance: 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:41.216249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.224737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.225803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.226968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.228273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.229094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.229879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.250291 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] HTTP exception thrown: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.251989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] HTTP exception thrown: No hypervisor matching 'cf05bdd4-5fd2-4ef1-9531-268318555e1f' could be found. Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Request method failure captured: Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 HTTP/1.1 Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYK40M1zayntdQFJM--Jil05UH6yXf_ofidphSRbfFHXiTpFEFfl87fBPDR0MkKbgghfvBw6kxWiJ85f0saF178LO5gQ73dmUF2RvPgteHekyyw9CCdXhnWPTD-x5WkbJSZNHC4cSZ_cAiwvuM-wEf1w-A__XxrPnwJfBs1bO_7oFpo Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:41.254797 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46bc04aff43d4a2c9eef1712856befba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46bc04aff43d4a2c9eef1712856befba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46bc04aff43d4a2c9eef1712856befba"}]}] Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 46bc04aff43d4a2c9eef1712856befba Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-284580140 Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: badc8bf36b3e4fb794c07c8c487d8007 Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersAdminTestJSON-284580140-project Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.256035 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2'} Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.256710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. Aug 30 03:24:41.258279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Request method failure captured: Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hypervisors/cf05bdd4-5fd2-4ef1-9531-268318555e1f/servers HTTP/1.1 Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYL2KpdfPf3LMYcoojHPVq95A4T85bHJGyIy-Em_zPcyB5shESpcUz6hQ4-tJYa0yJRKuHxA9idNixJUDA5mruOja__zDPRDJ6bm_06wVtWmViconWRzEpplTS7tXqCaVB8G4Rp2_3nxzvnWNw5G50jaCImZBk8pYDg987cB3Ks-KtI Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b2d99e1729424cbb80b841a3ba096dae Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-472554461 Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:41.259258 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2d99e1729424cbb80b841a3ba096dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2d99e1729424cbb80b841a3ba096dae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2d99e1729424cbb80b841a3ba096dae", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2d99e1729424cbb80b841a3ba096dae"}]}] Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-472554461 Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b2d99e1729424cbb80b841a3ba096dae Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-472554461 Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a94310d204ba401d82ddc13df890c6c0 Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: exception: No hypervisor matching 'cf05bdd4-5fd2-4ef1-9531-268318555e1f' could be found. Aug 30 03:24:41.260399 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'cf05bdd4-5fd2-4ef1-9531-268318555e1f'} Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'cf05bdd4-5fd2-4ef1-9531-268318555e1f' could be found. Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.261092 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'cf05bdd4-5fd2-4ef1-9531-268318555e1f' could be found. Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] Returning 404 to user: No hypervisor matching 'cf05bdd4-5fd2-4ef1-9531-268318555e1f' could be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.262285 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3cf8c86f-0f43-43f6-9100-deb93bda6891 tempest-HypervisorAdminNegativeUnderV252Test-472554461 tempest-HypervisorAdminNegativeUnderV252Test-472554461-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/cf05bdd4-5fd2-4ef1-9531-268318555e1f/servers" status: 404 len: 123 microversion: 2.1 time: 0.048529 Aug 30 03:24:41.265125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] Returning 404 to user: Instance 27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:41.266464 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9bdd956e-4628-4a72-bb25-3cd56f1644e8 tempest-DeleteServersAdminTestJSON-284580140 tempest-DeleteServersAdminTestJSON-284580140-project] 10.222.0.30 "GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2" status: 404 len: 111 microversion: 2.1 time: 0.056033 Aug 30 03:24:41.267405 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 169/341] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/os-hypervisors/cf05bdd4-5fd2-4ef1-9531-268318555e1f/servers => generated 123 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.267798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 173/342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/servers/27474d5d-bd2c-41a0-9a59-b2dcd0ed80d2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:41.274884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b72ef807-db60-417b-9cc2-029b7792774d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:41.286571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72ef807-db60-417b-9cc2-029b7792774d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.288251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72ef807-db60-417b-9cc2-029b7792774d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.289591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72ef807-db60-417b-9cc2-029b7792774d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.546852 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b72ef807-db60-417b-9cc2-029b7792774d tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.277278 Aug 30 03:24:41.548542 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 174/343] 10.222.0.30 () {62 vars in 1235 bytes} [Tue Aug 30 03:24:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:41.564652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-100b9ed3-df44-4cbf-aa8f-b33a59525837 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:41.601116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-100b9ed3-df44-4cbf-aa8f-b33a59525837 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.601949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-100b9ed3-df44-4cbf-aa8f-b33a59525837 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.615431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-100b9ed3-df44-4cbf-aa8f-b33a59525837 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.827813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:41.829397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:41.861692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.876090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.887578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.888897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:41.889848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:41.890841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:41.903971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-100b9ed3-df44-4cbf-aa8f-b33a59525837 tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.345917 Aug 30 03:24:41.919707 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 170/344] 10.222.0.30 () {62 vars in 1235 bytes} [Tue Aug 30 03:24:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:41.947729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3e669f7-bb60-4bbe-999c-b296cbd4939f tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:42.074792 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a3e669f7-bb60-4bbe-999c-b296cbd4939f tempest-AggregatesAdminTestV241-652865230 tempest-AggregatesAdminTestV241-652865230-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.139868 Aug 30 03:24:42.075874 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 171/345] 10.222.0.30 () {60 vars in 1196 bytes} [Tue Aug 30 03:24:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:42.779463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:42.797617 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63798231-6933-4110-b714-9bb9caa973ae tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.976395 Aug 30 03:24:42.804361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 175/346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:41 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:43.207216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b42df982-dbf4-486c-ab32-4b9f18d2ddb9 req-8148f898-5b48-4819-a02f-4c9189990c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add6aa5a-222e-4a38-9ce7-2903c6125cb7", "tag": "e5688b05-f297-4558-bc27-72bf3ffe4faf"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:43.230610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b42df982-dbf4-486c-ab32-4b9f18d2ddb9 req-8148f898-5b48-4819-a02f-4c9189990c68 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:43.230897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b42df982-dbf4-486c-ab32-4b9f18d2ddb9 req-8148f898-5b48-4819-a02f-4c9189990c68 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:43.231626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b42df982-dbf4-486c-ab32-4b9f18d2ddb9 req-8148f898-5b48-4819-a02f-4c9189990c68 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:43.254900 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b42df982-dbf4-486c-ab32-4b9f18d2ddb9 req-8148f898-5b48-4819-a02f-4c9189990c68 service nova] Creating event network-changed:e5688b05-f297-4558-bc27-72bf3ffe4faf for instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 on n-h1-854924-5 Aug 30 03:24:43.268295 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b42df982-dbf4-486c-ab32-4b9f18d2ddb9 req-8148f898-5b48-4819-a02f-4c9189990c68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066925 Aug 30 03:24:43.270870 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 172/347] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:43.826195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:43.826750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:43.834960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:43.835980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:43.836422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:43.837123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:43.842113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:43.842898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:44.269664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:44.303292 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2d5a4daf-c90c-4571-93cc-7b0b71af60bc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.480573 Aug 30 03:24:44.317906 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 176/348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:43 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:45.332135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:45.339566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:45.364303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:45.364303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:45.364303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:45.364303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:45.364980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:45.364980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:45.737928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:45.759918 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34801f63-dd88-465b-a3ab-ce7b5fbf4300 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.435585 Aug 30 03:24:45.773819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 173/349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:45 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:46.795777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:46.797231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:46.808480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=17 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:46.819804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:46.820814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:46.821229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:46.821998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:46.822457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:46.822886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:47.136248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:47.146719 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40b3b399-6329-4abb-b979-543dd85d0f6a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.355140 Aug 30 03:24:47.147914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 177/350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:46 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:47.428005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38c39100-b232-4a48-9a2a-74baf530e5b2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Action: 'create', calling method: .version_select at 0x7f898008a280>, body: {"keypair": {"name": "tempest-keypair-1224794241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNozSqitUNPMCQl5kbwmw7cpJwUzMlp3Odld2DUlVA0GoA5ZKo3ap3/MOTk45EqL2Zro9nwkeX8iboD6teWEOGjRJc9fJIzU2BMoIDcCy8d1mYZfxTsj2Prd1mLlePe/Kg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:47.490952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-38c39100-b232-4a48-9a2a-74baf530e5b2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Getting quotas for project 396e07d9190a4041a7d808113bb6b1cf. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:47.500734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-38c39100-b232-4a48-9a2a-74baf530e5b2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Getting quotas for user da45da7c2ce14c85b818eb0b9b3e5da9 and project 396e07d9190a4041a7d808113bb6b1cf. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:47.536564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38c39100-b232-4a48-9a2a-74baf530e5b2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.728529 Aug 30 03:24:47.537190 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 174/351] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:24:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:48.177229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:48.178390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:48.191611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:48.192105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:48.192792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:48.193599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:48.194700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:48.195515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:48.211704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:48.438237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:48.451639 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3327ba59-77c9-42cf-9bee-435bf5666926 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.278705 Aug 30 03:24:48.455305 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 175/352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:48 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:48.602638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9d248df-6391-4f89-ad88-606c22756e33 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Calling method '.version_select at 0x7f89801faee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:48.604906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9d248df-6391-4f89-ad88-606c22756e33 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c44a774276c7446ebc5f4f7e25f9f5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b0cf8649b04c768b5f031091e7ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9d248df-6391-4f89-ad88-606c22756e33 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Request method failure captured: Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL7V0EwfSibQigMo2aKea9N85od0aFmrG-WgoptirMp15wiq8eWrsvxbjQfq8cPz9-2zL487g9siGCSB7Fv9W1J1hhKcf5hm3ol54gf4HH6gZO9AcFjf07esj9VwmC4n3_A9yguG3nygf8sE_wV-gkntTO7UFnDx4_f_P28PnHMVpo Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:48.608212 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78b0cf8649b04c768b5f031091e7ec44", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}] Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c44a774276c7446ebc5f4f7e25f9f5a9 Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: action_args: {} Aug 30 03:24:48.609470 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:48.610266 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 03:24:48.611435 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.612599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9d248df-6391-4f89-ad88-606c22756e33 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:48.612599 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9d248df-6391-4f89-ad88-606c22756e33 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.538482 Aug 30 03:24:48.617683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 178/353] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:24:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 546 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:48.621715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67eddaf7-ef3c-43f9-8ea3-c6d063acb8bf tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Calling method '.version_select at 0x7f8980092670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:48.625196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67eddaf7-ef3c-43f9-8ea3-c6d063acb8bf tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c44a774276c7446ebc5f4f7e25f9f5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b0cf8649b04c768b5f031091e7ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67eddaf7-ef3c-43f9-8ea3-c6d063acb8bf tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Request method failure captured: Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYL7V0EwfSibQigMo2aKea9N85od0aFmrG-WgoptirMp15wiq8eWrsvxbjQfq8cPz9-2zL487g9siGCSB7Fv9W1J1hhKcf5hm3ol54gf4HH6gZO9AcFjf07esj9VwmC4n3_A9yguG3nygf8sE_wV-gkntTO7UFnDx4_f_P28PnHMVpo Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:48.627238 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78b0cf8649b04c768b5f031091e7ec44", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}] Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c44a774276c7446ebc5f4f7e25f9f5a9 Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:24:48.628451 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:48.629217 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 03:24:48.630298 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.633647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67eddaf7-ef3c-43f9-8ea3-c6d063acb8bf tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:48.635454 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67eddaf7-ef3c-43f9-8ea3-c6d063acb8bf tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.018164 Aug 30 03:24:48.640778 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 176/354] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:48 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:24:48.645993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c094aad-1702-4040-af27-bf8beb3b0819 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Calling method '.version_select at 0x7f8980278dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:48.648761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c094aad-1702-4040-af27-bf8beb3b0819 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c44a774276c7446ebc5f4f7e25f9f5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b0cf8649b04c768b5f031091e7ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c094aad-1702-4040-af27-bf8beb3b0819 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Request method failure captured: Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL7V0EwfSibQigMo2aKea9N85od0aFmrG-WgoptirMp15wiq8eWrsvxbjQfq8cPz9-2zL487g9siGCSB7Fv9W1J1hhKcf5hm3ol54gf4HH6gZO9AcFjf07esj9VwmC4n3_A9yguG3nygf8sE_wV-gkntTO7UFnDx4_f_P28PnHMVpo Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:48.650335 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78b0cf8649b04c768b5f031091e7ec44", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}] Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c44a774276c7446ebc5f4f7e25f9f5a9 Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: action_args: {} Aug 30 03:24:48.651576 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:48.652300 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 03:24:48.653376 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:48.658750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c094aad-1702-4040-af27-bf8beb3b0819 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:48.660390 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c094aad-1702-4040-af27-bf8beb3b0819 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018465 Aug 30 03:24:48.661089 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 179/355] 10.222.0.30 () {58 vars in 1179 bytes} [Tue Aug 30 03:24:48 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:24:49.036334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Calling method '.version_select at 0x7f89800a0f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.038137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.039131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.039495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.094924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.095427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.102243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.124302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.124940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.125483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.136576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-006580e6-3bb7-41bd-92ef-d6b9a65efe82 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.470140 Aug 30 03:24:49.140621 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 177/356] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:49.155889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-127a0e79-764a-47b4-84d5-f0bc48ad9dba tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Calling method '.version_select at 0x7f89801ea820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.157835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-127a0e79-764a-47b4-84d5-f0bc48ad9dba tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c44a774276c7446ebc5f4f7e25f9f5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b0cf8649b04c768b5f031091e7ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-127a0e79-764a-47b4-84d5-f0bc48ad9dba tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Request method failure captured: Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL7V0EwfSibQigMo2aKea9N85od0aFmrG-WgoptirMp15wiq8eWrsvxbjQfq8cPz9-2zL487g9siGCSB7Fv9W1J1hhKcf5hm3ol54gf4HH6gZO9AcFjf07esj9VwmC4n3_A9yguG3nygf8sE_wV-gkntTO7UFnDx4_f_P28PnHMVpo Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:24:49.161755 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78b0cf8649b04c768b5f031091e7ec44", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}] Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c44a774276c7446ebc5f4f7e25f9f5a9 Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1'} Aug 30 03:24:49.163320 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:49.164272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 03:24:49.165986 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.167032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-127a0e79-764a-47b4-84d5-f0bc48ad9dba tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:49.167032 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-127a0e79-764a-47b4-84d5-f0bc48ad9dba tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.016551 Aug 30 03:24:49.167032 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 180/357] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Aug 30 03:24:49 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:49.175394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a4a10da-64dd-4563-9281-dc446c5239c5 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Calling method '.version_select at 0x7f8980092670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.178095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9a4a10da-64dd-4563-9281-dc446c5239c5 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] HTTP exception thrown: Hypervisor with ID '85583faf-ce20-4978-8b9c-28f410de1194' could not be found. Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a4a10da-64dd-4563-9281-dc446c5239c5 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Request method failure captured: Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hypervisors/85583faf-ce20-4978-8b9c-28f410de1194/uptime HTTP/1.1 Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYL_Pq8vTRuY1njEJqu8I9fu4IS13XgeHZoBUwOI-LIHR5iKGq8-bOdyEH4ODESxi59OF8QnBQRFN-KHPsK8I2KmLvSzXIbXpGlGkek_WinLK75eKPIxzkgNv7QVKhC0lbKMhgtuDviTo8EbxVofbdDuRZh6I4FTUDWlsBQ3D9CxFTA Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 03c6cc776bf0420abe142c128ea6768d Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1832522616 Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:24:49.195444 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/03c6cc776bf0420abe142c128ea6768d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/03c6cc776bf0420abe142c128ea6768d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_03c6cc776bf0420abe142c128ea6768d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/03c6cc776bf0420abe142c128ea6768d"}]}] Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1832522616 Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 03c6cc776bf0420abe142c128ea6768d Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1832522616 Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: f5825353b40941289a4a2ee61f077d95 Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: exception: Hypervisor with ID '85583faf-ce20-4978-8b9c-28f410de1194' could not be found. Aug 30 03:24:49.196939 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '85583faf-ce20-4978-8b9c-28f410de1194'} Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '85583faf-ce20-4978-8b9c-28f410de1194' Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 03:24:49.198011 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '85583faf-ce20-4978-8b9c-28f410de1194' could not be found. Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.199479 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '85583faf-ce20-4978-8b9c-28f410de1194' could not be found. Aug 30 03:24:49.201154 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.204544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a4a10da-64dd-4563-9281-dc446c5239c5 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Returning 404 to user: Hypervisor with ID '85583faf-ce20-4978-8b9c-28f410de1194' could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:49.207138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a4a10da-64dd-4563-9281-dc446c5239c5 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/85583faf-ce20-4978-8b9c-28f410de1194/uptime" status: 404 len: 123 microversion: 2.1 time: 0.036657 Aug 30 03:24:49.213918 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 178/358] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 03:24:49 2022] GET /compute/v2.1/os-hypervisors/85583faf-ce20-4978-8b9c-28f410de1194/uptime => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:49.218808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Calling method '.version_select at 0x7f8980278280>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.221143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.221680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.222413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.230997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:49.256772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.257828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.258262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.270820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.271615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.272198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.279781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-870048aa-d379-466b-ad91-74eaac7f75eb tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065503 Aug 30 03:24:49.280613 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 181/359] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:24:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:24:49.292800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-737fb643-bdb9-4ee9-8927-73dd1b518488 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Calling method '.version_select at 0x7f89800a0ee0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.294983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-737fb643-bdb9-4ee9-8927-73dd1b518488 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c44a774276c7446ebc5f4f7e25f9f5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b0cf8649b04c768b5f031091e7ec44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-737fb643-bdb9-4ee9-8927-73dd1b518488 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Request method failure captured: Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYL7V0EwfSibQigMo2aKea9N85od0aFmrG-WgoptirMp15wiq8eWrsvxbjQfq8cPz9-2zL487g9siGCSB7Fv9W1J1hhKcf5hm3ol54gf4HH6gZO9AcFjf07esj9VwmC4n3_A9yguG3nygf8sE_wV-gkntTO7UFnDx4_f_P28PnHMVpo Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:24:49.297552 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78b0cf8649b04c768b5f031091e7ec44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78b0cf8649b04c768b5f031091e7ec44", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78b0cf8649b04c768b5f031091e7ec44"}]}] Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 78b0cf8649b04c768b5f031091e7ec44 Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-506414407 Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c44a774276c7446ebc5f4f7e25f9f5a9 Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-506414407-project Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '1'} Aug 30 03:24:49.298797 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:24:49.299610 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 03:24:49.300636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.306578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-737fb643-bdb9-4ee9-8927-73dd1b518488 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:49.308746 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-737fb643-bdb9-4ee9-8927-73dd1b518488 tempest-HypervisorAdminNegativeTestJSON-506414407 tempest-HypervisorAdminNegativeTestJSON-506414407-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020328 Aug 30 03:24:49.310819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 179/360] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:24:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:49.323577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b6d3291-6dbf-49e2-9f4c-03fd415d7b56 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Calling method '.version_select at 0x7f8980262ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.325765 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6b6d3291-6dbf-49e2-9f4c-03fd415d7b56 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] HTTP exception thrown: Hypervisor with ID '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff' could not be found. Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b6d3291-6dbf-49e2-9f4c-03fd415d7b56 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Request method failure captured: Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-hypervisors/230eb7ec-c723-4ecb-a2ab-25f18da6a4ff HTTP/1.1 Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL_Pq8vTRuY1njEJqu8I9fu4IS13XgeHZoBUwOI-LIHR5iKGq8-bOdyEH4ODESxi59OF8QnBQRFN-KHPsK8I2KmLvSzXIbXpGlGkek_WinLK75eKPIxzkgNv7QVKhC0lbKMhgtuDviTo8EbxVofbdDuRZh6I4FTUDWlsBQ3D9CxFTA Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 03c6cc776bf0420abe142c128ea6768d Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1832522616 Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:24:49.329796 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/03c6cc776bf0420abe142c128ea6768d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/03c6cc776bf0420abe142c128ea6768d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_03c6cc776bf0420abe142c128ea6768d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/03c6cc776bf0420abe142c128ea6768d"}]}] Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1832522616 Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 03c6cc776bf0420abe142c128ea6768d Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1832522616 Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: f5825353b40941289a4a2ee61f077d95 Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: exception: Hypervisor with ID '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff' could not be found. Aug 30 03:24:49.331279 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff'} Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff' Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 03:24:49.332078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:24:49.333397 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff' could not be found. Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff' could not be found. Aug 30 03:24:49.334680 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:24:49.337059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b6d3291-6dbf-49e2-9f4c-03fd415d7b56 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] Returning 404 to user: Hypervisor with ID '230eb7ec-c723-4ecb-a2ab-25f18da6a4ff' could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:24:49.338214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b6d3291-6dbf-49e2-9f4c-03fd415d7b56 tempest-HypervisorAdminNegativeTestJSON-1832522616 tempest-HypervisorAdminNegativeTestJSON-1832522616-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/230eb7ec-c723-4ecb-a2ab-25f18da6a4ff" status: 404 len: 123 microversion: 2.1 time: 0.019429 Aug 30 03:24:49.338776 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 182/361] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Aug 30 03:24:49 2022] GET /compute/v2.1/os-hypervisors/230eb7ec-c723-4ecb-a2ab-25f18da6a4ff => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:24:49.478533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:49.478533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:49.489404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.494291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.494845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.495674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:49.496692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:49.497268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:49.794653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:49.805996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69ec4605-5269-4fbc-b015-e562df0c1e8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.334443 Aug 30 03:24:49.824193 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 180/362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:49 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:50.469151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1114983185", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "95cfe89c-40ac-4527-96d6-a25cae46f5e7"}], "security_groups": [{"name": "tempest-securitygroup--189944717"}], "key_name": "tempest-keypair-1224794241", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:50.597322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] validate_networks() for [('95cfe89c-40ac-4527-96d6-a25cae46f5e7', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:24:50.842277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:50.844130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:50.856411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:50.857667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:50.858542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:50.859829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:50.860883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:50.862256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:51.142556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:51.150840 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42d8316a-e8ee-4a3e-92f5-b070bf36af45 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.313875 Aug 30 03:24:51.161708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 181/363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:50 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:51.311083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:24:51.311717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:24:51.312187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:24:51.312597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:24:51.312998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:24:51.338987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:51.339728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:51.342439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:51.343444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:51.346654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:51.347301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:51.390673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Getting quotas for project 396e07d9190a4041a7d808113bb6b1cf. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:24:51.407229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Getting quotas for user da45da7c2ce14c85b818eb0b9b3e5da9 and project 396e07d9190a4041a7d808113bb6b1cf. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:24:51.441568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:24:51.444262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:24:51.598083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d61fb04a-8de3-4a71-8ee5-a9e508ea5bc8 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.138171 Aug 30 03:24:51.598995 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 183/364] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:24:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:24:51.613329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03eb34e0-8324-4bdd-b363-ec173c0f8597 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:51.613973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03eb34e0-8324-4bdd-b363-ec173c0f8597 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:51.781007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-03eb34e0-8324-4bdd-b363-ec173c0f8597 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:51.792415 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03eb34e0-8324-4bdd-b363-ec173c0f8597 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1242 microversion: 2.1 time: 0.183105 Aug 30 03:24:51.794478 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 182/365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:51 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:51.876734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-85893965-885f-4ee3-b8ca-e749ac581ebf req-8f030fba-f6b0-49bd-a96d-be4f744b9862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add6aa5a-222e-4a38-9ce7-2903c6125cb7", "name": "network-vif-plugged", "status": "completed", "tag": "e5688b05-f297-4558-bc27-72bf3ffe4faf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:51.896229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-85893965-885f-4ee3-b8ca-e749ac581ebf req-8f030fba-f6b0-49bd-a96d-be4f744b9862 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:51.896891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-85893965-885f-4ee3-b8ca-e749ac581ebf req-8f030fba-f6b0-49bd-a96d-be4f744b9862 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:51.898201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-85893965-885f-4ee3-b8ca-e749ac581ebf req-8f030fba-f6b0-49bd-a96d-be4f744b9862 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:51.912314 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-85893965-885f-4ee3-b8ca-e749ac581ebf req-8f030fba-f6b0-49bd-a96d-be4f744b9862 service nova] Creating event network-vif-plugged:e5688b05-f297-4558-bc27-72bf3ffe4faf for instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 on n-h1-854924-5 Aug 30 03:24:51.919051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-85893965-885f-4ee3-b8ca-e749ac581ebf req-8f030fba-f6b0-49bd-a96d-be4f744b9862 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046589 Aug 30 03:24:51.919817 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 184/366] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:52.172044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:52.173742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:52.189585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:52.190409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:52.191104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:52.192594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:52.193218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:52.193820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:52.485950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:52.506913 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-89aaa505-e092-45da-bf0c-48cec894b983 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.338586 Aug 30 03:24:52.508053 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 183/367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:52 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:52.813542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:52.814167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:52.824007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:52.825174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:52.826677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:52.830019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:52.831203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:52.833137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:52.969413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:52.979795 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6897309f-583b-49bd-b1b0-c24e3f09a96c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1294 microversion: 2.1 time: 0.170272 Aug 30 03:24:52.984818 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 184/368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:52 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1294 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:24:53.104685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-105c4c14-89bc-4a07-8e8d-a9147d93c3a7 tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] Action: 'create', calling method: .version_select at 0x7f89801fa8b0>, body: {"security_group": {"name": "tempest-securitygroup-1518236452", "description": "tempest-description-767551462"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:53.593909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-024e4143-8794-48d1-b6c6-db88dca0593c tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-360373155", "id": 307989512, "os-flavor-access:is_public": "True"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:53.639026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:53.646620 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-024e4143-8794-48d1-b6c6-db88dca0593c tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.567614 Aug 30 03:24:53.647409 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 185/369] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:24:53 2022] POST /compute/v2.1/flavors => generated 464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:24:53.652098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:53.652703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:53.678634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:53.682302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:53.683270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:53.685840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:53.687660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:53.690644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:54.266218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:54.276396 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a41d7a86-a37b-4eba-b1eb-b29104aba7ec tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1390 microversion: 2.1 time: 0.628207 Aug 30 03:24:54.277285 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 186/370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:53 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1390 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:54.535669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4479cb91-36b6-469b-a0b2-1b9ca79d4837 tempest-FlavorsV261TestJSON-1131851462 tempest-FlavorsV261TestJSON-1131851462-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:54.545543 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4479cb91-36b6-469b-a0b2-1b9ca79d4837 tempest-FlavorsV261TestJSON-1131851462 tempest-FlavorsV261TestJSON-1131851462-project] 10.222.0.30 "GET /compute/v2.1/flavors/307989512" status: 200 len: 464 microversion: 2.61 time: 0.266731 Aug 30 03:24:54.546084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 187/371] 10.222.0.30 () {60 vars in 1196 bytes} [Tue Aug 30 03:24:54 2022] GET /compute/v2.1/flavors/307989512 => generated 464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:54.786121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cbcfd104-c8ce-4538-b20d-c83970442186 tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] Calling method '.version_select at 0x7f898018ef70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:54.786736 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-105c4c14-89bc-4a07-8e8d-a9147d93c3a7 tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.116245 Aug 30 03:24:54.788116 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 185/372] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:24:52 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:54.792889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:54.793895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:54.807059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:54.813778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:54.815186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:54.815597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cbcfd104-c8ce-4538-b20d-c83970442186 tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.268167 Aug 30 03:24:54.817229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:54.818222 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 188/373] 10.222.0.30 () {60 vars in 1226 bytes} [Tue Aug 30 03:24:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:54.818488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:54.820540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:54.995435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:55.004800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f875c9f3-6998-4fff-900a-e27861afa321 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1300 microversion: 2.1 time: 0.214944 Aug 30 03:24:55.017386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 186/374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:54 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:55.017798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66d5f34b-ec34-4dd7-a0af-bc44c9930011 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-224807725", "id": 908933045, "os-flavor-access:is_public": "True"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:55.017903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc60acca-0c11-4876-8634-083eb7af5621 tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] Action: 'update', calling method: .version_select at 0x7f89817c8b80>, body: {"flavor": {"description": "new"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:55.051243 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66d5f34b-ec34-4dd7-a0af-bc44c9930011 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.230540 Aug 30 03:24:55.052209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 189/375] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:24:54 2022] POST /compute/v2.1/flavors => generated 445 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:55.060555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-73e70a98-0b4e-4abb-9afa-370f1924ac9e tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] Action: 'create', calling method: .version_select at 0x7f898017f940>, body: {"security_group": {"name": "tempest-securitygroup-1071965711", "description": "tempest-description-799146162"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:55.089799 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc60acca-0c11-4876-8634-083eb7af5621 tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/307989512" status: 200 len: 465 microversion: 2.61 time: 0.080759 Aug 30 03:24:55.090619 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 187/376] 10.222.0.30 () {62 vars in 1216 bytes} [Tue Aug 30 03:24:55 2022] PUT /compute/v2.1/flavors/307989512 => generated 465 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:55.102669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e562b3ef-2361-4f94-8e6a-9d0d3d8af25f tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] Action: 'update', calling method: .version_select at 0x7f898048fca0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:55.406250 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e562b3ef-2361-4f94-8e6a-9d0d3d8af25f tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.312205 Aug 30 03:24:55.412083 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 188/377] 10.222.0.30 () {62 vars in 1247 bytes} [Tue Aug 30 03:24:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:55.662224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4259125-949e-480f-a91c-ed9dcde0bd67 tempest-FlavorsV255TestJSON-1867195461 tempest-FlavorsV255TestJSON-1867195461-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:55.677859 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d4259125-949e-480f-a91c-ed9dcde0bd67 tempest-FlavorsV255TestJSON-1867195461 tempest-FlavorsV255TestJSON-1867195461-project] 10.222.0.30 "GET /compute/v2.1/flavors/908933045" status: 200 len: 445 microversion: 2.55 time: 0.267920 Aug 30 03:24:55.679395 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 189/378] 10.222.0.30 () {60 vars in 1196 bytes} [Tue Aug 30 03:24:55 2022] GET /compute/v2.1/flavors/908933045 => generated 445 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:55.689818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51001dc4-a578-4a76-a4c9-b8511386f751 tempest-FlavorsV261TestJSON-1131851462 tempest-FlavorsV261TestJSON-1131851462-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:55.706660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:UPDATE=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:24:55.732726 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51001dc4-a578-4a76-a4c9-b8511386f751 tempest-FlavorsV261TestJSON-1131851462 tempest-FlavorsV261TestJSON-1131851462-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 7608 microversion: 2.61 time: 0.051562 Aug 30 03:24:55.745387 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 190/379] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:55 2022] GET /compute/v2.1/flavors/detail => generated 7608 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:55.745387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:55.745387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:55.751669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:55.752263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:55.753775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:55.754617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:55.755407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:55.755745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:55.998726 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-73e70a98-0b4e-4abb-9afa-370f1924ac9e tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.941781 Aug 30 03:24:56.000184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 190/380] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:24:55 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:56.004415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-772b543c-c1f5-41c3-a878-c30cbb76a3fd tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] Calling method '.version_select at 0x7f89800924c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:56.018471 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-772b543c-c1f5-41c3-a878-c30cbb76a3fd tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.018003 Aug 30 03:24:56.019638 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 191/381] 10.222.0.30 () {60 vars in 1226 bytes} [Tue Aug 30 03:24:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:56.027460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ef59d56-7d6e-4013-a774-fae79f136616 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] Action: 'update', calling method: .version_select at 0x7f898181df70>, body: {"flavor": {"description": "new"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:56.077095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ef59d56-7d6e-4013-a774-fae79f136616 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/908933045" status: 200 len: 446 microversion: 2.55 time: 0.056020 Aug 30 03:24:56.087557 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 192/382] 10.222.0.30 () {62 vars in 1216 bytes} [Tue Aug 30 03:24:56 2022] PUT /compute/v2.1/flavors/908933045 => generated 446 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:56.106664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d86b779-ee90-40f8-9a2f-980396749d28 tempest-FlavorsV261TestJSON-1131851462 tempest-FlavorsV261TestJSON-1131851462-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:56.139140 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d86b779-ee90-40f8-9a2f-980396749d28 tempest-FlavorsV261TestJSON-1131851462 tempest-FlavorsV261TestJSON-1131851462-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3946 microversion: 2.61 time: 0.049166 Aug 30 03:24:56.140755 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 193/383] 10.222.0.30 () {60 vars in 1166 bytes} [Tue Aug 30 03:24:56 2022] GET /compute/v2.1/flavors => generated 3946 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:56.323148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e86105b-ec83-4878-a701-6a43e50180f2 tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Action: 'create', calling method: .version_select at 0x7f8980092670>, body: {"security_group": {"name": "tempest-securitygroup-2028011753", "description": "tempest-description-1926618628"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:56.335938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:56.384477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1043027a-7f99-4cb6-9651-d2df16255f71 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1589 microversion: 2.1 time: 0.648886 Aug 30 03:24:56.394209 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 191/384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:55 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1589 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:56.415295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:56.416137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:56.423456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:56.424178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:56.424607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:56.425583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:56.426188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:56.426977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:57.141304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:24:57.158429 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e043c14c-934e-4ad6-8854-f53c5bc17eba tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 0.753474 Aug 30 03:24:57.159029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 192/385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:56 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:24:57.173665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e71230f-0511-4d5e-b562-fce8694733d1 tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] Action: 'update', calling method: .version_select at 0x7f898017bee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:57.265632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e71230f-0511-4d5e-b562-fce8694733d1 tempest-QuotaClassesAdmin257Test-537134077 tempest-QuotaClassesAdmin257Test-537134077-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.103018 Aug 30 03:24:57.266492 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 193/386] 10.222.0.30 () {62 vars in 1247 bytes} [Tue Aug 30 03:24:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:24:57.282805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-843690e1-b78c-455a-ba0e-060f6cc4100c tempest-FlavorsV255TestJSON-1867195461 tempest-FlavorsV255TestJSON-1867195461-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:57.314903 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-843690e1-b78c-455a-ba0e-060f6cc4100c tempest-FlavorsV255TestJSON-1867195461 tempest-FlavorsV255TestJSON-1867195461-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 7027 microversion: 2.55 time: 0.037255 Aug 30 03:24:57.330485 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 194/387] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:57 2022] GET /compute/v2.1/flavors/detail => generated 7027 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:57.345722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68a18eed-6742-4edc-9d02-1301db2ee8c4 tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:57.378026 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68a18eed-6742-4edc-9d02-1301db2ee8c4 tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/307989512" status: 202 len: 0 microversion: 2.61 time: 0.045411 Aug 30 03:24:57.379173 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 195/388] 10.222.0.30 () {60 vars in 1199 bytes} [Tue Aug 30 03:24:57 2022] DELETE /compute/v2.1/flavors/307989512 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:24:57.387851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:57.388859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:57.396216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:57.397004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:57.397411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:57.398610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:57.399375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:57.399969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:57.691197 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-616d3b7c-674d-48f3-9010-6cf05b26820c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.307192 Aug 30 03:24:57.692238 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 196/389] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:24:57 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7/os-interface => generated 285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:57.698284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54c2898f-43ef-40cd-94b3-0e24aecded69 tempest-FlavorsV255TestJSON-1867195461 tempest-FlavorsV255TestJSON-1867195461-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:57.816888 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54c2898f-43ef-40cd-94b3-0e24aecded69 tempest-FlavorsV255TestJSON-1867195461 tempest-FlavorsV255TestJSON-1867195461-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.123178 Aug 30 03:24:57.829476 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 197/390] 10.222.0.30 () {60 vars in 1166 bytes} [Tue Aug 30 03:24:57 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:57.834422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f615264-2162-440b-ab0e-0ad99a1a3256 tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:57.943502 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f615264-2162-440b-ab0e-0ad99a1a3256 tempest-FlavorsV261TestJSON-734000054 tempest-FlavorsV261TestJSON-734000054-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.112645 Aug 30 03:24:57.945869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 198/391] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:57 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:57.962813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13f4c3da-6a27-4ad6-9966-1b05b49d8348 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:58.026226 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13f4c3da-6a27-4ad6-9966-1b05b49d8348 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/908933045" status: 202 len: 0 microversion: 2.55 time: 0.077809 Aug 30 03:24:58.027767 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 199/392] 10.222.0.30 () {60 vars in 1199 bytes} [Tue Aug 30 03:24:57 2022] DELETE /compute/v2.1/flavors/908933045 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:24:58.040882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e1a394f0-5ab1-48c6-b826-22d0e51aa81d req-7857fb13-6379-4468-8a24-a53a36b720ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25d202c-a2b0-44f5-827e-cae9fd1f3a41", "tag": "7e5241cf-fddd-49ed-ab17-b7f1917e3bce"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:24:58.078569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e1a394f0-5ab1-48c6-b826-22d0e51aa81d req-7857fb13-6379-4468-8a24-a53a36b720ce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:58.078786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e1a394f0-5ab1-48c6-b826-22d0e51aa81d req-7857fb13-6379-4468-8a24-a53a36b720ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:58.079097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e1a394f0-5ab1-48c6-b826-22d0e51aa81d req-7857fb13-6379-4468-8a24-a53a36b720ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:58.112272 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e1a394f0-5ab1-48c6-b826-22d0e51aa81d req-7857fb13-6379-4468-8a24-a53a36b720ce service nova] Creating event network-changed:7e5241cf-fddd-49ed-ab17-b7f1917e3bce for instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 on n-h2-854924-5 Aug 30 03:24:58.121185 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e1a394f0-5ab1-48c6-b826-22d0e51aa81d req-7857fb13-6379-4468-8a24-a53a36b720ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091856 Aug 30 03:24:58.123757 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 200/393] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:58.133681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1b37085-e7b2-437e-aa14-905bd69a6835 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:58.184039 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1b37085-e7b2-437e-aa14-905bd69a6835 tempest-FlavorsV255TestJSON-308752716 tempest-FlavorsV255TestJSON-308752716-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.058743 Aug 30 03:24:58.188547 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 201/394] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:24:58 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:24:58.217887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:24:58.219011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:24:58.233731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:58.234474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:58.236326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:58.258046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:24:58.258988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:24:58.259991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:24:59.073776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e86105b-ec83-4878-a701-6a43e50180f2 tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.931210 Aug 30 03:24:59.084614 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 194/395] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:24:56 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:24:59.091663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84560dd0-5d9d-4342-a31d-c79fddc63ee9 tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Action: 'create', calling method: .version_select at 0x7f89801319d0>, body: {"security_group": {"name": "tempest-securitygroup-663977682", "description": "tempest-description-703133782"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:00.109682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:00.126322 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71002759-4c33-46b4-9775-2e40d9ea8ce9 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 1.930775 Aug 30 03:25:00.127443 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 202/396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:24:58 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:01.151021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:01.151702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:01.159654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:01.160149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:01.160895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:01.161657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:01.162249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:01.162866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:01.372692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84560dd0-5d9d-4342-a31d-c79fddc63ee9 tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.286840 Aug 30 03:25:01.373959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:01.374333 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 195/397] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:24:59 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:01.391898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Calling method '.version_select at 0x7f89800a0700>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:02.292310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:02.351384 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2d378637-67c2-402a-ac08-b208a3d1218e tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 1.203905 Aug 30 03:25:02.352439 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 203/398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:01 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:03.388564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:03.392570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:03.401509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:03.416724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:03.418016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:03.419287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:03.419941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:03.420865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:03.905700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:03.913920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2d321474-5d54-4c41-9db2-8b886e445e29 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 0.533578 Aug 30 03:25:03.925745 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 204/399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:03 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:04.272079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=81 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:04.708724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:04.709372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:04.721997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:04.723377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:04.725854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:04.726660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:04.727239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:04.728471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:05.516421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:05.536306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8c91267-c774-498a-964c-74ac186f7d57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 200 len: 1589 microversion: 2.1 time: 0.827580 Aug 30 03:25:05.537634 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 205/400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:04 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 1589 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:05.550856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3d5ff7db-d448-4d61-9b7a-bfe16a454ab9 req-b6dce10d-fb76-428c-a5ab-ef97c6d706b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add6aa5a-222e-4a38-9ce7-2903c6125cb7", "tag": "e5688b05-f297-4558-bc27-72bf3ffe4faf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:05.572923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5ff7db-d448-4d61-9b7a-bfe16a454ab9 req-b6dce10d-fb76-428c-a5ab-ef97c6d706b0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:05.573448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5ff7db-d448-4d61-9b7a-bfe16a454ab9 req-b6dce10d-fb76-428c-a5ab-ef97c6d706b0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:05.574080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5ff7db-d448-4d61-9b7a-bfe16a454ab9 req-b6dce10d-fb76-428c-a5ab-ef97c6d706b0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:05.594652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3d5ff7db-d448-4d61-9b7a-bfe16a454ab9 req-b6dce10d-fb76-428c-a5ab-ef97c6d706b0 service nova] Creating event network-changed:e5688b05-f297-4558-bc27-72bf3ffe4faf for instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 on n-h1-854924-5 Aug 30 03:25:05.603504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3d5ff7db-d448-4d61-9b7a-bfe16a454ab9 req-b6dce10d-fb76-428c-a5ab-ef97c6d706b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063776 Aug 30 03:25:05.604817 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 206/401] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:05.613010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:05.614782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:05.623475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:05.624981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:05.625918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:05.627101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:05.627717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:05.628290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:06.018283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:06.118316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:06.199387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:06.211105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea0bf2c0-3e60-418b-9626-991fa8174542 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 0.602391 Aug 30 03:25:06.213676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 207/402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:05 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:06.780459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eaa99d20-d09f-406b-a74e-3e621a24f8ed tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '.version_select at 0x7f89801fa310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:06.990533 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eaa99d20-d09f-406b-a74e-3e621a24f8ed tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd" status: 200 len: 371 microversion: 2.1 time: 0.570846 Aug 30 03:25:07.003120 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 208/403] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:25:06 2022] GET /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd => generated 371 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:25:07.016407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Action: 'update', calling method: .version_select at 0x7f89801ea160>, body: {"quota_set": {"ram": "5120"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:07.535297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:07.538599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:07.541699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:07.543035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:07.544296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:07.545584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:07.669881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d3178f96-8ded-492b-ac5d-91bb7f5d3093 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd" status: 200 len: 328 microversion: 2.1 time: 0.657703 Aug 30 03:25:07.671935 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 209/404] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:25:07 2022] PUT /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd => generated 328 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:25:07.683417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:07.684829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:07.695166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:07.697119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:07.697895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:07.699254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:07.700825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:07.701690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:08.162104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:08.192619 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f890cf9-080b-46fe-a99d-0b3811a5aabe tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 0.518872 Aug 30 03:25:08.194065 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 210/405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:07 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:08.211549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ab23353-1f51-4488-a100-e984d822d94f tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:08.244291 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ab23353-1f51-4488-a100-e984d822d94f tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd" status: 202 len: 0 microversion: 2.1 time: 0.045890 Aug 30 03:25:08.245697 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 211/406] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:25:08 2022] DELETE /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:08.294464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d8da5b9-1613-42b0-93f4-f364111c20de does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:25:08.295481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Neutron security group 9d8da5b9-1613-42b0-93f4-f364111c20de not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:25:08.296208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.security_groups [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Security Group ID 9d8da5b9-1613-42b0-93f4-f364111c20de does not exist {{(pid=122167) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 30 03:25:08.365455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d8da5b9-1613-42b0-93f4-f364111c20de does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:25:08.366960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Neutron security group 9d8da5b9-1613-42b0-93f4-f364111c20de not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:25:08.367643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.security_groups [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Security Group ID 9d8da5b9-1613-42b0-93f4-f364111c20de does not exist {{(pid=122167) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 30 03:25:08.458649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-191860525", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": "none"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:08.530201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:08.530674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:08.531401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:08.532060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:08.533252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:08.556351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:08.556936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:08.557276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:08.561847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:08.563797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:08.564249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:08.613068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Getting quotas for project ce064a28703a4db8b3ffeaf956dfdf3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:08.627882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Getting quotas for user c08061c6c1944e7c839d7fe217a97f33 and project ce064a28703a4db8b3ffeaf956dfdf3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:08.674159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:08.684571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:08.798041 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58d79600-7502-458e-9f38-eaeee2f97998 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.551013 Aug 30 03:25:08.810797 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 212/407] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:25:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:25:08.821280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d425ec38-cb62-4747-ac2d-0962be65ca0d tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '.version_select at 0x7f8980145040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:09.183471 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a64377ce-372f-4e27-896a-80e51ef8c3ef tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9787 microversion: 2.1 time: 7.799438 Aug 30 03:25:09.204132 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 196/408] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Aug 30 03:25:01 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9787 bytes in 7821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:09.498160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=7,nova_api:DELETE=8,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:09.541792 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d425ec38-cb62-4747-ac2d-0962be65ca0d tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd" status: 200 len: 371 microversion: 2.1 time: 0.723977 Aug 30 03:25:09.544535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 213/409] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:25:08 2022] GET /compute/v2.1/os-quota-sets/e2df07e52df544e7bc81636c382324fd => generated 371 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:09.553924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eab56a44-efb0-4d4d-90d4-b41546c2319c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:09.570111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eab56a44-efb0-4d4d-90d4-b41546c2319c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:09.812963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2084963735", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:09.823008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eab56a44-efb0-4d4d-90d4-b41546c2319c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:09.885376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eab56a44-efb0-4d4d-90d4-b41546c2319c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:09.898824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eab56a44-efb0-4d4d-90d4-b41546c2319c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:09.946744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eab56a44-efb0-4d4d-90d4-b41546c2319c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "PUT /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1358 microversion: 2.75 time: 0.400587 Aug 30 03:25:09.949062 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 214/410] 10.222.0.30 () {62 vars in 1297 bytes} [Tue Aug 30 03:25:09 2022] PUT /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:09.980489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:09.987083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a4fba507-41dc-4fff-8857-11c5fcf4e1c5 tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] Calling method '.version_select at 0x7f8980145dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:10.498812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:10.499507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:10.500517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:10.502121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:10.502717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:10.518909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:10.520029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:10.522865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:10.524161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:10.525172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:10.526076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:10.597702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a4fba507-41dc-4fff-8857-11c5fcf4e1c5 tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.647057 Aug 30 03:25:10.598644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Getting quotas for project 57bb4a88ede645388513fe70414ffd80. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:10.608014 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 215/411] 10.222.0.30 () {58 vars in 1191 bytes} [Tue Aug 30 03:25:09 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:10.613582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:10.615496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:10.625933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:10.626468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:10.628326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Getting quotas for user 3da64bce6c7a4ee49544e9679a3fd4a8 and project 57bb4a88ede645388513fe70414ffd80. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:10.629391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:10.630118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:10.630590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:10.631028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:10.655966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:10.659687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:10.784131 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92e447c7-6bab-4efa-b01f-d6ed569f065c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578447 Aug 30 03:25:10.784787 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 197/412] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:10.805434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e74a796d-7894-484b-b7e7-ca22cf2c8606 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '.version_select at 0x7f898018e550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:10.970737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:10.982638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b82b8045-ce79-4ad0-80cf-a5427afb6b01 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 0.379842 Aug 30 03:25:10.999364 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 216/413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:10 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:11.012247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:11.014166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:11.033249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:11.034102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:11.034883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:11.036044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:11.037153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:11.037981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:11.306083 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e74a796d-7894-484b-b7e7-ca22cf2c8606 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.520206 Aug 30 03:25:11.315889 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 198/414] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:25:10 2022] GET /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3/defaults => generated 371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:11.325431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0fe6d38-3fe8-4a3d-9359-409b9f964ec2 tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Calling method '.version_select at 0x7f898018e040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:11.356166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:11.368926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:11.377046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:11.396396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-312755d7-f963-4459-a7ee-e3c44a2ea2de tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1418 microversion: 2.75 time: 0.394278 Aug 30 03:25:11.409676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 217/415] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:10 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1418 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:11.409676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b97d017c-7fb3-4a17-ae08-ae0321df4867 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:11.409676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b97d017c-7fb3-4a17-ae08-ae0321df4867 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:11.638045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b97d017c-7fb3-4a17-ae08-ae0321df4867 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:11.650642 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b97d017c-7fb3-4a17-ae08-ae0321df4867 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1222 microversion: 2.1 time: 0.247858 Aug 30 03:25:11.652382 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 218/416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:11 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:11.775662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Action: 'update', calling method: .version_select at 0x7f898017b3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:12.166611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:12.168823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:12.169314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:12.182503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:12.184408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:12.184862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:12.255962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0fe6d38-3fe8-4a3d-9359-409b9f964ec2 tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/af536ae9-e4ae-48ba-b800-76c8b9e80e8f" status: 202 len: 0 microversion: 2.1 time: 0.947765 Aug 30 03:25:12.258284 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 199/417] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:25:11 2022] DELETE /compute/v2.1/os-security-groups/af536ae9-e4ae-48ba-b800-76c8b9e80e8f => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:12.266172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:12.269736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:12.295353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:12.296004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:12.298937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:12.300671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:12.306176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:12.307031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:12.378623 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8f2fac8-cf16-4854-ba93-44813a47994c tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc" status: 200 len: 328 microversion: 2.1 time: 0.606767 Aug 30 03:25:12.380493 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 219/418] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:25:11 2022] PUT /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc => generated 328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:12.400320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3bf6758c-2ab9-4c5d-b4ce-6ca37d9dbe8d tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] Calling method '.version_select at 0x7f898008b310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:12.816466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:12.826590 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4874f49b-c805-43c1-a22a-1de2899a8aa6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 0.567006 Aug 30 03:25:12.832727 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 200/419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:12 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:12.838163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '.version_select at 0x7f89800a08b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:12.995429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:12.996254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:12.997143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:12.998182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:12.998877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:12.999798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.003195 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3bf6758c-2ab9-4c5d-b4ce-6ca37d9dbe8d tempest-SecurityGroupsTestAdminJSON-1702363725 tempest-SecurityGroupsTestAdminJSON-1702363725-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/0f49c753-7b25-4bb4-8b8a-f1717959c28f" status: 202 len: 0 microversion: 2.1 time: 0.619633 Aug 30 03:25:13.004416 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 220/420] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:25:12 2022] DELETE /compute/v2.1/os-security-groups/0f49c753-7b25-4bb4-8b8a-f1717959c28f => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:13.010830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:13.011788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:13.031430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.032414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.032953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.033925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.034525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.035058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.076693 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f055e55b-7d30-48ce-ad23-1a077af6b0e3 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc/detail" status: 200 len: 916 microversion: 2.1 time: 0.237604 Aug 30 03:25:13.089771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 201/421] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:25:12 2022] GET /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc/detail => generated 916 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:13.111094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:13.112784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:13.123074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.123925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.127852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.129435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.130506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.131156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.231371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:13.249880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:13.252167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:13.260558 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-847197a0-c27e-4835-acc3-951fa865386b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1416 microversion: 2.75 time: 0.254130 Aug 30 03:25:13.262133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 221/422] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:13 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1416 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:13.270562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e81bd742-82bb-4da9-bae4-b262499f729d tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] Calling method '.version_select at 0x7f8980132160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:13.296270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:13.306135 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90dd04df-01ab-4031-961a-7bf0e088c880 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1274 microversion: 2.1 time: 0.214775 Aug 30 03:25:13.306738 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 202/423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:13 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:13.331147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f2d8da25-1794-4093-a764-88fe9ce0fa1b req-452cd022-cb29-4969-bccf-e4275a0b5d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25d202c-a2b0-44f5-827e-cae9fd1f3a41", "name": "network-vif-plugged", "status": "completed", "tag": "7e5241cf-fddd-49ed-ab17-b7f1917e3bce"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:13.370662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f2d8da25-1794-4093-a764-88fe9ce0fa1b req-452cd022-cb29-4969-bccf-e4275a0b5d02 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.372334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f2d8da25-1794-4093-a764-88fe9ce0fa1b req-452cd022-cb29-4969-bccf-e4275a0b5d02 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.373050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f2d8da25-1794-4093-a764-88fe9ce0fa1b req-452cd022-cb29-4969-bccf-e4275a0b5d02 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.421527 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f2d8da25-1794-4093-a764-88fe9ce0fa1b req-452cd022-cb29-4969-bccf-e4275a0b5d02 service nova] Creating event network-vif-plugged:7e5241cf-fddd-49ed-ab17-b7f1917e3bce for instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 on n-h2-854924-5 Aug 30 03:25:13.438714 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f2d8da25-1794-4093-a764-88fe9ce0fa1b req-452cd022-cb29-4969-bccf-e4275a0b5d02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130700 Aug 30 03:25:13.439874 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 203/424] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:13.459304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Action: 'update', calling method: .version_select at 0x7f8980063820>, body: {"quota_set": {"ram": "2048"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:13.586601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.587453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.588615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.589676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.590280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.590837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.643568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.644459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.645159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.646179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:13.646975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:13.648325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:13.820744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08aa5522-fdcd-419f-a9f8-db604c683635 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc?user_id=e7f9279f1b91495e92f9dc4addff5f07" status: 200 len: 328 microversion: 2.1 time: 0.366279 Aug 30 03:25:13.827105 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 204/425] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:25:13 2022] PUT /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc?user_id=e7f9279f1b91495e92f9dc4addff5f07 => generated 328 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:25:13.835460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7347b20-3420-48f7-be6f-0635ead64439 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '.version_select at 0x7f8980131160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:14.058946 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7347b20-3420-48f7-be6f-0635ead64439 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc?user_id=e7f9279f1b91495e92f9dc4addff5f07" status: 200 len: 370 microversion: 2.1 time: 0.228874 Aug 30 03:25:14.060022 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 205/426] 10.222.0.30 () {58 vars in 1323 bytes} [Tue Aug 30 03:25:13 2022] GET /compute/v2.1/os-quota-sets/5372b6580fed4756885bca104aff2fbc?user_id=e7f9279f1b91495e92f9dc4addff5f07 => generated 370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:25:14.071833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:14.072808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:14.104532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:14.105135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:14.105697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:14.110042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:14.110527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:14.110968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:15.389485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:15.407583 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c5756af-f6da-4230-a324-8a3788f2f7b3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1367 microversion: 2.1 time: 1.346394 Aug 30 03:25:15.408362 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 206/427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:14 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1367 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:15.426661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:15.427445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:15.437450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:15.438430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:15.439263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:15.440684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:15.441850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:15.442366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:15.667999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:15.697640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:15.710458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:15.726020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-875e4cf8-faf0-4a02-8d0a-69a2737e4e48 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1437 microversion: 2.75 time: 0.302933 Aug 30 03:25:15.733963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 207/428] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:15 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1437 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:15.750346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:15.754537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:15.770498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:15.773208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:15.781199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:15.782878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:15.783307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:15.783952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:15.895713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e81bd742-82bb-4da9-bae4-b262499f729d tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7cec90d4-9a06-4f58-a77f-e4830edc81d6" status: 202 len: 0 microversion: 2.1 time: 2.631730 Aug 30 03:25:15.904725 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 222/429] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:25:13 2022] DELETE /compute/v2.1/os-security-groups/7cec90d4-9a06-4f58-a77f-e4830edc81d6 => generated 0 bytes in 2642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:15.914897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01e960d5-9a73-4056-9c89-5e7ad72fb267 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Calling method '.version_select at 0x7f89801fa670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:16.258961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:16.285150 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-18a84bc6-5935-4c47-af1f-9a7d0eb8e18c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1280 microversion: 2.1 time: 0.549723 Aug 30 03:25:16.297377 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 208/430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:15 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1280 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:16.297377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:16.308414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:16.328978 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01e960d5-9a73-4056-9c89-5e7ad72fb267 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.422482 Aug 30 03:25:16.336863 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 223/431] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:25:15 2022] GET /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3/defaults => generated 371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:16.337496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:16.337496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:16.337496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:16.337496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:16.337836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:16.340513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:16.356918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9205437f-1668-4301-a55c-a0ebaa228a6e tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] Calling method '.version_select at 0x7f898008b1f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:16.552945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:16.553562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:16.554188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:16.554605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:16.555019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:16.667970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:16.698475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:16.699144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:16.704266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:16.706313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:16.708383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:16.709115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:16.960228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:16.973282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:16.975773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:16.982973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-62e1b4ce-dd2d-4ce7-9bfb-6091a5ffca17 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "POST /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6/action" status: 202 len: 1494 microversion: 2.75 time: 0.695223 Aug 30 03:25:16.983648 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 209/432] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:25:16 2022] POST /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6/action => generated 1494 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 03:25:16.994941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Action: 'update', calling method: .version_select at 0x7f8980063040>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:17.125042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:17.125855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:17.126538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:17.127517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:17.128194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:17.129143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:17.479049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:17.491404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9205437f-1668-4301-a55c-a0ebaa228a6e tempest-SecurityGroupsTestAdminJSON-1370852697 tempest-SecurityGroupsTestAdminJSON-1370852697-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/546e2bb6-0710-47fc-9dd1-e2e7b40cce45" status: 202 len: 0 microversion: 2.1 time: 1.150183 Aug 30 03:25:17.493308 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 224/433] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:25:16 2022] DELETE /compute/v2.1/os-security-groups/546e2bb6-0710-47fc-9dd1-e2e7b40cce45 => generated 0 bytes in 1153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:17.499207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:17.500148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:17.515667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:17.520135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:17.520953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:17.522789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:17.524871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:17.526768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:17.718845 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd6f7cb7-dd51-4c89-949c-8ab401b63496 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3" status: 200 len: 329 microversion: 2.1 time: 0.733701 Aug 30 03:25:17.719997 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 210/434] 10.222.0.30 () {60 vars in 1263 bytes} [Tue Aug 30 03:25:16 2022] PUT /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3 => generated 329 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:17.733619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:17.734966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:17.770234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:17.771040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:17.771781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:17.774296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:17.774989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:17.775703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:18.101266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:18.136241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:18.140475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:18.170005 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e22b7867-1d37-4c3d-bb77-e8e43beebfaa tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.447021 Aug 30 03:25:18.186994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 211/435] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:17 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:18.205040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:18.207456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:18.249791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:18.258138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:18.259004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:18.260210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:18.260995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:18.261877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:18.337798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:18.345690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:18.406346 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d1199e0-4f15-4f56-be9c-3340535dac20 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1557 microversion: 2.1 time: 0.910830 Aug 30 03:25:18.412618 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 225/436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:17 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1557 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:18.434644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Action: 'update', calling method: .version_select at 0x7f89801faee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:18.736841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:18.753125 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f2477f09-7b69-484a-8113-4954be1dcd24 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 0.564474 Aug 30 03:25:18.756282 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 212/437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:18 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:18.783773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:18.784278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:18.810257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:18.810758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:18.811200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:18.811911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:18.812362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:18.812780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:18.936335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=7 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:18.939531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:18.940434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:18.942609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:18.945113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:18.945809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:18.946386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:19.009369 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef9b5203-7493-4690-a52e-162a4c772258 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234171 Aug 30 03:25:19.010141 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 213/438] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:25:18 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:19.217730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:19.218609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:19.234652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:19.235808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:19.236722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:19.237691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:19.238311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:19.245697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:19.381469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=13,nova_api:UPDATE=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:19.415961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:19.434528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:19.437145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:19.449765 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db7533db-03c8-4f31-8d6f-bebfb0818276 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.236483 Aug 30 03:25:19.458340 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 214/439] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:19 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:19.523638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89811123-4f24-41e3-8aba-31437f35eb34 tempest-QuotasAdminTestJSON-2022476877 tempest-QuotasAdminTestJSON-2022476877-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3" status: 200 len: 329 microversion: 2.1 time: 1.108852 Aug 30 03:25:19.531976 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 226/440] 10.222.0.30 () {60 vars in 1263 bytes} [Tue Aug 30 03:25:18 2022] PUT /compute/v2.1/os-quota-sets/38e354f360014ad995d0c6f255a9a4a3 => generated 329 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:19.785372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:19.785998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:19.807405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:19.807911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:19.808362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:19.809064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:19.813598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:19.816774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:20.480905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:20.481746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:20.506223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:20.506863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:20.507491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:20.508622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:20.509116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:20.513618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:21.061274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:21.074464 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-169ea474-f540-4e99-a78c-a7e2616e9471 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 1.296416 Aug 30 03:25:21.106939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 215/441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:19 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:21.134597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:21.150164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:21.155633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:21.172613 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-763e6027-4089-461a-b48f-7cf2b3ce48f0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.696771 Aug 30 03:25:21.174173 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 227/442] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:20 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:21.267271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2b2aebaf-7d97-435e-81d6-816b0b735bbf req-6291f3a3-46c5-4e85-897c-0593fac1b410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35cdc6ed-f632-420f-b5d5-93c0071fe721", "tag": "a09a4c7c-0d8b-42d6-842d-949d38179b74"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:21.294525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2b2aebaf-7d97-435e-81d6-816b0b735bbf req-6291f3a3-46c5-4e85-897c-0593fac1b410 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:21.296340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2b2aebaf-7d97-435e-81d6-816b0b735bbf req-6291f3a3-46c5-4e85-897c-0593fac1b410 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:21.296954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2b2aebaf-7d97-435e-81d6-816b0b735bbf req-6291f3a3-46c5-4e85-897c-0593fac1b410 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:21.378328 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2b2aebaf-7d97-435e-81d6-816b0b735bbf req-6291f3a3-46c5-4e85-897c-0593fac1b410 service nova] Creating event network-changed:a09a4c7c-0d8b-42d6-842d-949d38179b74 for instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 on n-h1-854924-5 Aug 30 03:25:21.398960 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2b2aebaf-7d97-435e-81d6-816b0b735bbf req-6291f3a3-46c5-4e85-897c-0593fac1b410 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140509 Aug 30 03:25:21.400149 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 216/443] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:22.096745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:22.097546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:22.115682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:22.118539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:22.119571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:22.123779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:22.126592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:22.127353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:22.206315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:22.207018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:22.243036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:22.251841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:22.254773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:22.257584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:22.259495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:22.259946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:22.733004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:22.771458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:22.786777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:22.807828 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48c07edc-353e-45cc-809b-4a176d55cda5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.604625 Aug 30 03:25:22.821925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 217/444] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:22 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:22.914497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:22.930410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9c792c5-36ca-41ac-b23e-9e4a904d5dcf tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 0.834065 Aug 30 03:25:22.931386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 228/445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:22 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:23.797544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-64ebac49-8228-46ba-bffb-96fb524a621d req-3f0f6d14-3bc0-4ed5-a2a0-aece0aa32915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25d202c-a2b0-44f5-827e-cae9fd1f3a41", "tag": "7e5241cf-fddd-49ed-ab17-b7f1917e3bce"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:23.822775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64ebac49-8228-46ba-bffb-96fb524a621d req-3f0f6d14-3bc0-4ed5-a2a0-aece0aa32915 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:23.826523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64ebac49-8228-46ba-bffb-96fb524a621d req-3f0f6d14-3bc0-4ed5-a2a0-aece0aa32915 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:23.827131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64ebac49-8228-46ba-bffb-96fb524a621d req-3f0f6d14-3bc0-4ed5-a2a0-aece0aa32915 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:23.840057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:23.840675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:23.859680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:23.860184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:23.868035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:23.868347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:23.868657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:23.874089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:23.874933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:23.886965 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-64ebac49-8228-46ba-bffb-96fb524a621d req-3f0f6d14-3bc0-4ed5-a2a0-aece0aa32915 service nova] Creating event network-changed:7e5241cf-fddd-49ed-ab17-b7f1917e3bce for instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 on n-h2-854924-5 Aug 30 03:25:23.916418 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-64ebac49-8228-46ba-bffb-96fb524a621d req-3f0f6d14-3bc0-4ed5-a2a0-aece0aa32915 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122722 Aug 30 03:25:23.917027 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 218/446] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:23.968986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:23.970031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:23.980479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:23.986148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:23.998132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:23.999173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:24.001106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:24.009289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:24.352413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:24.370245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:24.371708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:24.391402 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-898c1c65-8387-4a55-96e3-bf393f9ed74e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.556255 Aug 30 03:25:24.393225 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 229/447] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:23 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:24.884331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-360411164", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "50cf9776-7fec-4e2a-bfd2-7cfd51c24288"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:25.015637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] validate_networks() for [('50cf9776-7fec-4e2a-bfd2-7cfd51c24288', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:25.434906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:25.447846 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4a84891-a37c-4d65-b938-d6b8b8c4f7d9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 1.482006 Aug 30 03:25:25.449756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 219/448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:23 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:25.462594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:25.466723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:25.482325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:25.483175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:25.486135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:25.487130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:25.489932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:25.491761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:26.012857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:26.056476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:26.057956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:26.082209 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8cf17662-a66c-4602-ba03-3828cbf24e7d tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.629182 Aug 30 03:25:26.085652 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 220/449] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:25 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:26.337318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2145206403", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:26.423945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:27.141484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:27.196552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:27.196969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:27.197854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:27.198272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:27.198687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:27.214015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:27.214510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:27.215121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:27.216855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:27.217551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:27.218543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:27.249954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Getting quotas for project fc50c2ff3ca9496db43ab1dcbad2347f. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:27.257027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Getting quotas for user c3bd201e25854ba8b76e36d0b2cdb553 and project fc50c2ff3ca9496db43ab1dcbad2347f. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:27.274524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:27.280007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:27.392757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21d0d5d4-5554-4935-8173-4b846ae9b427 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305480 Aug 30 03:25:27.393940 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 221/450] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:27.511002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-71a9d7eb-4f57-4d71-a79e-d8776e4c1527 tempest-ListImagesTestJSON-1494919535 tempest-ListImagesTestJSON-1494919535-project] Calling method '.version_select at 0x7f897bf6cb80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:27.568623 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-71a9d7eb-4f57-4d71-a79e-d8776e4c1527 tempest-ListImagesTestJSON-1494919535 tempest-ListImagesTestJSON-1494919535-project] 10.222.0.30 "GET /compute/v2.1/images/b40a5c3f-7379-4565-a6da-58a9aabde37c" status: 200 len: 784 microversion: 2.1 time: 0.173554 Aug 30 03:25:27.582651 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 222/451] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:25:27 2022] GET /compute/v2.1/images/b40a5c3f-7379-4565-a6da-58a9aabde37c => generated 784 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:27.589306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:27.589306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:27.601751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:27.602276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:27.602723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:27.606292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:27.606792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:27.607236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:27.845264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:27.845854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:27.846649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:27.846649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:27.846933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:27.866955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:27.867438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:27.867865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:27.868580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:27.869023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:27.869740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:27.910283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:27.919105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for user 15eb8a27991445a491ccce6ff650f32a and project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:27.941328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:27.944666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:28.016445 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f00ea5b-860f-4c3e-8755-99da2a8b2749 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573415 Aug 30 03:25:28.017155 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 230/452] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:25:28.034398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:28.035187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:28.043228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:28.043829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:28.044483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:28.045210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:28.045954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:28.046490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:28.167205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:28.195626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-efc7abd5-f62d-4276-978a-8aaef253d276 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 0.620529 Aug 30 03:25:28.199242 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 223/453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:27 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:28.214042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-447003807", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:28.266368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:28.326151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:28.328087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:28.344158 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-989f01ef-d244-4b61-bbd8-43b9ea2b0c20 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.325643 Aug 30 03:25:28.354450 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 231/454] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:28 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:28.356237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:28.372370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-791ad34d-2ad9-4a9f-b5cd-688a4d37cc3e tempest-ListImagesTestJSON-1494919535 tempest-ListImagesTestJSON-1494919535-project] Calling method '.version_select at 0x7f898008b4c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:28.512720 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-791ad34d-2ad9-4a9f-b5cd-688a4d37cc3e tempest-ListImagesTestJSON-1494919535 tempest-ListImagesTestJSON-1494919535-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.157075 Aug 30 03:25:28.514050 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 232/455] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 03:25:28 2022] GET /compute/v2.1/images => generated 445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:28.528113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96bb12d5-f00f-40f9-ad73-bab274c584fd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:28.528113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-96bb12d5-f00f-40f9-ad73-bab274c584fd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:28.854161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96bb12d5-f00f-40f9-ad73-bab274c584fd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:28.863573 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96bb12d5-f00f-40f9-ad73-bab274c584fd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1210 microversion: 2.1 time: 0.348046 Aug 30 03:25:28.864822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 233/456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:28 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1210 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:28.881333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80cec257-d9b4-4b89-a668-bdf44988c142 tempest-ListImagesTestJSON-1494919535 tempest-ListImagesTestJSON-1494919535-project] Calling method '.version_select at 0x7f897bfcb0d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:28.935299 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80cec257-d9b4-4b89-a668-bdf44988c142 tempest-ListImagesTestJSON-1494919535 tempest-ListImagesTestJSON-1494919535-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.068888 Aug 30 03:25:28.936399 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 234/457] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:25:28 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:28.949731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:28.950368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:28.951020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:28.951626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:28.952263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:28.965159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:28.965988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:28.966487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:28.967837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:28.968646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:28.969265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:29.000173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Getting quotas for project fc50c2ff3ca9496db43ab1dcbad2347f. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:29.010582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Getting quotas for user c3bd201e25854ba8b76e36d0b2cdb553 and project fc50c2ff3ca9496db43ab1dcbad2347f. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:29.026948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:29.029764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:29.140853 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-932fe31b-cc91-47bd-b493-e33edb0a9fab tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934220 Aug 30 03:25:29.143823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 224/458] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:29.163055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-691d5a27-cfff-4c72-a7cb-76a4cafd562c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:29.163318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-691d5a27-cfff-4c72-a7cb-76a4cafd562c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:29.223067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:29.223889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:29.246685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:29.247646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:29.248260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:29.249255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:29.251032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:29.254806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:29.550148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-691d5a27-cfff-4c72-a7cb-76a4cafd562c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:29.572591 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-691d5a27-cfff-4c72-a7cb-76a4cafd562c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1213 microversion: 2.1 time: 0.420833 Aug 30 03:25:29.577262 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 235/459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:29 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1213 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:29.608245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:29.608887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:29.621307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:29.621752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:29.622194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:29.622913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:29.623370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:29.623801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:29.998856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:30.008280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:30.017229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:30.028883 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c00d84ea-fcaf-48a3-bae0-36404be92659 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.450225 Aug 30 03:25:30.052390 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 236/460] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:29 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:30.084006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-689f46ea-a6f7-4e48-95e6-42a39af0d333 req-40b4f5a5-c834-4728-a796-15744619fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35cdc6ed-f632-420f-b5d5-93c0071fe721", "name": "network-vif-plugged", "status": "completed", "tag": "a09a4c7c-0d8b-42d6-842d-949d38179b74"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:30.116527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-689f46ea-a6f7-4e48-95e6-42a39af0d333 req-40b4f5a5-c834-4728-a796-15744619fb78 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:30.117249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-689f46ea-a6f7-4e48-95e6-42a39af0d333 req-40b4f5a5-c834-4728-a796-15744619fb78 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:30.117850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-689f46ea-a6f7-4e48-95e6-42a39af0d333 req-40b4f5a5-c834-4728-a796-15744619fb78 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:30.136840 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-689f46ea-a6f7-4e48-95e6-42a39af0d333 req-40b4f5a5-c834-4728-a796-15744619fb78 service nova] Creating event network-vif-plugged:a09a4c7c-0d8b-42d6-842d-949d38179b74 for instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 on n-h1-854924-5 Aug 30 03:25:30.145774 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-689f46ea-a6f7-4e48-95e6-42a39af0d333 req-40b4f5a5-c834-4728-a796-15744619fb78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090667 Aug 30 03:25:30.147731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 237/461] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:30.157262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:30.158738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:30.173254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:30.174166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:30.174768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:30.175628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:30.176268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:30.177599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:30.427936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:30.432727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:30.464225 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-703d9096-96fd-46f5-b7a0-6cf795978fc7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1262 microversion: 2.1 time: 0.314117 Aug 30 03:25:30.466997 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 238/462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:30 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1262 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:30.467870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fa0efffc-809c-4939-b664-978cc779d246 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 1.253678 Aug 30 03:25:30.486887 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 225/463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:29 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:30.603028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:30.604229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:30.618182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:30.619038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:30.620915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:30.621864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:30.622344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:30.622923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:30.746977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:30.760278 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d26df589-3cc1-4f10-99bf-1f29d676a23e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1265 microversion: 2.1 time: 0.164273 Aug 30 03:25:30.762531 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 239/464] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:30 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:31.063055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:31.064721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:31.081926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.086515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.087664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.088649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.089747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.090488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.274346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:31.291256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:31.292927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:31.324390 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7345968-43f1-456c-a513-1dad033287e1 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.270314 Aug 30 03:25:31.325193 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 226/465] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:31 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:31.502562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:31.503261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:31.506905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:31.507523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:31.526375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.526878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.529823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.531511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.532571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.533993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.535089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.535973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.536426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.538342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.540350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.540764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.734172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:31.762539 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a43321da-359a-4ce3-b4a8-7f1b38b681ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1268 microversion: 2.1 time: 0.263647 Aug 30 03:25:31.783167 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 227/466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:31 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1268 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:31.813227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:31.813899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:31.825675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.826539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.827139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:31.828105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:31.828774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:31.829470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:32.009818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:32.031852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9320ddeb-086b-427a-ad8a-de02bc70029c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1265 microversion: 2.1 time: 0.242798 Aug 30 03:25:32.046478 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 228/467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:31 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:32.233860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13c70f40-db45-45f6-be47-d5a44ef61216 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Action: 'create', calling method: .version_select at 0x7f897bf6cf70>, body: {"keypair": {"name": "tempest-keypair-501810715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD11ptWL4K/uSQYyEm36tI1+Ca0Hg7LCj1wiQXfYSGPnYuy1vEno4IT/DWptJ5/LpyY8NbBRwcBrBSqOZbUQEIqP5epnf6Ci1vkxsQPX+DGvVhfBufwZjsNkLx1nl866jA=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:32.250642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-13c70f40-db45-45f6-be47-d5a44ef61216 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:32.256132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-13c70f40-db45-45f6-be47-d5a44ef61216 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for user e1d3b1ab7e7c4aef8868a1024fd3815b and project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:32.293632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:32.304064 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13c70f40-db45-45f6-be47-d5a44ef61216 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254033 Aug 30 03:25:32.305120 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 229/468] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:25:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:32.316959 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2fa2eced-ec3e-4940-87fe-8eb5d4b82705 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1322 microversion: 2.1 time: 0.822893 Aug 30 03:25:32.319844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fec5fb87-ffba-4df0-a5bd-75e55ac56505 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f897bf19550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:32.321488 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 240/469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:31 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1322 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:32.328579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=87 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:32.339644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fec5fb87-ffba-4df0-a5bd-75e55ac56505 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-501810715" status: 200 len: 496 microversion: 2.1 time: 0.026500 Aug 30 03:25:32.340849 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 230/470] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Aug 30 03:25:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-501810715 => generated 496 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:32.352774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc3a56bc-1b6e-4bbc-b1f2-110da5b15d51 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f898004d5e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:32.367414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:32.368311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:32.375347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:32.376116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:32.376548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:32.377514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:32.378407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:32.379006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:32.414365 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc3a56bc-1b6e-4bbc-b1f2-110da5b15d51 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501810715" status: 202 len: 0 microversion: 2.1 time: 0.062217 Aug 30 03:25:32.417961 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 241/471] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501810715 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:32.432132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3764909-27f9-4683-8820-f5d337bd6459 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Action: 'create', calling method: .version_select at 0x7f898017b3a0>, body: {"keypair": {"name": "tempest-keypair-774704223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItCJDNfT1+4mUd6XFGYuE+uM1FSaUkes8hRA+fk8Mavx2YDV8xyCpKJELzL67YlHYuGn3qMdaK4bTetmbzYZqNp+VTw8E46bd+aFU6BR3l89pF6m3ICqYFrfOEPcaFTaw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:32.462375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b3764909-27f9-4683-8820-f5d337bd6459 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:32.469185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b3764909-27f9-4683-8820-f5d337bd6459 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for user e1d3b1ab7e7c4aef8868a1024fd3815b and project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:32.505198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3764909-27f9-4683-8820-f5d337bd6459 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081054 Aug 30 03:25:32.508777 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 242/472] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:25:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:32.521550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-22e1c57c-27ef-4cd2-9e98-73e9a964e3ad tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f898006a310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:32.554890 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-22e1c57c-27ef-4cd2-9e98-73e9a964e3ad tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774704223" status: 202 len: 0 microversion: 2.1 time: 0.041361 Aug 30 03:25:32.561431 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 243/473] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774704223 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:32.583475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f7cbf11-fbb0-46ec-8199-0575278177b5 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Action: 'create', calling method: .version_select at 0x7f898008bee0>, body: {"keypair": {"name": "tempest-keypair-663193425", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:32.586693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:32.606080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:32.608353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:32.608601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1f7cbf11-fbb0-46ec-8199-0575278177b5 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:32.614120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1f7cbf11-fbb0-46ec-8199-0575278177b5 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for user e1d3b1ab7e7c4aef8868a1024fd3815b and project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:32.616171 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-85741505-0248-4f2a-bddf-fe98892c4d19 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.254128 Aug 30 03:25:32.617323 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 231/474] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:32 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:32.661095 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f7cbf11-fbb0-46ec-8199-0575278177b5 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.098181 Aug 30 03:25:32.662169 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 244/475] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:25:32 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:32.679111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b94e7a58-8b3c-4b47-973e-3e55c2bcbf3e tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f897bf78160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:32.713393 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b94e7a58-8b3c-4b47-973e-3e55c2bcbf3e tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663193425" status: 202 len: 0 microversion: 2.1 time: 0.042611 Aug 30 03:25:32.714949 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 232/476] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663193425 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:25:32.727642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aebe027c-5658-44de-b101-5391ba7d0b9b tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Action: 'create', calling method: .version_select at 0x7f897bfcb280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1730879020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6dXgTZ9hQdEl5xZtSkhaACS4Lo1ec22GQ/3MxfBTrgcEKf0iroM1ccm5D/OBv9pfE0muYWeUaYlLsl9yXYCQTHOiVLeXf8j8GqRZLNnOmV4v4AvFpAdsVj9d7umZYv+w=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:32.763485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-aebe027c-5658-44de-b101-5391ba7d0b9b tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:32.767427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:32.776750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-aebe027c-5658-44de-b101-5391ba7d0b9b tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for user e1d3b1ab7e7c4aef8868a1024fd3815b and project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:32.801598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:32.802515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:32.822962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:32.823794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:32.824291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:32.825067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:32.826229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:32.826706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:32.854993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aebe027c-5658-44de-b101-5391ba7d0b9b tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.131914 Aug 30 03:25:32.857000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 245/477] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:25:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:32.873639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eda21099-44ce-4954-a862-6aa479258259 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Action: 'create', calling method: .version_select at 0x7f897bfcb160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1484243901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqai4gKO24vs1dEQFKWXCru8/hhYWZZkVqfpsHJ+qgxmia+HiF1JDAt52nFwN/FXOc2CSTKt/h/9g+UFUornFYHC+/Nc8IGrC7JILfAC6uzigodVLyp6Fde2q/I4DxpvA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:32.911690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-eda21099-44ce-4954-a862-6aa479258259 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:32.917742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-eda21099-44ce-4954-a862-6aa479258259 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for user e1d3b1ab7e7c4aef8868a1024fd3815b and project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:32.982325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eda21099-44ce-4954-a862-6aa479258259 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.114023 Aug 30 03:25:32.984347 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 246/478] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:25:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:25:32.997324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-193be783-8906-41b5-a443-6d500c7491f4 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Action: 'create', calling method: .version_select at 0x7f898004daf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1286783569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGw5qrKH9my3U9VIiYcDv+EDiYoVNccW9htcnGcD6f7qPQDM/vILjdRaQ27DtuH6tA4nFuYiD2/BHA/4AeI7pe9Zs2vhmrlkhg7ZuLCLXbDgA3/DUyXuHifGtEXvGe57Q=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:33.043889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-193be783-8906-41b5-a443-6d500c7491f4 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:33.055681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-193be783-8906-41b5-a443-6d500c7491f4 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Getting quotas for user e1d3b1ab7e7c4aef8868a1024fd3815b and project e5ab093e14e54b1eb40d1ff39b714d6b. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:33.108735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-193be783-8906-41b5-a443-6d500c7491f4 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.115594 Aug 30 03:25:33.109641 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 247/479] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:25:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:33.120674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:33.121722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:33.129496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.130559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.131913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:33.133053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.133735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.134320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:33.533141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:33.545204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d149a07-0223-4345-8a09-a40623046910 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1271 microversion: 2.1 time: 0.428573 Aug 30 03:25:33.547129 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 248/480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:33 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1271 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:33.562087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5ca5bda-e594-4d59-9dd4-5e4b8d83d5d0 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f898008baf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:33.568497 n-d-854924-5 devstack@n-api.service[122168]: WARNING oslo_db.sqlalchemy.utils [None req-f5ca5bda-e594-4d59-9dd4-5e4b8d83d5d0 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 03:25:33.575867 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5ca5bda-e594-4d59-9dd4-5e4b8d83d5d0 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.027176 Aug 30 03:25:33.576838 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 249/481] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:25:33 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:33.581634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9b87237c-69ff-4dcb-afd4-8c7de0d9aaf0 req-d46684df-247f-474d-8fa4-68946ebf0751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa8099c-f76b-4bb1-880f-b6422d1ac7c6", "tag": "57b82505-7683-441b-871d-3f24751cddff"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:33.597457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b87237c-69ff-4dcb-afd4-8c7de0d9aaf0 req-d46684df-247f-474d-8fa4-68946ebf0751 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.598277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b87237c-69ff-4dcb-afd4-8c7de0d9aaf0 req-d46684df-247f-474d-8fa4-68946ebf0751 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.598861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b87237c-69ff-4dcb-afd4-8c7de0d9aaf0 req-d46684df-247f-474d-8fa4-68946ebf0751 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:33.611770 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9b87237c-69ff-4dcb-afd4-8c7de0d9aaf0 req-d46684df-247f-474d-8fa4-68946ebf0751 service nova] Creating event network-changed:57b82505-7683-441b-871d-3f24751cddff for instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 on n-h2-854924-5 Aug 30 03:25:33.618074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9b87237c-69ff-4dcb-afd4-8c7de0d9aaf0 req-d46684df-247f-474d-8fa4-68946ebf0751 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039841 Aug 30 03:25:33.619361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 250/482] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:33.626226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:33.627085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:33.634404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.634898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.635333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:33.636042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.636790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.637456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:33.814534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:33.824829 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-214b5dc3-6d42-4b3e-8aa9-aa98ea273438 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1310 microversion: 2.1 time: 1.030227 Aug 30 03:25:33.825618 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 233/483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:32 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1310 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:33.831051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-548a6e0c-461d-49c3-be08-29ae36ed3a17 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f898018e9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:33.867095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-548a6e0c-461d-49c3-be08-29ae36ed3a17 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1286783569" status: 202 len: 0 microversion: 2.1 time: 0.038746 Aug 30 03:25:33.873377 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 234/484] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 03:25:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1286783569 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:33.880769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:33.882223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:33.899086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.899624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.900080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:33.900814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:33.901276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:33.901735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:34.082650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:34.095200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:34.098308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:34.105799 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61e14a93-da70-48a5-9a04-99de5e1b32d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.230226 Aug 30 03:25:34.106650 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 235/485] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:33 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:34.112627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d29fe00-f029-4d4a-9f16-9f1d9ab55ef1 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f897bf6c430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:34.141933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d29fe00-f029-4d4a-9f16-9f1d9ab55ef1 tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1484243901" status: 202 len: 0 microversion: 2.1 time: 0.033814 Aug 30 03:25:34.142986 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 236/486] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 03:25:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1484243901 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:34.152590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6828c549-faa8-43fd-bdba-c9eb0ef91eef tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] Calling method '.version_select at 0x7f897bf3f160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:34.174846 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6828c549-faa8-43fd-bdba-c9eb0ef91eef tempest-KeyPairsV2TestJSON-1161220550 tempest-KeyPairsV2TestJSON-1161220550-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1730879020" status: 202 len: 0 microversion: 2.1 time: 0.027673 Aug 30 03:25:34.177502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 237/487] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 03:25:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1730879020 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:25:34.190257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:34.198892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13c6d95f-dbf4-4c87-a6fc-16b23d003c98 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1471 microversion: 2.1 time: 0.577921 Aug 30 03:25:34.200053 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 251/488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:33 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1471 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:34.356639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25bd4b70-d8a0-4f5e-81e4-2722feffbea3 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:34.357215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-25bd4b70-d8a0-4f5e-81e4-2722feffbea3 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] [instance: 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:34.366504 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-25bd4b70-d8a0-4f5e-81e4-2722feffbea3 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] HTTP exception thrown: Instance 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e could not be found. Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25bd4b70-d8a0-4f5e-81e4-2722feffbea3 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Request method failure captured: Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/13f1e1f8-2e52-4a22-aae2-338ba0ebb23e/action HTTP/1.1 Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 15 Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMTnDFdnNoUlOBHpZTwaeKWFn1b8z7YU-rKEbFPU8IqRHHtQ_WgoDB4mAp6-WJvg8NQIFz1jbohfK10goxMwQDlAwDOVvJNcTvzH9vPO3h4hU5ajI0jT91HO4MUjvV3XpiFP1BSL6Jjp0aGzV1_QiAZ0BfcyshhZ6w_3jBJkO-gfZE Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:25:34.371833 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7932236751b44421a4ede0fb3016ae48", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}] Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 73b0e9926c8c4e0489fc29547690b29b Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: {"migrate": {}} Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:25:34.373327 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e could not be found. Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '13f1e1f8-2e52-4a22-aae2-338ba0ebb23e', 'body': {'migrate': {}}} Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e could not be found. Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:25:34.374886 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e could not be found. Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e could not be found. Aug 30 03:25:34.376449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:25:34.377861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25bd4b70-d8a0-4f5e-81e4-2722feffbea3 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Returning 404 to user: Instance 13f1e1f8-2e52-4a22-aae2-338ba0ebb23e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:25:34.381770 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25bd4b70-d8a0-4f5e-81e4-2722feffbea3 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/13f1e1f8-2e52-4a22-aae2-338ba0ebb23e/action" status: 404 len: 111 microversion: 2.1 time: 0.156786 Aug 30 03:25:34.392484 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 238/489] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:25:34 2022] POST /compute/v2.1/servers/13f1e1f8-2e52-4a22-aae2-338ba0ebb23e/action => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:25:34.496498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1584820722", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:34.572464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:34.573078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:34.575631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:34.581845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:34.584001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:34.587035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:34.587907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:34.590418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:34.590865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.211003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:35.220831 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a557010f-dcea-41b7-8a0f-eb12a7dce38d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.653133 Aug 30 03:25:35.237879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 239/490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:34 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:35.243411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:35.244027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:35.251043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:35.265986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:35.266454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.268657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:35.269840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:35.269840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.486484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:35.488094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:35.489095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:35.490707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:35.491604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:35.504187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:35.504744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:35.505100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.505978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:35.506468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:35.506890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.525693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=11 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:35.538467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Getting quotas for project 57bb4a88ede645388513fe70414ffd80. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:35.546564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Getting quotas for user 3da64bce6c7a4ee49544e9679a3fd4a8 and project 57bb4a88ede645388513fe70414ffd80. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:35.562790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:35.566030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:35.619892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-296040d6-1f29-4ab9-9218-e5b7dc288804 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127815 Aug 30 03:25:35.627737 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 252/491] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:35.633599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:35.634587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:35.642800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:35.644259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:35.647360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.650634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:35.653029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:35.653676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:35.840624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:35.852138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:35.865120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:35.867630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:35.868245 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fcdb787d-9537-4a66-a4d6-ea72aa05bb92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1310 microversion: 2.1 time: 0.626231 Aug 30 03:25:35.882290 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 240/492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:35 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1310 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:35.889525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6513aff-a152-4486-bdae-672a208d9c3c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:35.891040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6513aff-a152-4486-bdae-672a208d9c3c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:35.899084 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ad3eef49-a494-4086-9da0-354834c1794b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.260148 Aug 30 03:25:35.910868 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 253/493] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:35 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:36.243031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:36.243653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:36.250092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.250581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.251041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:36.251741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.252192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.252807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:36.331653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6513aff-a152-4486-bdae-672a208d9c3c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:36.333916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=75 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:36.350432 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6513aff-a152-4486-bdae-672a208d9c3c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1222 microversion: 2.1 time: 0.473526 Aug 30 03:25:36.351921 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 241/494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:35 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1222 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:36.643691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fc25cb24-0098-4532-af49-42715a6dc5c0 req-505999b7-853d-40d3-bc1d-fb26fb3afb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1170de4-1a41-4f08-b7e7-a849e4d989cb", "tag": "e7664671-e712-452c-9885-3c98261fb754"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:36.657819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fc25cb24-0098-4532-af49-42715a6dc5c0 req-505999b7-853d-40d3-bc1d-fb26fb3afb55 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.659210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fc25cb24-0098-4532-af49-42715a6dc5c0 req-505999b7-853d-40d3-bc1d-fb26fb3afb55 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.660401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fc25cb24-0098-4532-af49-42715a6dc5c0 req-505999b7-853d-40d3-bc1d-fb26fb3afb55 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:36.677107 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fc25cb24-0098-4532-af49-42715a6dc5c0 req-505999b7-853d-40d3-bc1d-fb26fb3afb55 service nova] Creating event network-changed:e7664671-e712-452c-9885-3c98261fb754 for instance c1170de4-1a41-4f08-b7e7-a849e4d989cb on n-h2-854924-5 Aug 30 03:25:36.683812 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fc25cb24-0098-4532-af49-42715a6dc5c0 req-505999b7-853d-40d3-bc1d-fb26fb3afb55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043663 Aug 30 03:25:36.684893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 242/495] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:36.849018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:36.859865 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-717a96b1-2995-42ad-a368-53da87e8af94 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.620167 Aug 30 03:25:36.860400 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 254/496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:36 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:36.888969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:36.889769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:36.898034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.898684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.899182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:36.899980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.900496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.900980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:36.925896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:36.926573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:36.945593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.955625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.956093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:36.956916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:36.957486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:36.957826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:37.091772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:37.103439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:37.104870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:37.120779 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-520193fb-0945-4753-a3b9-197442b4dce5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.200349 Aug 30 03:25:37.121610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 255/497] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:36 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:37.374040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:37.374853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:37.381321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:37.382067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:37.382680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:37.383561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:37.384164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:37.384734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:37.637671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:37.647354 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-568cef58-a517-456f-a648-a5f52a124325 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1280 microversion: 2.1 time: 0.277034 Aug 30 03:25:37.648498 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 256/498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:37 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:37.747476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:37.771002 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f03c80d6-55c5-46cd-8bfe-3db26798afe4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1310 microversion: 2.1 time: 0.885148 Aug 30 03:25:37.773041 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 243/499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:36 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1310 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:37.882748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:37.883379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:37.897451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:37.898141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:37.898799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:37.900170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:37.900803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:37.901227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.159088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:38.159823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:38.172255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.172611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.173055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.173868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.174314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.175779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.375671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:38.390134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:38.392151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:38.403213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dbb5dadd-9033-4f33-b1f7-1889a63cded7 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.252756 Aug 30 03:25:38.404378 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 244/500] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:38 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:38.453064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:38.455300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:38.463198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3425b631-8dbb-4109-ba8b-41bfb12b7296 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.584508 Aug 30 03:25:38.478183 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 257/501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:37 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:38.669592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:38.670649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:38.686501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.690608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.691555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.693201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.694350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.695004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.720754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f1c86c18-c0bb-4567-bd76-141313c8ba65 req-855d5853-32d2-4293-bfdf-a649a7c3e24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3a9feb-782c-474d-a994-e9748a03c1f8", "tag": "f0f9df97-f714-4929-81e4-4f1ba4b44b24"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:38.749151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f1c86c18-c0bb-4567-bd76-141313c8ba65 req-855d5853-32d2-4293-bfdf-a649a7c3e24d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.751864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f1c86c18-c0bb-4567-bd76-141313c8ba65 req-855d5853-32d2-4293-bfdf-a649a7c3e24d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.753960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f1c86c18-c0bb-4567-bd76-141313c8ba65 req-855d5853-32d2-4293-bfdf-a649a7c3e24d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.789232 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f1c86c18-c0bb-4567-bd76-141313c8ba65 req-855d5853-32d2-4293-bfdf-a649a7c3e24d service nova] Creating event network-changed:f0f9df97-f714-4929-81e4-4f1ba4b44b24 for instance ab3a9feb-782c-474d-a994-e9748a03c1f8 on n-h1-854924-5 Aug 30 03:25:38.799809 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f1c86c18-c0bb-4567-bd76-141313c8ba65 req-855d5853-32d2-4293-bfdf-a649a7c3e24d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083618 Aug 30 03:25:38.801648 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 258/502] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:38.808849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:38.810651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:38.820311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.821050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.822337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.823209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:38.823843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:38.824408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:38.832655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:38.846143 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-813cb8f6-4ef2-45a2-9b3c-684cc87b7244 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1280 microversion: 2.1 time: 0.180141 Aug 30 03:25:38.846804 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 245/503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:38 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:39.430301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:39.430825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:39.432799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:39.451293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.452044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.452638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:39.453566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.454178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.454791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:39.484478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:39.599154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:39.614127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-661c920f-77d0-4c02-9b0c-822219ef98ca tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1310 microversion: 2.1 time: 0.810858 Aug 30 03:25:39.614826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 259/504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:38 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1310 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:39.619866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:39.620480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:39.639297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.639796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.640237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:39.640963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.641446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.641921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:39.678992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:39.689383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:39.690760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:39.708747 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a30da88-421d-4cce-bc2f-5ce431fb0d54 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.282631 Aug 30 03:25:39.725778 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 246/505] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:39 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:39.735469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-de371f88-5691-45a7-a7c2-08b515d1b759 req-c4d40acd-4964-4dd0-8fe6-9f15aa465852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa8099c-f76b-4bb1-880f-b6422d1ac7c6", "name": "network-vif-plugged", "status": "completed", "tag": "57b82505-7683-441b-871d-3f24751cddff"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:39.746808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-de371f88-5691-45a7-a7c2-08b515d1b759 req-c4d40acd-4964-4dd0-8fe6-9f15aa465852 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.747547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-de371f88-5691-45a7-a7c2-08b515d1b759 req-c4d40acd-4964-4dd0-8fe6-9f15aa465852 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.748132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-de371f88-5691-45a7-a7c2-08b515d1b759 req-c4d40acd-4964-4dd0-8fe6-9f15aa465852 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:39.763857 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-de371f88-5691-45a7-a7c2-08b515d1b759 req-c4d40acd-4964-4dd0-8fe6-9f15aa465852 service nova] Creating event network-vif-plugged:57b82505-7683-441b-871d-3f24751cddff for instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 on n-h2-854924-5 Aug 30 03:25:39.769330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-de371f88-5691-45a7-a7c2-08b515d1b759 req-c4d40acd-4964-4dd0-8fe6-9f15aa465852 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041713 Aug 30 03:25:39.770295 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 247/506] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:39.868623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:39.869819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:39.885166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.888236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.888798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:39.889853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:39.896110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:39.896731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:40.284918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:40.297142 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc449b71-acf9-4a21-82c8-49163270c175 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.681203 Aug 30 03:25:40.299227 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 260/507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:39 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:40.346035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:40.356778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b77f8ac8-63b8-4675-9b0b-65e036203d47 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.493273 Aug 30 03:25:40.357914 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 248/508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:39 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:40.640396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:40.641753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:40.654430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:40.655250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:40.656042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:40.656929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:40.659711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:40.660177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:40.739857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:40.740739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:40.748392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:40.749267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:40.749908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:40.750838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:40.751627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:40.752274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:40.849642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:40.860241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:40.862220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:40.870449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:40.878830 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fee1fe6f-f1e3-47d8-a94a-b18b9c5bd0d2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.143038 Aug 30 03:25:40.879712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 249/509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:40 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:25:40.889742 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bb960685-d6fa-406f-8e9a-c4201b1457dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1310 microversion: 2.1 time: 0.243080 Aug 30 03:25:40.890370 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 261/510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:40 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1310 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:41.320101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:41.321660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:41.337160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.338092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.338731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.339753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.354822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.355640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.382525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:41.383684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:41.399120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.399120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.404407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.408917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.411802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.413364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.808845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:41.816884 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2fa07f66-901a-4f4d-b8af-67eb99c12271 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.440507 Aug 30 03:25:41.817471 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 262/511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:41 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:41.824547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:41.840419 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61efc57e-8b34-4ec6-a0da-29e78a65d8b9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.525657 Aug 30 03:25:41.841262 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 250/512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:41 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:41.910945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:41.913692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:41.915755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:41.916734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:41.936559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.937116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.937586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.938035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.938313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.938866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.939193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.939303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.939945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:41.940855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:41.941618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:41.942282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:42.118919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:42.130519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:42.140475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:42.150261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-201923c9-004c-4ec1-940b-fd5f04cf806b tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1446 microversion: 2.75 time: 0.249507 Aug 30 03:25:42.151407 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 263/513] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:41 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1446 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:42.443980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:42.456750 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30eadec3-b2f8-45f8-9d2a-bfdeb996a415 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1494 microversion: 2.1 time: 0.549254 Aug 30 03:25:42.458578 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 251/514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:41 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1494 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:42.637870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-178593437", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:42.714028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:42.719598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:42.720776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:42.727455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:42.728205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:42.728822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:42.729731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:42.730497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:42.731085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:43.654049 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b685608e-6b14-4b9d-be74-62fd6b8a5d0c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1645 microversion: 2.1 time: 1.175796 Aug 30 03:25:43.654708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 252/515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:42 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1645 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:43.674708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:43.675330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:43.707330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:43.707832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:43.708278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:43.709526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:43.709963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:43.710391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.118748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:44.119848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:44.120619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:44.123426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:44.124116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:44.139893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.140375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.140800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.141546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.144201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.144534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.173747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:44.183554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for user 948d18cc663b48028570132678823b93 and project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:44.212845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:44.215488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:44.283351 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fef4ff51-5bbe-4303-98e3-fc11897125bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816490 Aug 30 03:25:44.295534 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 264/516] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:44.307738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:44.309481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:44.321729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:44.324857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.330098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.330667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.331628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.332233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.335782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.344193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:44.377987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4f97519-6d0d-4c07-9675-dddf126e084a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.713895 Aug 30 03:25:44.384096 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 253/517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:43 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:44.412483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:44.415161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:44.433720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.436537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.440641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.441872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.442565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.444010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.612364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:44.625878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:44.627251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:44.639170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfe0627c-b366-40a7-b503-78ce912363d5 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1452 microversion: 2.75 time: 0.253046 Aug 30 03:25:44.639887 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 254/518] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:44 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:44.644432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:44.645305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:44.651859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.652672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.653326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.654270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:44.655610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:44.656625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:44.979560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:44.994099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dbb0f33d-8aa7-41eb-a9ec-07cd1c91433f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.696124 Aug 30 03:25:44.995536 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 265/519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:44 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:45.000642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:45.001381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:45.008614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.009275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.010040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.010825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.011400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.012033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.194047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:45.220929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a717e8a-cf39-422a-b7b3-1d9f45af0fc0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1216 microversion: 2.1 time: 0.224154 Aug 30 03:25:45.221535 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-659fcec0-d048-4d1a-ba23-77f9d4daaf35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1645 microversion: 2.1 time: 0.579185 Aug 30 03:25:45.222018 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 266/520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:44 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:45.234010 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 255/521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:44 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1645 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:45.243985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-74ad3ad1-785e-4a5b-bec3-cf0be61f7f23 req-22b56800-7b18-4ccc-8dac-9f6d64a3e2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4", "tag": "976e6900-cca6-4433-9efd-b31e84838830"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:45.254801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:45.260222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.261087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.261719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.262601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.263221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.263421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-74ad3ad1-785e-4a5b-bec3-cf0be61f7f23 req-22b56800-7b18-4ccc-8dac-9f6d64a3e2de service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.263982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-74ad3ad1-785e-4a5b-bec3-cf0be61f7f23 req-22b56800-7b18-4ccc-8dac-9f6d64a3e2de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.264675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.264816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-74ad3ad1-785e-4a5b-bec3-cf0be61f7f23 req-22b56800-7b18-4ccc-8dac-9f6d64a3e2de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.284514 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-74ad3ad1-785e-4a5b-bec3-cf0be61f7f23 req-22b56800-7b18-4ccc-8dac-9f6d64a3e2de service nova] Creating event network-changed:976e6900-cca6-4433-9efd-b31e84838830 for instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 on n-h1-854924-5 Aug 30 03:25:45.293416 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-74ad3ad1-785e-4a5b-bec3-cf0be61f7f23 req-22b56800-7b18-4ccc-8dac-9f6d64a3e2de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068101 Aug 30 03:25:45.295962 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 256/522] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:45.305655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c73f2714-a7e8-4492-b704-303819351ef6 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054362 Aug 30 03:25:45.313638 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 267/523] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:25:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:45.319516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:45.322930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:45.330269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.330973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.331617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.333013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.333664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.334853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.410233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:45.411033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:45.424248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.424910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.426166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.428148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.429548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.431066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:45.708579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lazy-loading 'flavor' on Instance uuid cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:45.783811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Going to try to live migrate instance to n-h1-854924-5 {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:25:45.936645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:45.950476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b589e5b7-769e-4a59-8776-6aaf2281988d tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.549411 Aug 30 03:25:45.951799 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 268/524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:45 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:45.959054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-15fc6893-962b-4bcc-a8e8-aaae8c5d475d req-d1744a82-1ce4-420a-b022-8355fc074146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1170de4-1a41-4f08-b7e7-a849e4d989cb", "name": "network-vif-plugged", "status": "completed", "tag": "e7664671-e712-452c-9885-3c98261fb754"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:45.993718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15fc6893-962b-4bcc-a8e8-aaae8c5d475d req-d1744a82-1ce4-420a-b022-8355fc074146 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:45.995438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15fc6893-962b-4bcc-a8e8-aaae8c5d475d req-d1744a82-1ce4-420a-b022-8355fc074146 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:45.995875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15fc6893-962b-4bcc-a8e8-aaae8c5d475d req-d1744a82-1ce4-420a-b022-8355fc074146 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.039454 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-15fc6893-962b-4bcc-a8e8-aaae8c5d475d req-d1744a82-1ce4-420a-b022-8355fc074146 service nova] Creating event network-vif-plugged:e7664671-e712-452c-9885-3c98261fb754 for instance c1170de4-1a41-4f08-b7e7-a849e4d989cb on n-h2-854924-5 Aug 30 03:25:46.046342 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-15fc6893-962b-4bcc-a8e8-aaae8c5d475d req-d1744a82-1ce4-420a-b022-8355fc074146 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093061 Aug 30 03:25:46.046944 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 269/525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:46.052277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:46.053543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:46.060041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.060946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.061396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.062415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.062867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.063287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.206431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:46.249017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:46.270708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:46.287747 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77eabbee-aa0e-4b60-ae81-cf416604172c tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1452 microversion: 2.75 time: 0.238497 Aug 30 03:25:46.289166 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 270/526] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:46 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:46.308615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:46.310506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:46.321756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.334161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.335170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.336569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.337568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.338475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.344900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:46.728368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:46.744393 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a027876-078c-4842-bdd1-34fe7421f1db tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.452303 Aug 30 03:25:46.760952 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 271/527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:46 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:46.769612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:46.771207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:46.780314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.781534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.782202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.784631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.785401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.786196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.874580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:46.884846 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-25016f1d-d6ff-4537-846c-57d47fa2ca92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1272 microversion: 2.1 time: 0.122586 Aug 30 03:25:46.895414 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 272/528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:46 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:46.972647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:46.973281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:46.982730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.983797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.984767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:46.985704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:46.988029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:46.988765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:47.600715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:47.609828 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c404a6b3-e34c-4b23-b113-ee8ce564324a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.641792 Aug 30 03:25:47.610660 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 273/529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:46 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:47.684662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-763324574", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6c5494dc-c3ff-4f66-b859-2513cfc9a502"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:47.750279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] validate_networks() for [('6c5494dc-c3ff-4f66-b859-2513cfc9a502', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:48.509903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:48.510326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:48.510794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:48.511752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:48.512192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:48.527819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:48.528312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:48.528754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:48.529590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:48.530253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:48.530675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:48.581858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Getting quotas for project cfd57c329f9d478c83e8a27a1b98fa9a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:48.600039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Getting quotas for user 11b4a2f12fbc443a8dbf55a0bc995eac and project cfd57c329f9d478c83e8a27a1b98fa9a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:48.657553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Going to run 3 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:48.661126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:48.731100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=97ac163f-21d5-4840-9842-9af9465a6b6f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:48.811730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:48.931534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1cdf837-99e9-4724-9be2-afa6b83afad1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319839 Aug 30 03:25:48.932572 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 274/530] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:48.943339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:48.944557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:48.957967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:48.958450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:48.959420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:48.960154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:48.960821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:48.961075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:49.292601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:49.336713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:49.345330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:49.357728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f40bb329-e7c6-473f-b5cc-2d7c41e2bef2 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1437 microversion: 2.75 time: 0.423822 Aug 30 03:25:49.382602 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 275/531] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:48 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1437 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:49.389786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:49.390681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:49.400817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:49.415071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:49.415871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:49.418095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:49.419258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:49.420225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:49.845724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:49.871548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5ba10f8-51e3-40eb-bb6e-ba91e0835cb5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.487655 Aug 30 03:25:49.874544 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 276/532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:49 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:49.882344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:49.883201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:49.894695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:49.896313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:49.897016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:49.897969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:49.898600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:49.899474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:50.322245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:50.337422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:50.343043 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ac4f2d9-9956-4e80-b6ce-47503864bf27 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1312 microversion: 2.1 time: 0.467055 Aug 30 03:25:50.343711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 277/533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:49 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:50.359285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3a2994d1-cdc6-4b73-b1ba-d4173a03a5d4 req-4fad0dc3-56f1-4446-900c-dcac5fa5183f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a9feb-782c-474d-a994-e9748a03c1f8", "name": "network-vif-plugged", "status": "completed", "tag": "f0f9df97-f714-4929-81e4-4f1ba4b44b24"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:50.392494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3a2994d1-cdc6-4b73-b1ba-d4173a03a5d4 req-4fad0dc3-56f1-4446-900c-dcac5fa5183f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:50.394036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3a2994d1-cdc6-4b73-b1ba-d4173a03a5d4 req-4fad0dc3-56f1-4446-900c-dcac5fa5183f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:50.394649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3a2994d1-cdc6-4b73-b1ba-d4173a03a5d4 req-4fad0dc3-56f1-4446-900c-dcac5fa5183f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:50.417476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3a2994d1-cdc6-4b73-b1ba-d4173a03a5d4 req-4fad0dc3-56f1-4446-900c-dcac5fa5183f service nova] Creating event network-vif-plugged:f0f9df97-f714-4929-81e4-4f1ba4b44b24 for instance ab3a9feb-782c-474d-a994-e9748a03c1f8 on n-h1-854924-5 Aug 30 03:25:50.423989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3a2994d1-cdc6-4b73-b1ba-d4173a03a5d4 req-4fad0dc3-56f1-4446-900c-dcac5fa5183f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072004 Aug 30 03:25:50.429867 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 278/534] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:50.438308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:50.439223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:50.456802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:50.457600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:50.458478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:50.460311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:50.461204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:50.462395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:50.783213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69f26956-f0b5-4b56-b447-4e4e30af4888 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6/action" status: 202 len: 0 microversion: 2.1 time: 5.467900 Aug 30 03:25:50.784046 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 257/535] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:25:45 2022] POST /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6/action => generated 0 bytes in 5470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:25:50.791522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:50.801185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:50.802309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:25:50.811851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:50.812635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:50.813435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:50.814271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:50.814926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:50.815569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:50.930623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:25:51.009973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:51.022387 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e14d0d1f-2d83-42d3-8659-f6b6cf84efe0 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.590284 Aug 30 03:25:51.024683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 279/536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:50 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:51.063671 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6d49a8f-32bf-4922-b5c4-68fca1d1cced tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.277991 Aug 30 03:25:51.065011 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 258/537] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:25:50 2022] GET /compute/v2.1/servers => generated 1015 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:51.070674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f3825d0b-acd9-4e46-9157-bad9051e1317 req-eff9868d-be50-45b7-95bf-1ef486aab615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de1eff5-6c6c-4c7f-80cf-67c968b17c6c", "tag": "b052046b-e33c-43d9-83ca-4c6c2d1c1945"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:51.104772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f3825d0b-acd9-4e46-9157-bad9051e1317 req-eff9868d-be50-45b7-95bf-1ef486aab615 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.105444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f3825d0b-acd9-4e46-9157-bad9051e1317 req-eff9868d-be50-45b7-95bf-1ef486aab615 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.106041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f3825d0b-acd9-4e46-9157-bad9051e1317 req-eff9868d-be50-45b7-95bf-1ef486aab615 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.123418 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f3825d0b-acd9-4e46-9157-bad9051e1317 req-eff9868d-be50-45b7-95bf-1ef486aab615 service nova] Creating event network-changed:b052046b-e33c-43d9-83ca-4c6c2d1c1945 for instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c on n-h2-854924-5 Aug 30 03:25:51.128952 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f3825d0b-acd9-4e46-9157-bad9051e1317 req-eff9868d-be50-45b7-95bf-1ef486aab615 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062390 Aug 30 03:25:51.130212 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 259/538] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:51.136420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:51.137458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.146097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.146842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.147542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.149018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.149735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.150375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.258644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:51.263206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.270861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.280296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.282132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.283013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.283783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.284400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.439084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:51.459510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:51.460086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:51.461282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:51.461911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:51.462597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:51.466913 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-edc4ca88-1e2b-429f-9c5e-948b9df3a945 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.334611 Aug 30 03:25:51.467572 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 260/539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:51 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:51.476930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:51.478029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.485747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.486320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.486825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.487588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.488155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.488647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.581643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.588811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.589483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.590093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.591020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.591628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.592434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.661244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:51.671584 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8c27473-ef46-477e-83af-f6b5aed89d08 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.202589 Aug 30 03:25:51.673134 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 261/540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:51 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:51.679231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:51.680118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.687493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.688226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.688813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.689978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.690676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.691257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.771921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:51.810390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:51.814943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:51.829713 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-001568ae-6248-4054-90a6-86274fccbd65 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1274 microversion: 2.1 time: 0.154700 Aug 30 03:25:51.830997 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 262/541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:51 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:51.842643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:51.844248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.856625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.857978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.859088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.860631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.861787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.862879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.872880 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cef6d0f5-b098-4ee2-be1c-857e9baba120 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6/action" status: 202 len: 1940 microversion: 2.75 time: 0.846903 Aug 30 03:25:51.874243 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 280/542] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:25:51 2022] POST /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6/action => generated 1940 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 03:25:51.916980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:51.918192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:51.929503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.930829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.931698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:51.933030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:51.934205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:51.935277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.187196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:52.211670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:52.221391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-842160e6-0be2-4a42-b509-fb8691d9b31e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1312 microversion: 2.1 time: 0.388515 Aug 30 03:25:52.222128 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 263/543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:51 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1312 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:52.227769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:52.228369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:52.234652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.235367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.235872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.236759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.237212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.237663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.265015 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-411d4094-681a-4bc5-bcd4-f1048f2c73cb tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.351992 Aug 30 03:25:52.267590 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 281/544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:51 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:52.426980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:52.435289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-306e0e01-b41a-4bc3-a442-907bfa00f8fe tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.211799 Aug 30 03:25:52.435901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 264/545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:52 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:52.493053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:52.493763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:52.504305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.506673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.507150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.507890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.508368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.508795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.655858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:52.664420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f24361a-63fb-4fc3-9f2f-47e8aa4ce9c2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.175783 Aug 30 03:25:52.664994 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 282/546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:52 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:52.696461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:52.697077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:52.704039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.704541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.705356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.706135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.706599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.707029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.856113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:52.859109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:52.876041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.876954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.877644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:52.879508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:52.880986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:52.881917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:53.133479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:53.149243 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e87f947-ca31-4948-855c-057578429e74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1313 microversion: 2.1 time: 0.456734 Aug 30 03:25:53.153155 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 265/547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:52 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:53.175744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:53.191707 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45f8c964-db0b-4604-8f30-f7601175bd55 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1274 microversion: 2.1 time: 0.340497 Aug 30 03:25:53.195050 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 283/548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:52 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:53.248614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:53.250161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:53.258527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:53.259808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:53.260559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:53.261833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:53.262533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:53.263202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:53.307439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:53.308313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:53.315330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:53.316500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:53.316990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:53.317760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:53.318789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:53.319276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:53.439268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:53.459106 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6271f6b3-8f43-460c-9970-12d5af8bda80 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.156343 Aug 30 03:25:53.459689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 284/549] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:53 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:53.464531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:53.465092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:53.471078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:53.471825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:53.472422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:53.473284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:53.473997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:53.474603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.063823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:54.075061 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fffea903-dae1-437f-a702-6800134787bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1312 microversion: 2.1 time: 0.830753 Aug 30 03:25:54.077025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 266/550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:53 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1312 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:25:54.084991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:54.086105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:54.093975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.094946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.095825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.096875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.097605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.098469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.308503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:54.324626 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c23d3877-dcae-4979-a85a-f0a286bf5e12 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.863606 Aug 30 03:25:54.327757 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 285/551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:53 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:54.347896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e8750f20-ebbe-4837-ba31-27dc022cfc88 req-f3ad6e34-3c32-46a4-9327-bb26c7176ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4", "name": "network-vif-plugged", "status": "completed", "tag": "976e6900-cca6-4433-9efd-b31e84838830"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:54.358121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e8750f20-ebbe-4837-ba31-27dc022cfc88 req-f3ad6e34-3c32-46a4-9327-bb26c7176ca6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.358912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e8750f20-ebbe-4837-ba31-27dc022cfc88 req-f3ad6e34-3c32-46a4-9327-bb26c7176ca6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.359525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e8750f20-ebbe-4837-ba31-27dc022cfc88 req-f3ad6e34-3c32-46a4-9327-bb26c7176ca6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.372024 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e8750f20-ebbe-4837-ba31-27dc022cfc88 req-f3ad6e34-3c32-46a4-9327-bb26c7176ca6 service nova] Creating event network-vif-plugged:976e6900-cca6-4433-9efd-b31e84838830 for instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 on n-h1-854924-5 Aug 30 03:25:54.378083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e8750f20-ebbe-4837-ba31-27dc022cfc88 req-f3ad6e34-3c32-46a4-9327-bb26c7176ca6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036833 Aug 30 03:25:54.379071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 286/552] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:54.389705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:54.390649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:54.398848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.399668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.400280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.401175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.401888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.402488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.635354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:54.644533 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8706784d-43de-4034-8cd7-89a0de060636 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.566041 Aug 30 03:25:54.645486 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 267/553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:54 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:54.652046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:54.652847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:54.656466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:54.667067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.667638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.669379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.669815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.670748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.671285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.827788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:54.838736 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-425087b6-9807-4b70-bc1a-577e6b84e51c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1462 microversion: 2.1 time: 0.457743 Aug 30 03:25:54.840825 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 287/554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:54 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1462 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:54.846192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:54.847041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:54.854990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.855731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.856354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.857367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:54.869987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:54.871256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:54.986068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:54.986806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:54.997087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a2250eb-3081-48f0-8b6d-24488f466a71 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.349061 Aug 30 03:25:54.998086 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 268/555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:54 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:55.003120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:55.004041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:55.010989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.011779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.012458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.013489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.014202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.014971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.018940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b85a537-6559-483c-834c-a8ad9ca0e462 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.176595 Aug 30 03:25:55.020100 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 288/556] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:54 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:55.102144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:55.103002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:55.109911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.110691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.111423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.112533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.112998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.113671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.504980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:55.544054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f2dc049-5cba-44e4-a6e4-013ea74a89cf tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1463 microversion: 2.1 time: 0.544279 Aug 30 03:25:55.546857 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 269/557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:54 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1463 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:55.552166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9c245f38-b4e7-44dc-a6ca-8260c464c483 req-41440314-c141-4644-9905-98f621909f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc", "tag": "3bae855b-829b-4283-85a2-d077c146decf"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:55.569398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9c245f38-b4e7-44dc-a6ca-8260c464c483 req-41440314-c141-4644-9905-98f621909f22 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.575138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9c245f38-b4e7-44dc-a6ca-8260c464c483 req-41440314-c141-4644-9905-98f621909f22 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.576538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9c245f38-b4e7-44dc-a6ca-8260c464c483 req-41440314-c141-4644-9905-98f621909f22 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.596329 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9c245f38-b4e7-44dc-a6ca-8260c464c483 req-41440314-c141-4644-9905-98f621909f22 service nova] Creating event network-changed:3bae855b-829b-4283-85a2-d077c146decf for instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc on n-h2-854924-5 Aug 30 03:25:55.616672 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9c245f38-b4e7-44dc-a6ca-8260c464c483 req-41440314-c141-4644-9905-98f621909f22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068384 Aug 30 03:25:55.617573 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 270/558] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:55.624149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:55.625105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:55.636857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.639286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.640410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.641653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.643907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.644636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.659752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:55.680347 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-addd8e33-bdc4-448b-8873-864f4c01b39d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1312 microversion: 2.1 time: 0.586933 Aug 30 03:25:55.685771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 289/559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:55 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:55.691602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:55.692589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:55.720965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.721575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.723333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:55.725436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:55.726149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:55.726910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:56.179329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:56.189390 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a1a7d4e-cac1-448e-b680-b13952ad43a7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.501977 Aug 30 03:25:56.190320 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 290/560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:55 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:56.195643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1281578860", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c1170de4-1a41-4f08-b7e7-a849e4d989cb"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:56.211382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:56.222159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a919041-51d2-4784-b8d2-bb471501efc6 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1322 microversion: 2.1 time: 0.603127 Aug 30 03:25:56.223269 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 271/561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:55 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:56.228598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:56.229215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:56.235071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:56.235739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:56.236330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:56.237201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:56.237852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:56.238449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:56.256326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:25:56.855357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:56.868406 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d804d9b4-2577-44eb-916f-db628266090b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.643469 Aug 30 03:25:56.869536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 272/562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:56 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:56.877212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:56.882580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:56.902344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:56.902854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:56.903345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:56.905280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:56.905798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:56.906235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:57.101570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:57.151077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:25:57.151681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:25:57.152139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:25:57.152812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:25:57.153585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:25:57.161024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=82 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:57.176106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:57.177209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:57.178443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:57.179504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:57.180237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:57.180901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:57.216459 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-06f5ab96-85e3-4d6c-9007-4efd8a8af7db tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.345163 Aug 30 03:25:57.222730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 273/563] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:56 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:57.227757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:57.228374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:57.242029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Getting quotas for project fc50c2ff3ca9496db43ab1dcbad2347f. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:25:57.249898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:57.251720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:57.253205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Getting quotas for user c3bd201e25854ba8b76e36d0b2cdb553 and project fc50c2ff3ca9496db43ab1dcbad2347f. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:25:57.253374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:57.254875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:57.258161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:57.258642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:57.265581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:57.288706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:25:57.304244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:25:57.361681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40aea9eb-a730-40d7-b9a4-1b3012723888 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170075 Aug 30 03:25:57.362717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 291/564] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:25:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:25:57.368125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:57.369113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:57.376085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:57.381628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:57.382388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:57.383620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:57.384329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:57.384971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.239367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:58.241704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:58.253517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:58.254907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d56e6ce9-f52f-4cf5-9e5f-cde8325dc0a0 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.890696 Aug 30 03:25:58.256771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 292/565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:57 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:58.266262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:58.279812 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2de437a-f0ce-4965-989f-f9446ce0879c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1312 microversion: 2.1 time: 1.055889 Aug 30 03:25:58.280720 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 274/566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:57 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1312 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:58.283116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:58.297059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-14a13b09-186a-41e7-a84f-109b6b6494fa req-c87f5331-3fb6-4063-b817-2d342257165b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa8099c-f76b-4bb1-880f-b6422d1ac7c6", "name": "network-vif-unplugged", "status": "completed", "tag": "57b82505-7683-441b-871d-3f24751cddff"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:58.305100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.309174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-14a13b09-186a-41e7-a84f-109b6b6494fa req-c87f5331-3fb6-4063-b817-2d342257165b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.309964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-14a13b09-186a-41e7-a84f-109b6b6494fa req-c87f5331-3fb6-4063-b817-2d342257165b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.310615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-14a13b09-186a-41e7-a84f-109b6b6494fa req-c87f5331-3fb6-4063-b817-2d342257165b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.313714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.314905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.315954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.316431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.317408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.332795 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-14a13b09-186a-41e7-a84f-109b6b6494fa req-c87f5331-3fb6-4063-b817-2d342257165b service nova] Creating event network-vif-unplugged:57b82505-7683-441b-871d-3f24751cddff for instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 on n-h2-854924-5 Aug 30 03:25:58.339707 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-14a13b09-186a-41e7-a84f-109b6b6494fa req-c87f5331-3fb6-4063-b817-2d342257165b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057422 Aug 30 03:25:58.340619 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 275/567] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:58.352683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-aee82dfd-da83-4a86-8db0-8eed448be07f req-b9442027-56cb-4cb4-b52e-8fc7b23c2d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de1eff5-6c6c-4c7f-80cf-67c968b17c6c", "name": "network-vif-plugged", "status": "completed", "tag": "b052046b-e33c-43d9-83ca-4c6c2d1c1945"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:58.366785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-aee82dfd-da83-4a86-8db0-8eed448be07f req-b9442027-56cb-4cb4-b52e-8fc7b23c2d59 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.367541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-aee82dfd-da83-4a86-8db0-8eed448be07f req-b9442027-56cb-4cb4-b52e-8fc7b23c2d59 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.368148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-aee82dfd-da83-4a86-8db0-8eed448be07f req-b9442027-56cb-4cb4-b52e-8fc7b23c2d59 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.383241 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-aee82dfd-da83-4a86-8db0-8eed448be07f req-b9442027-56cb-4cb4-b52e-8fc7b23c2d59 service nova] Creating event network-vif-plugged:b052046b-e33c-43d9-83ca-4c6c2d1c1945 for instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c on n-h2-854924-5 Aug 30 03:25:58.390994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-aee82dfd-da83-4a86-8db0-8eed448be07f req-b9442027-56cb-4cb4-b52e-8fc7b23c2d59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048230 Aug 30 03:25:58.392545 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 276/568] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:58.412352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:58.413531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:58.432890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.433591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.434715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.437826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.438451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.438997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.630970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:58.641664 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e398aac-b410-40b0-8a10-b3a6e14c440c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1210 microversion: 2.1 time: 0.247425 Aug 30 03:25:58.642247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 277/569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:58 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1210 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:58.648136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-267e307a-fb2a-493c-a73b-abc089ce8d8e req-0cd20c5b-b068-4360-a07b-79977c35fa9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1ab00a-a65c-4283-bdd3-4a1e3c7da559", "tag": "2bf5519e-3191-4915-8475-dd6cfbb9b3a4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:58.658512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-267e307a-fb2a-493c-a73b-abc089ce8d8e req-0cd20c5b-b068-4360-a07b-79977c35fa9a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.658989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-267e307a-fb2a-493c-a73b-abc089ce8d8e req-0cd20c5b-b068-4360-a07b-79977c35fa9a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.659645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-267e307a-fb2a-493c-a73b-abc089ce8d8e req-0cd20c5b-b068-4360-a07b-79977c35fa9a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.845396 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-267e307a-fb2a-493c-a73b-abc089ce8d8e req-0cd20c5b-b068-4360-a07b-79977c35fa9a service nova] Creating event network-changed:2bf5519e-3191-4915-8475-dd6cfbb9b3a4 for instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 on n-h1-854924-5 Aug 30 03:25:58.850517 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-267e307a-fb2a-493c-a73b-abc089ce8d8e req-0cd20c5b-b068-4360-a07b-79977c35fa9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206856 Aug 30 03:25:58.851469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 278/570] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:58.857482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:58.858266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:58.869164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.870458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.871167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.872414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.873549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.874278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.883843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:58.893370 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e8610c35-f873-44d9-b44c-24b971621d66 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1471 microversion: 2.1 time: 0.632643 Aug 30 03:25:58.894137 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 293/571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:58 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1471 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:58.899179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:58.900591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:58.906604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.907716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.908307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:58.909022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:58.909576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:58.910207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.104853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:59.144486 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0f72e5b-525f-4870-adb6-fa3a85bdad27 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.249039 Aug 30 03:25:59.146870 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 294/572] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:25:58 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:25:59.154047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73efb4f2-5395-4281-aeb7-b041ca382056"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:59.157122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:59.166030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.166529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.166961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.167671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.168130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.168550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.212148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:59.233057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21c6f859-3af7-414b-acb7-7c892c7e3013 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.379877 Aug 30 03:25:59.233532 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 279/573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:58 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:59.238405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:25:59.239207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:59.250882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.251553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.252344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.253362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.254150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.254692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.279231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lazy-loading 'flavor' on Instance uuid 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:25:59.329608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:25:59.376711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd1ada34-94c7-442c-aad5-e789c7a805d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4/action" status: 202 len: 0 microversion: 2.1 time: 0.141731 Aug 30 03:25:59.381802 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 280/574] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:25:59 2022] POST /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:25:59.383685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:59.384478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:59.391077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.391646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.392143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.392907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.393449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.393935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.545544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:59.554901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e94c959c-fbe6-4119-a4da-bbb525d7ae60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.176249 Aug 30 03:25:59.555495 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 281/575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:59 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:59.560224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:59.560835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:59.567168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.567880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.569034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.569945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.570403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.570819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.696711 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67b73acb-df9c-41e7-a9a5-25bc5592ea96 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "POST /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547700 Aug 30 03:25:59.697608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 295/576] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:25:59 2022] POST /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:25:59.702708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:59.703480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:59.712028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.712762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.713406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.714290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.714905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.715973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.743415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:59.752060 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f537971d-42ee-486f-8f66-c7f2582f1cd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1312 microversion: 2.1 time: 0.195522 Aug 30 03:25:59.753085 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 282/577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:59 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:25:59.759800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:25:59.760634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:25:59.770787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.771367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.771964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.772679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:25:59.773720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:25:59.774171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:25:59.851550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:25:59.859455 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-038e3f39-3745-4f86-b1a3-d11f56a4dec3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1266 microversion: 2.1 time: 0.105582 Aug 30 03:25:59.860215 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 283/578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:59 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:00.004504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0dbaab8-087b-4a76-9fd6-bd383174b1d7 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1630 microversion: 2.1 time: 0.305953 Aug 30 03:26:00.005138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 296/579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:25:59 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1630 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:00.176307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:00.176836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:00.183378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.183863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.184301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.184995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.185476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.185906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.254730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:00.255694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:00.263805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.264909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:00.265648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.266318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.267469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.268138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.269407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.290619 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-729264fc-8965-43cf-a5d1-96bcd5e3a66c tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.117941 Aug 30 03:26:00.291718 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 284/580] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:00 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:00.402792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa8099c-f76b-4bb1-880f-b6422d1ac7c6", "tag": "57b82505-7683-441b-871d-3f24751cddff"}, {"name": "network-changed", "server_uuid": "97ac163f-21d5-4840-9842-9af9465a6b6f", "tag": "7ac619bf-4b27-4849-9302-e3046e3f855b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:00.414133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.414615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.415041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.429160 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] Creating event network-changed:57b82505-7683-441b-871d-3f24751cddff for instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 on n-h2-854924-5 Aug 30 03:26:00.430043 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] Creating event network-changed:7ac619bf-4b27-4849-9302-e3046e3f855b for instance 97ac163f-21d5-4840-9842-9af9465a6b6f on n-h1-854924-5 Aug 30 03:26:00.430200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:00.438222 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6a60bbc0-1885-4b30-be4e-542854a18352 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.187320 Aug 30 03:26:00.439315 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 297/581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:00 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:00.457625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-dbee4eeb-9367-4d4d-bfc4-36704d57ccf3 req-232d0566-61f4-4125-bb93-2fa635a3bd4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058080 Aug 30 03:26:00.459147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 285/582] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:26:00.579048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:00.579674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:00.586421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.587189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.587694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.588404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.588860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.589285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.776770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:00.778570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:00.788156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.789495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.791431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.792573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.794115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.795252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.807335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:00.824281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bef8c9fc-61af-4a68-b2cd-1d7840675a60 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.249176 Aug 30 03:26:00.824881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 298/583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:00 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:00.877326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:00.880378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:00.881100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:00.894381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.894883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.895430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:00.896657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:00.897119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:00.897570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:01.017260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:01.031475 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-108507bd-5177-4df2-b481-052aa92b7d28 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1272 microversion: 2.1 time: 0.155296 Aug 30 03:26:01.034234 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 299/584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:00 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:01.045995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:01.049935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:01.063273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:01.063782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:01.064194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:01.064922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:01.065397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:01.065826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:01.334906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:01.349626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d11ab0fc-cbcd-4300-b995-034021a34f43 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1462 microversion: 2.1 time: 0.578659 Aug 30 03:26:01.357398 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 286/585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:00 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1462 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:01.363173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:01.363807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:01.375273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:01.375979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:01.376609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:01.377698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:01.378323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:01.378914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:01.560180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:01.602650 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-148ebdea-9b63-4d3c-92a5-7c9121000238 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.243637 Aug 30 03:26:01.617372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 287/586] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:01 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:01.722345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:01.723014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:01.744241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:01.744481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:01.744752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:01.745752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:01.746209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:01.746684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:02.135625 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d4ecc8d-9db3-4a8c-a6d5-cfc4ca1414bb tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1630 microversion: 2.1 time: 1.100022 Aug 30 03:26:02.136216 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 300/587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:01 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1630 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:02.154794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:02.155758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:02.163805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:02.164639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:02.165475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:02.166449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:02.166913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:02.167437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:02.589505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:02.605245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2cfa26c2-749d-4de8-a915-b9fa37fd3aab tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.458246 Aug 30 03:26:02.609640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 301/588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:02 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:02.617953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-82ea4b38-daea-4089-8cad-fe823cc411c8 req-b7e28da0-ea87-44a1-b653-33181eb22eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc", "name": "network-vif-plugged", "status": "completed", "tag": "3bae855b-829b-4283-85a2-d077c146decf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:02.660132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-82ea4b38-daea-4089-8cad-fe823cc411c8 req-b7e28da0-ea87-44a1-b653-33181eb22eed service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:02.660870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-82ea4b38-daea-4089-8cad-fe823cc411c8 req-b7e28da0-ea87-44a1-b653-33181eb22eed service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:02.661328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-82ea4b38-daea-4089-8cad-fe823cc411c8 req-b7e28da0-ea87-44a1-b653-33181eb22eed service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:02.677942 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-82ea4b38-daea-4089-8cad-fe823cc411c8 req-b7e28da0-ea87-44a1-b653-33181eb22eed service nova] Creating event network-vif-plugged:3bae855b-829b-4283-85a2-d077c146decf for instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc on n-h2-854924-5 Aug 30 03:26:02.684170 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-82ea4b38-daea-4089-8cad-fe823cc411c8 req-b7e28da0-ea87-44a1-b653-33181eb22eed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074723 Aug 30 03:26:02.685254 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 302/589] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:02.693812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:02.694528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:02.704661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:02.705252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:02.705749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:02.706512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:02.707329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:02.708135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.199541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27649f02-0c28-4cbc-b202-5101ad0e6bfb tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1613 microversion: 2.1 time: 1.579929 Aug 30 03:26:03.200292 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 288/590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:01 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1613 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:03.206311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:03.207315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:03.216510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.217407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.218212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.219437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.220094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.220648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.399948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:03.409120 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-79eaeead-a49c-44ff-9528-4185aeff7478 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.722560 Aug 30 03:26:03.421830 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 303/591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:02 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:03.428879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2542600c-9131-4a18-a801-4ae1e43db1b6 req-61c0da77-4e20-4eec-bcae-ca491cb65dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe5611c-680e-4656-8942-0bcab5aeda8c", "tag": "637d35ab-e0e2-4fc8-a907-a6992d7f63d1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:03.439660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2542600c-9131-4a18-a801-4ae1e43db1b6 req-61c0da77-4e20-4eec-bcae-ca491cb65dc3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.441089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2542600c-9131-4a18-a801-4ae1e43db1b6 req-61c0da77-4e20-4eec-bcae-ca491cb65dc3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.441830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2542600c-9131-4a18-a801-4ae1e43db1b6 req-61c0da77-4e20-4eec-bcae-ca491cb65dc3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.462639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2542600c-9131-4a18-a801-4ae1e43db1b6 req-61c0da77-4e20-4eec-bcae-ca491cb65dc3 service nova] Creating event network-changed:637d35ab-e0e2-4fc8-a907-a6992d7f63d1 for instance afe5611c-680e-4656-8942-0bcab5aeda8c on n-h2-854924-5 Aug 30 03:26:03.469939 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2542600c-9131-4a18-a801-4ae1e43db1b6 req-61c0da77-4e20-4eec-bcae-ca491cb65dc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044897 Aug 30 03:26:03.471391 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 304/592] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:03.483436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:03.485027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:03.496496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.497245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.497951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.499008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.499678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.500419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.624233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:03.637229 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2fe39b99-82e7-45ca-9a8d-f33b4f29f3a7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.435323 Aug 30 03:26:03.640288 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 289/593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:03 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:03.644082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:03.644717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:03.659003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.659943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.661746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.662236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:03.663417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.664433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.665133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.700865 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f9c67c2-ebc3-410d-89b8-e0c3a11c4de9 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.227170 Aug 30 03:26:03.702938 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 305/594] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:03 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:03.709983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:03.711346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:03.720306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.721243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.722209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.724605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.725477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.725986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.841955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0132d42b469b433b9ef6a21e0d2c868e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7314d94504457abb9dcdc58a4774d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:03.842671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] flavor_id is None. Assuming migration. {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 03:26:03.843203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 03:26:03.917833 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aab918d2-4159-40d1-affe-a0e8a2d329ef tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1613 microversion: 2.1 time: 0.278584 Aug 30 03:26:03.918662 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 290/595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:03 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1613 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:03.926541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:03.927252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:03.935800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.936356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.936793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:03.937613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:03.938377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:03.938840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.025129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8eaf2cb-8ae8-4aaa-b9ba-c4e7fd68e830 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c/action" status: 202 len: 0 microversion: 2.1 time: 0.320251 Aug 30 03:26:04.025762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 306/596] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:03 2022] POST /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:26:04.031303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:04.031895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.038817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.039319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.039757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.040531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.040902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.041319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.053530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:04.106364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] HTTP exception thrown: Cannot 'migrate' instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 while it is in vm_state suspended Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Request method failure captured: Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4/action HTTP/1.1 Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 15 Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYMTnDFdnNoUlOBHpZTwaeKWFn1b8z7YU-rKEbFPU8IqRHHtQ_WgoDB4mAp6-WJvg8NQIFz1jbohfK10goxMwQDlAwDOVvJNcTvzH9vPO3h4hU5ajI0jT91HO4MUjvV3XpiFP1BSL6Jjp0aGzV1_QiAZ0BfcyshhZ6w_3jBJkO-gfZE Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:26:04.108363 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7932236751b44421a4ede0fb3016ae48", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}] Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 73b0e9926c8c4e0489fc29547690b29b Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: {"migrate": {}} Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:26:04.110336 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'migrate' instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 while it is in vm_state suspended Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4', 'body': {'migrate': {}}} Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 in vm_state suspended. Cannot resize while the instance is in this state. Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.111312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 while it is in vm_state suspended Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.113056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.114550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:04.114550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:04.114550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 while it is in vm_state suspended Aug 30 03:26:04.114550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.114550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Returning 409 to user: Cannot 'migrate' instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 while it is in vm_state suspended {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:04.122357 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c8af372-9118-4eb9-b3ad-62d7ebdd9468 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4/action" status: 409 len: 148 microversion: 2.1 time: 0.095170 Aug 30 03:26:04.123084 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 307/597] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:04 2022] POST /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4/action => generated 148 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:26:04.129073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:04.129073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.144566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.145058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.145537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.146309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.147072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.147190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.153134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:04.162299 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7db89c29-49ae-4f0b-a642-0eb050f579a7 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.242628 Aug 30 03:26:04.179255 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 291/598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:03 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:04.192059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-327830fd-3159-4ac1-bc76-b0246b9bebe2 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-327830fd-3159-4ac1-bc76-b0246b9bebe2 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Request method failure captured: Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721/action HTTP/1.1 Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 39 Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMTnDFdnNoUlOBHpZTwaeKWFn1b8z7YU-rKEbFPU8IqRHHtQ_WgoDB4mAp6-WJvg8NQIFz1jbohfK10goxMwQDlAwDOVvJNcTvzH9vPO3h4hU5ajI0jT91HO4MUjvV3XpiFP1BSL6Jjp0aGzV1_QiAZ0BfcyshhZ6w_3jBJkO-gfZE Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:26:04.208422 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7932236751b44421a4ede0fb3016ae48", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}] Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 73b0e9926c8c4e0489fc29547690b29b Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: {"os-resetState": {"state": "invalid"}} Aug 30 03:26:04.210354 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '35cdc6ed-f632-420f-b5d5-93c0071fe721', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.211170 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:26:04.213018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 03:26:04.216282 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.216282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-327830fd-3159-4ac1-bc76-b0246b9bebe2 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:04.216282 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-327830fd-3159-4ac1-bc76-b0246b9bebe2 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721/action" status: 400 len: 144 microversion: 2.1 time: 0.023233 Aug 30 03:26:04.229776 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 292/599] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:04 2022] POST /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721/action => generated 144 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:04.235305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3236060-414d-4d51-9c0d-36116f54df23 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3236060-414d-4d51-9c0d-36116f54df23 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Request method failure captured: Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721/action HTTP/1.1 Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 31 Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMTnDFdnNoUlOBHpZTwaeKWFn1b8z7YU-rKEbFPU8IqRHHtQ_WgoDB4mAp6-WJvg8NQIFz1jbohfK10goxMwQDlAwDOVvJNcTvzH9vPO3h4hU5ajI0jT91HO4MUjvV3XpiFP1BSL6Jjp0aGzV1_QiAZ0BfcyshhZ6w_3jBJkO-gfZE Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:26:04.239412 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7932236751b44421a4ede0fb3016ae48", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}] Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 73b0e9926c8c4e0489fc29547690b29b Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: {"os-resetState": {"state": 1}} Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:04.241942 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '35cdc6ed-f632-420f-b5d5-93c0071fe721', 'body': {'os-resetState': {'state': 1}}} Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 1 Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:04.242756 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 03:26:04.246440 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.249926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3236060-414d-4d51-9c0d-36116f54df23 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:04.249926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3236060-414d-4d51-9c0d-36116f54df23 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721/action" status: 400 len: 120 microversion: 2.1 time: 0.010623 Aug 30 03:26:04.249926 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 293/600] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:04 2022] POST /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:04.260468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cefe152-c85e-43be-adf8-28aba8b3f2b5 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:04.262801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5cefe152-c85e-43be-adf8-28aba8b3f2b5 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Failed to fetch instance by id 999 {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:26:04.263425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5cefe152-c85e-43be-adf8-28aba8b3f2b5 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cefe152-c85e-43be-adf8-28aba8b3f2b5 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Request method failure captured: Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 37 Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMTnDFdnNoUlOBHpZTwaeKWFn1b8z7YU-rKEbFPU8IqRHHtQ_WgoDB4mAp6-WJvg8NQIFz1jbohfK10goxMwQDlAwDOVvJNcTvzH9vPO3h4hU5ajI0jT91HO4MUjvV3XpiFP1BSL6Jjp0aGzV1_QiAZ0BfcyshhZ6w_3jBJkO-gfZE Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:26:04.265213 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7932236751b44421a4ede0fb3016ae48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7932236751b44421a4ede0fb3016ae48", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7932236751b44421a4ede0fb3016ae48"}]}] Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7932236751b44421a4ede0fb3016ae48 Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1498124862 Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 73b0e9926c8c4e0489fc29547690b29b Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1498124862-project-admin Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: {"os-resetState": {"state": "error"}} Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:04.267111 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 999 could not be found. Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:04.267945 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cefe152-c85e-43be-adf8-28aba8b3f2b5 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:04.269763 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5cefe152-c85e-43be-adf8-28aba8b3f2b5 tempest-ServersAdminNegativeTestJSON-1498124862 tempest-ServersAdminNegativeTestJSON-1498124862-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.010571 Aug 30 03:26:04.276097 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 294/601] 10.222.0.30 () {60 vars in 1179 bytes} [Tue Aug 30 03:26:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:26:04.287862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:04.288699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.296817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.297579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.298203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.299105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.299730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.300336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.363316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:04.427119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:04.441116 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-816ee2dc-e6fa-4075-b894-80f3da03a1bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.316698 Aug 30 03:26:04.442671 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 308/602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:04 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:04.451489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:04.456642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.475217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.480306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.481326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.484562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.485483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.486839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.563607 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9fdda8e1-d299-4207-a432-ae28af1283ca tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 204 len: 0 microversion: 2.1 time: 0.280843 Aug 30 03:26:04.564423 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 295/603] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:04 2022] DELETE /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:26:04.573686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:04.574692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.582886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.584126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.584780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.585739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.586371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.586965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.825030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:04.845826 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c2c3e2f-697f-4a6b-a830-f1a67b3ba963 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.401671 Aug 30 03:26:04.846607 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 309/604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:04 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:04.866088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:04.866719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.867045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:04.873483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.873974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.874418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.875154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.875610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.876039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.878293 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92ef6c49-d891-43f0-91cc-710b30d613da tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1468 microversion: 2.1 time: 0.308868 Aug 30 03:26:04.879296 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 296/605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:04 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1468 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:04.885511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:04.886191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:04.895552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.895552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.895552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.895941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:04.896943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:04.897437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:04.994123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:05.007130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:05.015630 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c4a88ef-adbd-40dd-aa87-9211c5e9c280 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.135041 Aug 30 03:26:05.016560 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 297/606] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:04 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:05.150991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:05.172059 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9802e581-f60e-4819-9398-cc7cd8185a74 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.312561 Aug 30 03:26:05.173410 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 310/607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:04 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:05.191567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:05.192189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:05.211375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.211927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.212126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.213076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.213762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.214368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.375806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:05.388154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f44d50f0-5ce3-4c26-ad59-1523cc3d5bbd tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1322 microversion: 2.1 time: 0.201275 Aug 30 03:26:05.388745 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 298/608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:05 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:05.469729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:05.471058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:05.478902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.479731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.480384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.481271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.481967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.482616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.635325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:05.649710 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-347c53ae-0c2e-41a1-a325-edf7ce3d7cf2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.183358 Aug 30 03:26:05.650628 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 311/609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:05 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:05.872174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:05.874606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:05.886050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.886824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.887592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.888729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.889489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.890172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.900253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:05.901135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:05.908503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.909300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.909972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:05.910877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:05.911592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:05.912283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.113244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:06.119079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:06.122721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-847d2910-dd42-41cb-a72f-7c4dc5065d02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.257992 Aug 30 03:26:06.123456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 299/610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:05 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:06.127831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:06.128515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:06.135940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c29adec-8879-4920-b2e8-32306afa9fe3 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1468 microversion: 2.1 time: 0.240801 Aug 30 03:26:06.136610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 312/611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:05 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1468 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:06.147088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.147588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.148023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.148859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.149574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.150038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.198436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:06.198960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:06.206323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.206823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.207270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.207978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.208434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.208888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.224041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:06.247675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-191a0275-aaea-46db-a171-293c29bf1b8d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.123204 Aug 30 03:26:06.256298 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 300/612] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:06 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:06.361944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:06.370498 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f85b91a-dbd7-401f-8f27-685e2b45becd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.175692 Aug 30 03:26:06.371060 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 313/613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:06 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:06.412232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:06.413077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:06.419800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.420383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.420827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.421564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.422022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.422445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.577412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:06.585688 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7e8d061-5f91-4c0c-b86c-75b59b7390b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 200 len: 1513 microversion: 2.1 time: 0.177365 Aug 30 03:26:06.586268 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 301/614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:06 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:06.607683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:06.608288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:06.614414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.615479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.615914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.616608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.617056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.617512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.684782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:06.685449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:06.691656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.692152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.692576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.693651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:06.694158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:06.694719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:06.813953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:06.823203 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a1e4b15-38d7-4ff7-b697-b5800d04b6d8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1322 microversion: 2.1 time: 0.219095 Aug 30 03:26:06.823829 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 314/615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:06 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:06.870600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:06.882736 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af436290-c585-453c-ae5b-3ebdd6328560 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.202250 Aug 30 03:26:06.883771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 302/616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:06 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:07.156302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:07.156912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:07.157946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:07.158596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:07.164331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.164824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.165334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.166007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.166632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.167222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.171713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.172204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.172663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.173618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.173905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.174255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.211372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:07.273930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=5 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:07.387338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:07.390255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:07.395759 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27c2af36-ea72-4e0f-84da-079761a78c62 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1468 microversion: 2.1 time: 0.243350 Aug 30 03:26:07.397633 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 315/617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:07 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1468 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:07.402677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:07.403263 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0245db26-036e-495e-970a-65e75aa7b9fa tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.249330 Aug 30 03:26:07.403560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:07.404101 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 303/618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:07 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:07.408379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:07.409183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:07.414845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.415581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.416020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.416742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.417224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.417937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.421173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.421713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.423410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.423410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.423410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.423824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.502570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:07.520536 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21b2ff0b-775d-40cf-8809-a259a65fde19 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.121541 Aug 30 03:26:07.522163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 316/619] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:07 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:07.592245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5a2e8ac3-9594-4e95-9e79-1e76e7b6b684 req-9c5ff6d7-8e57-4334-9b81-8f4365d25ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1ab00a-a65c-4283-bdd3-4a1e3c7da559", "name": "network-vif-plugged", "status": "completed", "tag": "2bf5519e-3191-4915-8475-dd6cfbb9b3a4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:07.593438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:07.602755 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c2ff299-90d7-47f7-be88-8f32f64dc738 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.197756 Aug 30 03:26:07.603048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a2e8ac3-9594-4e95-9e79-1e76e7b6b684 req-9c5ff6d7-8e57-4334-9b81-8f4365d25ef5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.605409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a2e8ac3-9594-4e95-9e79-1e76e7b6b684 req-9c5ff6d7-8e57-4334-9b81-8f4365d25ef5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.605571 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 304/620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:07 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:07.605662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a2e8ac3-9594-4e95-9e79-1e76e7b6b684 req-9c5ff6d7-8e57-4334-9b81-8f4365d25ef5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.618094 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5a2e8ac3-9594-4e95-9e79-1e76e7b6b684 req-9c5ff6d7-8e57-4334-9b81-8f4365d25ef5 service nova] Creating event network-vif-plugged:2bf5519e-3191-4915-8475-dd6cfbb9b3a4 for instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 on n-h1-854924-5 Aug 30 03:26:07.623229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5a2e8ac3-9594-4e95-9e79-1e76e7b6b684 req-9c5ff6d7-8e57-4334-9b81-8f4365d25ef5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036417 Aug 30 03:26:07.623819 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 317/621] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:07.845561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:07.846086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:07.852239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.852750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.853667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.853667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.854475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.854847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.904725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:07.905593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:07.912062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.912552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.912992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:07.913828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:07.914279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:07.914700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.028750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:08.037797 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f64b0fbc-9032-4be0-926b-5cac99dc5050 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1322 microversion: 2.1 time: 0.196103 Aug 30 03:26:08.038387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 305/622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:07 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:08.079757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:08.087503 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0601f27a-676b-4bbb-a23c-7304a8a5f602 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.187108 Aug 30 03:26:08.088062 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 318/623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:07 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:08.418846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:08.419473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:08.425547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:08.426315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.426490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:08.426801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.427235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.427935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.428393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.428813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.437659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.438579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.439387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.440671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.441604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.442355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.637152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:08.644068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:08.644897 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5d5ee86-4f2f-4993-8bb6-da9d7b87e159 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1468 microversion: 2.1 time: 0.229908 Aug 30 03:26:08.645533 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 306/624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:08 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1468 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:08.650582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:08.651178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:08.653581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f12eb4b-c30a-454b-96e6-f51dca536e47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.231758 Aug 30 03:26:08.665506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 319/625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:08 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:08.665708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.665708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.665708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.665708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.666035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.666112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:08.666188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.666272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:08.667362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.667847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.668505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.669159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:08.669774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:08.670190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:08.761523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:08.781175 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a03a537d-91eb-4aea-85f6-056a9d5e0642 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.133910 Aug 30 03:26:08.782020 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 307/626] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:08 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:08.830011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:08.843591 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61cd01f5-adac-4049-be6b-ab2f4890b877 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.187735 Aug 30 03:26:08.845023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 320/627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:08 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:09.058281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:09.058945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:09.065306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.065813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.066248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.066941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.067393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.068316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.109416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:09.110034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:09.116583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.117078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.117615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.118245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.118696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.119118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.272448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:09.282039 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a3909886-cfd7-40d9-9e27-40d39535b323 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1322 microversion: 2.1 time: 0.227536 Aug 30 03:26:09.284037 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 308/628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:09 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:09.301329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:09.309604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9639f6a-1c96-49ee-8776-5530669320fd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.203925 Aug 30 03:26:09.310167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 321/629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:09 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:09.644048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1cba7ffa-d036-4561-ab73-a0131ab4e58e req-e88fc485-f871-46d2-823b-d48e78d6edeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe5611c-680e-4656-8942-0bcab5aeda8c", "name": "network-vif-plugged", "status": "completed", "tag": "637d35ab-e0e2-4fc8-a907-a6992d7f63d1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:09.655321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1cba7ffa-d036-4561-ab73-a0131ab4e58e req-e88fc485-f871-46d2-823b-d48e78d6edeb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.655788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1cba7ffa-d036-4561-ab73-a0131ab4e58e req-e88fc485-f871-46d2-823b-d48e78d6edeb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.656219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1cba7ffa-d036-4561-ab73-a0131ab4e58e req-e88fc485-f871-46d2-823b-d48e78d6edeb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.666781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:09.667463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:09.668078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1cba7ffa-d036-4561-ab73-a0131ab4e58e req-e88fc485-f871-46d2-823b-d48e78d6edeb service nova] Creating event network-vif-plugged:637d35ab-e0e2-4fc8-a907-a6992d7f63d1 for instance afe5611c-680e-4656-8942-0bcab5aeda8c on n-h2-854924-5 Aug 30 03:26:09.673195 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1cba7ffa-d036-4561-ab73-a0131ab4e58e req-e88fc485-f871-46d2-823b-d48e78d6edeb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033133 Aug 30 03:26:09.673924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.674141 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 309/630] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:09.674522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.674964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.676026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.676799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.678211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.679805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:09.680508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:09.687339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.688039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.688039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.688756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.689211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.689666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.923569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:09.931072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:09.940165 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9f8e0549-628c-441d-bdfe-0b9144f5b6df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.264813 Aug 30 03:26:09.940672 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0a9e7eaa-7ff7-42a2-bd7d-9a6aa152711c tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1468 microversion: 2.1 time: 0.277397 Aug 30 03:26:09.941655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 310/631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:09 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:09.947332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:09.948609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:09.952615 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 322/632] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:09 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:09.957890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.959318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.959769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:09.960497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.960756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:09.961428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.961990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.962505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.971015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.971933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.971933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:09.972824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:09.973563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:09.974874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.050190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:10.066695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:10.070255 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61d877d6-f1c7-4106-b505-d4a21947ed3f tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.127642 Aug 30 03:26:10.071040 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 311/633] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:09 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:10.130949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:10.138781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da85f424-af83-4c56-b877-85bec793d6fd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.184741 Aug 30 03:26:10.139344 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 323/634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:09 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:10.306105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:10.307178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:10.316266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.317026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.317590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.319231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.319988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.320503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.332010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:10.332777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:10.340198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.340862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.341942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.342094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.342505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.342920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.359196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:10.534258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:10.543163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:10.554906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f94ba3b-820d-4870-8e4e-858ac31e8080 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.227399 Aug 30 03:26:10.556120 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 324/635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:10 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:10.559195 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64378642-9fc4-4acf-80ec-2a01e1f0cf8d tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1322 microversion: 2.1 time: 0.258340 Aug 30 03:26:10.573521 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 312/636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:10 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:10.978074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:10.978697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:10.983637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:10.984409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:10.986263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.986753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.987242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.988003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.988550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.988976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.992901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.993460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.993867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:10.994563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:10.995271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:10.995693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.342325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:11.350758 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9d55597-5e38-41d5-acdd-92829372b0e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.377736 Aug 30 03:26:11.351535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 325/637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:10 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:11.356055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:11.356736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:11.362139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:11.364576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.365160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.365713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.366833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.367353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.368009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.373912 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cefc9c82-7c90-4b7e-8b63-03f927a24954 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1468 microversion: 2.1 time: 0.397509 Aug 30 03:26:11.380328 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 313/638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:10 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1468 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:11.387255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:11.396940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:11.411183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.412404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.412925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.413735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.414312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.414618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.419271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:11.533210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:11.557279 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-488f18a3-c592-4ac7-ad0d-738188041ffc tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.204607 Aug 30 03:26:11.558532 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 326/639] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:11 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:11.575968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:11.576910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:11.584316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.585036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.585657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.586693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.587213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.588063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.889707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:11.898769 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23bcdcb8-c5cc-41ca-b920-94b041826f5a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1314 microversion: 2.1 time: 0.515113 Aug 30 03:26:11.899697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 314/640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:11 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:11.906871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:11.907835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:11.915955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.917050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.917719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.918781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.919483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.920126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.926813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:11.935847 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e11fb3d2-edac-42fe-8dfd-07c584fcdabd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.363525 Aug 30 03:26:11.936783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 327/641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:11 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:11.941748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9bc20a27-4539-4f4b-9ca5-75533ca70c7f req-5410e106-e05b-4d27-a7a0-d8d14f1fdcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ac163f-21d5-4840-9842-9af9465a6b6f", "name": "network-vif-plugged", "status": "completed", "tag": "7ac619bf-4b27-4849-9302-e3046e3f855b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:11.953019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9bc20a27-4539-4f4b-9ca5-75533ca70c7f req-5410e106-e05b-4d27-a7a0-d8d14f1fdcd2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:11.954110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9bc20a27-4539-4f4b-9ca5-75533ca70c7f req-5410e106-e05b-4d27-a7a0-d8d14f1fdcd2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:11.954741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9bc20a27-4539-4f4b-9ca5-75533ca70c7f req-5410e106-e05b-4d27-a7a0-d8d14f1fdcd2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:11.967650 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9bc20a27-4539-4f4b-9ca5-75533ca70c7f req-5410e106-e05b-4d27-a7a0-d8d14f1fdcd2 service nova] Creating event network-vif-plugged:7ac619bf-4b27-4849-9302-e3046e3f855b for instance 97ac163f-21d5-4840-9842-9af9465a6b6f on n-h1-854924-5 Aug 30 03:26:11.972665 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9bc20a27-4539-4f4b-9ca5-75533ca70c7f req-5410e106-e05b-4d27-a7a0-d8d14f1fdcd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034369 Aug 30 03:26:11.973272 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 328/642] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:12.373393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:12.374280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:12.381794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.382287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.389973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.390897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.391460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.391909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.556466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:12.566862 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c7802c1-601a-416b-9f74-5c363928846a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1322 microversion: 2.1 time: 0.665660 Aug 30 03:26:12.572018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 315/643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:11 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:12.581637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:12.585214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:12.596201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.597809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.598307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.599969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.600583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.601563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.619390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:12.627448 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d59bf7c-da75-4586-bda3-965f94617037 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.259141 Aug 30 03:26:12.628026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 329/644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:12 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:12.632525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b611adf3-1d5c-47de-9a8f-ce56e4843257 req-bfaf88b5-50be-402d-a1d9-d9ed24459e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4", "name": "network-vif-deleted", "tag": "976e6900-cca6-4433-9efd-b31e84838830"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:12.641923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b611adf3-1d5c-47de-9a8f-ce56e4843257 req-bfaf88b5-50be-402d-a1d9-d9ed24459e88 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.642401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b611adf3-1d5c-47de-9a8f-ce56e4843257 req-bfaf88b5-50be-402d-a1d9-d9ed24459e88 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.642835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b611adf3-1d5c-47de-9a8f-ce56e4843257 req-bfaf88b5-50be-402d-a1d9-d9ed24459e88 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.656074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b611adf3-1d5c-47de-9a8f-ce56e4843257 req-bfaf88b5-50be-402d-a1d9-d9ed24459e88 service nova] Creating event network-vif-deleted:976e6900-cca6-4433-9efd-b31e84838830 for instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 on n-h1-854924-5 Aug 30 03:26:12.661307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b611adf3-1d5c-47de-9a8f-ce56e4843257 req-bfaf88b5-50be-402d-a1d9-d9ed24459e88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Aug 30 03:26:12.662612 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 330/645] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:12.668616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:12.669107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:12.674520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:12.675585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.675986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.676416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.677163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.678188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.680364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.686097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c7b906c6-67cf-4693-a8a8-dfcf4ce74383 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1426 microversion: 2.1 time: 0.112685 Aug 30 03:26:12.686732 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 316/646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:12 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:12.755156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:12.775272 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec02986e-cd70-47d5-ba28-ae20c7913503 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.111432 Aug 30 03:26:12.775854 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 331/647] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:12 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:12.927454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:12.928170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:12.935166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.935834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.936564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.937894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.938709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.939498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.958852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:12.959678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:12.963256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:12.967331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.967839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.968332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:12.969096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:12.969852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:12.970303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.168322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:13.175954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:13.176893 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b514bd2c-b6b6-4769-b0e0-ef723649c7cd tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1464 microversion: 2.1 time: 0.253408 Aug 30 03:26:13.177502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 317/648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:12 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:13.184009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-592b8bce-492e-4f81-9e79-d5a816efd631 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.229779 Aug 30 03:26:13.184600 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 332/649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:12 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:13.308560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:13.313659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'deleted': False, 'project_id': '72d7ae6f1b3a4da38a685f6530303c1d'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:13.320459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.320940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.321409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.322139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.322596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.323020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.417262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b96fa85-370e-4229-b012-a91c5646a641 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.222674 Aug 30 03:26:13.417878 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 318/650] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:26:13 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:26:13.436644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:13.443270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'deleted': False} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:13.449760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.450246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.450680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.451405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.451859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.452283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.573066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:13.588601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:13.589282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:13.595479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.595960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.596391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.597084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.597564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.597983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.712341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:13.713089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:13.713701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:13.971590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:13.986148 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-366fdc6b-04a0-4c05-b2eb-e92e9b97872b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1322 microversion: 2.1 time: 0.400899 Aug 30 03:26:13.988125 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 319/651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:13 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:13.995466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:13.996562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:14.004755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.005716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.006165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.007045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.007652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.008148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.236437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:14.245946 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-804f842c-09e6-4d09-8121-dacca44d908a tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1504 microversion: 2.1 time: 0.256323 Aug 30 03:26:14.255874 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 320/652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:13 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:14.262426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:14.262999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:14.270942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.271692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.272123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.272823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.273268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.273862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.310300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.310781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.311214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.311656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lazy-loading 'fault' on Instance uuid 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:14.351005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42344d00-829c-4fb9-8e4d-705b26a7acb6 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21070 microversion: 2.1 time: 0.917822 Aug 30 03:26:14.361846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 333/653] 10.222.0.30 () {58 vars in 1171 bytes} [Tue Aug 30 03:26:13 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21070 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:26:14.382163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:14.382781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:14.402348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.403393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.404167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.404859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.405498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.405915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.423901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:14.440831 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c5462dab-c4af-4073-b4a0-9e75e15c12ed tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 200 len: 1312 microversion: 2.1 time: 0.183267 Aug 30 03:26:14.458988 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 321/654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:14 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:14.465390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:14.471455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:14.478681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.479171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.479635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.480410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.481126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.481576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.549263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:14.577566 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0315636-8077-44e5-87ec-ac6190557dec tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.214077 Aug 30 03:26:14.578411 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 334/655] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:14 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:14.585305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:14.597855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'deleted': False, 'project_id': '72d7ae6f1b3a4da38a685f6530303c1d'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:14.607393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.607966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.608572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.609289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.609783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.610200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.662483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:14.674429 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec7dcd3d-88d5-4d7a-ab15-ba7faa76c37e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1471 microversion: 2.1 time: 0.213501 Aug 30 03:26:14.675228 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 322/656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:14 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:14.705960 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68abf816-925f-417b-af05-3ca8d6624336 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=fc50c2ff3ca9496db43ab1dcbad2347f" status: 200 len: 15 microversion: 2.1 time: 0.126286 Aug 30 03:26:14.706530 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 335/657] 10.222.0.30 () {58 vars in 1231 bytes} [Tue Aug 30 03:26:14 2022] GET /compute/v2.1/servers/detail?tenant_id=fc50c2ff3ca9496db43ab1dcbad2347f => generated 15 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:14.725685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:14.732346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'tenant_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'deleted': False} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:14.737466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.737953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.738395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.739119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.739642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.740072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:14.779690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:14.887963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:14.888272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:14.888867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.032961 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3567238c-640b-4cd0-b02c-5a8f865bc48f tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fc50c2ff3ca9496db43ab1dcbad2347f" status: 200 len: 4825 microversion: 2.1 time: 0.311002 Aug 30 03:26:15.037395 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 323/658] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Aug 30 03:26:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fc50c2ff3ca9496db43ab1dcbad2347f => generated 4825 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:15.038709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.039548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.048317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.048921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.049495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.050512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.051107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.051708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.163236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff9f595-e2bb-4341-81df-746d18df9ad6"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:15.164146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.171392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.172169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.173184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.174568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.175578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.176531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.228830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:15.252610 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ffb19bf-f579-42bb-bb48-05741dfc8521 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1513 microversion: 2.1 time: 0.217749 Aug 30 03:26:15.253543 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 324/659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:15.261543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.269727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'tenant_id': '72d7ae6f1b3a4da38a685f6530303c1d', 'deleted': False} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:15.276174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.276650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.277075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.277823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.278417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.279132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.318410 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b5de5d2-736f-4e92-9145-7e94f3053c51 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72d7ae6f1b3a4da38a685f6530303c1d" status: 200 len: 15 microversion: 2.1 time: 0.063196 Aug 30 03:26:15.319182 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 325/660] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72d7ae6f1b3a4da38a685f6530303c1d => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:15.324655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.325653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.334421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.335518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.336076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.336821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.337287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.337753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.552682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] HTTP exception thrown: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Request method failure captured: Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments/73efb4f2-5395-4281-aeb7-b041ca382056 HTTP/1.1 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 74 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL-YwI7BujC9FkmpHP-O6XymXr16m3Qiudl8mbKo73ilIsmR0wV9lEN1BiMfNDBgjBk0MJe71hiJd8fIrWJQ4v2ISLF2mhUPr_-mIDRePX3LYDWggboGq8f4nFpq2-bg5_J6PNlV0CaoP2NjxPDVxvf0ZSw-qlmepHbri-zAqUaAf0 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 923d839267b44bfba87b0ea8631aace8 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesAdminNegativeTest-1513752498 Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:26:15.564241 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/923d839267b44bfba87b0ea8631aace8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/923d839267b44bfba87b0ea8631aace8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_923d839267b44bfba87b0ea8631aace8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/923d839267b44bfba87b0ea8631aace8"}]}] Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesAdminNegativeTest-1513752498 Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 923d839267b44bfba87b0ea8631aace8 Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1513752498 Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesAdminNegativeTest-1513752498-project-admin Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 54645ee9e3b5462da0fc51f41b65ae77 Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesAdminNegativeTest-1513752498-project-admin Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: {"volumeAttachment": {"volumeId": "3ff9f595-e2bb-4341-81df-746d18df9ad6"}} Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:26:15.566744 n-d-854924-5 devstack@n-api.service[122168]: exception: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': 'c25d202c-a2b0-44f5-827e-cae9fd1f3a41', 'id': '73efb4f2-5395-4281-aeb7-b041ca382056', 'body': {'volumeAttachment': {'volumeId': '3ff9f595-e2bb-4341-81df-746d18df9ad6'}}} Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:26:15.568305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. (HTTP 404) (Request-ID: req-e4fd9dac-0d7a-4739-bb17-c1acf7dc2b9b) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:26:15.571585 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:15.573644 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. Aug 30 03:26:15.578766 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.580126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:15.580871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Returning 400 to user: Volume 3ff9f595-e2bb-4341-81df-746d18df9ad6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:15.580871 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53bf6cf9-6493-4bbf-926f-88a66913eebc tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments/73efb4f2-5395-4281-aeb7-b041ca382056" status: 400 len: 107 microversion: 2.1 time: 0.558133 Aug 30 03:26:15.580871 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 336/661] 10.222.0.30 () {60 vars in 1433 bytes} [Tue Aug 30 03:26:15 2022] PUT /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments/73efb4f2-5395-4281-aeb7-b041ca382056 => generated 107 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:15.585616 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cff53049-8122-47b5-b282-81002b513de6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1494 microversion: 2.1 time: 0.265215 Aug 30 03:26:15.586200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 326/662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1494 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:15.588389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.589329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.597197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.597961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.598573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.599926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.600526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.601479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e9fe4683-fe73-40d9-9a55-d5892a3775e1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.601615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.607230 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e9fe4683-fe73-40d9-9a55-d5892a3775e1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014932 Aug 30 03:26:15.608095 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 327/663] 10.222.0.30 () {58 vars in 1189 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:15.613320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.614075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.623248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.623935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.624584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.625320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.625860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.626367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.642989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] HTTP exception thrown: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 could not be found. Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Request method failure captured: Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 HTTP/1.1 Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMRo0loSS7t_i3UROGLwZ4xIaBrMxCT1glPQ8mVEH2C_P4Y7lffsFRs0fdTk3KmMfVb32D5PRgGvf-1zXnDDTnQeiMC3qZ12Ew2uZooFT14iDAvyJrhvZbenN9NOgn2hYD5FE4S6zO70ADtRtqpaqaTXPMNMLu6-0DYJYrCom8OzRU Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 57bb4a88ede645388513fe70414ffd80 Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1450524666 Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:15.644797 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/57bb4a88ede645388513fe70414ffd80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/57bb4a88ede645388513fe70414ffd80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_57bb4a88ede645388513fe70414ffd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/57bb4a88ede645388513fe70414ffd80"}]}] Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1450524666 Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 57bb4a88ede645388513fe70414ffd80 Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1450524666 Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1450524666-project Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 3da64bce6c7a4ee49544e9679a3fd4a8 Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1450524666-project Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 could not be found. Aug 30 03:26:15.646292 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4'} Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 could not be found. Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:15.647147 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 could not be found. Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 could not be found. Aug 30 03:26:15.648624 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:15.649748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Returning 404 to user: Instance 50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:15.649748 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a3e0d312-477e-4bee-b094-3a9e6880e5fb tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4" status: 404 len: 111 microversion: 2.1 time: 0.037211 Aug 30 03:26:15.650061 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 328/664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/50bf9f7c-b91a-4c9c-a1bb-f77475b7dff4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:15.654576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2d17d040-9ca1-4c22-8d0c-c34800c85039 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '.version_select at 0x7f8980063d30>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.657973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d17d040-9ca1-4c22-8d0c-c34800c85039 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.658469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d17d040-9ca1-4c22-8d0c-c34800c85039 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.658914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d17d040-9ca1-4c22-8d0c-c34800c85039 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.678746 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2d17d040-9ca1-4c22-8d0c-c34800c85039 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.027540 Aug 30 03:26:15.679397 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 329/665] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:15.683908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.684520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.691669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.692163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.692610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.693370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.693840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.694268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.779388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:15.779552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:15.788132 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-57219765-ad10-4b05-b2d8-e45fd353a2e8 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1514 microversion: 2.1 time: 0.210459 Aug 30 03:26:15.788802 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 337/666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:15.793514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:15.795897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.798332 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9195cc9f-b024-424d-b55c-3b8c3204594b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.117920 Aug 30 03:26:15.799148 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 330/667] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:15.804315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.804867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.811811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.812377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.812872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.813684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.814189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.814669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.816455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.817276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.818119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.819307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.820092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.820811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.841096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:15.894330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:15.935746 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-360b24fe-8059-4868-90ad-c9c7038093a9 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "DELETE /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 204 len: 0 microversion: 2.1 time: 0.135343 Aug 30 03:26:15.936349 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 331/668] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:15 2022] DELETE /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:15.942823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.943502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.943983 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45e3b565-42c1-4dfc-a895-678e2818be39 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 0 microversion: 2.1 time: 0.152888 Aug 30 03:26:15.945125 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 338/669] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:15 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:26:15.950164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:15.950994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:15.956142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.956634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.957121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.957315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.957890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.958062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.958859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.959026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.959320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:15.961100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:15.961664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:15.962262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.114747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lazy-loading 'services' on Instance uuid c25d202c-a2b0-44f5-827e-cae9fd1f3a41 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:16.122342 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e8091942-ac72-4277-b516-8566a399e1ec tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1645 microversion: 2.1 time: 0.175745 Aug 30 03:26:16.122909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 339/670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:15 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1645 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:16.127384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:16.127982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:16.134165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.134651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.135081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.135769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.136211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.136902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.303211 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7861085-5cab-4b6a-95ae-71b5d6787944 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments/73efb4f2-5395-4281-aeb7-b041ca382056" status: 202 len: 0 microversion: 2.1 time: 0.365123 Aug 30 03:26:16.304283 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 332/671] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:26:15 2022] DELETE /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments/73efb4f2-5395-4281-aeb7-b041ca382056 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:26:16.315375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:16.316733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:16.330712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.331963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.333281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.335631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.337007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.338086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.363767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:16.401503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:16.494438 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-def155a3-679b-4ac8-a77e-6107589c0bc2 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "DELETE /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 204 len: 0 microversion: 2.1 time: 0.187294 Aug 30 03:26:16.495278 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 333/672] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:16 2022] DELETE /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:16.503494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:16.504187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:16.510773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.511257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.511691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.512375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.512820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.513231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.519660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:16.528664 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb95a5d3-4f8c-4cf4-8e40-97c79f05eddd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.404712 Aug 30 03:26:16.533961 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 340/673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:16 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:16.538764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:16.544733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:16.545680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:16.552725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.553771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.554063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.554805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.555256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.555684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.664730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:16.699065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:16.712552 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68514dfa-77a2-408f-8f6d-22c8ed5f5390 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1477 microversion: 2.1 time: 0.213079 Aug 30 03:26:16.713574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 334/674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:16 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:16.732885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-529629321", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "50cf9776-7fec-4e2a-bfd2-7cfd51c24288"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:16.755257 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e4acac8-4038-478e-8107-28d37b3bc841 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.219980 Aug 30 03:26:16.756323 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 341/675] 10.222.0.30 () {58 vars in 1150 bytes} [Tue Aug 30 03:26:16 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:16.761045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:16.763580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:16.771301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.771795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.772227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.772930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.773393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.773817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.796298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] validate_networks() for [('50cf9776-7fec-4e2a-bfd2-7cfd51c24288', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:26:16.817232 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c08f5b1-0a6a-46f3-8e0a-652470bd47ce tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059711 Aug 30 03:26:16.824261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 342/676] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:26:16 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:16.824261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:16.824261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:16.829867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.830366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.830803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:16.831501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:16.831958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:16.832581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.040084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:17.055209 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eb82f81a-97db-4b6d-9298-25c08b894ccf tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1519 microversion: 2.1 time: 0.235375 Aug 30 03:26:17.068163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 343/677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:16 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:17.068163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:17.068859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.079790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.080630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.081452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.082681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.083501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.084297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.202277 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db515055-cd99-4f4f-93ec-f4493c37e9b1 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 0 microversion: 2.1 time: 0.144466 Aug 30 03:26:17.207205 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 344/678] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:17 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:26:17.211644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.212488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.220674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.221300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.221866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.222837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.223418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.224466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.346758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:17.373149 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6c887a1f-b8bc-46bb-8bf9-af921e42531b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.168774 Aug 30 03:26:17.374174 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 345/679] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:17.379056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.379851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.386738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.387510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.388580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.388930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.389543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.390083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.405229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:17.406751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:17.407260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:17.408417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:17.408845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:17.420399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.420878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.421306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.422120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.422721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.423978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.443116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:26:17.448937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for user 15eb8a27991445a491ccce6ff650f32a and project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:26:17.463797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:26:17.466468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:26:17.516657 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8813699-4fa6-4a43-9d06-34f9208a676f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791126 Aug 30 03:26:17.517674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 335/680] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:26:17.528774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-667fc55a-7234-4c64-8375-7267b267c480 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.529702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-667fc55a-7234-4c64-8375-7267b267c480 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.568398 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e83bf1d4-2876-468b-bb79-fb02f60a4aa9 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1614 microversion: 2.1 time: 0.192802 Aug 30 03:26:17.570410 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 346/681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1614 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:17.595281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.595966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.599895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-667fc55a-7234-4c64-8375-7267b267c480 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:17.603751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.604574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.605464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.607065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.607816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.608487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.610060 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-667fc55a-7234-4c64-8375-7267b267c480 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1210 microversion: 2.1 time: 0.084990 Aug 30 03:26:17.622360 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 336/682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:17.627195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.627808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.639066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.639556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.640191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.641056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.641760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.642904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.861024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:17.872060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5187f622-4b7f-4f8b-a13a-915111a2da98 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.299665 Aug 30 03:26:17.873641 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 347/683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:17.881877 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-779ffd98-13e4-4ef1-aefa-dfbc2859d107 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1614 microversion: 2.1 time: 0.258279 Aug 30 03:26:17.889814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.890844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.897821 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 337/684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1614 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:17.899125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.899818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.900428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.901321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.902012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.902598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.903377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.906016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:17.913564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.914537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.916111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.917058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.917759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.918362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.957325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-60346acc-4647-403f-8699-351eafc2eaaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058210 Aug 30 03:26:17.958273 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 338/685] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:17.963640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:17.970040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'host': 'n-h2-854924-5', 'deleted': False} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:17.980696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.981221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.981706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:17.982422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:17.982869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:17.983286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.094409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:18.110228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:18.119799 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80825d70-0055-4eb1-b47d-2ac36c545963 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1477 microversion: 2.1 time: 0.244601 Aug 30 03:26:18.135290 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 348/686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:18.141494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:18.142246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.154353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.155191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.155938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.157167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.158000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.158872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.197882 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-468548ea-a04b-4045-82e3-0d15dfbbe762 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=n-h2-854924-5&all_tenants=1" status: 200 len: 1977 microversion: 2.1 time: 0.237794 Aug 30 03:26:18.200247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 339/687] 10.222.0.30 () {58 vars in 1190 bytes} [Tue Aug 30 03:26:17 2022] GET /compute/v2.1/servers?host=n-h2-854924-5&all_tenants=1 => generated 1977 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:18.219172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:18.225706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:18.237540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.238541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.239339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.241559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.242496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.243500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.273194 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfaae99a-84ab-4af1-89b9-a0c5874a6eef tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.058276 Aug 30 03:26:18.274270 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 340/688] 10.222.0.30 () {58 vars in 1196 bytes} [Tue Aug 30 03:26:18 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:26:18.300832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:18.303706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.310349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.311059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.311491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.312177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.312619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.313045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.384449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:18.396177 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b130565-a1e0-4b94-8a69-a5fee19b5c66 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1519 microversion: 2.1 time: 0.258976 Aug 30 03:26:18.397284 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 349/689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:18 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:18.409230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:18.409972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.420333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.420938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.421317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.422196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.422698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.423366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.436763 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b4c7631-bf88-4c71-ab2d-537192b97c71 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 0 microversion: 2.1 time: 0.140389 Aug 30 03:26:18.443659 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 341/690] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:18 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:26:18.452180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:18.457167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.467977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.468921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.469815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.471142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.472002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.472825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.529835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:18.554119 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09c7d7e5-a692-4ae3-8734-8ca1f1347d82 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.148620 Aug 30 03:26:18.555186 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 350/691] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:18 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:18.588873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:18.589718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:18.591033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:18.591549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:18.592061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:18.639096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:18.640474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.651958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.654613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.655411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.656457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.657154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.657877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.666733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.670803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:18.696204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.697055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.698775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.703025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.703798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.705466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.764301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:18.771534 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9afda90f-ae01-402e-8c43-cf88563c9ff3 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 1067 microversion: 2.1 time: 0.325668 Aug 30 03:26:18.781632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5366641d-cc01-45c3-b2a2-0150cf6c14e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1262 microversion: 2.1 time: 0.144953 Aug 30 03:26:18.781632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 351/692] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:18 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:18.783327 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 342/693] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:18 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 1067 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 03:26:18.799889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:18.808726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.815306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.815809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.816549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.817302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.817937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.818376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.897777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:18.898453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:18.904921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.905607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.906151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:18.906998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:18.907561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:18.908087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.000203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:19.009307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce434b88-a1e2-4858-80aa-7bdb751f214d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.213991 Aug 30 03:26:19.012711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 352/694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:18 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:19.016837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:19.023000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:19.034117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.035014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.035874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.037997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.038875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.039598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.074862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:19.083838 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93094fd2-3651-412e-a117-aac26f1eee67 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.190130 Aug 30 03:26:19.097815 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 343/695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:18 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:19.097815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:19.097815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:19.098508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2de522c7-0c1c-4d54-a635-4c8ede267b23 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082212 Aug 30 03:26:19.098508 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 353/696] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:26:19 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:19.103809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.104578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.105816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.107209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.107209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.107416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.112688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:19.142850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:19.151167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:19.153167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:19.166605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.167127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.167617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.172568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.173078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.173550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.207150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:19.263035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a66c1cd5-12fc-4598-8e18-820bf4bff94a tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 204 len: 0 microversion: 2.1 time: 0.177222 Aug 30 03:26:19.264614 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 344/697] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:19 2022] DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:19.419321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:19.420621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:19.439644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.440453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.441222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.453620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.454775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.455492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.500079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:19.538289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e92e3320-81ff-4bf9-a332-e879b556a908 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1477 microversion: 2.1 time: 0.394649 Aug 30 03:26:19.539024 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 354/698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:19 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:19.553931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1082393018", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "1007162536", "adminPass": "***", "networks": [{"uuid": "b143f024-e525-45dd-a5b1-9ac46d78bbf7"}], "security_groups": [{"name": "tempest-securitygroup--2017497196"}], "key_name": "tempest-keypair-806602623", "user_data": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:19.684724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:19.694095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5880dbec-610e-4f84-a8ce-2e130211a263 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1519 microversion: 2.1 time: 0.280479 Aug 30 03:26:19.705387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 345/699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:19 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:19.705387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:19.705387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:19.712805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.713729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.714343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.715267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.717192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.717967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.785775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] validate_networks() for [('b143f024-e525-45dd-a5b1-9ac46d78bbf7', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:26:19.839209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:19.860420 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a613ee53-ec63-4096-9433-a8ee04aa9aaf tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.164138 Aug 30 03:26:19.861386 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 346/700] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:19 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:19.870734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:19.871383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:19.879632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.880785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.881481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:19.882208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:19.883007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:19.883431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.000512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:20.016698 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0dee79d7-26d1-4448-98bc-0942a3a8f8a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1268 microversion: 2.1 time: 0.151636 Aug 30 03:26:20.018887 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 347/701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:19 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:20.039756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:20.040836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:20.048821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.050095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.050995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.052124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.053580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.054280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.379635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:20.390076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-252255e8-45f2-46b6-9728-bab08a8c4a6b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.356414 Aug 30 03:26:20.404380 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 348/702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:20 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:20.414345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:20.417068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:20.424166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.424931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.425612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.426256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.427133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.427133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.575980 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-243c8368-e9e0-445b-86fa-0ccfc3a4fcaf tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169052 Aug 30 03:26:20.578017 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 349/703] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:26:20 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:20.605401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:20.606475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:20.620939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.621480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.623052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.623814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.625442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.625442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.791504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:20.792073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:20.792612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:20.793089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:20.793597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:20.813987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.814586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.815100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.815916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.816473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.816974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.842693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Getting quotas for project 6815ed26b67b481aa4213a7f99653625. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:26:20.848698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Getting quotas for user d5daf93738ce4ea2941438e615625fe6 and project 6815ed26b67b481aa4213a7f99653625. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:26:20.863966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:26:20.867471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:26:20.926707 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5c401180-30c0-4a6e-ade5-ace5fc208810 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.386228 Aug 30 03:26:20.928639 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 355/704] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:26:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:26:20.934016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:20.935155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:20.946090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.946910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.947547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:20.948705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:20.949447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:20.950099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:21.665159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:21.676632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e42bd448-927e-47a1-81ab-cea15ebccb7f tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1477 microversion: 2.1 time: 0.746416 Aug 30 03:26:21.694656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 356/705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:20 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1477 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:21.716050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:21.718764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:21.724427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:21.726040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3e6bd17-4094-4cf4-92fd-dcf6f879d392 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 1.146326 Aug 30 03:26:21.726625 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 350/706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:20 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:21.735923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:21.737071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:21.738047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:21.739453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:21.740436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:21.741379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:21.752813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:21.753464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:21.773955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:21.774765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:21.775387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:21.776328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:21.776976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:21.778352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:21.925993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:21.977745 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35fec846-0156-4025-bfcb-ca6845b9d420 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.229669 Aug 30 03:26:21.981507 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 351/707] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:21 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:21.996011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:21.996780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:22.008099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.008591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.009032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.009763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.010216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.012988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.123532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:22.138206 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c8daa94-6228-495a-ad9a-3ae141f9a69a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1519 microversion: 2.1 time: 0.440434 Aug 30 03:26:22.148342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:22.156620 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 357/708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:21 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:22.161040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa0a1df1-a462-4c19-a82a-536f971b3e57 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1260 microversion: 2.1 time: 0.174121 Aug 30 03:26:22.162010 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 352/709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:21 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:22.174392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:22.175018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:22.181640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:22.182688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:22.188926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.191100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.193198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.194574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.194574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.195047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.196830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.202277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.203824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.204805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.220881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.224633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.853466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:22.869262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05f22445-eed9-41a2-9083-c92678c7e1b7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.703352 Aug 30 03:26:22.871989 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 353/710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:22 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:22.880584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:22.890600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:22.895489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:22.904967 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b76d866-de48-4ceb-a8b0-becb18867f7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.745552 Aug 30 03:26:22.909001 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 358/711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:22 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:22.913976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-093e92bc-2a64-449f-a3ce-c34e02d68194 req-27e09d09-5e33-49bd-9caf-cb708f9911ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35cdc6ed-f632-420f-b5d5-93c0071fe721", "name": "network-vif-deleted", "tag": "a09a4c7c-0d8b-42d6-842d-949d38179b74"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:22.924914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.925983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.926609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.928237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.928854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.929476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.940217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-093e92bc-2a64-449f-a3ce-c34e02d68194 req-27e09d09-5e33-49bd-9caf-cb708f9911ef service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.946296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-093e92bc-2a64-449f-a3ce-c34e02d68194 req-27e09d09-5e33-49bd-9caf-cb708f9911ef service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.946913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-093e92bc-2a64-449f-a3ce-c34e02d68194 req-27e09d09-5e33-49bd-9caf-cb708f9911ef service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.966117 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-093e92bc-2a64-449f-a3ce-c34e02d68194 req-27e09d09-5e33-49bd-9caf-cb708f9911ef service nova] Creating event network-vif-deleted:a09a4c7c-0d8b-42d6-842d-949d38179b74 for instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 on n-h1-854924-5 Aug 30 03:26:22.973506 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-093e92bc-2a64-449f-a3ce-c34e02d68194 req-27e09d09-5e33-49bd-9caf-cb708f9911ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062596 Aug 30 03:26:22.975016 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 359/712] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:22.985262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:22.986232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:22.994387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.995552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.996171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:22.997272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:22.997911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:22.998250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9489d08e-4049-4afc-862d-c8e881dcb373 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123690 Aug 30 03:26:22.998834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.003039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 354/713] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:26:22 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:23.007415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:23.008431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:23.031413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.031920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.032611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.033328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.034437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.034882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.091858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.093379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.093827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.094304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lazy-loading 'fault' on Instance uuid 35cdc6ed-f632-420f-b5d5-93c0071fe721 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:23.343082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da64bce6c7a4ee49544e9679a3fd4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb4a88ede645388513fe70414ffd80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:23.376761 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70579544-dc29-4837-b4ee-97fc5cb6b478 tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 200 len: 1312 microversion: 2.1 time: 0.395084 Aug 30 03:26:23.405686 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 360/714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:22 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 1312 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:23.416789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:23.419705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:23.437190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.437719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.445859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.446896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.447542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.449212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.656327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:23.712524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:23.718745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d33d06c-e16b-4293-95c0-73bca91f777d tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.311679 Aug 30 03:26:23.724519 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 361/715] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:23 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:23.725738 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bca4dc24-681f-4e90-be3a-091efc42361e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.724494 Aug 30 03:26:23.726757 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 355/716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:22 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:23.735521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:23.737163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:23.740959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:23.751542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:23.760107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.762406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.762878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.763568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.766212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.766672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.773626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.775367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.776049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.780781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.782126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.782584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.855801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:23.857941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:23.858431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:23.858896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lazy-loading 'fault' on Instance uuid 97ac163f-21d5-4840-9842-9af9465a6b6f {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:24.022715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:24.023704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:24.039940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ade9278-2d4e-4cc0-ab6c-d72356fdf50a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 200 len: 1312 microversion: 2.1 time: 0.313645 Aug 30 03:26:24.043118 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08efa560-3e9e-426a-bb0f-f2141e9f2894 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1324 microversion: 2.1 time: 0.315064 Aug 30 03:26:24.046052 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 362/717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:23 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:24.046513 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 356/718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:23 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:24.053501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:24.054674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:24.063556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-53f323b1-4440-4e00-9535-9b246bf4303b req-5fb26ee1-23a2-4846-96b6-febbd12c770f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55ec963-f681-4634-a76a-136dbefc4d4a", "tag": "437d327d-babd-4d6f-afbf-fd52a78b63e4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:24.071302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.072156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.072833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.073802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.074974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.079032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.081220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-53f323b1-4440-4e00-9535-9b246bf4303b req-5fb26ee1-23a2-4846-96b6-febbd12c770f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.085257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-53f323b1-4440-4e00-9535-9b246bf4303b req-5fb26ee1-23a2-4846-96b6-febbd12c770f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.104475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-53f323b1-4440-4e00-9535-9b246bf4303b req-5fb26ee1-23a2-4846-96b6-febbd12c770f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.127721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-53f323b1-4440-4e00-9535-9b246bf4303b req-5fb26ee1-23a2-4846-96b6-febbd12c770f service nova] Creating event network-changed:437d327d-babd-4d6f-afbf-fd52a78b63e4 for instance f55ec963-f681-4634-a76a-136dbefc4d4a on n-h2-854924-5 Aug 30 03:26:24.138521 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-53f323b1-4440-4e00-9535-9b246bf4303b req-5fb26ee1-23a2-4846-96b6-febbd12c770f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090546 Aug 30 03:26:24.141570 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 357/719] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:24.154802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:24.156743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:24.170656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.171143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.171711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.172423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.173169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.173622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.442869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:24.454219 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85866ccb-25c9-4ff0-be2f-1a03128f5b26 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.405141 Aug 30 03:26:24.466789 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 363/720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:24 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:24.471973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:24.475457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:24.484568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.484912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.485371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.486079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.486533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.486955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.517281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:24.544923 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-86af4fa8-80a6-4496-ba04-bc9988a84843 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.397288 Aug 30 03:26:24.545676 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 358/721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:24 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:24.576918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:24.579929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] [instance: 35cdc6ed-f632-420f-b5d5-93c0071fe721] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:24.595970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.596466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.599974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.600731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.601204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.601658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.606337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:24.612886 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b239892-4600-4427-8ee2-325e68ac2a8d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144833 Aug 30 03:26:24.613872 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 364/722] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:26:24 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:24.625685 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] HTTP exception thrown: Instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 could not be found. Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Request method failure captured: Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 HTTP/1.1 Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMRo0loSS7t_i3UROGLwZ4xIaBrMxCT1glPQ8mVEH2C_P4Y7lffsFRs0fdTk3KmMfVb32D5PRgGvf-1zXnDDTnQeiMC3qZ12Ew2uZooFT14iDAvyJrhvZbenN9NOgn2hYD5FE4S6zO70ADtRtqpaqaTXPMNMLu6-0DYJYrCom8OzRU Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 57bb4a88ede645388513fe70414ffd80 Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1450524666 Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:24.628429 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/57bb4a88ede645388513fe70414ffd80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/57bb4a88ede645388513fe70414ffd80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_57bb4a88ede645388513fe70414ffd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/57bb4a88ede645388513fe70414ffd80"}]}] Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1450524666 Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 57bb4a88ede645388513fe70414ffd80 Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1450524666 Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1450524666-project Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 3da64bce6c7a4ee49544e9679a3fd4a8 Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1450524666-project Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 could not be found. Aug 30 03:26:24.630569 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '35cdc6ed-f632-420f-b5d5-93c0071fe721'} Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 could not be found. Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:24.631335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 could not be found. Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 could not be found. Aug 30 03:26:24.632609 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:24.633877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] Returning 404 to user: Instance 35cdc6ed-f632-420f-b5d5-93c0071fe721 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:24.633877 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c511f61f-dca4-4f70-bf9c-297f65a8409a tempest-ServersAdminNegativeTestJSON-1450524666 tempest-ServersAdminNegativeTestJSON-1450524666-project] 10.222.0.30 "GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721" status: 404 len: 111 microversion: 2.1 time: 0.066207 Aug 30 03:26:24.635535 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 359/723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:24 2022] GET /compute/v2.1/servers/35cdc6ed-f632-420f-b5d5-93c0071fe721 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:24.778086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:24.782828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:24.783926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:24.789882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:24.803590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.805886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.806543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.808527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.810119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.810665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.811329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.815817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.816508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:24.817257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:24.818590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:24.819739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.103992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:25.139864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:25.149931 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5f66446-8ea4-41cb-af15-25d39c148666 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.376053 Aug 30 03:26:25.151133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 365/724] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:24 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:25.160993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1087847969", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "95cfe89c-40ac-4527-96d6-a25cae46f5e7"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:25.264329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] validate_networks() for [('95cfe89c-40ac-4527-96d6-a25cae46f5e7', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:26:25.352622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:25.370630 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ac6fb38-8339-4508-ba51-f512bf042d89 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.595909 Aug 30 03:26:25.371556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 360/725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:24 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:25.386883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9367155b-650c-4382-8c2a-31871518dd2a req-6d232094-24fc-41d8-a692-404d94746ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ac163f-21d5-4840-9842-9af9465a6b6f", "name": "network-vif-deleted", "tag": "7ac619bf-4b27-4849-9302-e3046e3f855b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:25.422710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9367155b-650c-4382-8c2a-31871518dd2a req-6d232094-24fc-41d8-a692-404d94746ef2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.423233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9367155b-650c-4382-8c2a-31871518dd2a req-6d232094-24fc-41d8-a692-404d94746ef2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.423860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9367155b-650c-4382-8c2a-31871518dd2a req-6d232094-24fc-41d8-a692-404d94746ef2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.451185 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9367155b-650c-4382-8c2a-31871518dd2a req-6d232094-24fc-41d8-a692-404d94746ef2 service nova] Creating event network-vif-deleted:7ac619bf-4b27-4849-9302-e3046e3f855b for instance 97ac163f-21d5-4840-9842-9af9465a6b6f on n-h1-854924-5 Aug 30 03:26:25.463264 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9367155b-650c-4382-8c2a-31871518dd2a req-6d232094-24fc-41d8-a692-404d94746ef2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090305 Aug 30 03:26:25.464348 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 361/726] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:25.475683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:25.476394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:25.495899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.501239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.501985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.502989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.503607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.504253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.549494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] HTTP exception thrown: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f HTTP/1.1 Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:25.559536 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:25.561167 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '97ac163f-21d5-4840-9842-9af9465a6b6f'} Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:25.562120 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:25.563566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:25.567316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 404 to user: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:25.571041 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-140d4bfb-fefc-4b32-b79b-086f142bb8db tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 404 len: 111 microversion: 2.1 time: 0.105527 Aug 30 03:26:25.573708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 362/727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:25 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:25.582455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:25.584217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:25.591219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.596665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.597955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.599090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.600111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.600841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.778485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:25.789286 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bcc0d7f2-b19b-4d30-8c1c-741e180278ac tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1322 microversion: 2.1 time: 0.214261 Aug 30 03:26:25.792542 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 363/728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:25 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:25.798256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:25.799225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:25.812206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.813286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.813981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:25.814974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:25.815807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:25.816488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.308908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:26.325629 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3c09ab08-41c1-4ac3-80d4-aeb72c25cc85 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.531049 Aug 30 03:26:26.326910 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 364/729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:25 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:26.336282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:26.337738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:26.354571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.355513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.355513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.356271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.356621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.357239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.580308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:26.580863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:26.581188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:26.582140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:26.582924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:26.602026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.604079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.604800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.606262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.607120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.607611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.630941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Getting quotas for project 396e07d9190a4041a7d808113bb6b1cf. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:26:26.636581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Getting quotas for user da45da7c2ce14c85b818eb0b9b3e5da9 and project 396e07d9190a4041a7d808113bb6b1cf. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:26:26.652217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:26:26.656843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:26:26.717111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:26.727877 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d43de19-01a2-4e1b-90d0-cd720d6b58b5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.399036 Aug 30 03:26:26.728484 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 365/730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:26 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:26.734582 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e4f7d5d5-45b2-447b-8151-02904a66cbeb tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582001 Aug 30 03:26:26.743753 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 366/731] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:26:26.747174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:26.752519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:26.753972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:26.757754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d2317f33-6d30-47a5-b87b-3b5342ef9a88 req-73e67142-c1fd-4b15-92f2-b4214f8f571a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add6aa5a-222e-4a38-9ce7-2903c6125cb7", "name": "network-vif-deleted", "tag": "e5688b05-f297-4558-bc27-72bf3ffe4faf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:26.760906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.761690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.762981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.764474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.765903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.766707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.801458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d2317f33-6d30-47a5-b87b-3b5342ef9a88 req-73e67142-c1fd-4b15-92f2-b4214f8f571a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.801984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d2317f33-6d30-47a5-b87b-3b5342ef9a88 req-73e67142-c1fd-4b15-92f2-b4214f8f571a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.802425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d2317f33-6d30-47a5-b87b-3b5342ef9a88 req-73e67142-c1fd-4b15-92f2-b4214f8f571a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.849206 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d2317f33-6d30-47a5-b87b-3b5342ef9a88 req-73e67142-c1fd-4b15-92f2-b4214f8f571a service nova] Creating event network-vif-deleted:e5688b05-f297-4558-bc27-72bf3ffe4faf for instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 on n-h1-854924-5 Aug 30 03:26:26.860078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d2317f33-6d30-47a5-b87b-3b5342ef9a88 req-73e67142-c1fd-4b15-92f2-b4214f8f571a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116617 Aug 30 03:26:26.864399 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cf90f054-4a67-44f7-b638-b8dea7795b62 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.134780 Aug 30 03:26:26.865029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 367/732] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:26.875938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 366/733] 10.222.0.30 () {58 vars in 1230 bytes} [Tue Aug 30 03:26:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:26.879850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:26.881324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:26.883330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:26.886770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:26.894345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.896423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.897456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.900260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.902094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.904375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.905118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.907781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.908317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:26.909162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:26.912059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:26.912723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.154971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:27.207569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf6ddb19-c1a2-4cf5-9cb6-442efd478128 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1927 microversion: 2.75 time: 0.340845 Aug 30 03:26:27.217799 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 368/734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:26 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1927 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:27.232816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3cc80249-155d-4d91-bde5-1bd63469fff1 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:27.233735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3cc80249-155d-4d91-bde5-1bd63469fff1 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:27.325733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3cc80249-155d-4d91-bde5-1bd63469fff1 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:27.339098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3cc80249-155d-4d91-bde5-1bd63469fff1 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1218 microversion: 2.1 time: 0.123826 Aug 30 03:26:27.339697 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 369/735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:27 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:27.353426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:27.354085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:27.367364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.368035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.368775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.371018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.371850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.372964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.424954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:27.434961 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b98043c-568d-4c50-b7ca-2a0bf4e3209c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.557591 Aug 30 03:26:27.435623 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 367/736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:26 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:27.440794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5aa13970-d39a-4733-8b5e-5f7b94b865d9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5aa13970-d39a-4733-8b5e-5f7b94b865d9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:27.445838 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 03:26:27.448260 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:27.449613 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:27.452246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5aa13970-d39a-4733-8b5e-5f7b94b865d9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5aa13970-d39a-4733-8b5e-5f7b94b865d9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010546 Aug 30 03:26:27.454948 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 368/737] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Aug 30 03:26:27 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:27.460050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:27.460777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:27.469820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.470375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.471014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.472008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.472841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.474243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.606678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:27.749523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:27.759728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d08b08b3-f7c4-451b-b4d5-3af81e195705 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.418945 Aug 30 03:26:27.773096 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 370/738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:27 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:27.773096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:27.774120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:27.775389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:27.785802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.787113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.788262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.789087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.789619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.790051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.806875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:27.816373 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-797bd016-2910-4d88-8084-02dcfc236a4d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.361842 Aug 30 03:26:27.817132 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 369/739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:27 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:27.834401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:27.835016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:27.844567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.845061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.845537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.846245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:27.846697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:27.847120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:27.916463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:27.994922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-868f33d7-9c1c-4e57-8a23-f88376ef3ca1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.231746 Aug 30 03:26:27.996721 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 371/740] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:26:27 2022] GET /compute/v2.1/servers => generated 681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:28.002868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-01525540-1c3c-4a5a-969d-739b08c13cd6 req-9c331784-b7eb-493c-82f2-801689875a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e068f47-c7bd-474d-b436-30eea982b5c1", "tag": "ac777799-c1ff-4dbd-9182-bc46eb01ccd2"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:28.023291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-01525540-1c3c-4a5a-969d-739b08c13cd6 req-9c331784-b7eb-493c-82f2-801689875a96 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.024025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-01525540-1c3c-4a5a-969d-739b08c13cd6 req-9c331784-b7eb-493c-82f2-801689875a96 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.024515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-01525540-1c3c-4a5a-969d-739b08c13cd6 req-9c331784-b7eb-493c-82f2-801689875a96 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.037847 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-01525540-1c3c-4a5a-969d-739b08c13cd6 req-9c331784-b7eb-493c-82f2-801689875a96 service nova] Creating event network-changed:ac777799-c1ff-4dbd-9182-bc46eb01ccd2 for instance 2e068f47-c7bd-474d-b436-30eea982b5c1 on n-h1-854924-5 Aug 30 03:26:28.043056 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-01525540-1c3c-4a5a-969d-739b08c13cd6 req-9c331784-b7eb-493c-82f2-801689875a96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044503 Aug 30 03:26:28.043950 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 372/741] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:28.049164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.054681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.055397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.servers [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Removing options 'limit' from query {{(pid=122168) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 03:26:28.055989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:28.062399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.062723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.062961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.063918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.064377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.064791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.090552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:28.099573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:28.117916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.134537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bb53f64-59d9-47cd-9a8a-b189918bd370 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.303809 Aug 30 03:26:28.134808 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 370/742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:27 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:28.155588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-adf0fdf8-b235-4ad8-81e7-ec88be4d9422 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.109381 Aug 30 03:26:28.156597 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 373/743] 10.222.0.30 () {58 vars in 1144 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:28.169584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9aa11aaa-d30c-449c-8c84-f79427ab9404 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9aa11aaa-d30c-449c-8c84-f79427ab9404 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:28.174202 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 03:26:28.175569 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi '-1' Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:28.176295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.177887 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9aa11aaa-d30c-449c-8c84-f79427ab9404 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9aa11aaa-d30c-449c-8c84-f79427ab9404 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010389 Aug 30 03:26:28.179144 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 371/744] 10.222.0.30 () {58 vars in 1142 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:28.190188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e61be47-ca9b-4a0a-b7e5-0b2aeaa38759 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e61be47-ca9b-4a0a-b7e5-0b2aeaa38759 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:26:28.194224 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 03:26:28.195807 n-d-854924-5 devstack@n-api.service[122168]: action_args: {} Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'testing' Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:28.196654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.198358 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:28.199804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e61be47-ca9b-4a0a-b7e5-0b2aeaa38759 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:28.200661 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e61be47-ca9b-4a0a-b7e5-0b2aeaa38759 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.014718 Aug 30 03:26:28.201506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 374/745] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:28.210818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3df3e247-f7e1-4899-bc7d-c2b1ed363665 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.216110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3df3e247-f7e1-4899-bc7d-c2b1ed363665 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.217166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3df3e247-f7e1-4899-bc7d-c2b1ed363665 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:28.230963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.servers [None req-3df3e247-f7e1-4899-bc7d-c2b1ed363665 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Flavor 'non_existing_flavor' could not be found {{(pid=122167) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 30 03:26:28.232188 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3df3e247-f7e1-4899-bc7d-c2b1ed363665 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025787 Aug 30 03:26:28.233410 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 372/746] 10.222.0.30 () {58 vars in 1178 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:28.235471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.236248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:28.245684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.248459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.249023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.249488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.250179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.250630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.250898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.251063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.252568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:28.260638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.261108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.261957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.272358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.272358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.272358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.378545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f635d5a5-eccf-46e3-a9f4-e7999eabd82a tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.136706 Aug 30 03:26:28.378545 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 373/747] 10.222.0.30 () {58 vars in 1174 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:28.399402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.400302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:28.407158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.408183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.408303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:28.409032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.410164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.410842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.411551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.443252 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d434833c-2e9a-40fb-a542-fd4980bc7b45 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1933 microversion: 2.75 time: 0.211468 Aug 30 03:26:28.443848 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 375/748] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1933 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:26:28.467502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.478089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.478760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:28.497754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.498513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.499355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.500508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.501233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.501868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.571090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.589638 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e594486-875f-4924-a138-7342ff4b4a15 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1270 microversion: 2.1 time: 0.207824 Aug 30 03:26:28.601708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 374/749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:28.601708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.601708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:28.611986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.612781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.613454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.614863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.615512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.616093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.675548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0f5d5d0-0d93-475c-b6b8-4c913f2ff5b1 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.222111 Aug 30 03:26:28.676449 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 376/750] 10.222.0.30 () {58 vars in 1184 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:28.914929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.922180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.922972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.923690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.925163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:28.925956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:28.927429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:28.971643 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-00d1f01a-50b4-4e5d-8140-0619eb9808e5 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.292904 Aug 30 03:26:28.980866 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 377/751] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:28.982648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:28.991670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:28.993252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:29.002581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.003788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.004379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.005678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.006444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.007136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.026020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:29.035078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2900da54-866e-451e-80ca-c9dc74c23019 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.439852 Aug 30 03:26:29.036048 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 375/752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:29.043670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:29.056213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:29.057198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:29.063460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.063951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.064390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.065086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.065580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.066003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.132159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:29.143033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.143815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.144437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.300640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:29.310496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-beab23d2-0a40-408a-ae41-ad5b05f60be4 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.259358 Aug 30 03:26:29.311107 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 376/753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:29 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:29.322873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:29.323800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:29.338426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.338926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.339394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.343920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.344862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.348146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.707050 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9ced6247-81a9-4f5f-baaa-4c063f2c6554 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3020 microversion: 2.1 time: 0.733014 Aug 30 03:26:29.707685 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 378/754] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:26:28 2022] GET /compute/v2.1/servers/detail => generated 3020 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:29.732801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:29.737634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.738379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.739005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.740310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.740951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.741395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.767569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0e416c0-03f1-42c8-ac4d-50bfbf9e0edd tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-854924-5" status: 200 len: 578 microversion: 2.1 time: 0.058406 Aug 30 03:26:29.777281 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 379/755] 10.222.0.30 () {58 vars in 1172 bytes} [Tue Aug 30 03:26:29 2022] GET /compute/v2.1/os-services?host=n-d-854924-5 => generated 578 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:29.782729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:29.783369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:29.790868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.791386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.791786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.792904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.793587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.794171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.939844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:29.951303 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6159043-8bdf-4455-bd98-eca46684caa9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.632134 Aug 30 03:26:29.952197 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 377/756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:29 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:29.963159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:29.964221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:29.971107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.971844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.972539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:29.973536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:29.974801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:29.975389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.055807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.064111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99035202-19ff-4089-a9b2-1a3d9a736421 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.285464 Aug 30 03:26:30.073138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 380/757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:29 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:30.073138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.073138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.078513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.079253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.079704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.080461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.080892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.081292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.081932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:30.103225 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de5ebbe9-037a-498a-95a0-be96b116da50 tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1933 microversion: 2.75 time: 0.149749 Aug 30 03:26:30.103829 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 378/758] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:29 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1933 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:30.110992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-44ef8dda-8166-47b9-b159-f9acd28e768e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.115606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-44ef8dda-8166-47b9-b159-f9acd28e768e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.116595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-44ef8dda-8166-47b9-b159-f9acd28e768e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011835 Aug 30 03:26:30.117142 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 379/759] 10.222.0.30 () {58 vars in 1178 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:30.121922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.125897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.126603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.127039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.127780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.128235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.128663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.154584 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe8da8c4-d3e3-4edd-8157-f842d2af4086 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036183 Aug 30 03:26:30.155197 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 380/760] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:30.162971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.162971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.167318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.167822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.168261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.168961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.169454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.169886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.260548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.274007 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2145fae4-2f37-4493-936b-54c99e978d48 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.207834 Aug 30 03:26:30.274585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 381/761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:30.279288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.284189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.285062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Searching by: {'deleted': False, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:26:30.291201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.291675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.292101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.292813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.293251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.293688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.321327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:26:30.331743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.342474 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7642996-2964-488a-886c-b108fe448315 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.185583 Aug 30 03:26:30.343069 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 381/762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:30.347737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.354625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.355181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.355626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.356355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.357016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.357467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.368322 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c2bb6b3-3a95-4a80-8cb7-eb9125babb24 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.092358 Aug 30 03:26:30.369418 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 382/763] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers => generated 681 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:30.377564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.378556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.383415 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8bc83f65-52ea-4e47-ae24-b54a91c32f01 tempest-ServicesAdminTestJSON-1356220109 tempest-ServicesAdminTestJSON-1356220109-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039083 Aug 30 03:26:30.384247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 382/764] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:30.387964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.388751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.389441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.391532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.391673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.391760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.391851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.391934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.399795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.400290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.400864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.401764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.402221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.402649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.429756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:30.444802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:30.523799 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84206b2c-22d6-4482-95e7-76252df59f06 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 204 len: 0 microversion: 2.1 time: 0.137960 Aug 30 03:26:30.524662 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 383/765] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:30 2022] DELETE /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:30.534446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.535129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.537216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:30.544663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.545315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.545773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.546510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.546959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.547379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.561503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.563467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] HTTP exception thrown: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f HTTP/1.1 Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:30.565831 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:30.567250 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '97ac163f-21d5-4840-9842-9af9465a6b6f'} Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:30.568547 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:30.569837 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:30.571208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 404 to user: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:30.571208 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e1703e6-7cbe-4dc1-a8be-5e5d1d43168e tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "DELETE /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 404 len: 111 microversion: 2.1 time: 0.037362 Aug 30 03:26:30.571208 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 384/766] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:30 2022] DELETE /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:26:30.579280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.579865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.583980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b6270456-8d7d-43e5-b5d4-35e9bdc1a5dc tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.212009 Aug 30 03:26:30.597373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 383/767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:30.597712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.597712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.597712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.597712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.598097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.598097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.625236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:30.705506 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-175bc0d3-f426-44f4-8112-72d277836850 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "DELETE /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 204 len: 0 microversion: 2.1 time: 0.130528 Aug 30 03:26:30.707351 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 385/768] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:30 2022] DELETE /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:30.715563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.716352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.722496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.722977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.723442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.724170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.724621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.725037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.874854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:30.884766 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1255b2f6-8166-46a5-a391-dfe89eb0826b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1520 microversion: 2.1 time: 0.173018 Aug 30 03:26:30.885805 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 384/769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:30.976857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:30.978538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:30.992536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.993891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.994711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:30.996305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:30.997062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:30.997800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.086705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:31.087274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:31.102538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.103933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.104613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.105666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.106035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.106463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.249050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:31.260835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-728e8e96-70ca-40c5-a814-67f3c9ccae21 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1471 microversion: 2.1 time: 0.291384 Aug 30 03:26:31.261853 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 386/770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:30 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:31.277670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:31.279362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:31.290049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.291001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.291661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.292616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.293408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.294688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.352777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:31.368270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c11965fd-26a1-47df-8d23-e6ce330bc193 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.286880 Aug 30 03:26:31.370727 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 385/771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:31 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:31.390792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:31.393141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:31.405026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.406489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.409308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.411799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.414888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.416200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.470248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:31.513604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0cf8e249-9e71-41fe-a757-82aa4df6633a tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1933 microversion: 2.75 time: 0.250218 Aug 30 03:26:31.515404 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 387/772] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:31 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1933 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:31.527027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:31.529859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:31.550824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.551327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.552313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.555248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.555721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.557188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.719532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:31.734273 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d59e387f-f375-4b8e-b71c-6304f462ac97 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.356880 Aug 30 03:26:31.734834 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 386/773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:31 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:31.749538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ce76bcad-03a9-4cbe-8a91-87e490d3af4a req-4bb244f2-90fc-451a-a132-2e2f7f94bfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55ec963-f681-4634-a76a-136dbefc4d4a", "name": "network-vif-plugged", "status": "completed", "tag": "437d327d-babd-4d6f-afbf-fd52a78b63e4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:31.752482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ce76bcad-03a9-4cbe-8a91-87e490d3af4a req-4bb244f2-90fc-451a-a132-2e2f7f94bfa2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.753043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ce76bcad-03a9-4cbe-8a91-87e490d3af4a req-4bb244f2-90fc-451a-a132-2e2f7f94bfa2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.753527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ce76bcad-03a9-4cbe-8a91-87e490d3af4a req-4bb244f2-90fc-451a-a132-2e2f7f94bfa2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.766433 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ce76bcad-03a9-4cbe-8a91-87e490d3af4a req-4bb244f2-90fc-451a-a132-2e2f7f94bfa2 service nova] Creating event network-vif-plugged:437d327d-babd-4d6f-afbf-fd52a78b63e4 for instance f55ec963-f681-4634-a76a-136dbefc4d4a on n-h2-854924-5 Aug 30 03:26:31.773451 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ce76bcad-03a9-4cbe-8a91-87e490d3af4a req-4bb244f2-90fc-451a-a132-2e2f7f94bfa2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037221 Aug 30 03:26:31.774193 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 387/774] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:31.780224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:31.781162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:31.789002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.790146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.790606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.791420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.791992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.792428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.823081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:31.834432 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26291130-e9c4-499d-a8ee-685465b080fb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.317140 Aug 30 03:26:31.845732 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 388/775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:31 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:31.907111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:31.908117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:31.914953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.915822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.916339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.917210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:31.917899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:31.918525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:31.997634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:32.007027 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3dc2d3de-4fb5-4dc8-85ad-3ffa409de963 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.231778 Aug 30 03:26:32.007620 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 388/776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:31 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:32.069031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:32.077895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8a04ccd-f525-4901-bd62-7d1d6b0efb87 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1520 microversion: 2.1 time: 0.174617 Aug 30 03:26:32.078487 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 389/777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:31 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:32.283440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:32.284749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:32.292544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.293529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.294134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.295020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.295783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.296472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.400421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:32.401297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:32.420152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.420902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.421567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.422334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.422988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.423421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.493185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:32.503669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08ac12e3-b5ed-4161-ab0f-1ae1b2b83ace tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1489 microversion: 2.1 time: 0.224427 Aug 30 03:26:32.506045 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 389/778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:32 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1489 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:32.546591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:32.546819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:32.555896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.556393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.556827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.557567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.558094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.558424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.657885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] Lazy-loading 'services' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:32.660078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:32.676752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3852b60b-1138-4cfd-8069-8fcd51358686 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.284017 Aug 30 03:26:32.687052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cf6ccb0c-b1f5-4bef-b41b-76bd07daab9b tempest-ServersAdmin275Test-1786961426 tempest-ServersAdmin275Test-1786961426-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1918 microversion: 2.75 time: 0.147199 Aug 30 03:26:32.690182 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 390/779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:32 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:32.693738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 390/780] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:32 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1918 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:26:32.720655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:32.721160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:32.743742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.744457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.744891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.746463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.747190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.747319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.758778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:32.759402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:32.777375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.778099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.779031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.779918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:32.780370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:32.780956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:32.793172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:32.963944 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1dd97d85-dcfe-42b0-9fe8-c7bc1f02845e tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 204 len: 0 microversion: 2.75 time: 0.247462 Aug 30 03:26:32.971883 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 391/781] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:26:32 2022] DELETE /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:26:32.996680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:33.008183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:33.020446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.022163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.024538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.026378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.027450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.028375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.071078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:33.085224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:33.095403 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b509e40-5e96-41a2-b94b-970747a5a9b6 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.341097 Aug 30 03:26:33.101907 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 391/782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:32 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:33.109384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:33.110218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:33.118521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.119313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.119932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.121151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.121871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.122491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.235821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:33.246842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:33.248602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:33.254782 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62ee4346-bb25-4a23-94d1-437c322d9865 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1443 microversion: 2.75 time: 0.150294 Aug 30 03:26:33.274043 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 392/783] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:33 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:33.279389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:33.280023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:33.287379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.288072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.288449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.289363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.289854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.290338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.382412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:33.402802 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1d967c0-2975-45f9-b200-5713b1b6d2f7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.428213 Aug 30 03:26:33.405200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 392/784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:32 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:33.416862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:33.419392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:33.434022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.435409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.436225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.437673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.438830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.439563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.657541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:33.677961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-60dcaf5d-7923-4146-86d5-38003afba0c8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.392981 Aug 30 03:26:33.678947 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 393/785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:33 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:33.697169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-353eb3cc-d8ea-40e3-92ac-9d33fe3bdff6 req-def88ae9-cc51-4f46-a3d7-c27c07b1f034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af00f80-ce1a-4449-a84a-d0194c07e476", "tag": "5d2c81d4-43dd-4595-ba0f-e80653f4b6ec"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:33.721590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-353eb3cc-d8ea-40e3-92ac-9d33fe3bdff6 req-def88ae9-cc51-4f46-a3d7-c27c07b1f034 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.722074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-353eb3cc-d8ea-40e3-92ac-9d33fe3bdff6 req-def88ae9-cc51-4f46-a3d7-c27c07b1f034 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.722630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-353eb3cc-d8ea-40e3-92ac-9d33fe3bdff6 req-def88ae9-cc51-4f46-a3d7-c27c07b1f034 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.735512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-353eb3cc-d8ea-40e3-92ac-9d33fe3bdff6 req-def88ae9-cc51-4f46-a3d7-c27c07b1f034 service nova] Creating event network-changed:5d2c81d4-43dd-4595-ba0f-e80653f4b6ec for instance 1af00f80-ce1a-4449-a84a-d0194c07e476 on n-h1-854924-5 Aug 30 03:26:33.741382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-353eb3cc-d8ea-40e3-92ac-9d33fe3bdff6 req-def88ae9-cc51-4f46-a3d7-c27c07b1f034 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061188 Aug 30 03:26:33.744925 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 394/786] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:33.751637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:33.752351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:33.758989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.759480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.759922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:33.760765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:33.761432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:33.762211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.056871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.074363 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e52f6ec-7f27-4005-9a7f-e574ad690c7b tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1520 microversion: 2.1 time: 0.667099 Aug 30 03:26:34.075570 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 393/787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:33 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1520 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:34.083001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:34.084523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:34.100959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.102777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.103721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.104915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.105393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.106030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.158462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.174075 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1dca4dd4-d9f8-4f59-9480-545c1c211951 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1477 microversion: 2.1 time: 0.423311 Aug 30 03:26:34.188591 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 395/788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:33 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1477 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:34.194911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:34.196199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:34.203617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.204239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.204923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.206044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.206598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.207174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.569729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.587928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93edef06-84f7-4c9d-a39f-86e9f39f0645 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.511069 Aug 30 03:26:34.588891 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 394/789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:34 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:34.596183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:34.597788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:34.610823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.611588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.612710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.614057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.614723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.615255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.740780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.760861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.763960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.774508 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dadd85e8-3d23-4da2-98d2-36047c520fef tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1443 microversion: 2.75 time: 0.183399 Aug 30 03:26:34.776287 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 395/790] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:34 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1443 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:34.815320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:34.832481 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba25117c-2f74-455b-84f3-a1780b546133 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.653117 Aug 30 03:26:34.833643 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 396/791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:34 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:34.846006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:34.855234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:34.871754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.872383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.873309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.874284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:34.875980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:34.876782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:34.991158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1574551698", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:35.064172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:26:35.131916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:35.142138 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ce8f9de-5dc3-488a-9112-457ba9359c6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.302418 Aug 30 03:26:35.143592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 397/792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:34 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:35.162200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:35.163602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:35.206455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.207574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.208975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.210624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.214215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.215343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.474317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:35.474885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:35.475451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:35.475946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:35.476468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:35.487023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.487663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.488205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.489706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.490407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.490984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.499911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:35.500174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:35.510735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-418b0f6c-1446-4627-9049-d9ae1b3580b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.365704 Aug 30 03:26:35.511695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 398/793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:35 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:35.516694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Getting quotas for project b58cf29b8a294a90ae9ad70676ad4987. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:26:35.517480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:35.518591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:35.522465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Getting quotas for user 752ae4c59f784ad09d87edf5faa8dbd5 and project b58cf29b8a294a90ae9ad70676ad4987. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:26:35.526101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.526730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.527275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.528089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.528616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.529128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.536952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:26:35.540010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:26:35.610043 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70d7d071-a765-473c-96d7-a134f91fd138 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832029 Aug 30 03:26:35.617537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 396/794] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:26:35.618060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:35.618690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:35.628280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:35.630848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.631335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.631769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.632471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.632919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.633369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.639894 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc4ec2a6-a575-4266-a963-f70ebb173b9f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1478 microversion: 2.1 time: 0.126652 Aug 30 03:26:35.653631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 399/795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:35 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1478 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:35.653631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-97570a08-0b51-4d2e-8c95-a3ea311eecb2 req-d1a01e2a-8552-4693-87c6-c5f75f2b7343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1170de4-1a41-4f08-b7e7-a849e4d989cb", "name": "network-vif-unplugged", "status": "completed", "tag": "e7664671-e712-452c-9885-3c98261fb754"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:35.660265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-97570a08-0b51-4d2e-8c95-a3ea311eecb2 req-d1a01e2a-8552-4693-87c6-c5f75f2b7343 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.660998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-97570a08-0b51-4d2e-8c95-a3ea311eecb2 req-d1a01e2a-8552-4693-87c6-c5f75f2b7343 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.661485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-97570a08-0b51-4d2e-8c95-a3ea311eecb2 req-d1a01e2a-8552-4693-87c6-c5f75f2b7343 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.687993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-97570a08-0b51-4d2e-8c95-a3ea311eecb2 req-d1a01e2a-8552-4693-87c6-c5f75f2b7343 service nova] Creating event network-vif-unplugged:e7664671-e712-452c-9885-3c98261fb754 for instance c1170de4-1a41-4f08-b7e7-a849e4d989cb on n-h2-854924-5 Aug 30 03:26:35.694934 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-97570a08-0b51-4d2e-8c95-a3ea311eecb2 req-d1a01e2a-8552-4693-87c6-c5f75f2b7343 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053229 Aug 30 03:26:35.695889 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 400/796] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:35.702236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2ef48264-cb3d-4d34-a5fd-7111efdb5cfc req-14202a0e-70d7-4a8b-be73-841b647ddf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1ab00a-a65c-4283-bdd3-4a1e3c7da559", "name": "network-vif-deleted", "tag": "2bf5519e-3191-4915-8475-dd6cfbb9b3a4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:35.711589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:35.713734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2ef48264-cb3d-4d34-a5fd-7111efdb5cfc req-14202a0e-70d7-4a8b-be73-841b647ddf34 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.714204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2ef48264-cb3d-4d34-a5fd-7111efdb5cfc req-14202a0e-70d7-4a8b-be73-841b647ddf34 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.714715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2ef48264-cb3d-4d34-a5fd-7111efdb5cfc req-14202a0e-70d7-4a8b-be73-841b647ddf34 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.728495 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2ef48264-cb3d-4d34-a5fd-7111efdb5cfc req-14202a0e-70d7-4a8b-be73-841b647ddf34 service nova] Creating event network-vif-deleted:2bf5519e-3191-4915-8475-dd6cfbb9b3a4 for instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 on n-h1-854924-5 Aug 30 03:26:35.734421 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2ef48264-cb3d-4d34-a5fd-7111efdb5cfc req-14202a0e-70d7-4a8b-be73-841b647ddf34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037156 Aug 30 03:26:35.735595 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 401/797] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:35.741719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:35.742511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:35.749147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.749659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.750637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.751515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:35.752313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:35.753056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:35.859793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:35.872835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a191b8e-e73d-46f2-8329-7549ab0e60d6 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1477 microversion: 2.1 time: 0.260424 Aug 30 03:26:35.873443 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 397/798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:35 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:35.879306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54fc3358-a973-4a86-a4dd-802b7905920e tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:35.880203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54fc3358-a973-4a86-a4dd-802b7905920e tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:35.967612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-54fc3358-a973-4a86-a4dd-802b7905920e tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:35.974956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:35.976223 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54fc3358-a973-4a86-a4dd-802b7905920e tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1214 microversion: 2.1 time: 0.101655 Aug 30 03:26:35.976693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 398/799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:35 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:35.985956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6aee94c8-be93-41dc-9550-cfc1bdd18709 req-b2c631a6-f1c1-439b-8f96-a2a5694d64e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc", "name": "network-vif-deleted", "tag": "3bae855b-829b-4283-85a2-d077c146decf"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:36.000708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6aee94c8-be93-41dc-9550-cfc1bdd18709 req-b2c631a6-f1c1-439b-8f96-a2a5694d64e2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.001685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6aee94c8-be93-41dc-9550-cfc1bdd18709 req-b2c631a6-f1c1-439b-8f96-a2a5694d64e2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.002060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eb278e36-9fa7-4883-9fef-88d0ce60ac9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1310 microversion: 2.1 time: 0.264802 Aug 30 03:26:36.002475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6aee94c8-be93-41dc-9550-cfc1bdd18709 req-b2c631a6-f1c1-439b-8f96-a2a5694d64e2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.006197 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 402/800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:35 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:36.016420 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6aee94c8-be93-41dc-9550-cfc1bdd18709 req-b2c631a6-f1c1-439b-8f96-a2a5694d64e2 service nova] Creating event network-vif-deleted:3bae855b-829b-4283-85a2-d077c146decf for instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc on n-h2-854924-5 Aug 30 03:26:36.017436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.018106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:36.022413 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6aee94c8-be93-41dc-9550-cfc1bdd18709 req-b2c631a6-f1c1-439b-8f96-a2a5694d64e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044308 Aug 30 03:26:36.025464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.026051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.026334 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 399/801] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:36.026507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.027276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.027731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.028152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.036950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.038015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:36.044675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.045166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.045651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.046531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.047751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.048397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.116921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.132506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.136346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.146964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ece46fc-5b80-426e-ae13-f8cb645c74c3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1443 microversion: 2.75 time: 0.137978 Aug 30 03:26:36.148228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 403/802] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1443 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:36.186673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.188414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:36.201486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.202542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.203426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.204886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.205813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.206563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.220257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.235987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-29b6b132-7fa4-4390-851a-9fa4e4f03c2d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.207535 Aug 30 03:26:36.236999 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 400/803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:36.346200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.353997 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65b92f6b-c024-4e87-8b72-f328c61a2ac1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.174676 Aug 30 03:26:36.354568 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 404/804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:36.531929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.532539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:36.539105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.539629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.540075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.540977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.541510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.542000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.659945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.660803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:36.668144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.668634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.669089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.669793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.670245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.670666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.676541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.686209 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2620f2b-8607-4fd4-adc7-8ebfd372de95 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.158143 Aug 30 03:26:36.686779 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 401/805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:36.751216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:36.758967 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0527353e-ff78-4eeb-9c8a-203d30a281b4 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1478 microversion: 2.1 time: 0.102813 Aug 30 03:26:36.759538 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 405/806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1478 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:36.893907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.894442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:36.901360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.901914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.902346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.903199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:36.903741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:36.904229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:36.997120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:36.998326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.006305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.006778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.007389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.008114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.008668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.009076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.045490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.053679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-65235ee0-0644-4db2-9ddd-961097b88487 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1477 microversion: 2.1 time: 0.163839 Aug 30 03:26:37.054516 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 402/807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:37.059261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:37.059873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.066106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.066753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.067251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.068143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.068768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.069222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.077366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.085989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f231231-3b32-4aab-b2ba-686adb2a34c2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1210 microversion: 2.1 time: 0.093571 Aug 30 03:26:37.086580 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 406/808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:36 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:37.174879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:37.175482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.182109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.183653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.184168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.185088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.185579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.186036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.216064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.224882 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-813ef842-6ac0-4ffd-8378-9197ea1d6c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1494 microversion: 2.1 time: 0.169322 Aug 30 03:26:37.225668 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 403/809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:37 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1494 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:37.247621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:37.249193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.258497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.260675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.261944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.262585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.263307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.263769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.264197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.269194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.271335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.280306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-87cc5637-0a35-4791-88c6-1c3d3992a7b0 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1443 microversion: 2.75 time: 0.108203 Aug 30 03:26:37.280306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 407/810] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:37 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:37.284781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:37.285507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.293557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.294438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.297082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.298146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.298854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.299445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.582496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1cabe6ff-874c-406e-950a-373cd9444b07 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1645 microversion: 2.1 time: 0.338800 Aug 30 03:26:37.588656 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 404/811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:37 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1645 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:37.599144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:37.599775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.606719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.607538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.607989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.608717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.609176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.611708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.626378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:37.641243 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-79af7809-2913-4b5d-bd3a-882d7fc71d82 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.359973 Aug 30 03:26:37.642365 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 408/812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:37 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:37.650529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:37.651142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:37.665690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.666184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.669676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:37.670712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:37.671569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:37.672501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.002651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:38.011606 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b537bbb8-1220-49f0-9c82-7320fdc8f82d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1645 microversion: 2.1 time: 0.365013 Aug 30 03:26:38.016677 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5086966-d26f-4b89-80c2-4c5855d42349 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1476 microversion: 2.1 time: 0.425003 Aug 30 03:26:38.020304 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 405/813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:37 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:38.025881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 409/814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:37 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1645 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:38.035622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-80b3e9fd-f4b1-434d-a7e9-4e1db87fa72a req-7dbae025-e224-4b2a-ad79-366a7e86b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e068f47-c7bd-474d-b436-30eea982b5c1", "name": "network-vif-plugged", "status": "completed", "tag": "ac777799-c1ff-4dbd-9182-bc46eb01ccd2"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:38.058776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:38.059373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:38.067468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.068385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.068832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.071112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.071660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.072146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.080992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-80b3e9fd-f4b1-434d-a7e9-4e1db87fa72a req-7dbae025-e224-4b2a-ad79-366a7e86b9ff service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.088864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-80b3e9fd-f4b1-434d-a7e9-4e1db87fa72a req-7dbae025-e224-4b2a-ad79-366a7e86b9ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.092689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-80b3e9fd-f4b1-434d-a7e9-4e1db87fa72a req-7dbae025-e224-4b2a-ad79-366a7e86b9ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.119167 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-80b3e9fd-f4b1-434d-a7e9-4e1db87fa72a req-7dbae025-e224-4b2a-ad79-366a7e86b9ff service nova] Creating event network-vif-plugged:ac777799-c1ff-4dbd-9182-bc46eb01ccd2 for instance 2e068f47-c7bd-474d-b436-30eea982b5c1 on n-h1-854924-5 Aug 30 03:26:38.147671 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-80b3e9fd-f4b1-434d-a7e9-4e1db87fa72a req-7dbae025-e224-4b2a-ad79-366a7e86b9ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119822 Aug 30 03:26:38.151487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 410/815] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:38.156884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:38.157845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:38.165809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.166543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.167153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.168210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.168893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.169607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.175138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:38.241015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.241538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.244013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.244502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lazy-loading 'fault' on Instance uuid fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:38.351051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11b4a2f12fbc443a8dbf55a0bc995eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd57c329f9d478c83e8a27a1b98fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:38.372253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5564f88a-c5e4-47a7-8591-96ec66799fb6 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 200 len: 1312 microversion: 2.1 time: 0.217669 Aug 30 03:26:38.373134 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 411/816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:38 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:38.397660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:38.409051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.409818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.410271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.412810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.413321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.413780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.433869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=25 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:38.496802 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a521d22-c8c3-4a5e-8732-2fd81eb88bfe tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.116464 Aug 30 03:26:38.498400 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 412/817] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:26:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:38.509899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:38.511438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:38.512520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:38.530667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.534224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.534698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.535441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.539654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.540157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.544873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2257f687-acdd-44e4-b8da-baacadc08d6e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.509408 Aug 30 03:26:38.545836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 406/818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:38 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:38.558623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:38.559528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:38.582552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.583891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.584612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:38.586637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:38.595208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:38.600792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.128821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=18 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:39.137189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:39.148529 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8a71e92-7a62-49fb-97db-3e88d48fddfa tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1266 microversion: 2.1 time: 0.599097 Aug 30 03:26:39.150416 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 407/819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:38 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1266 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:39.159697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:39.160492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:39.179138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.180237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.180906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.182113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.183465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.184238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.280835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.284505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.288091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.290231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lazy-loading 'fault' on Instance uuid 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:39.359612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:39.382195 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edd098ae-ee5e-4db6-9588-4e0cff7a1ec4 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1477 microversion: 2.1 time: 0.882049 Aug 30 03:26:39.383383 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 413/820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:38 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1477 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:39.397322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:39.398567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:39.414341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.415590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.416423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.418987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.420731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.421507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.616445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:39.640085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:39.643093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12e40102-7f48-44e3-852b-0733d6d12572 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a/action" status: 202 len: 0 microversion: 2.1 time: 0.257071 Aug 30 03:26:39.644560 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 414/821] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:39 2022] POST /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:26:39.650713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08061c6c1944e7c839d7fe217a97f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce064a28703a4db8b3ffeaf956dfdf3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:39.656735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:39.658644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:39.672916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.674298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.675845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.678574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.679711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.680111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1f4e2a3-beca-48eb-98be-f7382fc53dc3 tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 200 len: 1448 microversion: 2.75 time: 0.527188 Aug 30 03:26:39.681033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.686310 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 408/822] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:39 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 1448 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:26:39.691415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:39.701273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:39.714094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.724635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.725449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:39.729610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:39.731269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:39.732073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.023861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:40.039931 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e7d9ce9b-4f39-4e62-a22c-07c063d22f3c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.392638 Aug 30 03:26:40.040527 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 415/823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:39 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:40.058149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.058768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: fc1ab00a-a65c-4283-bdd3-4a1e3c7da559] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.078006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.078512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.079042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.079770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.080333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.080755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.129196 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] HTTP exception thrown: Instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 could not be found. Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 HTTP/1.1 Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:26:40.133234 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 could not be found. Aug 30 03:26:40.134891 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'fc1ab00a-a65c-4283-bdd3-4a1e3c7da559'} Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 could not be found. Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:40.135793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 could not be found. Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 could not be found. Aug 30 03:26:40.138634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.141030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:40.145111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 404 to user: Instance fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:40.146603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1bd66607-8f24-4d8f-b8e4-e7946da0180f tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559" status: 404 len: 111 microversion: 2.1 time: 0.092392 Aug 30 03:26:40.154335 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 416/824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/fc1ab00a-a65c-4283-bdd3-4a1e3c7da559 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:40.156791 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e064fe4-05b3-46fe-8050-3f10fc4256a1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1475 microversion: 2.1 time: 0.468715 Aug 30 03:26:40.159893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.160798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.162340 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 409/825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:39 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1475 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:40.170671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.171431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.172592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.175298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.176333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.176965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.185477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.192457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.221401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.222434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.225236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.226360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.227290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.228151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.400500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:40.410236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-242e67bd-8ae1-4026-badb-ee66217bc510 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1390 microversion: 2.1 time: 0.255862 Aug 30 03:26:40.424096 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 417/826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:40.429052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de1eff5-6c6c-4c7f-80cf-67c968b17c6c", "name": "network-vif-unplugged", "status": "completed", "tag": "b052046b-e33c-43d9-83ca-4c6c2d1c1945"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:40.438871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.439347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.440111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.448320 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0d11199-394f-4001-bdc3-261d94563963 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1630 microversion: 2.1 time: 0.280099 Aug 30 03:26:40.448918 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 410/827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1630 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:40.454456 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] Creating event network-vif-unplugged:b052046b-e33c-43d9-83ca-4c6c2d1c1945 for instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c on n-h1-854924-5 Aug 30 03:26:40.454666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.455373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 97ac163f-21d5-4840-9842-9af9465a6b6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.463144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.464007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.464623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.465992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.466666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.467279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.467603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:26:40.482005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d6209750-c064-4cfb-80b3-0cca81485451 req-439f4bc8-82c7-4615-a4fa-4d98d3f6764e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055971 Aug 30 03:26:40.483456 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 418/828] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:40.485220 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] HTTP exception thrown: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f HTTP/1.1 Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:40.487828 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:40.489207 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '97ac163f-21d5-4840-9842-9af9465a6b6f'} Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:40.490353 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. Aug 30 03:26:40.493758 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.496442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 404 to user: Instance 97ac163f-21d5-4840-9842-9af9465a6b6f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:40.496442 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e58585a6-a018-47d7-bbe5-bb6e408461a9 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f" status: 404 len: 111 microversion: 2.1 time: 0.038584 Aug 30 03:26:40.496442 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 411/829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/97ac163f-21d5-4840-9842-9af9465a6b6f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:40.496832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.496832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.498551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1170de4-1a41-4f08-b7e7-a849e4d989cb", "name": "network-vif-plugged", "status": "completed", "tag": "e7664671-e712-452c-9885-3c98261fb754"}, {"server_uuid": "1af00f80-ce1a-4449-a84a-d0194c07e476", "name": "network-vif-plugged", "status": "completed", "tag": "5d2c81d4-43dd-4595-ba0f-e80653f4b6ec"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:40.503500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.504237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.505588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.506477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.506941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.507367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.510392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.510978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.511459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.525894 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] Creating event network-vif-plugged:e7664671-e712-452c-9885-3c98261fb754 for instance c1170de4-1a41-4f08-b7e7-a849e4d989cb on n-h2-854924-5 Aug 30 03:26:40.526511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] Creating event network-vif-plugged:5d2c81d4-43dd-4595-ba0f-e80653f4b6ec for instance 1af00f80-ce1a-4449-a84a-d0194c07e476 on n-h1-854924-5 Aug 30 03:26:40.535291 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-94dca890-1aac-4268-a5d0-5e9460e5b922 req-0bd68c7c-1ca3-4315-af45-6047fb0d4ec0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044369 Aug 30 03:26:40.536311 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 412/830] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:40.543136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.544275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.551391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.552285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.553020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.554030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.554717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.555384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.631685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:40.644716 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4300ddd9-000c-4568-a4b7-7031d612358c tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1272 microversion: 2.1 time: 0.158932 Aug 30 03:26:40.658134 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 419/831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:40.664781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:40.667349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.676213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.677114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.678245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.679198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.679873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.680573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.768338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lazy-loading 'flavor' on Instance uuid f55ec963-f681-4634-a76a-136dbefc4d4a {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:40.822208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Going to try to live migrate instance to n-h1-854924-5 {{(pid=122168) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:26:40.871065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:40.886389 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ff350fe-355e-426e-92b4-05c5535a59af tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1477 microversion: 2.1 time: 0.348613 Aug 30 03:26:40.898551 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 413/832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:40.908875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.909911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] [instance: 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.917014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.917636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.918528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.919469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.920041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.920470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.937030 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] HTTP exception thrown: Instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc could not be found. Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Request method failure captured: Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc HTTP/1.1 Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM6gDmM9XFkKTzk0cpSSp6XlhmJbCqMXitHD_wvJzhAfXZFQaY-qP0aUD7NRMmrvlIMiFbB04o8F_EmLtgu2uc8fGN4tjQiXlIt5QSevLPJsKwxaGmylLd9DD1STfw_Z2sk0pf5tx_Khc58_IaILXXtdasUTbGWHC7ogD_N1Z9-PHk Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:40.939161 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cfd57c329f9d478c83e8a27a1b98fa9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cfd57c329f9d478c83e8a27a1b98fa9a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cfd57c329f9d478c83e8a27a1b98fa9a"}]}] Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cfd57c329f9d478c83e8a27a1b98fa9a Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-37884790 Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 11b4a2f12fbc443a8dbf55a0bc995eac Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServersNegativeTestJSON-37884790-project Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc could not be found. Aug 30 03:26:40.940454 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc'} Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc could not be found. Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:40.941186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc could not be found. Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc could not be found. Aug 30 03:26:40.942982 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.945528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] Returning 404 to user: Instance 71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:40.946454 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2201d9df-5c8d-4ac0-a466-d74e2f084d89 tempest-ListServersNegativeTestJSON-37884790 tempest-ListServersNegativeTestJSON-37884790-project] 10.222.0.30 "GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc" status: 404 len: 111 microversion: 2.1 time: 0.046664 Aug 30 03:26:40.950386 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 414/833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/71f1d4b0-34ca-4f04-85b1-f2e598b4ebfc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:40.951684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:40.952303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] [instance: 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:40.960524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.961041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.961487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.962263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:40.962918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:40.963397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:40.988719 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] HTTP exception thrown: Instance 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 could not be found. Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Request method failure captured: Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 HTTP/1.1 Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMRLzUV8zjCoGa-SHqFTiBLaVxNm1rxJn3JD5-OZfEkIGXWlvu9KchIf3vPdSu12kYl5wJenoPRGVs8MNfePf--km8rdOiMa3vxCGrk3uGWgvrWdjulxJaZHdTJ-saP8HHcFT3l8NgDaIKwYPwBc8bgAbV4sDOciGhK-n9837SYJ3M Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.75 Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ce064a28703a4db8b3ffeaf956dfdf3c Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdmin275Test-1854927022 Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:40.992932 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce064a28703a4db8b3ffeaf956dfdf3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ce064a28703a4db8b3ffeaf956dfdf3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ce064a28703a4db8b3ffeaf956dfdf3c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce064a28703a4db8b3ffeaf956dfdf3c"}]}] Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdmin275Test-1854927022 Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ce064a28703a4db8b3ffeaf956dfdf3c Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdmin275Test-1854927022 Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdmin275Test-1854927022-project Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c08061c6c1944e7c839d7fe217a97f33 Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdmin275Test-1854927022-project Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 could not be found. Aug 30 03:26:40.994363 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6'} Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 could not be found. Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:40.995233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 could not be found. Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 could not be found. Aug 30 03:26:40.996818 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:41.000378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] Returning 404 to user: Instance 3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:41.001650 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f94eac91-181a-428d-a7d3-1976ca229f5a tempest-ServersAdmin275Test-1854927022 tempest-ServersAdmin275Test-1854927022-project] 10.222.0.30 "GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6" status: 404 len: 111 microversion: 2.75 time: 0.053686 Aug 30 03:26:41.003419 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 415/834] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:26:40 2022] GET /compute/v2.1/servers/3d2bb833-9d91-46cf-a8d1-dd0916b0b1e6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:41.060029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:41.060814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:41.071493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:41.073709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:41.074197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:41.074633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:41.082816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:41.083704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:41.084150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:41.447431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:41.461097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a42107f6-0eb7-4cf0-aa32-19bf8326bd73 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1318 microversion: 2.1 time: 0.404871 Aug 30 03:26:41.462083 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 416/835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:41 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:41.468319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:41.469168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:41.481527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:41.482322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:41.482925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:41.483796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:41.484455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:41.485266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:41.514722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:41.861712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:41.878175 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f6153a5-4ef8-42af-b060-d00173ad211f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1475 microversion: 2.1 time: 0.414417 Aug 30 03:26:41.879166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 417/836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:41 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1475 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:41.889385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:41.890199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:41.898079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:41.898726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:41.899260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:41.901181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:41.901971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:41.903078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:42.555188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:42.576959 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac822fb6-13f2-4a29-8d2c-807dc2dacd3e tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1589 microversion: 2.1 time: 0.694567 Aug 30 03:26:42.579436 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 418/837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:41 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1589 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:42.611334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:42.612034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:42.643354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:42.647559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:42.648403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:42.650904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:42.652341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:42.658064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.018413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:43.039371 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b066ba7-a49e-4404-8385-bd1b5e37ddfe tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 0.455542 Aug 30 03:26:43.041607 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 419/838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:42 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:43.052755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:43.052755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:43.061477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.065127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.067243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.069278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.070104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.070849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.404963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:43.418157 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ac6e9e2-a16a-4ff0-9f41-5752269a4a07 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1463 microversion: 2.1 time: 0.373766 Aug 30 03:26:43.420522 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 420/839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:43 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1463 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:43.421473 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7224c420-10d4-4e70-b7bb-841bda5ee5a1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a/action" status: 202 len: 0 microversion: 2.1 time: 2.762056 Aug 30 03:26:43.425662 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 420/840] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:40 2022] POST /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a/action => generated 0 bytes in 2766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:26:43.429172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:43.430108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:43.430350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:43.430849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:43.438186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.439068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.439756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.440548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.440973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.441089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.441478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.442582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.442747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.443115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.443218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.443553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.907439 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65640e84-cd34-499c-ae03-7e008ed538e0 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.480971 Aug 30 03:26:43.917640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 421/841] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:26:43 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1/os-interface => generated 285 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:43.923175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de1eff5-6c6c-4c7f-80cf-67c968b17c6c", "tag": "b052046b-e33c-43d9-83ca-4c6c2d1c1945"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:43.936553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:43.937968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:43.938552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:43.954017 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] Creating event network-changed:b052046b-e33c-43d9-83ca-4c6c2d1c1945 for instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c on n-h1-854924-5 Aug 30 03:26:43.960858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:26:43.975306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-46d9ea21-1e06-43dc-ab5c-edd6ddb89b5f req-86bf5b5c-c82c-4ec0-9003-ab4a095eb8d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055901 Aug 30 03:26:43.977639 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 422/842] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:44.001074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:44.002706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:44.011542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.012315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.013285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:44.013780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.014215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.014686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.015111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.021164 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d82cdccf-4b59-4599-8a06-f5762afc6e66 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1508 microversion: 2.1 time: 0.599216 Aug 30 03:26:44.024447 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 421/843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:43 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:44.030951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:44.032856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:44.047174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.047664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.048094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.048782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.049234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.049692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.643827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:44.654683 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5bfa585a-5d89-4857-9720-52cbf4d8709f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1473 microversion: 2.1 time: 0.662371 Aug 30 03:26:44.658549 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 423/844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:43 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1473 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:44.665762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:44.666547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:44.678367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.679232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:44.682320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.687754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.688575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.689151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.691722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.697593 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12c80beb-7bf6-4f24-ab5b-46e134223b56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.671827 Aug 30 03:26:44.698200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 422/845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:44 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:44.726023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:44.726645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:44.742058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.743840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.744395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:44.745329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:44.746233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:44.746810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.047994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:45.056152 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d69144bb-5c05-4354-842c-021ccfb91822 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1463 microversion: 2.1 time: 0.396384 Aug 30 03:26:45.060107 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 424/846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:44 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1463 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:45.087757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:45.101687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:45.116834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.119418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.119964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.121089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.125283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.125851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.133582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:45.143997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7aec47b-5531-44e3-a0d0-273b4048fea2 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 0.426247 Aug 30 03:26:45.158739 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 423/847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:44 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:45.248441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:45.249038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:45.249778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:45.250424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:45.250944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:45.301106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:45.369664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:45.376662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.377610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.378322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.380055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.380933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.382357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.440519 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d247494d-d463-4f4d-bd65-e8d11880c770 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 1067 microversion: 2.1 time: 0.362247 Aug 30 03:26:45.443031 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 425/848] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:45 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 1067 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 03:26:45.465249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:45.466146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:45.479340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.479934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.482222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.484039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.485435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.487935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.544876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=22 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:45.690273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:45.692644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:45.711670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.715720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.717741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.721149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.721772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.725329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.887308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:45.904638 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f5d8d225-6e26-4304-a873-27b0edd7a44b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.445979 Aug 30 03:26:45.905247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 424/849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:45 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:45.964795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:45.965999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:45.979680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:45.988322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.994043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.996622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:45.997491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:45.999459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:45.999967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.345799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:46.357747 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0eba39dd-831c-4149-ad19-53277bea6b5d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1473 microversion: 2.1 time: 0.677220 Aug 30 03:26:46.372114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 426/850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:45 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1473 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:46.381618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:46.383283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:46.390118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.390774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.391475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.402222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.406535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.407027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.676518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:46.687713 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-60daf7e1-ed31-4032-bb2f-508f99248490 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.743674 Aug 30 03:26:46.693137 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 425/851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:45 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:46.703438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5db83ed6-a91b-427e-82e9-823f69f11da5 req-0f77434f-3422-446b-8c41-831d3056850c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72f550c-d25f-4d74-912b-4f977ee8bc3c", "tag": "4d662782-d4a0-4227-b509-0e75fba8d065"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:46.732071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5db83ed6-a91b-427e-82e9-823f69f11da5 req-0f77434f-3422-446b-8c41-831d3056850c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.733019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5db83ed6-a91b-427e-82e9-823f69f11da5 req-0f77434f-3422-446b-8c41-831d3056850c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.733775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5db83ed6-a91b-427e-82e9-823f69f11da5 req-0f77434f-3422-446b-8c41-831d3056850c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.753447 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5db83ed6-a91b-427e-82e9-823f69f11da5 req-0f77434f-3422-446b-8c41-831d3056850c service nova] Creating event network-changed:4d662782-d4a0-4227-b509-0e75fba8d065 for instance f72f550c-d25f-4d74-912b-4f977ee8bc3c on n-h2-854924-5 Aug 30 03:26:46.760287 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5db83ed6-a91b-427e-82e9-823f69f11da5 req-0f77434f-3422-446b-8c41-831d3056850c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065139 Aug 30 03:26:46.771624 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 426/852] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:46.825724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:46.850028 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-213c31c9-c0de-498c-ae65-820674b41094 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 0.476007 Aug 30 03:26:46.851836 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 427/853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:46 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:46.862390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "81daecec-b0d0-4eae-931c-3d6356e2f98b"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:46.868059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:46.884910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.885773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.886648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.887681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.889052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.890039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.938282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:46.944167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.945167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.945786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.946695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:46.947142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:46.948150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:46.969400 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] HTTP exception thrown: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Request method failure captured: Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476/os-volume_attachments/e74fdc90-d6ce-447f-b068-6c2724219e1b HTTP/1.1 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 74 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYL-YwI7BujC9FkmpHP-O6XymXr16m3Qiudl8mbKo73ilIsmR0wV9lEN1BiMfNDBgjBk0MJe71hiJd8fIrWJQ4v2ISLF2mhUPr_-mIDRePX3LYDWggboGq8f4nFpq2-bg5_J6PNlV0CaoP2NjxPDVxvf0ZSw-qlmepHbri-zAqUaAf0 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 923d839267b44bfba87b0ea8631aace8 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesAdminNegativeTest-1513752498 Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:26:46.971842 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/923d839267b44bfba87b0ea8631aace8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/923d839267b44bfba87b0ea8631aace8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_923d839267b44bfba87b0ea8631aace8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/923d839267b44bfba87b0ea8631aace8"}]}] Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesAdminNegativeTest-1513752498 Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 923d839267b44bfba87b0ea8631aace8 Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1513752498 Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesAdminNegativeTest-1513752498-project-admin Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 54645ee9e3b5462da0fc51f41b65ae77 Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesAdminNegativeTest-1513752498-project-admin Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: {"volumeAttachment": {"volumeId": "81daecec-b0d0-4eae-931c-3d6356e2f98b"}} Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:26:46.973309 n-d-854924-5 devstack@n-api.service[122168]: exception: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': '1af00f80-ce1a-4449-a84a-d0194c07e476', 'id': 'e74fdc90-d6ce-447f-b068-6c2724219e1b', 'body': {'volumeAttachment': {'volumeId': '81daecec-b0d0-4eae-931c-3d6356e2f98b'}}} Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:26:46.974805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. (HTTP 404) (Request-ID: req-bf1795ed-435f-456d-8652-497eed2c533e) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:26:46.976069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:46.977612 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. Aug 30 03:26:46.979108 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:46.982049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] Returning 404 to user: Volume e74fdc90-d6ce-447f-b068-6c2724219e1b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:46.983165 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-773983ba-18a2-4ca3-9a3a-90d8127aa3dd tempest-VolumesAdminNegativeTest-1513752498 tempest-VolumesAdminNegativeTest-1513752498-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476/os-volume_attachments/e74fdc90-d6ce-447f-b068-6c2724219e1b" status: 404 len: 109 microversion: 2.1 time: 0.129854 Aug 30 03:26:46.983988 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 428/854] 10.222.0.30 () {60 vars in 1433 bytes} [Tue Aug 30 03:26:46 2022] PUT /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476/os-volume_attachments/e74fdc90-d6ce-447f-b068-6c2724219e1b => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:47.002508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.003336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:47.015514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.016361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.017146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.018892 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32f04b98-0d13-4792-b59f-cd3e810017bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.245542 Aug 30 03:26:47.019274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.019910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.021222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.022624 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 427/855] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:26:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:47.038650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.052898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.053615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.055379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.062290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.063578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.064256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.161087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ada079b0-06bf-4448-89b7-2d93c892e4c4 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.119177 Aug 30 03:26:47.165279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 428/856] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:47.179343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.185605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.186336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.187129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.188096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.191269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.192962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.266921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-969444ff-a173-411d-abf0-3bf62bf92d20 tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.092758 Aug 30 03:26:47.267542 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 429/857] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:47.290391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.294252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.294745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.295182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.295923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.296385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.296797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.363290 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3676180b-eba3-44f6-a392-789bd6f3d5ab tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-854924-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.076559 Aug 30 03:26:47.364868 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 430/858] 10.222.0.30 () {58 vars in 1194 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/os-services?host=n-d-854924-5&binary=xxx => generated 16 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:47.382109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.389006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.389888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.390572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.391836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.392551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.393248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.409023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:47.430030 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62f3fdec-582a-4251-8e01-89e2db254aa7 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.444765 Aug 30 03:26:47.431475 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 429/859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:46 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:47.436667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.438074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:47.444767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.445611 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc3dc8a7-c74d-4661-af1f-34a17a16e5bc tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.069065 Aug 30 03:26:47.445888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.449536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 431/860] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:47.459744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.461306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.462312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.463305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.477679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.486641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.487904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.489334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.490771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.491585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.492215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.560252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5fe39070-679b-4a0a-945c-017754c0f26d tempest-ServicesAdminNegativeTestJSON-886987464 tempest-ServicesAdminNegativeTestJSON-886987464-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.096478 Aug 30 03:26:47.565084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 432/861] 10.222.0.30 () {58 vars in 1198 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:26:47.800313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:47.812599 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a4e79b9-e4bc-44c0-8bfc-3877813ee40a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1470 microversion: 2.1 time: 0.379706 Aug 30 03:26:47.813929 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 430/862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1470 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:47.829202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2440e6cc-e9ce-4f3c-be6b-6d1a66a069cc tempest-ServicesAdminNegativeTestJSON-24349090 tempest-ServicesAdminNegativeTestJSON-24349090-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.836544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:47.838277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:47.840131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2440e6cc-e9ce-4f3c-be6b-6d1a66a069cc tempest-ServicesAdminNegativeTestJSON-24349090 tempest-ServicesAdminNegativeTestJSON-24349090-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1ed9e393c93d4d89aca3cc8dca913037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c719bd85994db590cb799c29003ea9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2440e6cc-e9ce-4f3c-be6b-6d1a66a069cc tempest-ServicesAdminNegativeTestJSON-24349090 tempest-ServicesAdminNegativeTestJSON-24349090-project] Request method failure captured: Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYN1NBrRbDaJYmGQdg8gQLrnZv0I0OIJ_qDTz-z0L_GIPg4lpc7ESPbTg7vF5hPeljJ2xKwbfmwOFzncsQezKHje_149r7g4Pc0KR8Odimf0kisnQRvvQ2w0SyFpUJCV02uQe85LT84m4pKg82sHn0tsT5tf9zXt6sJ_t0k9qRnj-3Y Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: c1c719bd85994db590cb799c29003ea9 Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-24349090 Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:26:47.847335 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c1c719bd85994db590cb799c29003ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c1c719bd85994db590cb799c29003ea9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c1c719bd85994db590cb799c29003ea9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c1c719bd85994db590cb799c29003ea9"}]}] Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-24349090 Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: c1c719bd85994db590cb799c29003ea9 Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-24349090 Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServicesAdminNegativeTestJSON-24349090-project Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 1ed9e393c93d4d89aca3cc8dca913037 Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-24349090-project Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 03:26:47.850523 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:26:47.851776 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 03:26:47.853187 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:26:47.855528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2440e6cc-e9ce-4f3c-be6b-6d1a66a069cc tempest-ServicesAdminNegativeTestJSON-24349090 tempest-ServicesAdminNegativeTestJSON-24349090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:47.859778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2440e6cc-e9ce-4f3c-be6b-6d1a66a069cc tempest-ServicesAdminNegativeTestJSON-24349090 tempest-ServicesAdminNegativeTestJSON-24349090-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.285563 Aug 30 03:26:47.868108 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 433/863] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/os-services => generated 112 bytes in 288 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:47.870301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.876363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.877259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.878342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.879016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.880175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:47.880380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.881541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:47.894512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.896795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.897553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:47.898548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:47.899447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:47.901275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.038279 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f09cfc65-c23f-41fd-a52e-a2c9d41a15de tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c/action" status: 204 len: 0 microversion: 2.1 time: 0.163068 Aug 30 03:26:48.042480 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 434/864] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:26:47 2022] POST /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c/action => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:48.050075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:48.051096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:48.064357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.065642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.066107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.081998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.084970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.085516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.302937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:48.316098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ac48f01-9749-4eca-b845-a9daa7742566 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.500130 Aug 30 03:26:48.321886 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 431/865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:47 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:48.333069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:48.334024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:48.351039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.351858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.352952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.355963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.357628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.358347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.462854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:48.679974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:48.695112 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f938081-6502-45eb-a9e5-7be1ed48f970 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 0.653673 Aug 30 03:26:48.695719 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 435/866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:48 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:48.710722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:48.711333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:48.718874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:48.721036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.721764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.725531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.726514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.727141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.727752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.734964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9426edd5-e005-4cbf-aeba-534884d414a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1470 microversion: 2.1 time: 0.410615 Aug 30 03:26:48.735787 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 432/867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:48 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:48.811050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:48.811663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:48.823189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.823686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.824121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:48.824830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:48.833255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:48.835574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:49.577052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:49.599963 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a4ff47ba-f5c3-4aa0-b991-2db17c1112f1 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.901360 Aug 30 03:26:49.602907 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 436/868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:48 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:49.632713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c6ca51e4-a8ac-4c46-ab70-132f57991d1d req-0de60068-c9c9-4584-8059-1eedfd19efeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e068f47-c7bd-474d-b436-30eea982b5c1", "tag": "ac777799-c1ff-4dbd-9182-bc46eb01ccd2"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:49.646403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c6ca51e4-a8ac-4c46-ab70-132f57991d1d req-0de60068-c9c9-4584-8059-1eedfd19efeb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:49.646691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:49.648445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c6ca51e4-a8ac-4c46-ab70-132f57991d1d req-0de60068-c9c9-4584-8059-1eedfd19efeb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:49.649279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c6ca51e4-a8ac-4c46-ab70-132f57991d1d req-0de60068-c9c9-4584-8059-1eedfd19efeb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:49.664567 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c6ca51e4-a8ac-4c46-ab70-132f57991d1d req-0de60068-c9c9-4584-8059-1eedfd19efeb service nova] Creating event network-changed:ac777799-c1ff-4dbd-9182-bc46eb01ccd2 for instance 2e068f47-c7bd-474d-b436-30eea982b5c1 on n-h1-854924-5 Aug 30 03:26:49.671198 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c6ca51e4-a8ac-4c46-ab70-132f57991d1d req-0de60068-c9c9-4584-8059-1eedfd19efeb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066636 Aug 30 03:26:49.672602 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 437/869] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:49.676730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f940ced7-3bf4-4b94-87ed-036f3d7d0264 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1589 microversion: 2.1 time: 0.865890 Aug 30 03:26:49.677453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 433/870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:48 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1589 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:49.679904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:49.682792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:49.690694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:49.691478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:49.692294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:49.693234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:49.694016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:49.694633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:49.719190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:49.734053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:49.759737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:49.760645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:49.761414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:49.762418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:49.765796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:49.766550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:50.531166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:50.543566 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2fdbcb5-27af-4d10-845b-791a63f94f9b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.869385 Aug 30 03:26:50.545525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 438/871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:49 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:50.564867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:50.564867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:50.584515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:50.585164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:50.585473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:50.586612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:50.587417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:50.588070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:50.611178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:50.619840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:50.634473 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9e5abfb-3b56-4f4f-aaaa-cea69179501a tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 0.919327 Aug 30 03:26:50.638773 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 434/872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:49 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:50.651931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de1eff5-6c6c-4c7f-80cf-67c968b17c6c", "name": "network-vif-plugged", "status": "completed", "tag": "b052046b-e33c-43d9-83ca-4c6c2d1c1945"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:50.679387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:50.681727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:50.683889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:50.705005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] Creating event network-vif-plugged:b052046b-e33c-43d9-83ca-4c6c2d1c1945 for instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c on n-h1-854924-5 Aug 30 03:26:50.728671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:26:50.761712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1e6f8235-633c-4a32-9e8e-bfd91c05a76f req-5d260cfd-3054-4035-9132-319c18d3f1f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121526 Aug 30 03:26:50.767114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 435/873] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:50.777545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:50.785111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:50.794457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:50.794956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:50.795450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:50.796376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:50.797010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:50.797673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.017671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:51.045479 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0acf9671-47ee-416f-9e3d-fdd740ea6887 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1470 microversion: 2.1 time: 0.496269 Aug 30 03:26:51.051060 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 439/874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:50 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1470 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:51.065221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:51.066099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:51.074873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.075770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.076417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.078092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.079000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.079870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.162188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:51.295875 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c3292f5-f81f-4d4b-99cb-dbbdc69e2a47 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 204 len: 0 microversion: 2.1 time: 0.241063 Aug 30 03:26:51.298510 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 440/875] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:51 2022] DELETE /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:51.319453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:51.329667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:51.338064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.338577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.339024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.339757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.340225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.340658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.427712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:51.449276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c1f9d19b-7614-44bd-9d08-9401d4cc066a tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.680522 Aug 30 03:26:51.451133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 436/876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:50 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:51.461621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-43137a9b-5289-4587-8d5d-169de5ced580 req-8408d08c-e771-45b0-b922-9aa940e81ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55ec963-f681-4634-a76a-136dbefc4d4a", "name": "network-vif-unplugged", "status": "completed", "tag": "437d327d-babd-4d6f-afbf-fd52a78b63e4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:51.498665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-43137a9b-5289-4587-8d5d-169de5ced580 req-8408d08c-e771-45b0-b922-9aa940e81ce7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.501816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-43137a9b-5289-4587-8d5d-169de5ced580 req-8408d08c-e771-45b0-b922-9aa940e81ce7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.502440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-43137a9b-5289-4587-8d5d-169de5ced580 req-8408d08c-e771-45b0-b922-9aa940e81ce7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.531097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-43137a9b-5289-4587-8d5d-169de5ced580 req-8408d08c-e771-45b0-b922-9aa940e81ce7 service nova] Creating event network-vif-unplugged:437d327d-babd-4d6f-afbf-fd52a78b63e4 for instance f55ec963-f681-4634-a76a-136dbefc4d4a on n-h2-854924-5 Aug 30 03:26:51.538450 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-43137a9b-5289-4587-8d5d-169de5ced580 req-8408d08c-e771-45b0-b922-9aa940e81ce7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085024 Aug 30 03:26:51.539896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 437/877] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:51.571718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:51.574038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:51.584698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.600135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.603078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:51.605227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:51.607251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:51.610071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:52.117184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:52.125668 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0900f0a6-c02d-4807-9f61-4585177e55a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1514 microversion: 2.1 time: 0.818447 Aug 30 03:26:52.126239 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 441/878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:51 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1514 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:52.146950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:52.147603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:52.176954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:52.178248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:52.178248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:52.178596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:52.182405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:52.183083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:52.231358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:52.248306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f38f3cb9-2e9d-4cb0-a2dc-633170a704b9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.682839 Aug 30 03:26:52.265796 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 438/879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:51 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:52.281427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:52.282061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:52.307332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:52.307734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:52.308471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:52.309366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:52.309983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:52.310572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.091046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:53.112239 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-faa12418-2f8e-44b8-bbb6-7de0d6155a4c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1470 microversion: 2.1 time: 0.842402 Aug 30 03:26:53.113603 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 439/880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:52 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1470 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:53.133050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:53.134100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:53.148930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.151229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.153016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.155515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.158105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.161423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.265183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:53.279995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-424ede34-d469-4f27-8b57-6519930e8249 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 1.138349 Aug 30 03:26:53.281639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 442/881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:52 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:53.304319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f90ef202-83e3-46ef-a0d2-a0c63b79f696 req-b9f38ac4-b3a7-4f42-b570-1b81a76c9e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72f550c-d25f-4d74-912b-4f977ee8bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "4d662782-d4a0-4227-b509-0e75fba8d065"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:53.339396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f90ef202-83e3-46ef-a0d2-a0c63b79f696 req-b9f38ac4-b3a7-4f42-b570-1b81a76c9e23 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.340445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f90ef202-83e3-46ef-a0d2-a0c63b79f696 req-b9f38ac4-b3a7-4f42-b570-1b81a76c9e23 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.340445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f90ef202-83e3-46ef-a0d2-a0c63b79f696 req-b9f38ac4-b3a7-4f42-b570-1b81a76c9e23 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.387109 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f90ef202-83e3-46ef-a0d2-a0c63b79f696 req-b9f38ac4-b3a7-4f42-b570-1b81a76c9e23 service nova] Creating event network-vif-plugged:4d662782-d4a0-4227-b509-0e75fba8d065 for instance f72f550c-d25f-4d74-912b-4f977ee8bc3c on n-h2-854924-5 Aug 30 03:26:53.406407 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f90ef202-83e3-46ef-a0d2-a0c63b79f696 req-b9f38ac4-b3a7-4f42-b570-1b81a76c9e23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123186 Aug 30 03:26:53.407665 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 443/882] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:53.419112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:53.419867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:53.446391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.446977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.447437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.448455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.449315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.449852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.875210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:53.881499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:53.887272 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d4c9a210-4acb-42e8-8291-b7a0dcabb0ea tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1514 microversion: 2.1 time: 0.477580 Aug 30 03:26:53.897383 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 444/883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:53 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:53.897383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:53.897383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:53.904441 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-535a90cd-8e02-497e-b927-fa551ac26081 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.788380 Aug 30 03:26:53.905236 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 440/884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:53 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:53.909667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5bd67057-2a05-4320-9953-bb7c71808e43 req-19ed2b64-8cbc-4867-94bb-f21565e59919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55ec963-f681-4634-a76a-136dbefc4d4a", "tag": "437d327d-babd-4d6f-afbf-fd52a78b63e4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:53.927208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.930498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.931382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.932493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5bd67057-2a05-4320-9953-bb7c71808e43 req-19ed2b64-8cbc-4867-94bb-f21565e59919 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.932974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5bd67057-2a05-4320-9953-bb7c71808e43 req-19ed2b64-8cbc-4867-94bb-f21565e59919 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.933880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:53.935878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:53.938079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5bd67057-2a05-4320-9953-bb7c71808e43 req-19ed2b64-8cbc-4867-94bb-f21565e59919 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.938423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:53.959960 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5bd67057-2a05-4320-9953-bb7c71808e43 req-19ed2b64-8cbc-4867-94bb-f21565e59919 service nova] Creating event network-changed:437d327d-babd-4d6f-afbf-fd52a78b63e4 for instance f55ec963-f681-4634-a76a-136dbefc4d4a on n-h2-854924-5 Aug 30 03:26:53.967414 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5bd67057-2a05-4320-9953-bb7c71808e43 req-19ed2b64-8cbc-4867-94bb-f21565e59919 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060957 Aug 30 03:26:53.968708 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 441/885] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:54.140181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:54.140778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:54.153984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.154782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.155387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.156134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.156603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.157162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.242000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:54.255924 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a561086-972b-4d4b-8828-c2c2bb7dd7df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.366703 Aug 30 03:26:54.262059 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 445/886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:53 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:54.303847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:54.304457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:54.310779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.311685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.312294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.313175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.313818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.314467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.530514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:54.546259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6eecda56-b057-44d4-b5c7-edab1c806e05 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1462 microversion: 2.1 time: 0.408318 Aug 30 03:26:54.560114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 442/887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:54 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1462 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:54.575984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:54.577222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:54.602272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.605998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.606723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.607925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.608740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.612485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.637744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:54.650714 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ed93c72e-5cf4-4348-9d04-11502f971d7b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1314 microversion: 2.1 time: 0.351191 Aug 30 03:26:54.656168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:54.666885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 446/888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:54 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:26:54.911456 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-573c8516-1d9e-4d04-8c1c-07454234fe0f tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1613 microversion: 2.1 time: 0.344424 Aug 30 03:26:54.912439 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 443/889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:54 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1613 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:54.918488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:54.919103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:54.929042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:54.931276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.931807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.932510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.933413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.933874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.934472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.978569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:54.979314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:54.980212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:54.981616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lazy-loading 'fault' on Instance uuid 1af00f80-ce1a-4449-a84a-d0194c07e476 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:55.010411 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a291ca2b-0514-49ee-a612-ca9659ffd676 tempest-TenantUsagesNegativeTestJSON-378237110 tempest-TenantUsagesNegativeTestJSON-378237110-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T03%3A26%3A54.750684&end=2022-08-31T03%3A26%3A54.750684" status: 404 len: 112 microversion: - time: 0.253965 Aug 30 03:26:55.016241 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 447/890] 10.222.0.30 () {58 vars in 1316 bytes} [Tue Aug 30 03:26:54 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T03%3A26%3A54.750684&end=2022-08-31T03%3A26%3A54.750684 => generated 112 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 03:26:55.021681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:55.022209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:55.034041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.034541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.035032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:55.036004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.036653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.037269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:55.038175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:55.053910 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89db84e4-8d42-4416-9e64-97c50641c502 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1308 microversion: 2.1 time: 0.135331 Aug 30 03:26:55.054678 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 444/891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:54 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:55.060008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e406948e-e31c-4d88-a1b0-b047cf9a2e2b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '.version_select at 0x7f897b82e940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:55.064078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e406948e-e31c-4d88-a1b0-b047cf9a2e2b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.064847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e406948e-e31c-4d88-a1b0-b047cf9a2e2b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.065479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e406948e-e31c-4d88-a1b0-b047cf9a2e2b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:55.086630 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e406948e-e31c-4d88-a1b0-b047cf9a2e2b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.030431 Aug 30 03:26:55.101653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 445/892] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:26:55 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:55.122106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8fce60c-dc29-44b8-bf46-af50cfc02d59 tempest-TenantUsagesNegativeTestJSON-378237110 tempest-TenantUsagesNegativeTestJSON-378237110-project-admin] Calling method '.version_select at 0x7f897b7b1700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:55.139771 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a8fce60c-dc29-44b8-bf46-af50cfc02d59 tempest-TenantUsagesNegativeTestJSON-378237110 tempest-TenantUsagesNegativeTestJSON-378237110-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8fce60c-dc29-44b8-bf46-af50cfc02d59 tempest-TenantUsagesNegativeTestJSON-378237110 tempest-TenantUsagesNegativeTestJSON-378237110-project-admin] Request method failure captured: Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-simple-tenant-usage/e3cc8e84c0004f66bdc8980e53d62d05?start=2022-08-31T03%3A26%3A54.750684&end=2022-08-29T03%3A26%3A54.750684 HTTP/1.1 Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYN-gLMwHgUcGUONCY2YwufJqW1Juxtvv5oPax5CFYFEgS1LF71oo279qOVIZ-fGNUhLd6SZ1SOj4bKTzAItjn2fBTFWxkZzbCWETGgdipBqOXykaNIbU_pud5lX1PKmTHXfBuw6bRhqV-VL0g_IPPch9inAmWIZtgvp0pbE2rLsXyw Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bb8e16164b454f5eae48e5c0b16f0fb6 Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-378237110 Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:26:55.149850 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bb8e16164b454f5eae48e5c0b16f0fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bb8e16164b454f5eae48e5c0b16f0fb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bb8e16164b454f5eae48e5c0b16f0fb6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bb8e16164b454f5eae48e5c0b16f0fb6"}]}] Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-378237110 Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bb8e16164b454f5eae48e5c0b16f0fb6 Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-378237110 Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TenantUsagesNegativeTestJSON-378237110-project-admin Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: fcaec78aa4a946749c24e0ca1923854e Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-378237110-project-admin Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid start time. The start time cannot occur after the end time. Aug 30 03:26:55.151408 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e3cc8e84c0004f66bdc8980e53d62d05'} Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 03:26:55.152250 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 30 03:26:55.153635 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:55.157237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8fce60c-dc29-44b8-bf46-af50cfc02d59 tempest-TenantUsagesNegativeTestJSON-378237110 tempest-TenantUsagesNegativeTestJSON-378237110-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:55.159247 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8fce60c-dc29-44b8-bf46-af50cfc02d59 tempest-TenantUsagesNegativeTestJSON-378237110 tempest-TenantUsagesNegativeTestJSON-378237110-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/e3cc8e84c0004f66bdc8980e53d62d05?start=2022-08-31T03%3A26%3A54.750684&end=2022-08-29T03%3A26%3A54.750684" status: 400 len: 111 microversion: 2.1 time: 0.051721 Aug 30 03:26:55.162451 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 446/893] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Aug 30 03:26:55 2022] GET /compute/v2.1/os-simple-tenant-usage/e3cc8e84c0004f66bdc8980e53d62d05?start=2022-08-31T03%3A26%3A54.750684&end=2022-08-29T03%3A26%3A54.750684 => generated 111 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:26:55.245465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:55.258349 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-638057e0-c90c-4510-94d3-5673a3df2cce tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.240672 Aug 30 03:26:55.259085 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 448/894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:55 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:55.286450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:55.287488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:55.300086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.300952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.302577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:55.304231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.305722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.306789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:55.499439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:55.507811 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-266dbd96-762c-41f4-ab44-81c88a6e7a8d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.227994 Aug 30 03:26:55.508707 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 449/895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:55 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:55.517494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-988254218", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:55.584245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:26:55.699308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd2ad837-96e2-4d4f-b5cd-58f598aee8bc tempest-TenantUsagesNegativeTestJSON-1002512512 tempest-TenantUsagesNegativeTestJSON-1002512512-project] Calling method '.version_select at 0x7f897b70c1f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:55.703930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fd2ad837-96e2-4d4f-b5cd-58f598aee8bc tempest-TenantUsagesNegativeTestJSON-1002512512 tempest-TenantUsagesNegativeTestJSON-1002512512-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '483b87429a4842788ebad307291f7437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8e84c0004f66bdc8980e53d62d05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd2ad837-96e2-4d4f-b5cd-58f598aee8bc tempest-TenantUsagesNegativeTestJSON-1002512512 tempest-TenantUsagesNegativeTestJSON-1002512512-project] Request method failure captured: Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T03%3A26%3A54.750684&end=2022-08-31T03%3A26%3A54.750684&detailed=1 HTTP/1.1 Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYN9_j3zfOE2Mg3MNbHCbM4SxzEQ3L8-Qmlf52R8mH5RwZOneyaPirNfUieNpdgt8UWnCIw8cWtz11AxiMW2-uQi4xRo-M02veWcKhvMfWca2HCEgKMa0mUsuyH9zOLHbBQ28vSriBtjSlSEakvvnpL2AwerHu1XlyDMZ-7NvNTIoyw Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e3cc8e84c0004f66bdc8980e53d62d05 Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1002512512 Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:26:55.706751 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e3cc8e84c0004f66bdc8980e53d62d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e3cc8e84c0004f66bdc8980e53d62d05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e3cc8e84c0004f66bdc8980e53d62d05", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e3cc8e84c0004f66bdc8980e53d62d05"}]}] Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1002512512 Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e3cc8e84c0004f66bdc8980e53d62d05 Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1002512512 Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TenantUsagesNegativeTestJSON-1002512512-project Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 483b87429a4842788ebad307291f7437 Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1002512512-project Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: action_args: {} Aug 30 03:26:55.709552 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:26:55.710442 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:26:55.711818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:26:55.714324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 03:26:55.714324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:55.716231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd2ad837-96e2-4d4f-b5cd-58f598aee8bc tempest-TenantUsagesNegativeTestJSON-1002512512 tempest-TenantUsagesNegativeTestJSON-1002512512-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:55.717685 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd2ad837-96e2-4d4f-b5cd-58f598aee8bc tempest-TenantUsagesNegativeTestJSON-1002512512 tempest-TenantUsagesNegativeTestJSON-1002512512-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T03%3A26%3A54.750684&end=2022-08-31T03%3A26%3A54.750684&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.549350 Aug 30 03:26:55.719087 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 447/896] 10.222.0.30 () {58 vars in 1335 bytes} [Tue Aug 30 03:26:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T03%3A26%3A54.750684&end=2022-08-31T03%3A26%3A54.750684&detailed=1 => generated 123 bytes in 551 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:55.727662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:55.728510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:55.736489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.737369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.737980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:55.750718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:55.752995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:55.754974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.294079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:26:56.296005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:26:56.299040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:26:56.300154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:26:56.301370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:26:56.319944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.320823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.322002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.323935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.325095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.326005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.334483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:56.342783 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bbc963b-dce5-49c6-aba8-4f07ede38be9 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1464 microversion: 2.1 time: 0.621703 Aug 30 03:26:56.343356 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 448/897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:55 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1464 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:56.348708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:56.349331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:56.359466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.360217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.360879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.361381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.361814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.362233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.364233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:26:56.370185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for user 948d18cc663b48028570132678823b93 and project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:26:56.386204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:26:56.390064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:26:56.408087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.408555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.409178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.409681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lazy-loading 'fault' on Instance uuid 1af00f80-ce1a-4449-a84a-d0194c07e476 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:26:56.443210 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4657bfa-b51d-4490-a6c9-e776392b513e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931901 Aug 30 03:26:56.444188 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 450/898] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:26:56.451168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-62058ed4-1051-4ee8-844c-0602af726ef2 req-99540a35-ba29-4266-be69-f0e256142d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af00f80-ce1a-4449-a84a-d0194c07e476", "name": "network-vif-deleted", "tag": "5d2c81d4-43dd-4595-ba0f-e80653f4b6ec"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:26:56.456407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:56.461998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-62058ed4-1051-4ee8-844c-0602af726ef2 req-99540a35-ba29-4266-be69-f0e256142d41 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.463287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-62058ed4-1051-4ee8-844c-0602af726ef2 req-99540a35-ba29-4266-be69-f0e256142d41 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.463896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-62058ed4-1051-4ee8-844c-0602af726ef2 req-99540a35-ba29-4266-be69-f0e256142d41 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.464085 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4460daa7-26f4-483e-aa2f-6206201fa205 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 200 len: 1308 microversion: 2.1 time: 0.119374 Aug 30 03:26:56.465158 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 449/899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:56 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:56.474918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:56.475536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:56.483591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.486193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.486961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.489386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.490031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.490614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.491780 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-62058ed4-1051-4ee8-844c-0602af726ef2 req-99540a35-ba29-4266-be69-f0e256142d41 service nova] Creating event network-vif-deleted:5d2c81d4-43dd-4595-ba0f-e80653f4b6ec for instance 1af00f80-ce1a-4449-a84a-d0194c07e476 on n-h1-854924-5 Aug 30 03:26:56.499428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-62058ed4-1051-4ee8-844c-0602af726ef2 req-99540a35-ba29-4266-be69-f0e256142d41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053669 Aug 30 03:26:56.500262 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 451/900] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:56.731310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:56.765199 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6568e24b-5db2-430a-bf99-48ec09824316 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.298694 Aug 30 03:26:56.777381 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 450/901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:56 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:56.778942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c54c881e-ed7d-4aa8-9b6c-a66275c2a51f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:56.781749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c54c881e-ed7d-4aa8-9b6c-a66275c2a51f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:56.798789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Calling method '.version_select at 0x7f897b9adc10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:56.814695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:26:56.821218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.821699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.822207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.853270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.854373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.855090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.873980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c54c881e-ed7d-4aa8-9b6c-a66275c2a51f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:56.886618 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c54c881e-ed7d-4aa8-9b6c-a66275c2a51f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1212 microversion: 2.1 time: 0.118284 Aug 30 03:26:56.887445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 451/902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:56 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:56.897704 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca87265e-f994-4c12-abad-4efe53a52948 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/b58cf29b8a294a90ae9ad70676ad4987?start=2022-08-29T03%3A26%3A56.356996&end=2022-08-31T03%3A26%3A56.356996" status: 200 len: 695 microversion: 2.1 time: 0.388138 Aug 30 03:26:56.897704 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 452/903] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Aug 30 03:26:56 2022] GET /compute/v2.1/os-simple-tenant-usage/b58cf29b8a294a90ae9ad70676ad4987?start=2022-08-29T03%3A26%3A56.356996&end=2022-08-31T03%3A26%3A56.356996 => generated 695 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:56.897704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:56.897704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:56.908427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.908427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.908427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.908863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.912389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.913456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.920213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '.version_select at 0x7f897b7b0310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:56.953438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.953898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.955235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.977395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:56.978001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:56.978454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:56.998629 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12a6aa80-d169-4a03-9ed0-e581b3bb315f tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/b58cf29b8a294a90ae9ad70676ad4987?start=2022-08-29T03%3A26%3A56.356996&end=2022-08-31T03%3A26%3A56.356996" status: 200 len: 695 microversion: 2.1 time: 0.084069 Aug 30 03:26:57.004673 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 452/904] 10.222.0.30 () {58 vars in 1412 bytes} [Tue Aug 30 03:26:56 2022] GET /compute/v2.1/os-simple-tenant-usage/b58cf29b8a294a90ae9ad70676ad4987?start=2022-08-29T03%3A26%3A56.356996&end=2022-08-31T03%3A26%3A56.356996 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:26:57.025093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Calling method '.version_select at 0x7f897b7b0ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:57.042354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.043171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.043801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.061680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.062614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.063224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.137845 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06aff156-86c6-4b79-8763-de5ddee0d758 tempest-TenantUsagesTestJSON-225072470 tempest-TenantUsagesTestJSON-225072470-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T03%3A26%3A56.356996&end=2022-08-31T03%3A26%3A56.356996&detailed=1" status: 200 len: 11038 microversion: 2.1 time: 0.122666 Aug 30 03:26:57.150567 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 453/905] 10.222.0.30 () {58 vars in 1335 bytes} [Tue Aug 30 03:26:57 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T03%3A26%3A56.356996&end=2022-08-31T03%3A26%3A56.356996&detailed=1 => generated 11038 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:26:57.177142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:57.177683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:57.185464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.186244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.186879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.187904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.188562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.189181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.208896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:57.217476 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ad6f6e9-cb48-4133-826f-1170f05a9016 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.324862 Aug 30 03:26:57.218084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 453/906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:56 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:57.237168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:26:57.387181 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-377ea404-284f-4a00-a230-7cc9e0e4324b tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 204 len: 0 microversion: 2.1 time: 0.214117 Aug 30 03:26:57.389478 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 454/907] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:26:57 2022] DELETE /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:26:57.399489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:57.400115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:57.409553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.410303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.411702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.412402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.413054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.413692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.492476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:57.493627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: 1af00f80-ce1a-4449-a84a-d0194c07e476] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:57.502353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.503239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.504031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.505513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.506179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.507243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.530845 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] HTTP exception thrown: Instance 1af00f80-ce1a-4449-a84a-d0194c07e476 could not be found. Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Request method failure captured: Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 HTTP/1.1 Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLwHL85NWVNaiWMPW4vmbJS-X-IIa5pT89-Uey3Hv9OrBeROCEj1dSn9lNbk10FhFfjoaHDdgUxzV2LFcwsDUCvSpHsHLEnP5I7j7eDNbm71qxCG93aQfh-3KkJB0Va5bp2enXG3P-9GQc0VR9MOsS662-vwMh0tuBBPMV9GBFGM8k Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 396e07d9190a4041a7d808113bb6b1cf Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesAdminNegativeTest-660832019 Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:26:57.533591 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/396e07d9190a4041a7d808113bb6b1cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/396e07d9190a4041a7d808113bb6b1cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_396e07d9190a4041a7d808113bb6b1cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/396e07d9190a4041a7d808113bb6b1cf"}]}] Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesAdminNegativeTest-660832019 Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 396e07d9190a4041a7d808113bb6b1cf Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-660832019 Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesAdminNegativeTest-660832019-project Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: da45da7c2ce14c85b818eb0b9b3e5da9 Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesAdminNegativeTest-660832019-project Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 1af00f80-ce1a-4449-a84a-d0194c07e476 could not be found. Aug 30 03:26:57.535505 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1af00f80-ce1a-4449-a84a-d0194c07e476'} Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af00f80-ce1a-4449-a84a-d0194c07e476 could not be found. Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:26:57.536307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af00f80-ce1a-4449-a84a-d0194c07e476 could not be found. Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af00f80-ce1a-4449-a84a-d0194c07e476 could not be found. Aug 30 03:26:57.537637 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:26:57.540851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Returning 404 to user: Instance 1af00f80-ce1a-4449-a84a-d0194c07e476 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:26:57.542110 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bcf772df-6d38-4841-bbe3-5e7e217e71a2 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476" status: 404 len: 111 microversion: 2.1 time: 0.056260 Aug 30 03:26:57.543369 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 455/908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:57 2022] GET /compute/v2.1/servers/1af00f80-ce1a-4449-a84a-d0194c07e476 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:26:57.637121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:57.650679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-892f5119-f5f9-4ac1-9910-1d61999a9f5d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1470 microversion: 2.1 time: 0.255023 Aug 30 03:26:57.669447 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 454/909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:57 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:57.788565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:57.789367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:57.801243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.803421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.805678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.806591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.809226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.809851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.932240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:57.932919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:57.954455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.956431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.957244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:57.964357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:57.965029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:57.965685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:58.021644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:58.033385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82a5d5db-7f1d-4fcb-9747-7ed94a0a7b80 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.248633 Aug 30 03:26:58.035798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 456/910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:57 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:58.083316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:58.099850 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3eb9ea3-383e-4467-868b-24c26f14c197 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1264 microversion: 2.1 time: 0.177087 Aug 30 03:26:58.100443 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 455/911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:57 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:58.256848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:58.259657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:58.284529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:58.286802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:58.288557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:58.292621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:58.294961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:58.296742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:58.575801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:58.585683 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c142ac9-9218-477e-92fd-368fa2848b65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.348178 Aug 30 03:26:58.586282 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 457/912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:58 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:58.688909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:58.698431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:58.728970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:58.729402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:58.730120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:58.730875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:58.733790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:58.734980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.064617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:59.065606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:59.123447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:59.124229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:59.124864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.126438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:59.127085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:59.127712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.210202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:59.226588 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-987b2816-c4f5-4ef1-b0c0-320674f3d50d tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1470 microversion: 2.1 time: 0.555037 Aug 30 03:26:59.227769 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 456/913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:58 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:59.233451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:59.234912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:59.249977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:59.250750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:59.251407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.252309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:59.253563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:59.265363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.411669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:59.439125 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5be329e7-2500-4083-9817-7d90993b0992 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1270 microversion: 2.1 time: 0.204027 Aug 30 03:26:59.462242 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 457/914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:59 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:59.479515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:26:59.493499 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59553af9-0187-4809-8391-9f5a7f0f25a9 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.436531 Aug 30 03:26:59.494789 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 458/915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:59 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:26:59.612412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:26:59.613115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:26:59.623545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:59.624046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:59.626838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.633964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:26:59.634815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:26:59.635417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:26:59.702658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:00.167156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:00.183020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e04be973-ae43-4f35-b9b6-11fb1587e52b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.576806 Aug 30 03:27:00.184465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 458/916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:26:59 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:00.254304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:00.259862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:00.276496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:00.279028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:00.280876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:00.282951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:00.283808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:00.284834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:00.472547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:00.473749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:00.486449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:00.486949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:00.487389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:00.488117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:00.488631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:00.489065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:00.848837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:00.857966 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05b4f95c-fb3a-4005-b111-356abe42e631 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1470 microversion: 2.1 time: 0.614405 Aug 30 03:27:00.865690 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 459/917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:00 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1470 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:00.871068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:00.878838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:00.895097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:00.902535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:00.903250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:00.904144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:00.904951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:00.905587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:00.931849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:00.940177 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8243e4b7-c5c9-4064-9dd2-59e20a40e82e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.471781 Aug 30 03:27:00.940783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 459/918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:00 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:01.225074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Calling method '.version_select at 0x7f897b7d6ca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:01.248477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.249933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.255018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:01.256494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.257181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.257821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:01.309492 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c570c60a-7c65-4491-89df-50e879203eaa tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.362403 Aug 30 03:27:01.313054 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 460/919] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 03:27:00 2022] GET /compute/v2.1/limits => generated 511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:01.329130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:01.330052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:01.342408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.344439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.345102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:01.346039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.348828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.358640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:01.529639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:01.546071 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-946a682b-ba4f-4d7a-a975-19d3863967ba tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.678834 Aug 30 03:27:01.547509 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 460/920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:00 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:01.555438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-df213f84-dc18-4320-9778-31a10d494380 req-144bc426-cecb-4b66-a3a9-4de45801bedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72f550c-d25f-4d74-912b-4f977ee8bc3c", "name": "network-vif-deleted", "tag": "4d662782-d4a0-4227-b509-0e75fba8d065"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:01.591046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-df213f84-dc18-4320-9778-31a10d494380 req-144bc426-cecb-4b66-a3a9-4de45801bedd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.597095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-df213f84-dc18-4320-9778-31a10d494380 req-144bc426-cecb-4b66-a3a9-4de45801bedd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.597832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-df213f84-dc18-4320-9778-31a10d494380 req-144bc426-cecb-4b66-a3a9-4de45801bedd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:01.627994 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-df213f84-dc18-4320-9778-31a10d494380 req-144bc426-cecb-4b66-a3a9-4de45801bedd service nova] Creating event network-vif-deleted:4d662782-d4a0-4227-b509-0e75fba8d065 for instance f72f550c-d25f-4d74-912b-4f977ee8bc3c on n-h2-854924-5 Aug 30 03:27:01.643446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-df213f84-dc18-4320-9778-31a10d494380 req-144bc426-cecb-4b66-a3a9-4de45801bedd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091266 Aug 30 03:27:01.645278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 461/921] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:01.654740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-748229858", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:01.734681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:27:01.953601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:01.963531 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c0170eb-da33-4cd1-824b-e0caa2a7de51 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.648953 Aug 30 03:27:01.978198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 461/922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:01 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:01.984242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:01.985291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:01.993037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.993976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.994685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:01.995921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:01.996718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:01.997411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:02.058401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:02.059750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:02.060224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:02.060836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lazy-loading 'fault' on Instance uuid f72f550c-d25f-4d74-912b-4f977ee8bc3c {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:27:02.233668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752ae4c59f784ad09d87edf5faa8dbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58cf29b8a294a90ae9ad70676ad4987', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:02.244091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e827bd3b-4fcd-4534-bc7e-20002f168b51 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 200 len: 1304 microversion: 2.1 time: 0.264259 Aug 30 03:27:02.244836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 462/923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:01 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 1304 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:02.281193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:02.281963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:02.290923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:02.291428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:02.292083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:02.294521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:02.295013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:02.295529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:02.351894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Getting quotas for project 02e719ccb67a458cb2bc9d49a505c370. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:02.357522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Getting quotas for user 737ba751ca4d46c09365ab39caf3f785 and project 02e719ccb67a458cb2bc9d49a505c370. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:02.374146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Request method failure captured: Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 1751 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOEhGvtkG4Vy8It_GdokrTGcsULt50HgtOl4wZFV-wb5rYZspPNKVwmLlJuCB20xhkvlPHdIzmp-bMFZnRX_w5yxpCw8alfosqHt5vfCJtWeo196uG3J9CEQPbW9HAwDy9vC1L4i8KBo1CZkeGI37p7qM9O3N45aSYKmFtGcS1d6Uo Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 02e719ccb67a458cb2bc9d49a505c370 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1829001389 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/02e719ccb67a458cb2bc9d49a505c370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/02e719ccb67a458cb2bc9d49a505c370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_02e719ccb67a458cb2bc9d49a505c370", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/02e719ccb67a458cb2bc9d49a505c370"}]}] Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1829001389 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 02e719ccb67a458cb2bc9d49a505c370 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1829001389 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 737ba751ca4d46c09365ab39caf3f785 Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-748229858", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:27:02.377610 n-d-854924-5 devstack@n-api.service[122168]: exception: Maximum number of metadata items exceeds 128 Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-748229858', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:02.379919 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 30 03:27:02.384769 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:02.390962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:02.391977 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9c4c60d-7fa2-4069-ba70-d177c538e173 tempest-AbsoluteLimitsNegativeTestJSON-1829001389 tempest-AbsoluteLimitsNegativeTestJSON-1829001389-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.744274 Aug 30 03:27:02.392649 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 462/924] 10.222.0.30 () {60 vars in 1148 bytes} [Tue Aug 30 03:27:01 2022] POST /compute/v2.1/servers => generated 87 bytes in 746 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:27:02.571453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:02.572290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:02.588951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:02.589525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:02.600246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:02.601150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:02.604457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:02.609603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:02.934794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:02.944205 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1225993b-a737-4096-b468-0ea0294fa2f9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.678799 Aug 30 03:27:02.945145 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 463/925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:02 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:02.965427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a94e5c6e-ced0-4d4f-a6c8-a33be921a09c req-439d1338-08c1-4abe-89f6-788e16a07ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a00fa0-ccdc-44ca-8b84-d0e21eaa69da", "tag": "bb4b4044-487e-4c38-b707-a31e52f91c1f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:02.999821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a94e5c6e-ced0-4d4f-a6c8-a33be921a09c req-439d1338-08c1-4abe-89f6-788e16a07ec8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.001299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a94e5c6e-ced0-4d4f-a6c8-a33be921a09c req-439d1338-08c1-4abe-89f6-788e16a07ec8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.001299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a94e5c6e-ced0-4d4f-a6c8-a33be921a09c req-439d1338-08c1-4abe-89f6-788e16a07ec8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.032166 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a94e5c6e-ced0-4d4f-a6c8-a33be921a09c req-439d1338-08c1-4abe-89f6-788e16a07ec8 service nova] Creating event network-changed:bb4b4044-487e-4c38-b707-a31e52f91c1f for instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da on n-h1-854924-5 Aug 30 03:27:03.045305 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a94e5c6e-ced0-4d4f-a6c8-a33be921a09c req-439d1338-08c1-4abe-89f6-788e16a07ec8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085694 Aug 30 03:27:03.046007 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 464/926] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:03.063952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:03.065726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:03.084592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.085482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.086182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.087165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.087855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.088508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.131427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:03.143535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb540d70-9368-4e42-bcc1-f8a1535802f2 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.577626 Aug 30 03:27:03.144304 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 463/927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:02 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:03.273552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:03.274537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] [instance: f72f550c-d25f-4d74-912b-4f977ee8bc3c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:03.292202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.295248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.299637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.300808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.302097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.302618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.345926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] HTTP exception thrown: Instance f72f550c-d25f-4d74-912b-4f977ee8bc3c could not be found. Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Request method failure captured: Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c HTTP/1.1 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYNpVILjfdT_pZAXS19VPQrZTCd5Yk-l4hjw9r5EQKr8QTAY9ATI78TIlcn2irR6XVSzSxLYEhgisGDDGq-AFSJWeWJWioViehx5c-tV7tZTUYg9oAGqSo3KvHOMuv_1rQ4QpDgL7EqCIIi1QEd8eoPr9Of7F3HWnmXEJ74nKNrwlBw Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b58cf29b8a294a90ae9ad70676ad4987 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TenantUsagesTestJSON-315524850 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b58cf29b8a294a90ae9ad70676ad4987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b58cf29b8a294a90ae9ad70676ad4987"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b58cf29b8a294a90ae9ad70676ad4987", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b58cf29b8a294a90ae9ad70676ad4987"}]}] Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TenantUsagesTestJSON-315524850 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b58cf29b8a294a90ae9ad70676ad4987 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TenantUsagesTestJSON-315524850 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TenantUsagesTestJSON-315524850-project Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 752ae4c59f784ad09d87edf5faa8dbd5 Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TenantUsagesTestJSON-315524850-project Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f72f550c-d25f-4d74-912b-4f977ee8bc3c could not be found. Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f72f550c-d25f-4d74-912b-4f977ee8bc3c'} Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72f550c-d25f-4d74-912b-4f977ee8bc3c could not be found. Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72f550c-d25f-4d74-912b-4f977ee8bc3c could not be found. Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:03.353004 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72f550c-d25f-4d74-912b-4f977ee8bc3c could not be found. Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] Returning 404 to user: Instance f72f550c-d25f-4d74-912b-4f977ee8bc3c could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d92e02f-1f53-400d-877d-11cb35946e07 tempest-TenantUsagesTestJSON-315524850 tempest-TenantUsagesTestJSON-315524850-project] 10.222.0.30 "GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c" status: 404 len: 111 microversion: 2.1 time: 0.088073 Aug 30 03:27:03.364381 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 464/928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:03 2022] GET /compute/v2.1/servers/f72f550c-d25f-4d74-912b-4f977ee8bc3c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:27:03.564922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:03.565571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:03.578953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.579920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.579920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.580589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.581048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.581504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.659735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:27:03.679914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:03.851820 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-846a586a-7465-4a4b-a18a-a0ad7e7cd3d7 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 204 len: 0 microversion: 2.1 time: 0.290576 Aug 30 03:27:03.855933 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 465/929] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:27:03 2022] DELETE /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:27:03.862068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:03.863944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:03.873395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.873884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.874508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:03.876859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:03.877418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:03.878961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:04.101293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:04.132397 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-409d8104-1b44-41c0-aa89-b545c248f724 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 1.084861 Aug 30 03:27:04.132817 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 465/930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:03 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:04.137551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:04.139572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:04.154237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:04.154973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:04.155576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:04.158884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:04.160150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:04.173465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:04.442028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:04.461626 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af4f9480-2845-4c3f-b78f-94ccb48f040d tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1681 microversion: 2.1 time: 0.604069 Aug 30 03:27:04.462415 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 466/931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:03 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1681 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:04.479579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:04.480199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:04.500504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:04.501253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:04.501993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:04.502905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:04.503550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:04.504162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:04.643335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:04.658934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-da14d826-8f94-4445-b81e-990260d4b070 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.524950 Aug 30 03:27:04.659560 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 466/932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:04 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:04.834447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:04.847012 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3ffd93f-f38c-4546-ba99-b0e9da26e459 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.383619 Aug 30 03:27:04.849669 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 467/933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:04 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:05.160095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:05.161858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:05.171198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.171894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.172738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.173620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.174219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.175388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.438536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:05.448702 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b9b0d6f-f44f-421a-96e6-bcc8e592e9d3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.294297 Aug 30 03:27:05.449592 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 467/934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:05 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:05.487769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:05.489817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:05.509081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.510103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.510795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.512037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.513589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.514796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.685441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:05.687016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:05.706761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.707312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.710062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.710890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.711373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.711806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.884920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:05.895858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-32d3a00a-a0df-44ee-a8be-fefc9a1136a5 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1681 microversion: 2.1 time: 0.414693 Aug 30 03:27:05.897012 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 468/935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:05 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:05.903184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:05.904123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:05.916089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.916844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.918107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.919920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:05.920566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:05.921147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:05.970247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:05.986563 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fc0ae2f6-2c8f-4f0b-82aa-8b53cf7a03da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.308410 Aug 30 03:27:05.988094 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 468/936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:05 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:06.174580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:06.184366 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fbe74f62-7530-461c-a2e2-0369cb9b5dd5 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.285939 Aug 30 03:27:06.193675 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 469/937] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:05 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:06.484801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:06.485525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:06.493842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:06.494338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:06.494781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:06.495494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:06.496579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:06.496993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:06.726948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:06.747180 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93d57201-e96b-4308-8792-4414cf6497f9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1504 microversion: 2.1 time: 0.268734 Aug 30 03:27:06.762257 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 469/938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:06 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:06.916890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:06.917706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:06.938902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:06.939942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:06.940397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:06.941313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:06.943403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:06.945302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:07.011904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:07.011904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:07.034747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:07.038453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:07.039151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:07.040214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:07.041673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:07.045107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:07.049962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:07.061477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86f9662b-e001-4de6-928a-08d9f41208e3 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1614 microversion: 2.1 time: 0.148355 Aug 30 03:27:07.064735 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 470/939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:06 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1614 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:07.211896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:07.212569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:07.215338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:07.235579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:07.239648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:07.241841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:07.242610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:07.243092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:07.249628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.012038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:08.028369 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f36e19b-0b7b-47bc-a12a-b2401bb7686c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 1.023014 Aug 30 03:27:08.035457 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 470/940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:07 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:08.138034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:08.147046 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-819e9fba-ec66-440a-8419-acf3bacef466 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.939994 Aug 30 03:27:08.169371 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 471/941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:07 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:08.169371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:08.178688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:08.193991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:08.194492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:08.194964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.195681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:08.196138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:08.196561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.443180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae9aea31-27e1-4421-8c72-3845eb986128 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Action: 'create', calling method: .version_select at 0x7f897b7589d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:08.517171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ae9aea31-27e1-4421-8c72-3845eb986128 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Getting quotas for project 4aa158143a6f4bc7b0216359b9fa67e3. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:08.549893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ae9aea31-27e1-4421-8c72-3845eb986128 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Getting quotas for user 767649e215b44866bf7ba282f88fac5d and project 4aa158143a6f4bc7b0216359b9fa67e3. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:08.710300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ae9aea31-27e1-4421-8c72-3845eb986128 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Getting quotas for project 4aa158143a6f4bc7b0216359b9fa67e3. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:08.725158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ae9aea31-27e1-4421-8c72-3845eb986128 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Getting quotas for user 767649e215b44866bf7ba282f88fac5d and project 4aa158143a6f4bc7b0216359b9fa67e3. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:08.766718 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae9aea31-27e1-4421-8c72-3845eb986128 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.723595 Aug 30 03:27:08.771756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 471/942] 10.222.0.30 () {62 vars in 1214 bytes} [Tue Aug 30 03:27:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:27:08.789878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0e2132ec-d151-4707-96e9-f3432cbfd05c req-32d00f13-98b3-4308-b447-5fbb0a75d04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25d202c-a2b0-44f5-827e-cae9fd1f3a41", "name": "network-vif-deleted", "tag": "7e5241cf-fddd-49ed-ab17-b7f1917e3bce"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:08.827421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e2132ec-d151-4707-96e9-f3432cbfd05c req-32d00f13-98b3-4308-b447-5fbb0a75d04b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:08.828166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e2132ec-d151-4707-96e9-f3432cbfd05c req-32d00f13-98b3-4308-b447-5fbb0a75d04b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:08.828821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e2132ec-d151-4707-96e9-f3432cbfd05c req-32d00f13-98b3-4308-b447-5fbb0a75d04b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.856159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0e2132ec-d151-4707-96e9-f3432cbfd05c req-32d00f13-98b3-4308-b447-5fbb0a75d04b service nova] Creating event network-vif-deleted:7e5241cf-fddd-49ed-ab17-b7f1917e3bce for instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 on n-h2-854924-5 Aug 30 03:27:08.864061 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0e2132ec-d151-4707-96e9-f3432cbfd05c req-32d00f13-98b3-4308-b447-5fbb0a75d04b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088455 Aug 30 03:27:08.865730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 472/943] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:08.873938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:08.874713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:08.885609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:08.886462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:08.886905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.887790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:08.888865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:08.888865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.934636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:08.935131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:08.935636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:08.936104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lazy-loading 'fault' on Instance uuid c25d202c-a2b0-44f5-827e-cae9fd1f3a41 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:27:09.010585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:09.023802 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a22826ed-5c05-4412-a1b5-46e0cb918b15 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1479 microversion: 2.1 time: 0.863461 Aug 30 03:27:09.024423 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 472/944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:08 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1479 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:09.042577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-627ffbef-ce08-4faf-8e42-4a6edec94f99 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.048186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da45da7c2ce14c85b818eb0b9b3e5da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396e07d9190a4041a7d808113bb6b1cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:09.072189 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ef6e25d-ec69-4688-9427-4325f0568771 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 200 len: 1332 microversion: 2.1 time: 0.204669 Aug 30 03:27:09.081803 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 473/945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:08 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 1332 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:09.117713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fc28e86c-8d1d-4375-84e1-ed8f077dee48 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '.version_select at 0x7f897b7d6940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.123507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-627ffbef-ce08-4faf-8e42-4a6edec94f99 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.095489 Aug 30 03:27:09.123805 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 473/946] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 03:27:09 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:27:09.135173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.138025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:09.139930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc28e86c-8d1d-4375-84e1-ed8f077dee48 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.147397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc28e86c-8d1d-4375-84e1-ed8f077dee48 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.148327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc28e86c-8d1d-4375-84e1-ed8f077dee48 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.152834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.155312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.157280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.158141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.161686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.162420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.192239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fc28e86c-8d1d-4375-84e1-ed8f077dee48 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.108034 Aug 30 03:27:09.209500 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 474/947] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:27:09 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:09.232384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41a9b352-6848-41a6-b4f8-196159d3533b tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.303826 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-41a9b352-6848-41a6-b4f8-196159d3533b tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390" status: 200 len: 235 microversion: 2.64 time: 0.094017 Aug 30 03:27:09.304700 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 475/948] 10.222.0.30 () {60 vars in 1304 bytes} [Tue Aug 30 03:27:09 2022] GET /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390 => generated 235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:27:09.320179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.320721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:09.353379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.354272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.355100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.360450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.361081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.361688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.672627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:09.686397 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c85ac700-8d66-477d-87c8-355ce8c42ac8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.554390 Aug 30 03:27:09.699623 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 474/949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:09 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:09.715625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.717934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:09.739022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.739926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.740715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.741766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:09.742554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:09.743273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:09.757811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:09.770943 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1197c001-47fb-4809-8f9e-69d4f9e12a2f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.462945 Aug 30 03:27:09.771817 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 476/950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:09 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:09.784948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-496997a2-7fee-4817-b1af-0285fc548b1e tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.861712 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-496997a2-7fee-4817-b1af-0285fc548b1e tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390" status: 204 len: 0 microversion: 2.64 time: 0.087248 Aug 30 03:27:09.867257 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 477/951] 10.222.0.30 () {60 vars in 1307 bytes} [Tue Aug 30 03:27:09 2022] DELETE /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:27:09.874043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51f93548-d853-44a1-9feb-df7c764494c5 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:09.890549 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-51f93548-d853-44a1-9feb-df7c764494c5 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] HTTP exception thrown: Instance group 2f0c35d7-b939-4169-b69b-bf1e38925390 could not be found. Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51f93548-d853-44a1-9feb-df7c764494c5 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Request method failure captured: Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390 HTTP/1.1 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOLt0Cv7INYVlYkbC7k-V8gZLgRkexDGRXuvGNabfIuQy5esvZIEAfdm_nlUikJy9zuXneH1JyK5iwYC4uVGrUQBZ-gdXXyKHA6mP1Qupw_VSkozJAOmXKME8iZN6yTQUpuJ-_bAjG0Epp7GjKq9PQ2J8A78LgEIzH9UzVULhPYiMU Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.64 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 4aa158143a6f4bc7b0216359b9fa67e3 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerGroup264TestJSON-1194015709 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4aa158143a6f4bc7b0216359b9fa67e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4aa158143a6f4bc7b0216359b9fa67e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4aa158143a6f4bc7b0216359b9fa67e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4aa158143a6f4bc7b0216359b9fa67e3"}]}] Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerGroup264TestJSON-1194015709 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 4aa158143a6f4bc7b0216359b9fa67e3 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1194015709 Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerGroup264TestJSON-1194015709-project Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 767649e215b44866bf7ba282f88fac5d Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerGroup264TestJSON-1194015709-project Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance group 2f0c35d7-b939-4169-b69b-bf1e38925390 could not be found. Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2f0c35d7-b939-4169-b69b-bf1e38925390'} Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2f0c35d7-b939-4169-b69b-bf1e38925390 could not be found. Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2f0c35d7-b939-4169-b69b-bf1e38925390 could not be found. Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:09.895021 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:09.899168 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:09.899168 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:09.899168 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:09.899168 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:09.899168 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2f0c35d7-b939-4169-b69b-bf1e38925390 could not be found. Aug 30 03:27:09.899168 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:09.901571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51f93548-d853-44a1-9feb-df7c764494c5 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] Returning 404 to user: Instance group 2f0c35d7-b939-4169-b69b-bf1e38925390 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:09.902782 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-51f93548-d853-44a1-9feb-df7c764494c5 tempest-ServerGroup264TestJSON-1194015709 tempest-ServerGroup264TestJSON-1194015709-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390" status: 404 len: 117 microversion: 2.64 time: 0.034087 Aug 30 03:27:09.903967 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 478/952] 10.222.0.30 () {60 vars in 1307 bytes} [Tue Aug 30 03:27:09 2022] DELETE /compute/v2.1/os-server-groups/2f0c35d7-b939-4169-b69b-bf1e38925390 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:10.108379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:10.109125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] [instance: c25d202c-a2b0-44f5-827e-cae9fd1f3a41] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:10.121692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:10.122182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:10.126082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:10.127203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:10.127686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:10.128122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:10.172095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] HTTP exception thrown: Instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 could not be found. Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Request method failure captured: Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 HTTP/1.1 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLwHL85NWVNaiWMPW4vmbJS-X-IIa5pT89-Uey3Hv9OrBeROCEj1dSn9lNbk10FhFfjoaHDdgUxzV2LFcwsDUCvSpHsHLEnP5I7j7eDNbm71qxCG93aQfh-3KkJB0Va5bp2enXG3P-9GQc0VR9MOsS662-vwMh0tuBBPMV9GBFGM8k Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 396e07d9190a4041a7d808113bb6b1cf Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesAdminNegativeTest-660832019 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/396e07d9190a4041a7d808113bb6b1cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/396e07d9190a4041a7d808113bb6b1cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_396e07d9190a4041a7d808113bb6b1cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/396e07d9190a4041a7d808113bb6b1cf"}]}] Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesAdminNegativeTest-660832019 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 396e07d9190a4041a7d808113bb6b1cf Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-660832019 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesAdminNegativeTest-660832019-project Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: da45da7c2ce14c85b818eb0b9b3e5da9 Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesAdminNegativeTest-660832019-project Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 could not be found. Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c25d202c-a2b0-44f5-827e-cae9fd1f3a41'} Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 could not be found. Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 could not be found. Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:10.174064 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 could not be found. Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Returning 404 to user: Instance c25d202c-a2b0-44f5-827e-cae9fd1f3a41 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:10.178768 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68335c94-26e2-4b13-a791-2243e5e2525c tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41" status: 404 len: 111 microversion: 2.1 time: 0.073849 Aug 30 03:27:10.185470 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 479/953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:10 2022] GET /compute/v2.1/servers/c25d202c-a2b0-44f5-827e-cae9fd1f3a41 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:27:10.195588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6b56de4-48a1-48a8-961a-d1f413df7f50 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] Calling method '.version_select at 0x7f897b7cae50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:10.246637 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6b56de4-48a1-48a8-961a-d1f413df7f50 tempest-VolumesAdminNegativeTest-660832019 tempest-VolumesAdminNegativeTest-660832019-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224794241" status: 202 len: 0 microversion: 2.1 time: 0.056249 Aug 30 03:27:10.247818 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 480/954] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224794241 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:27:10.438858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c00e8b12-db59-4ea4-ba1d-bf93f4e6e27e tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1630 microversion: 2.1 time: 0.736472 Aug 30 03:27:10.439505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 475/955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:09 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1630 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:10.474545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21100a17-8530-41a0-bb26-bdcadda5dcdc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Action: 'create', calling method: .version_select at 0x7f897b7ab8b0>, body: {"keypair": {"name": "tempest-keypair-1055053357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvkGGQ/9Lkxg67CxtqQ1Ssgc4zQApM4lEULVX7rZfUlet+Z5xS4CFF+9lkyi7ljo0+MWQPJxO8zJaT/UzZ2Ic36qj1dbpT0MkodmPh7Vcu2X1YpSddu6XanK+9ENZpD5g=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:10.502447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:10.529172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-21100a17-8530-41a0-bb26-bdcadda5dcdc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for project ae15b112fcf0488aa618aedf7b310348. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:10.542032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-21100a17-8530-41a0-bb26-bdcadda5dcdc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for user 15eb8a27991445a491ccce6ff650f32a and project ae15b112fcf0488aa618aedf7b310348. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:10.623292 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21100a17-8530-41a0-bb26-bdcadda5dcdc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159536 Aug 30 03:27:10.627863 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 481/956] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:27:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:10.724081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:10.727080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:10.736071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:10.737230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:10.739317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:10.740522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:10.741219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:10.742125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:10.795779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:10.796843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:10.806497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:10.811714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:10.812467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:10.813293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:10.813878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:10.817229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:11.275566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=18 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:11.318688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:11.328421 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-95190c6f-a8db-499d-96ad-668e6f1c46b4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.621602 Aug 30 03:27:11.340978 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 476/957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:10 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:11.617169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:11.639381 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-37a1523e-42d4-4ebc-9c78-ef6e7f01e29b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1472 microversion: 2.1 time: 0.849975 Aug 30 03:27:11.687812 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 482/958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:10 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1472 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:12.352284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:12.352903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:12.366229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:12.367072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:12.374346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:12.376210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:12.377084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:12.377968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:12.380920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:12.641433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-661b1184-cf1a-42a1-bdd6-d1f5bf9f6e2b req-ef2520c4-dcb3-469b-a97d-72ae1337f558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a00fa0-ccdc-44ca-8b84-d0e21eaa69da", "name": "network-vif-plugged", "status": "completed", "tag": "bb4b4044-487e-4c38-b707-a31e52f91c1f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:12.670020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-661b1184-cf1a-42a1-bdd6-d1f5bf9f6e2b req-ef2520c4-dcb3-469b-a97d-72ae1337f558 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:12.670731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-661b1184-cf1a-42a1-bdd6-d1f5bf9f6e2b req-ef2520c4-dcb3-469b-a97d-72ae1337f558 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:12.671430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-661b1184-cf1a-42a1-bdd6-d1f5bf9f6e2b req-ef2520c4-dcb3-469b-a97d-72ae1337f558 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:12.719913 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-661b1184-cf1a-42a1-bdd6-d1f5bf9f6e2b req-ef2520c4-dcb3-469b-a97d-72ae1337f558 service nova] Creating event network-vif-plugged:bb4b4044-487e-4c38-b707-a31e52f91c1f for instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da on n-h1-854924-5 Aug 30 03:27:12.735003 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-661b1184-cf1a-42a1-bdd6-d1f5bf9f6e2b req-ef2520c4-dcb3-469b-a97d-72ae1337f558 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098788 Aug 30 03:27:12.736093 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 483/959] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:27:12.765078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:12.765850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:12.780999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:12.781745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:12.782347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:12.783227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:12.783884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:12.785809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:12.836267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:13.908188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:13.928534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d160a5de-ec1c-4344-9bbf-d110845a9cfd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 1.580473 Aug 30 03:27:13.930061 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 477/960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:12 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:14.171396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:14.189537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb1d9880-36eb-4b2a-9413-8981e2ad2400 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1478 microversion: 2.1 time: 1.428798 Aug 30 03:27:14.190133 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 484/961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:12 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1478 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:14.952189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:14.953649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:14.962342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:14.962935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:14.963442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:14.964282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:14.964805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:14.968349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:15.216308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:15.217626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:15.236083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:15.236927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:15.237622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:15.239827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:15.240574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:15.241052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:15.672376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:15.685730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-652469b8-cb04-40eb-b55b-bfcc78ec4967 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1312 microversion: 2.1 time: 0.737419 Aug 30 03:27:15.701437 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 478/962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:14 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1312 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:15.939477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-97bccd7d-8cf3-45b9-86a5-5c1bcdf4663e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Action: 'create', calling method: .version_select at 0x7f897b693940>, body: {"keypair": {"name": "tempest-keypair-1546993434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsItkUbdu4I2o6WZtvbKfnYLxxvWHgLmsekPzNoGDrxyREej0EJa/Q6FDjbsP3R+9YsRzE0p4RgPRGm+YkpxWlHgtQJhGVTWfbEDh5Tp5Xc2czSb/fQ/1O03zyxvtvdQw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:15.959714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-97bccd7d-8cf3-45b9-86a5-5c1bcdf4663e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Getting quotas for project bd0664f994b4485a88a343742c1ec9bf. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:15.973723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-97bccd7d-8cf3-45b9-86a5-5c1bcdf4663e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Getting quotas for user 0d1638ffc8b0478d875ad0f4b79e333f and project bd0664f994b4485a88a343742c1ec9bf. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:16.009681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:16.024669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-97bccd7d-8cf3-45b9-86a5-5c1bcdf4663e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251300 Aug 30 03:27:16.027087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:16.029093 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 479/963] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:27:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:16.063761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d11c824d-1244-4a6b-8863-bae2acf88b11 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1478 microversion: 2.1 time: 0.848544 Aug 30 03:27:16.064771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 485/964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:15 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1478 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:16.709307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:16.709952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:16.730126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:16.730615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:16.731055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:16.731771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:16.732212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:16.732816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:17.098153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:17.098996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:17.110206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:17.113624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:17.115718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:17.117290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:17.118599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:17.119633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:17.374796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:17.390538 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-648fcb5f-00cc-4ff1-81c2-51d98f0e29d5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1462 microversion: 2.1 time: 0.686234 Aug 30 03:27:17.391829 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 480/965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:16 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1462 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:17.412183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:17.416578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:17.424419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:17.425258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:17.426393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:17.427329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:17.427957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:17.428552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:17.666647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:17.675051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Old instance type m1.heat2, new instance type m1.heat {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 03:27:17.724495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:27:17.727737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:27:17.729337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:27:17.731081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:27:17.733978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:27:17.754442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:17.764736 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-caf96f51-bd26-47d9-a86f-5a6b09830313 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1478 microversion: 2.1 time: 0.670886 Aug 30 03:27:17.778529 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 486/966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:17 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1478 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:17.854855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5bf06651-a578-45d2-823c-d0ba03544d4e req-bae8a2b2-484b-4b73-baf4-0b8d2cb2de91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1170de4-1a41-4f08-b7e7-a849e4d989cb", "name": "network-vif-plugged", "status": "completed", "tag": "e7664671-e712-452c-9885-3c98261fb754"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:17.876969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5bf06651-a578-45d2-823c-d0ba03544d4e req-bae8a2b2-484b-4b73-baf4-0b8d2cb2de91 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:17.878911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5bf06651-a578-45d2-823c-d0ba03544d4e req-bae8a2b2-484b-4b73-baf4-0b8d2cb2de91 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:17.880225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5bf06651-a578-45d2-823c-d0ba03544d4e req-bae8a2b2-484b-4b73-baf4-0b8d2cb2de91 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:17.890757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:17.909425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5bf06651-a578-45d2-823c-d0ba03544d4e req-bae8a2b2-484b-4b73-baf4-0b8d2cb2de91 service nova] Creating event network-vif-plugged:e7664671-e712-452c-9885-3c98261fb754 for instance c1170de4-1a41-4f08-b7e7-a849e4d989cb on n-h2-854924-5 Aug 30 03:27:17.923663 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5bf06651-a578-45d2-823c-d0ba03544d4e req-bae8a2b2-484b-4b73-baf4-0b8d2cb2de91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072687 Aug 30 03:27:17.926773 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 487/967] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:27:18.006601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-889733cb-b17f-42e5-9258-45d2f4676b08 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da/action" status: 202 len: 0 microversion: 2.1 time: 0.590542 Aug 30 03:27:18.011574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 481/968] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:27:17 2022] POST /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:27:18.022450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:18.023404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:18.038467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:18.038960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:18.039397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:18.046174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:18.046865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:18.047463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:18.823503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:18.825024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:18.844843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:18.845441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:18.846162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:18.847314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:18.848256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:18.848256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:19.531419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:19.544708 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e5b8c93-438e-49c3-a88b-fbbb37c672bc tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1471 microversion: 2.1 time: 1.532659 Aug 30 03:27:19.546286 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 488/969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:18 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1471 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:19.567575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "847025fc-8389-4668-87df-cf24646c12f9"}], "security_groups": [{"name": "tempest-securitygroup--324946902"}], "key_name": "tempest-keypair-1546993434", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:19.864260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:19.876753 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da76ba05-a919-4c4c-818c-c475f37e2e1b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1478 microversion: 2.1 time: 1.072186 Aug 30 03:27:19.878627 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 482/970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:18 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1478 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:20.032002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] validate_networks() for [('847025fc-8389-4668-87df-cf24646c12f9', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:27:20.263246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2017937352", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "50cf9776-7fec-4e2a-bfd2-7cfd51c24288"}], "security_groups": [{"name": "tempest-securitygroup--192190787"}], "key_name": "tempest-keypair-1055053357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:20.572833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=20 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:20.761303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] validate_networks() for [('50cf9776-7fec-4e2a-bfd2-7cfd51c24288', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:27:23.077575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:27:23.078061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:27:23.078543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:27:23.078858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:27:23.079270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:27:23.082429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:27:23.083495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:27:23.084197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:27:23.084846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:27:23.085528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:27:23.106239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.107029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.107685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.108615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.109540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.112638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.119791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.120716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.122571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.123565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.126159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.127282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.171336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Getting quotas for project bd0664f994b4485a88a343742c1ec9bf. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:23.184621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:23.197367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for user 15eb8a27991445a491ccce6ff650f32a and project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:23.199633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Getting quotas for user 0d1638ffc8b0478d875ad0f4b79e333f and project bd0664f994b4485a88a343742c1ec9bf. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:23.222347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:27:23.225906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:27:23.261039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:27:23.285164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:27:23.319778 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b4d0ea82-254b-42a4-9af0-9a3abfcf4948 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.062790 Aug 30 03:27:23.321687 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 483/971] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:27:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:27:23.326354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:23.330812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:23.352545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.353080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.353751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.354492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.354961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.357855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.500472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4b903242-2fdf-4899-9a47-aea7203eec8d tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.953057 Aug 30 03:27:23.507282 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 489/972] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:27:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 3954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:27:23.514713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:23.515319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:23.536392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.537056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.537560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:23.538310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:23.538777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:23.539280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:24.045263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:24.062874 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2eabc85e-b58c-466e-a10b-c47186e1af6b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1471 microversion: 2.1 time: 0.739950 Aug 30 03:27:24.068250 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 484/973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:23 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1471 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:24.084097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f10388b-2ddb-4ca1-b4a0-29340f14cf88 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:24.087820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f10388b-2ddb-4ca1-b4a0-29340f14cf88 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:24.243640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f10388b-2ddb-4ca1-b4a0-29340f14cf88 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:24.252069 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f10388b-2ddb-4ca1-b4a0-29340f14cf88 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1235 microversion: 2.1 time: 0.182676 Aug 30 03:27:24.254595 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 485/974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:24 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1235 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:24.271933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac444870-f495-4922-96ed-11b8f2e5cb4a tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:24.272679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ac444870-f495-4922-96ed-11b8f2e5cb4a tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:24.416876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:24.436784 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d2c8cef-dc66-4990-ae24-370f538e6959 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1463 microversion: 2.1 time: 0.933008 Aug 30 03:27:24.445790 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 490/975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:23 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1463 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:24.465745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:24.469485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:24.490959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:24.491787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:24.492256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:24.492991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:24.493563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:24.497661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac444870-f495-4922-96ed-11b8f2e5cb4a tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:24.509586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:24.521408 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac444870-f495-4922-96ed-11b8f2e5cb4a tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1226 microversion: 2.1 time: 0.251183 Aug 30 03:27:24.522451 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 486/976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:24 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1226 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:24.759315 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac4ec25b-83e2-4ea3-a1ed-1d891a27fef5 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 0 microversion: 2.1 time: 0.297162 Aug 30 03:27:24.760667 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 491/977] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:27:24 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:27:24.769521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:24.770594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:24.779349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:24.786140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:24.786672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:24.787697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:24.797683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:24.798382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:24.884136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:24.884637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:24.885215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:24.885907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lazy-loading 'fault' on Instance uuid c1170de4-1a41-4f08-b7e7-a849e4d989cb {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:27:25.084424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:25.086043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:25.096254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:25.097137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:25.099283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:25.100873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:25.102337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:25.104181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:25.555514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a86af082-53bb-4d53-aa3e-07b8084e4aca tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1597 microversion: 2.1 time: 0.789964 Aug 30 03:27:25.572399 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 487/978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:24 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1597 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:25.591722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:25.594263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:25.610800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:25.611684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:25.612422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:25.614220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:25.614921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:25.615573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:26.168385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:26.198628 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f0914fd3-240a-47ce-b786-5fddd32e1b7c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1287 microversion: 2.1 time: 0.621545 Aug 30 03:27:26.202199 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 488/979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:25 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1287 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:26.210329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:26.223359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:26.227870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:26.232125 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8dc40f8d-166d-4714-93ea-25214306bf20 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 1.152693 Aug 30 03:27:26.236932 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 492/980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:25 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:26.249727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:26.255325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:26.269928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:26.271830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:26.280555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:26.282341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:26.283993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:26.284565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:26.285102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:26.285994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:26.286522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:26.286650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:26.288374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:26.288949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:26.530522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:26.538499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e934262d-5643-43ce-96ad-b05a1b60f967 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action" status: 202 len: 0 microversion: 2.1 time: 0.296997 Aug 30 03:27:26.541162 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 493/981] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:27:26 2022] POST /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:27:26.552066 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-deac0fe5-4148-4894-9c2e-a964dd8368bd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1284 microversion: 2.1 time: 0.348137 Aug 30 03:27:26.553138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 489/982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:26 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1284 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:26.556667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:26.557870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:26.565769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:26.567196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:26.568266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:26.569314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:26.570267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:26.571038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.067931 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9f4eaa78-e0ec-4a09-abe8-d987c7ef1746 tempest-ServersAdminTestJSON-1985432682 tempest-ServersAdminTestJSON-1985432682-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1614 microversion: 2.1 time: 0.522166 Aug 30 03:27:27.068538 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 494/983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:26 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1614 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:27.090482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:27.106550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:27.114576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.115361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.115952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.117059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.117696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.118292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.169447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:27:27.228082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:27.229291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:27.240707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.243811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.244600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.248014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.248727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.250012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.390716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:27.403815 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-206d36f9-74bf-4644-8da2-52dd42b09512 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1293 microversion: 2.1 time: 0.179007 Aug 30 03:27:27.406686 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 495/984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:27 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1293 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:27.418971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:27.419204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2b29b6a2-64c5-4b66-abbf-ea6c16bff47d tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 204 len: 0 microversion: 2.1 time: 0.331814 Aug 30 03:27:27.420065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:27.422990 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 490/985] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:27:27 2022] DELETE /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:27:27.429459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:27.432552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:27.439438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.440324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.441060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.442297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.443033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.443669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.454039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.454749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.455375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:27.456268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:27.457474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:27.458089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:28.227910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:28.244967 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7419a64-b86c-40fb-b482-f6dc41b62551 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1470 microversion: 2.1 time: 0.816443 Aug 30 03:27:28.248316 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 491/986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:27 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1470 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:28.270232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:28.271671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:28.274404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:28.286028 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a66ae8ee-201a-4052-81b4-809bfc069bb7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.875734 Aug 30 03:27:28.287133 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 496/987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:27 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:28.304175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:28.317851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:28.320629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:28.321448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:28.321946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:28.325528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:28.429487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:28.430895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:28.437944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:28.438785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:28.443663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:28.445231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:28.445984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:28.446656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:28.698466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:28.717765 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-17bc67df-fc71-4a9b-8a0a-e227ef26826e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1293 microversion: 2.1 time: 0.293101 Aug 30 03:27:28.719907 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 497/988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:28 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1293 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:29.059029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:29.070204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65d57043-f4e2-4e8f-9d5f-b656233bcb3c tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.819046 Aug 30 03:27:29.071703 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 492/989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:28 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:29.271453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:29.272383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:29.282930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:29.284270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:29.284767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:29.285492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:29.285949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:29.286376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:29.309495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:29.310119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:29.322084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:29.323208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:29.323650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:29.326930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:29.327452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:29.327895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:29.960695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:29.968715 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b519056-1243-404f-b14b-812402fc4d18 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.663304 Aug 30 03:27:29.969285 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 493/990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:29 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:29.980874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:29.983184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:29.984054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:30.000071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:30.000933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:30.004859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:30.005954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:30.006654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:30.007296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:30.008738 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d66322fe-5177-420d-a5b6-aecb36d17488 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1470 microversion: 2.1 time: 0.741223 Aug 30 03:27:30.015357 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 498/991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:29 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1470 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:30.111746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:30.112388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:30.128687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:30.129393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:30.129854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:30.130794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:30.132324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:30.132773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:30.140914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:30.495960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:30.526097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edcc59e4-1bea-47f0-a0e7-349a7ded0f28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.546434 Aug 30 03:27:30.529897 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 494/992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:29 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:30.749856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-873485649", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9377aef6-2466-46d9-91da-27a2f4acb097"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:30.783454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:30.801676 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd5e8357-a94d-41e7-aa72-cf83a34f6c91 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.707606 Aug 30 03:27:30.802522 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 499/993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:30 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:30.821737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6991809d-6573-4bd3-9b4f-9d1612ab5a89 req-2dab354e-0935-44d9-98fe-ef0b22a3bb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe5611c-680e-4656-8942-0bcab5aeda8c", "name": "network-vif-deleted", "tag": "637d35ab-e0e2-4fc8-a907-a6992d7f63d1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:30.833796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6991809d-6573-4bd3-9b4f-9d1612ab5a89 req-2dab354e-0935-44d9-98fe-ef0b22a3bb7b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:30.859513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] validate_networks() for [('9377aef6-2466-46d9-91da-27a2f4acb097', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:27:30.859967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6991809d-6573-4bd3-9b4f-9d1612ab5a89 req-2dab354e-0935-44d9-98fe-ef0b22a3bb7b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:30.860605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6991809d-6573-4bd3-9b4f-9d1612ab5a89 req-2dab354e-0935-44d9-98fe-ef0b22a3bb7b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:30.882975 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6991809d-6573-4bd3-9b4f-9d1612ab5a89 req-2dab354e-0935-44d9-98fe-ef0b22a3bb7b service nova] Creating event network-vif-deleted:637d35ab-e0e2-4fc8-a907-a6992d7f63d1 for instance afe5611c-680e-4656-8942-0bcab5aeda8c on n-h2-854924-5 Aug 30 03:27:30.895012 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6991809d-6573-4bd3-9b4f-9d1612ab5a89 req-2dab354e-0935-44d9-98fe-ef0b22a3bb7b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076832 Aug 30 03:27:30.896169 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 500/994] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:30.902135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0cdcb86b-220a-41d0-aa7b-d52994b4c209 req-05a0b79c-df1c-414e-b4c8-0af900e6f867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab6cf50-c7ee-404c-9c2d-a858aaf86c39", "tag": "f1cda62b-b470-4e44-a6d5-06ee7393c4e1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:30.913643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0cdcb86b-220a-41d0-aa7b-d52994b4c209 req-05a0b79c-df1c-414e-b4c8-0af900e6f867 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:30.914501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0cdcb86b-220a-41d0-aa7b-d52994b4c209 req-05a0b79c-df1c-414e-b4c8-0af900e6f867 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:30.915150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0cdcb86b-220a-41d0-aa7b-d52994b4c209 req-05a0b79c-df1c-414e-b4c8-0af900e6f867 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:30.930818 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0cdcb86b-220a-41d0-aa7b-d52994b4c209 req-05a0b79c-df1c-414e-b4c8-0af900e6f867 service nova] Creating event network-changed:f1cda62b-b470-4e44-a6d5-06ee7393c4e1 for instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 on n-h2-854924-5 Aug 30 03:27:30.936265 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0cdcb86b-220a-41d0-aa7b-d52994b4c209 req-05a0b79c-df1c-414e-b4c8-0af900e6f867 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038604 Aug 30 03:27:30.937877 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 501/995] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:31.033063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:31.037523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:31.071235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:31.071235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:31.071235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:31.071872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:31.072238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:31.072853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:31.851603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:31.867280 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77531ab3-038b-481a-9d44-771971c2aebe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.861588 Aug 30 03:27:31.886084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 502/996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:30 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:31.891870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:31.892729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:31.902179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:31.903112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:31.903554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:31.904285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:31.905379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:31.906106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.011186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.012097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.012688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.013296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lazy-loading 'fault' on Instance uuid afe5611c-680e-4656-8942-0bcab5aeda8c {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:27:32.177386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:32.187622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ed5a78e-681e-4c09-8207-6393cf912a0e tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 200 len: 1304 microversion: 2.1 time: 0.300267 Aug 30 03:27:32.188251 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 503/997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:31 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 1304 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:32.198491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:32.199581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:32.221329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.222151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.223232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.224119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.224750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.225334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.272571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:27:32.273091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:27:32.273687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:27:32.274108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:27:32.274520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:27:32.293628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.295803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.296468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.298297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.299511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.300728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.342976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:32.351256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for user 7957bda6b3f3422a94f08752db13ddec and project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:32.374141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:27:32.377049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:27:32.431504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-66a25c49-f0ea-4eb5-a248-3bbf1128f439 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899630 Aug 30 03:27:32.433330 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 495/998] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:27:32.440462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:32.442023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:32.450791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.451326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.451752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.452668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.453732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.454346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.872939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:32.885903 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7865ec56-399e-4bb0-ac3c-17d671b0f0ef tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.691127 Aug 30 03:27:32.887396 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 504/999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:32 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:32.894545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9899ec08-33e9-48ce-bfc0-a8f07be3f66a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:32.895633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9899ec08-33e9-48ce-bfc0-a8f07be3f66a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:32.909625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:32.931808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea3f7520-1c19-4ddb-b4b9-c35192f817dd tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.497072 Aug 30 03:27:32.932404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 496/1000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:32 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:32.938526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:32.939453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:32.946606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.947388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.948006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:32.949399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:32.950478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:32.951077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.062582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9899ec08-33e9-48ce-bfc0-a8f07be3f66a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:33.070654 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9899ec08-33e9-48ce-bfc0-a8f07be3f66a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1224 microversion: 2.1 time: 0.181958 Aug 30 03:27:33.071562 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 505/1001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:32 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:33.094403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-43b5108a-9188-4933-a731-12e1710ff0e0 req-ffdf17ce-c045-47bf-a162-8e197220fd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ab56e1-fa28-4a76-8f7c-f21ad1acd129", "tag": "e30cbadc-95e2-4ab6-9a62-fbf45745804c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:33.136632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-43b5108a-9188-4933-a731-12e1710ff0e0 req-ffdf17ce-c045-47bf-a162-8e197220fd45 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.137111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-43b5108a-9188-4933-a731-12e1710ff0e0 req-ffdf17ce-c045-47bf-a162-8e197220fd45 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.138411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-43b5108a-9188-4933-a731-12e1710ff0e0 req-ffdf17ce-c045-47bf-a162-8e197220fd45 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.186754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:33.251756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-43b5108a-9188-4933-a731-12e1710ff0e0 req-ffdf17ce-c045-47bf-a162-8e197220fd45 service nova] Creating event network-changed:e30cbadc-95e2-4ab6-9a62-fbf45745804c for instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 on n-h2-854924-5 Aug 30 03:27:33.264003 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-43b5108a-9188-4933-a731-12e1710ff0e0 req-ffdf17ce-c045-47bf-a162-8e197220fd45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191024 Aug 30 03:27:33.266783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 506/1002] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:33.281463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:33.282593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: afe5611c-680e-4656-8942-0bcab5aeda8c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:33.324182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.325295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.326250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.327154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.327762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.328471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.353751 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] HTTP exception thrown: Instance afe5611c-680e-4656-8942-0bcab5aeda8c could not be found. Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Request method failure captured: Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c HTTP/1.1 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMkGQArnRQX_2NWhsSDNseJMdkbcvHJaeXGTTCeHBhySsYQGVgM8JHJsD-Lr87ppTthJ-U_k92OJmSHdeMpoEI2DArt5pvLW6E9SPqjFtd6XizPcIcWJMIpg2_oukkknds8bIyfgvawNO7DuwtPKNUwBOTRLxei8YwsX1N0GXB_QdY Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc50c2ff3ca9496db43ab1dcbad2347f Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc50c2ff3ca9496db43ab1dcbad2347f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc50c2ff3ca9496db43ab1dcbad2347f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc50c2ff3ca9496db43ab1dcbad2347f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc50c2ff3ca9496db43ab1dcbad2347f"}]}] Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc50c2ff3ca9496db43ab1dcbad2347f Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminTestJSON-1220183908-project Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c3bd201e25854ba8b76e36d0b2cdb553 Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminTestJSON-1220183908-project Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance afe5611c-680e-4656-8942-0bcab5aeda8c could not be found. Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'afe5611c-680e-4656-8942-0bcab5aeda8c'} Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe5611c-680e-4656-8942-0bcab5aeda8c could not be found. Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe5611c-680e-4656-8942-0bcab5aeda8c could not be found. Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:33.358330 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe5611c-680e-4656-8942-0bcab5aeda8c could not be found. Aug 30 03:27:33.365658 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:33.369310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Returning 404 to user: Instance afe5611c-680e-4656-8942-0bcab5aeda8c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:33.371024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cac3696e-44e5-48d1-859a-c5dc6cbad9fb tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c" status: 404 len: 111 microversion: 2.1 time: 0.098782 Aug 30 03:27:33.372363 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 507/1003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:33 2022] GET /compute/v2.1/servers/afe5611c-680e-4656-8942-0bcab5aeda8c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:27:33.383292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:33.384072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:33.402836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.403517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.404108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.405107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.405821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.406489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.458384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:27:33.619973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6498027b-7b0c-48f2-9a5f-0a8815f3a783 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 204 len: 0 microversion: 2.1 time: 0.242193 Aug 30 03:27:33.623092 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 508/1004] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:27:33 2022] DELETE /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:27:33.659577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:33.660208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:33.663427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:33.677141 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dad69e21-dfaf-4a69-8f44-e8ccc0dabd79 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.742528 Aug 30 03:27:33.678498 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 497/1005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:32 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:33.707688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.709803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.710656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.711691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.712372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.712962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.907109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:33.907738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:33.919479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.930229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.930947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:33.932086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:33.932732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:33.933397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:34.226637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:34.235693 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-968c0cf5-7394-49bf-95f4-3e4068850262 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1468 microversion: 2.1 time: 0.604916 Aug 30 03:27:34.249018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 509/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:33 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1468 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:34.249018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:34.249018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:34.250870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:34.251570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:34.251809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:34.252647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:34.253126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:34.254137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:34.419108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:34.428396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-25e934ed-dc22-457f-b5ff-27bb5f589f4b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.524972 Aug 30 03:27:34.442508 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 498/1007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:33 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:34.447899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:34.453426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:34.462990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:34.463491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:34.463992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:34.464749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:34.465432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:34.465867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:34.496625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:34.632314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:34.648193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:34.657006 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-569683ab-7641-44a4-a9d9-10d0751932b2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1276 microversion: 2.1 time: 0.213114 Aug 30 03:27:34.657551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 499/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:34 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:34.662757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eda6d8c0-10df-4c09-a214-bb394e83fa28 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.424942 Aug 30 03:27:34.687718 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 510/1009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:34 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:34.705637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:34.706858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:34.727682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:34.728192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:34.728929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:34.729700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:34.730983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:34.731630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:35.149229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:35.172592 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8f788bae-dd3a-48bf-bd56-c586dd4b893b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.471673 Aug 30 03:27:35.172957 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 500/1010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:34 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:35.256393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:35.257668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:35.269166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:35.269696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:35.279945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:35.281540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:35.282028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:35.282463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:35.450503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:35.451140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:35.467939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:35.468843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:35.469246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:35.470058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:35.470554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:35.470986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:36.577389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:36.588266 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a25f362-3b32-46c7-a08c-7c1c279d9ce8 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1468 microversion: 2.1 time: 1.335967 Aug 30 03:27:36.591142 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 511/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:35 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1468 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:36.609106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:36.612293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:36.644166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:36.646136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:36.646609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:36.647369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:36.647817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:36.651480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:36.776008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:36.788879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4094f39c-90b2-4804-a6ed-60cdd813b0d8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 1.342729 Aug 30 03:27:36.795213 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 501/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:35 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:36.817621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:36.825934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:36.826787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:36.835471 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0d579c1-ee15-472b-ae7f-680bacf4c96e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1282 microversion: 2.1 time: 0.241785 Aug 30 03:27:36.851846 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 512/1013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:36 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:36.868438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:36.869996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:36.870577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:36.872344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:36.873112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:36.873718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:36.877270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:36.877952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:36.893304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:36.894635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:36.895453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:36.896607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:36.906856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:36.908151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:37.587027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:37.603535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3fad0256-a4c9-4b72-9b85-dd99cfecc59b tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.803471 Aug 30 03:27:37.606975 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 502/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:36 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:37.632220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:37.633806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:37.635144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:37.645259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:37.646327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:37.647036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:37.648043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:37.648761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:37.649222 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca6270fb-77b2-406a-899b-ab08bbb34fc2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.794286 Aug 30 03:27:37.649667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:37.652650 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 513/1015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:36 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:37.825096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:37.827097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:37.837629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:37.846533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:37.854422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aab0df2f-e568-4f26-8624-f7ba023b8a9f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1426 microversion: 2.1 time: 0.226324 Aug 30 03:27:37.856376 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 503/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:37 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1426 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:37.868278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:37.871141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:37.876365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:37.877506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:37.878798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:37.879636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:37.880095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:37.880724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:37.897470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:37.898105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:37.898665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:37.907207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:37.907862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:37.908421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.392146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:38.400339 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-76a11280-69b7-45af-a28e-f770702b916d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.581784 Aug 30 03:27:38.416880 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 514/1017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:37 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:38.422578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d7b5074e-35a6-4b1d-801b-76781b4ebe57 req-39e4ac05-a441-4042-adc9-4b7163d96376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a9feb-782c-474d-a994-e9748a03c1f8", "name": "network-vif-deleted", "tag": "f0f9df97-f714-4929-81e4-4f1ba4b44b24"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:38.456752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d7b5074e-35a6-4b1d-801b-76781b4ebe57 req-39e4ac05-a441-4042-adc9-4b7163d96376 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.457246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d7b5074e-35a6-4b1d-801b-76781b4ebe57 req-39e4ac05-a441-4042-adc9-4b7163d96376 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.468499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d7b5074e-35a6-4b1d-801b-76781b4ebe57 req-39e4ac05-a441-4042-adc9-4b7163d96376 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.505624 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d7b5074e-35a6-4b1d-801b-76781b4ebe57 req-39e4ac05-a441-4042-adc9-4b7163d96376 service nova] Creating event network-vif-deleted:f0f9df97-f714-4929-81e4-4f1ba4b44b24 for instance ab3a9feb-782c-474d-a994-e9748a03c1f8 on n-h1-854924-5 Aug 30 03:27:38.525717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d7b5074e-35a6-4b1d-801b-76781b4ebe57 req-39e4ac05-a441-4042-adc9-4b7163d96376 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117228 Aug 30 03:27:38.527025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 515/1018] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:38.532722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9c006a7c-7c68-4df0-b931-7d24dcbf0afa req-2fcaec6b-e453-4d0f-a500-7a3817d7a336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab6cf50-c7ee-404c-9c2d-a858aaf86c39", "name": "network-vif-plugged", "status": "completed", "tag": "f1cda62b-b470-4e44-a6d5-06ee7393c4e1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:38.573225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9c006a7c-7c68-4df0-b931-7d24dcbf0afa req-2fcaec6b-e453-4d0f-a500-7a3817d7a336 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.575614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9c006a7c-7c68-4df0-b931-7d24dcbf0afa req-2fcaec6b-e453-4d0f-a500-7a3817d7a336 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.576581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9c006a7c-7c68-4df0-b931-7d24dcbf0afa req-2fcaec6b-e453-4d0f-a500-7a3817d7a336 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.606069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9c006a7c-7c68-4df0-b931-7d24dcbf0afa req-2fcaec6b-e453-4d0f-a500-7a3817d7a336 service nova] Creating event network-vif-plugged:f1cda62b-b470-4e44-a6d5-06ee7393c4e1 for instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 on n-h2-854924-5 Aug 30 03:27:38.620211 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9c006a7c-7c68-4df0-b931-7d24dcbf0afa req-2fcaec6b-e453-4d0f-a500-7a3817d7a336 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091532 Aug 30 03:27:38.620934 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 516/1019] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:38.642197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:38.643063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:38.660428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.664194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.664811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.666011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.666555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.669260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.710388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:38.718679 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d4c6a610-3dac-481f-acc9-466148aa76bf tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 0.851635 Aug 30 03:27:38.721807 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 504/1020] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:37 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:38.742306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-cd9a8cf0-41df-4941-8771-8c19cd473f26 req-08258888-b00c-4d65-b342-937df462a722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28b0ad0-b499-4791-863b-3e38658f5822", "tag": "90baf28f-1f7a-4337-a8cc-136ca27b642a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:38.786845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cd9a8cf0-41df-4941-8771-8c19cd473f26 req-08258888-b00c-4d65-b342-937df462a722 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.787654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cd9a8cf0-41df-4941-8771-8c19cd473f26 req-08258888-b00c-4d65-b342-937df462a722 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.788272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cd9a8cf0-41df-4941-8771-8c19cd473f26 req-08258888-b00c-4d65-b342-937df462a722 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.811919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-cd9a8cf0-41df-4941-8771-8c19cd473f26 req-08258888-b00c-4d65-b342-937df462a722 service nova] Creating event network-changed:90baf28f-1f7a-4337-a8cc-136ca27b642a for instance a28b0ad0-b499-4791-863b-3e38658f5822 on n-h1-854924-5 Aug 30 03:27:38.831287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-cd9a8cf0-41df-4941-8771-8c19cd473f26 req-08258888-b00c-4d65-b342-937df462a722 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100419 Aug 30 03:27:38.832399 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 505/1021] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:38.837805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:38.838518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:38.848468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:38.856708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.857575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.858178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.859079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.859735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.860635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.912192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:38.920991 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68d59481-666b-4b39-a0bf-c510c6b75369 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.290231 Aug 30 03:27:38.923732 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 517/1022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:38 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:38.929687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:38.930508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:38.937095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.937897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.938479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.939341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.939955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.940982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.976997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:38.978036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:38.978640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:38.979256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lazy-loading 'fault' on Instance uuid ab3a9feb-782c-474d-a994-e9748a03c1f8 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:27:38.982796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:39.061403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:39.075215 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ae5f976-28cc-4c8c-ae02-c16bcfe12ecc tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 200 len: 1303 microversion: 2.1 time: 0.149101 Aug 30 03:27:39.076583 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 518/1023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:38 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:39.363528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:39.381426 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-addb8f47-00c6-49d5-a8f6-2dd34cde5f6d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 0.545171 Aug 30 03:27:39.382313 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 506/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:38 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:39.428029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:39.429076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:39.449427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:39.450396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:39.451045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:39.451786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:39.454361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:39.455009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:39.749900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:39.751178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:39.770450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:39.771329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:39.772021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:39.772975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:39.773685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:39.774327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:39.777641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:39.790110 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e39e1716-daeb-43a0-a451-7326618f1769 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.369246 Aug 30 03:27:39.792590 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 519/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:39 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:39.949752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:39.950647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:39.961431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:39.962319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:39.962914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:39.963849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:39.965687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:39.966676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:40.656994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:40.673094 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0a378bb-f91b-443f-938a-a3155a8cfd4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 0.926050 Aug 30 03:27:40.674234 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 507/1026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:39 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:40.690352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:40.691200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: ab3a9feb-782c-474d-a994-e9748a03c1f8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:40.705321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:40.706140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:40.707116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:40.707856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:40.708316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:40.717860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:40.763210 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] HTTP exception thrown: Instance ab3a9feb-782c-474d-a994-e9748a03c1f8 could not be found. Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Request method failure captured: Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 HTTP/1.1 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYMkGQArnRQX_2NWhsSDNseJMdkbcvHJaeXGTTCeHBhySsYQGVgM8JHJsD-Lr87ppTthJ-U_k92OJmSHdeMpoEI2DArt5pvLW6E9SPqjFtd6XizPcIcWJMIpg2_oukkknds8bIyfgvawNO7DuwtPKNUwBOTRLxei8YwsX1N0GXB_QdY Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: fc50c2ff3ca9496db43ab1dcbad2347f Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc50c2ff3ca9496db43ab1dcbad2347f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc50c2ff3ca9496db43ab1dcbad2347f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc50c2ff3ca9496db43ab1dcbad2347f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc50c2ff3ca9496db43ab1dcbad2347f"}]}] Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: fc50c2ff3ca9496db43ab1dcbad2347f Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersAdminTestJSON-1220183908-project Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c3bd201e25854ba8b76e36d0b2cdb553 Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersAdminTestJSON-1220183908-project Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance ab3a9feb-782c-474d-a994-e9748a03c1f8 could not be found. Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'ab3a9feb-782c-474d-a994-e9748a03c1f8'} Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3a9feb-782c-474d-a994-e9748a03c1f8 could not be found. Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3a9feb-782c-474d-a994-e9748a03c1f8 could not be found. Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:40.765193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3a9feb-782c-474d-a994-e9748a03c1f8 could not be found. Aug 30 03:27:40.770119 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:40.771566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Returning 404 to user: Instance ab3a9feb-782c-474d-a994-e9748a03c1f8 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:40.772609 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2502294c-8327-495f-b547-4aa4e095b201 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8" status: 404 len: 111 microversion: 2.1 time: 0.097345 Aug 30 03:27:40.773359 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 508/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:40 2022] GET /compute/v2.1/servers/ab3a9feb-782c-474d-a994-e9748a03c1f8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:27:40.778785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:40.779645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:40.793453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:40.795168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:40.795907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:40.796992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:40.797648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:40.798261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:40.830044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:40.847051 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af321817-04b5-4ba5-9ef8-4d7d4e7481df tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1351 microversion: 2.1 time: 0.901820 Aug 30 03:27:40.847682 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 520/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:39 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1351 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:40.892693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-bdd16e28-352b-4c6c-aa5c-0a520807524e req-df958f62-191e-4882-bd2a-c42b512995b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ab56e1-fa28-4a76-8f7c-f21ad1acd129", "name": "network-vif-plugged", "status": "completed", "tag": "e30cbadc-95e2-4ab6-9a62-fbf45745804c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:40.917519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bdd16e28-352b-4c6c-aa5c-0a520807524e req-df958f62-191e-4882-bd2a-c42b512995b7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:40.919820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bdd16e28-352b-4c6c-aa5c-0a520807524e req-df958f62-191e-4882-bd2a-c42b512995b7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:40.920418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bdd16e28-352b-4c6c-aa5c-0a520807524e req-df958f62-191e-4882-bd2a-c42b512995b7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:40.955917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-bdd16e28-352b-4c6c-aa5c-0a520807524e req-df958f62-191e-4882-bd2a-c42b512995b7 service nova] Creating event network-vif-plugged:e30cbadc-95e2-4ab6-9a62-fbf45745804c for instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 on n-h2-854924-5 Aug 30 03:27:40.971321 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-bdd16e28-352b-4c6c-aa5c-0a520807524e req-df958f62-191e-4882-bd2a-c42b512995b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102251 Aug 30 03:27:40.975127 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 521/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:40.993203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:40.995773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:41.022573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:41.023106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:41.023556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:41.024435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:41.026508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:41.027316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:41.131079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:27:41.794717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7e40cef-d026-4121-9967-c0ac8e36593f tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 204 len: 0 microversion: 2.1 time: 0.817676 Aug 30 03:27:41.798443 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 522/1030] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:27:40 2022] DELETE /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:27:41.804980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:41.805493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:41.817828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:41.818963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:41.819420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:41.825520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:41.826208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:41.832689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.020117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:42.029928 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b6860879-e6ce-44aa-adc8-d09dfe05d2cf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1476 microversion: 2.1 time: 1.255378 Aug 30 03:27:42.034805 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 509/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:40 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1476 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:42.050550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:42.051341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:42.057528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.058011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.058779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.067291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.067983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.068572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.315529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:42.368288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=20 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:42.417659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:42.427932 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-526056ab-c47c-4cfc-9417-3ef61cd5a086 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 0.391986 Aug 30 03:27:42.428822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 510/1032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:42 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:42.434816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:42.436145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:42.443823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.444689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.445215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.446686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.447553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.448124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.455697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:42.478669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d54e8163-518c-4b8a-8337-73a48e46fe4c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.678798 Aug 30 03:27:42.479505 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 523/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:41 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:42.485801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:42.486896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:42.494122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.497632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.498463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.500801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.502274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.503499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.743065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:42.753627 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e59091b5-c842-4ff1-92e6-92edaf2de341 tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1469 microversion: 2.1 time: 0.323191 Aug 30 03:27:42.754526 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 511/1034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:42 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:42.759312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a00fa0-ccdc-44ca-8b84-d0e21eaa69da", "name": "network-vif-unplugged", "status": "completed", "tag": "bb4b4044-487e-4c38-b707-a31e52f91c1f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:42.769706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.770483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.771085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.786345 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] Creating event network-vif-unplugged:bb4b4044-487e-4c38-b707-a31e52f91c1f for instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da on n-h2-854924-5 Aug 30 03:27:42.793860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:27:42.810194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1cfb7b17-a95a-4ea2-bdee-52db732ffd29 req-59cab941-c5e3-4927-ad3e-80b1c40d98da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053613 Aug 30 03:27:42.811425 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 512/1035] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:42.862228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:42.897790 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a962cd76-6b80-4293-96f3-52c0e228667e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1541 microversion: 2.1 time: 0.412318 Aug 30 03:27:42.904139 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 524/1036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:42 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1541 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:42.925786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:42.926377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:42.944074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.944515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.944959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:42.948491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:42.949143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:42.949613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:43.057172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:43.058275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:43.068777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:43.072734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:43.078234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:43.086102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:43.094046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:43.109539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:43.110762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:43.160990 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74097219-fe7b-4c87-acea-bb6e2892937e tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239597 Aug 30 03:27:43.162351 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 513/1037] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:27:42 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:43.393147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:43.405296 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6dbcecb-77c9-4805-9e80-8962ff918406 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1475 microversion: 2.1 time: 0.352338 Aug 30 03:27:43.408254 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 525/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:43 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:43.452491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:43.453120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:43.468759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:43.469295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:43.470235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:43.470466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:43.470924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:43.471353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:43.502672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:43.503162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:43.511401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:43.511788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:43.512407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:43.513296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:43.513937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:43.517904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:44.118460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:44.133704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8e594b9-cc17-4d9b-9279-7a15fa52e4da tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 0.685053 Aug 30 03:27:44.135023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 514/1039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:43 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:44.140610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:44.142379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:44.148337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:44.150370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:44.151120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:44.152482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:44.153961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:44.155200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:44.155971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:44.160776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa2ec951-9c4f-43d7-864b-e609cacec78c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1360 microversion: 2.1 time: 0.659351 Aug 30 03:27:44.161779 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 526/1040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:43 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1360 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:44.428727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:44.429508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:44.442071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:44.444730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:44.445793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:44.453286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:44.455485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:44.457211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:44.792862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:44.804994 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c87a0083-f84e-49d6-8964-383dd5d8941c tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1469 microversion: 2.1 time: 0.668479 Aug 30 03:27:44.808981 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 515/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:44 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:44.912184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a00fa0-ccdc-44ca-8b84-d0e21eaa69da", "tag": "bb4b4044-487e-4c38-b707-a31e52f91c1f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:44.925847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:44.926631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:44.927223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:44.943764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] Creating event network-changed:bb4b4044-487e-4c38-b707-a31e52f91c1f for instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da on n-h2-854924-5 Aug 30 03:27:44.954707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:27:44.979020 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5ee773ea-d4f5-4034-978d-1ba237aa328d req-a032a541-654f-4398-a008-ae85782d9abd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075546 Aug 30 03:27:44.980969 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 516/1042] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:45.267633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:45.287590 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc0da6f5-6282-4b09-83a2-ce5779127ae7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1475 microversion: 2.1 time: 0.859854 Aug 30 03:27:45.288883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-827451569", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "fda7ca06-21ce-49ed-8d95-054c265310b6"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:45.290670 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 527/1043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:44 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1475 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:45.305970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:45.307953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:45.323555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:45.325588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:45.329179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:45.332362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:45.337169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:45.338511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:45.397464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] validate_networks() for [('fda7ca06-21ce-49ed-8d95-054c265310b6', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:27:46.683565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:46.694992 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a473722e-dc84-42f6-ad08-9b6c19ed4c7f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 1.402889 Aug 30 03:27:46.695514 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 528/1044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:45 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:46.709888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:46.710512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:46.717077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:46.731911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:46.732834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:46.734127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:46.734960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:46.735837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:47.685886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:47.702785 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db6b0610-8fd0-4de7-adbf-59355c0fe484 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1544 microversion: 2.1 time: 1.005891 Aug 30 03:27:47.705895 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 529/1045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:46 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1544 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:47.719354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:47.724171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:47.745444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:47.746339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:47.747280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:47.748583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:47.750003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:47.752096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:47.804233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:47.805631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:47.806385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:47.807207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lazy-loading 'fault' on Instance uuid c1170de4-1a41-4f08-b7e7-a849e4d989cb {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:27:47.880425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3bd201e25854ba8b76e36d0b2cdb553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc50c2ff3ca9496db43ab1dcbad2347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:47.889259 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2eb7ef71-80c0-4520-b9ff-53061c2d195b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 200 len: 1304 microversion: 2.1 time: 0.180818 Aug 30 03:27:47.896114 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 530/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:47 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:47.901291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:47.902354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:47.918751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:47.920266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:47.921172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:47.922172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:47.922931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:47.923417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.137296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:27:48.138326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:27:48.139151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:27:48.139764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:27:48.140380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:27:48.154729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.155486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.156166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.157144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.158135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.158770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.188710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Getting quotas for project ed0e65f15e1e4d0b953c83c266e55f87. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:48.195565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Getting quotas for user 5fc34b15187a45249edac6ee63c4a2c9 and project ed0e65f15e1e4d0b953c83c266e55f87. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:48.210149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:27:48.213012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:27:48.279202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4bda02fa-58e5-4923-ac3c-fd38d54de70f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.296059 Aug 30 03:27:48.281808 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 517/1047] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:27:48.289022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2313f731-7f9b-4968-8257-34fd297e564f req-a7ff90f5-3a87-4daf-8f64-b820efebcf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1170de4-1a41-4f08-b7e7-a849e4d989cb", "name": "network-vif-deleted", "tag": "e7664671-e712-452c-9885-3c98261fb754"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:48.301822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2313f731-7f9b-4968-8257-34fd297e564f req-a7ff90f5-3a87-4daf-8f64-b820efebcf3c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.303269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2313f731-7f9b-4968-8257-34fd297e564f req-a7ff90f5-3a87-4daf-8f64-b820efebcf3c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.303937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2313f731-7f9b-4968-8257-34fd297e564f req-a7ff90f5-3a87-4daf-8f64-b820efebcf3c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.330524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2313f731-7f9b-4968-8257-34fd297e564f req-a7ff90f5-3a87-4daf-8f64-b820efebcf3c service nova] Creating event network-vif-deleted:e7664671-e712-452c-9885-3c98261fb754 for instance c1170de4-1a41-4f08-b7e7-a849e4d989cb on n-h2-854924-5 Aug 30 03:27:48.337841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2313f731-7f9b-4968-8257-34fd297e564f req-a7ff90f5-3a87-4daf-8f64-b820efebcf3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054061 Aug 30 03:27:48.338874 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 518/1048] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:48.345520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d4958cf2-fd29-4ab7-ab16-4fabfdb1996b req-89c7bde1-8a79-4271-80cf-caeeede07f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab6cf50-c7ee-404c-9c2d-a858aaf86c39", "tag": "f1cda62b-b470-4e44-a6d5-06ee7393c4e1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:48.355606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4958cf2-fd29-4ab7-ab16-4fabfdb1996b req-89c7bde1-8a79-4271-80cf-caeeede07f36 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.356088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4958cf2-fd29-4ab7-ab16-4fabfdb1996b req-89c7bde1-8a79-4271-80cf-caeeede07f36 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.357133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4958cf2-fd29-4ab7-ab16-4fabfdb1996b req-89c7bde1-8a79-4271-80cf-caeeede07f36 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.371787 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d4958cf2-fd29-4ab7-ab16-4fabfdb1996b req-89c7bde1-8a79-4271-80cf-caeeede07f36 service nova] Creating event network-changed:f1cda62b-b470-4e44-a6d5-06ee7393c4e1 for instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 on n-h2-854924-5 Aug 30 03:27:48.380507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d4958cf2-fd29-4ab7-ab16-4fabfdb1996b req-89c7bde1-8a79-4271-80cf-caeeede07f36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039664 Aug 30 03:27:48.390698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:48.394290 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 519/1049] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:48.406598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:48.407576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:48.416563 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c7ed57e-a003-4b3a-b744-f00cd1dbce57 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1470 microversion: 2.1 time: 0.518921 Aug 30 03:27:48.418361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.419437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.420466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.421054 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 531/1050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:47 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1470 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:48.438550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.439742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.440199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.446480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:48.448026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:48.473748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.482967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.484085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.484216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:48.488196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:48.489114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:48.489815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:48.775457 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a43b666-1001-4ad6-93af-e6b7b319d9ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.347345 Aug 30 03:27:48.778514 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 532/1051] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:27:48 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-interface => generated 285 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:48.784839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84a8bf29-e508-4164-a377-103d0f441ce4 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:48.785933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84a8bf29-e508-4164-a377-103d0f441ce4 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:49.070766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84a8bf29-e508-4164-a377-103d0f441ce4 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:49.094004 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84a8bf29-e508-4164-a377-103d0f441ce4 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1215 microversion: 2.1 time: 0.313279 Aug 30 03:27:49.095055 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 533/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:48 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:49.105045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:49.106380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:49.116576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:49.117639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:49.118342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:49.119328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:49.121164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:49.122161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:49.223879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:49.232337 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4962f371-9133-4300-9776-e857e985793c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 0.834367 Aug 30 03:27:49.241451 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 520/1053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:48 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:49.251512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:49.262162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:49.262790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] [instance: c1170de4-1a41-4f08-b7e7-a849e4d989cb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:49.285908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:49.286433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:49.286884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:49.290957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:49.291458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:49.291903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:49.329854 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fea4e853-8b79-4b4f-b155-265d8bff9235 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da/action" status: 204 len: 0 microversion: 2.1 time: 0.231400 Aug 30 03:27:49.337881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] HTTP exception thrown: Instance c1170de4-1a41-4f08-b7e7-a849e4d989cb could not be found. Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Request method failure captured: Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb HTTP/1.1 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYMkGQArnRQX_2NWhsSDNseJMdkbcvHJaeXGTTCeHBhySsYQGVgM8JHJsD-Lr87ppTthJ-U_k92OJmSHdeMpoEI2DArt5pvLW6E9SPqjFtd6XizPcIcWJMIpg2_oukkknds8bIyfgvawNO7DuwtPKNUwBOTRLxei8YwsX1N0GXB_QdY Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: fc50c2ff3ca9496db43ab1dcbad2347f Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc50c2ff3ca9496db43ab1dcbad2347f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc50c2ff3ca9496db43ab1dcbad2347f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc50c2ff3ca9496db43ab1dcbad2347f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc50c2ff3ca9496db43ab1dcbad2347f"}]}] Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: fc50c2ff3ca9496db43ab1dcbad2347f Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersAdminTestJSON-1220183908 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersAdminTestJSON-1220183908-project Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c3bd201e25854ba8b76e36d0b2cdb553 Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersAdminTestJSON-1220183908-project Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance c1170de4-1a41-4f08-b7e7-a849e4d989cb could not be found. Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c1170de4-1a41-4f08-b7e7-a849e4d989cb'} Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1170de4-1a41-4f08-b7e7-a849e4d989cb could not be found. Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1170de4-1a41-4f08-b7e7-a849e4d989cb could not be found. Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:49.340182 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1170de4-1a41-4f08-b7e7-a849e4d989cb could not be found. Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] Returning 404 to user: Instance c1170de4-1a41-4f08-b7e7-a849e4d989cb could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e23bc115-1e11-460a-86b1-86d0afe5f51b tempest-ServersAdminTestJSON-1220183908 tempest-ServersAdminTestJSON-1220183908-project] 10.222.0.30 "GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb" status: 404 len: 111 microversion: 2.1 time: 0.098811 Aug 30 03:27:49.345123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 521/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:49 2022] GET /compute/v2.1/servers/c1170de4-1a41-4f08-b7e7-a849e4d989cb => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:27:49.356480 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 534/1055] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:27:49 2022] POST /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da/action => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:27:49.365875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:49.366504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:49.402911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:49.403419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:49.403864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:49.404598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:49.405063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:49.405534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:50.118888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:50.120656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:50.145587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:50.146096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:50.161183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:50.162371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:50.165439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:50.167288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:50.774654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:50.798059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a9162bf9-df80-4265-b285-e3e4d5e53869 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1267 microversion: 2.1 time: 0.685498 Aug 30 03:27:50.798983 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 535/1056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:50 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1267 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:50.813461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:50.814091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:50.821946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:50.822561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:50.827349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:50.829636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:50.833388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:50.834515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:50.963670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:50.982866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3edaa446-1b8a-48dd-b0ac-af07c6b3d3bb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1470 microversion: 2.1 time: 1.639427 Aug 30 03:27:50.984584 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 522/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:49 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1470 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:50.993561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d99aedf9-4aa3-46bf-9d31-c98cced1edd5 req-4fd94027-5bd0-4362-b392-cab9eb9eba6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28b0ad0-b499-4791-863b-3e38658f5822", "name": "network-vif-plugged", "status": "completed", "tag": "90baf28f-1f7a-4337-a8cc-136ca27b642a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:51.006512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d99aedf9-4aa3-46bf-9d31-c98cced1edd5 req-4fd94027-5bd0-4362-b392-cab9eb9eba6d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:51.007112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d99aedf9-4aa3-46bf-9d31-c98cced1edd5 req-4fd94027-5bd0-4362-b392-cab9eb9eba6d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:51.007613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d99aedf9-4aa3-46bf-9d31-c98cced1edd5 req-4fd94027-5bd0-4362-b392-cab9eb9eba6d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:51.021207 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d99aedf9-4aa3-46bf-9d31-c98cced1edd5 req-4fd94027-5bd0-4362-b392-cab9eb9eba6d service nova] Creating event network-vif-plugged:90baf28f-1f7a-4337-a8cc-136ca27b642a for instance a28b0ad0-b499-4791-863b-3e38658f5822 on n-h1-854924-5 Aug 30 03:27:51.026362 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d99aedf9-4aa3-46bf-9d31-c98cced1edd5 req-4fd94027-5bd0-4362-b392-cab9eb9eba6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039556 Aug 30 03:27:51.027440 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 523/1058] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:51.357744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:51.374857 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a91f4fb1-2832-4367-8787-224628602453 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 0.573754 Aug 30 03:27:51.377313 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 536/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:50 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:51.825363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:51.826511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:51.854166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:51.854869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:51.855324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:51.856060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:51.856529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:51.856962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:52.011542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:52.013929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:52.033464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:52.043273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:52.044037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:52.045490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:52.046497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:52.047803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:52.476676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:52.484725 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-517b8c23-2521-4c99-9ff8-decc5bc1de32 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.665555 Aug 30 03:27:52.502705 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 524/1060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:51 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:52.516398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:52.517021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:52.540186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:52.540186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:52.540582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:52.541082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:52.541790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:52.542406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:52.576010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:52.598749 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3fae47f8-d966-460d-8df2-90383c653c97 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1470 microversion: 2.1 time: 0.596864 Aug 30 03:27:52.600992 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 537/1061] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:52 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1470 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:52.978547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a4522a0e-7507-465c-8592-20667afe56d3 req-8c8d6724-455f-46d8-ae0d-b6821c55e8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b72f4f-bcde-4df9-9123-6cdf19f2df29", "tag": "ba7754ab-7f34-4c86-829f-90f32e6bc383"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:53.010303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a4522a0e-7507-465c-8592-20667afe56d3 req-8c8d6724-455f-46d8-ae0d-b6821c55e8e5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:53.010879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a4522a0e-7507-465c-8592-20667afe56d3 req-8c8d6724-455f-46d8-ae0d-b6821c55e8e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:53.011327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a4522a0e-7507-465c-8592-20667afe56d3 req-8c8d6724-455f-46d8-ae0d-b6821c55e8e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:53.041123 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a4522a0e-7507-465c-8592-20667afe56d3 req-8c8d6724-455f-46d8-ae0d-b6821c55e8e5 service nova] Creating event network-changed:ba7754ab-7f34-4c86-829f-90f32e6bc383 for instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 on n-h2-854924-5 Aug 30 03:27:53.053747 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a4522a0e-7507-465c-8592-20667afe56d3 req-8c8d6724-455f-46d8-ae0d-b6821c55e8e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084672 Aug 30 03:27:53.056087 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 538/1062] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:53.066008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a00fa0-ccdc-44ca-8b84-d0e21eaa69da", "name": "network-vif-plugged", "status": "completed", "tag": "bb4b4044-487e-4c38-b707-a31e52f91c1f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:53.114611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:53.115351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:53.117004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:53.165070 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] Creating event network-vif-plugged:bb4b4044-487e-4c38-b707-a31e52f91c1f for instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da on n-h2-854924-5 Aug 30 03:27:53.181449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:27:53.251811 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-13acb9cf-44e0-4d3e-ab74-5893d32012b7 req-05359139-f0ba-49f9-af03-7f9f784346d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193116 Aug 30 03:27:53.257213 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 539/1063] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:53.283018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-91530dc2-0e35-4833-89b0-45396a9e978f req-0e8e4944-d229-4d7d-800e-518b784aa314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ab56e1-fa28-4a76-8f7c-f21ad1acd129", "tag": "e30cbadc-95e2-4ab6-9a62-fbf45745804c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:53.317234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-91530dc2-0e35-4833-89b0-45396a9e978f req-0e8e4944-d229-4d7d-800e-518b784aa314 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:53.318585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-91530dc2-0e35-4833-89b0-45396a9e978f req-0e8e4944-d229-4d7d-800e-518b784aa314 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:53.321192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-91530dc2-0e35-4833-89b0-45396a9e978f req-0e8e4944-d229-4d7d-800e-518b784aa314 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:53.348766 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-91530dc2-0e35-4833-89b0-45396a9e978f req-0e8e4944-d229-4d7d-800e-518b784aa314 service nova] Creating event network-changed:e30cbadc-95e2-4ab6-9a62-fbf45745804c for instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 on n-h2-854924-5 Aug 30 03:27:53.365914 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-91530dc2-0e35-4833-89b0-45396a9e978f req-0e8e4944-d229-4d7d-800e-518b784aa314 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105109 Aug 30 03:27:53.369713 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 540/1064] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:53.516370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:53.522390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:53.561031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:53.562985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:53.566493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:53.569207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:53.573475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:53.577235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.028514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:54.038764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7afa7e34-cf0c-40e3-92d4-039bad1bb659 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1324 microversion: 2.1 time: 1.534320 Aug 30 03:27:54.039453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 525/1065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:52 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1324 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:54.045778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.046784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:54.058239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.058844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.060117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.060845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.061316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.061975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.217694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:54.227134 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-95dc6364-dd34-4b12-899e-4510addc389d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.719727 Aug 30 03:27:54.240255 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 541/1066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:53 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:54.377717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:54.391870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21a66dc7-e549-4777-8d80-0b86c776e0a7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1470 microversion: 2.1 time: 0.350231 Aug 30 03:27:54.394160 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 526/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:54.470514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Action: 'update', calling method: .version_select at 0x7f897b874700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:54.476627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.477296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.477964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.486713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.487709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.488345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.498821 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] HTTP exception thrown: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Request method failure captured: Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c HTTP/1.1 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 56 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO5yf40PWt5wvMuIuARWIHvwOm2v4E716Lwt_YzFLyqKVa1qw-bkPxY6oqCDuxJccvHWtd1aWhB5edWhnlvN5QmQHbBlidAD3_RZS5RywHQ3cog-RKtUHGI9oJKnwgfFlxEuJ7i0SkmwpklJJDyQ7VMoYPvCxmtkfdr-z-rjSqFRlE Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f935a2544180489891de5284ad17568a Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f935a2544180489891de5284ad17568a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f935a2544180489891de5284ad17568a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f935a2544180489891de5284ad17568a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f935a2544180489891de5284ad17568a"}]}] Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f935a2544180489891de5284ad17568a Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 740aeeec83e44dbbb7182fc607734f58 Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: exception: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '43fd2596-1893-4196-9b4d-9fea4bfc233c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:54.506405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.510971 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.513016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Returning 404 to user: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:54.513972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c5215ece-929d-42a8-8474-8519689095ad tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c" status: 404 len: 110 microversion: 2.53 time: 0.272491 Aug 30 03:27:54.517377 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 542/1068] 10.222.0.30 () {62 vars in 1309 bytes} [Tue Aug 30 03:27:54 2022] PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c => generated 110 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:54.525449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Action: 'update', calling method: .version_select at 0x7f897b7ebe50>, body: {"status": "disabled"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:54.529534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.530262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.530994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.537723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.538395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.539146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.554864 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] HTTP exception thrown: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Request method failure captured: Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c HTTP/1.1 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 22 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO5yf40PWt5wvMuIuARWIHvwOm2v4E716Lwt_YzFLyqKVa1qw-bkPxY6oqCDuxJccvHWtd1aWhB5edWhnlvN5QmQHbBlidAD3_RZS5RywHQ3cog-RKtUHGI9oJKnwgfFlxEuJ7i0SkmwpklJJDyQ7VMoYPvCxmtkfdr-z-rjSqFRlE Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f935a2544180489891de5284ad17568a Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f935a2544180489891de5284ad17568a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f935a2544180489891de5284ad17568a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f935a2544180489891de5284ad17568a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f935a2544180489891de5284ad17568a"}]}] Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f935a2544180489891de5284ad17568a Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 740aeeec83e44dbbb7182fc607734f58 Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: {"status": "disabled"} Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: exception: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '43fd2596-1893-4196-9b4d-9fea4bfc233c', 'body': {'status': 'disabled'}} Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:54.558539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Returning 404 to user: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-49391101-fb43-4fe0-9432-533b28bc5c64 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c" status: 404 len: 110 microversion: 2.53 time: 0.039154 Aug 30 03:27:54.569387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 543/1069] 10.222.0.30 () {62 vars in 1309 bytes} [Tue Aug 30 03:27:54 2022] PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:54.571910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1587657352", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "4d44ede8-8b68-4f52-ac64-6d4a055c5efe"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:54.572061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Action: 'update', calling method: .version_select at 0x7f897b861d30>, body: {"status": "enabled"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:54.575227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.575719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.576153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.586244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.586921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.587564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.593382 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] HTTP exception thrown: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Request method failure captured: Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c HTTP/1.1 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 21 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO5yf40PWt5wvMuIuARWIHvwOm2v4E716Lwt_YzFLyqKVa1qw-bkPxY6oqCDuxJccvHWtd1aWhB5edWhnlvN5QmQHbBlidAD3_RZS5RywHQ3cog-RKtUHGI9oJKnwgfFlxEuJ7i0SkmwpklJJDyQ7VMoYPvCxmtkfdr-z-rjSqFRlE Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f935a2544180489891de5284ad17568a Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f935a2544180489891de5284ad17568a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f935a2544180489891de5284ad17568a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f935a2544180489891de5284ad17568a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f935a2544180489891de5284ad17568a"}]}] Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f935a2544180489891de5284ad17568a Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 740aeeec83e44dbbb7182fc607734f58 Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: {"status": "enabled"} Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: exception: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '43fd2596-1893-4196-9b4d-9fea4bfc233c', 'body': {'status': 'enabled'}} Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:54.595332 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. Aug 30 03:27:54.600288 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:54.602594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Returning 404 to user: Service 43fd2596-1893-4196-9b4d-9fea4bfc233c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:54.603286 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26f55c6d-91c9-427e-a10b-0366122beae7 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c" status: 404 len: 110 microversion: 2.53 time: 0.035936 Aug 30 03:27:54.604148 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 544/1070] 10.222.0.30 () {62 vars in 1309 bytes} [Tue Aug 30 03:27:54 2022] PUT /compute/v2.1/os-services/43fd2596-1893-4196-9b4d-9fea4bfc233c => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:27:54.615076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.646571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.647064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.647499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.648233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.648925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.649845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.652922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] validate_networks() for [('4d44ede8-8b68-4f52-ac64-6d4a055c5efe', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:27:54.675858 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84e28993-476f-4fd8-91cd-f83d8f11d3c0 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.065919 Aug 30 03:27:54.676463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 545/1071] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:27:54.688885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.696182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.696669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.697098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.697860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.698308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.698728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.743990 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ffba86a4-f69f-4bfc-be4b-c0f4ac127d40 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.058896 Aug 30 03:27:54.745068 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 546/1072] 10.222.0.30 () {60 vars in 1211 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:27:54.762415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.765884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.766435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.766938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.767732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.768458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.769594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.793497 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce23c902-9fc4-420c-9341-4c64bb8c98a4 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035003 Aug 30 03:27:54.794183 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 547/1073] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:27:54.806488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.811624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.812112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.812737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.813504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.813967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.814390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.841322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fbadcc08-3268-474d-ab7e-055b468dd535 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-854924-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038414 Aug 30 03:27:54.842142 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 548/1074] 10.222.0.30 () {60 vars in 1235 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services?host=n-d-854924-5&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:54.853659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.857135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.857644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.858086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.858816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.859266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.859688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.894648 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b246d36-d26a-4c56-8d50-53d94135e10d tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043895 Aug 30 03:27:54.895459 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 549/1075] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:27:54.911408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:54.916011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.916506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.916946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.917752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:54.918978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:54.919432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:54.950112 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc4ddb0c-affe-4967-9def-0a8a05b6af23 tempest-ServicesAdminNegativeV253TestJSON-1911845188 tempest-ServicesAdminNegativeV253TestJSON-1911845188-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.042629 Aug 30 03:27:54.958806 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 550/1076] 10.222.0.30 () {60 vars in 1239 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:55.121821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d9235db-831f-4c89-aca4-d146796801d3 tempest-ServicesAdminNegativeV253TestJSON-1638065346 tempest-ServicesAdminNegativeV253TestJSON-1638065346-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:55.129018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9d9235db-831f-4c89-aca4-d146796801d3 tempest-ServicesAdminNegativeV253TestJSON-1638065346 tempest-ServicesAdminNegativeV253TestJSON-1638065346-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a5cf6ff1be5843d8b4f915292bd11ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a9fa3abd8e46468ff71437dc4fe5b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d9235db-831f-4c89-aca4-d146796801d3 tempest-ServicesAdminNegativeV253TestJSON-1638065346 tempest-ServicesAdminNegativeV253TestJSON-1638065346-project] Request method failure captured: Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO4rMVXGIesIGVgymrBAoIxK6xSgEAV5q53G6-vrtyvwev5BQWlalF11jaXrHXseK7UATStDUN4zg7hSoppKG_A03fSgTsu5NF6psMgRG7nhxlTyHsi8anD5PSjl0LLuDr53aV_5YhRyLkcKjc4vrdPX6APPZYhdlzed3OygIQ3ugE Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 06a9fa3abd8e46468ff71437dc4fe5b1 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1638065346 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/06a9fa3abd8e46468ff71437dc4fe5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/06a9fa3abd8e46468ff71437dc4fe5b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_06a9fa3abd8e46468ff71437dc4fe5b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/06a9fa3abd8e46468ff71437dc4fe5b1"}]}] Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1638065346 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 06a9fa3abd8e46468ff71437dc4fe5b1 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1638065346 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1638065346-project Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a5cf6ff1be5843d8b4f915292bd11ca2 Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1638065346-project Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: action_args: {} Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:27:55.138591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d9235db-831f-4c89-aca4-d146796801d3 tempest-ServicesAdminNegativeV253TestJSON-1638065346 tempest-ServicesAdminNegativeV253TestJSON-1638065346-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9d9235db-831f-4c89-aca4-d146796801d3 tempest-ServicesAdminNegativeV253TestJSON-1638065346 tempest-ServicesAdminNegativeV253TestJSON-1638065346-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.180070 Aug 30 03:27:55.146063 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 551/1077] 10.222.0.30 () {60 vars in 1178 bytes} [Tue Aug 30 03:27:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:55.152538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:55.153168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:55.161012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.161617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.162071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.162793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.163437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.164032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.545650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:27:55.546776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:27:55.547591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:27:55.548333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:27:55.549107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:27:55.562736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.563842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.564529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.566240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.567240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.567939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.592261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Getting quotas for project 90d0d07546b84c74a0bb83559f246788. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:55.599344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Getting quotas for user dc24d80f6a294faea61cfb309f438bdd and project 90d0d07546b84c74a0bb83559f246788. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:55.610051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:55.615296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:27:55.617666 n-d-854924-5 devstack@n-api.service[122168]: WARNING nova.utils [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1587657352 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-158765735 Aug 30 03:27:55.618707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:27:55.619107 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-76523151-26ea-4408-a306-2532b049222d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.476559 Aug 30 03:27:55.626112 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 552/1078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:55 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:55.632090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:55.632793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:55.645721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.646224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.646664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.647373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.647827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.648251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.703336 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab5fe745-024b-441f-90ad-e8c31849a977 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208542 Aug 30 03:27:55.704303 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 527/1079] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:27:55.710375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:55.711434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:55.727926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.728700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.729301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:55.731397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:55.732361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:55.733225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.089848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:56.104182 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a451261b-db9f-4883-afe7-d080c2912eec tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1462 microversion: 2.1 time: 0.398558 Aug 30 03:27:56.106693 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 528/1080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:55 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1462 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:56.116543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:56.119655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:56.121916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:56.124858 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa87bbf3-9736-4093-bfe0-c271fafe5d3d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.497566 Aug 30 03:27:56.125470 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 553/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:55 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:56.137136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-56ce1c23-6083-4c09-980b-af9ad8f6cb45 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:56.145684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.146946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.148457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.150265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-56ce1c23-6083-4c09-980b-af9ad8f6cb45 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:56.150768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.151434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.152043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.247800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-56ce1c23-6083-4c09-980b-af9ad8f6cb45 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:56.266409 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-56ce1c23-6083-4c09-980b-af9ad8f6cb45 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1232 microversion: 2.1 time: 0.135556 Aug 30 03:27:56.279381 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 554/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:56 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1232 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:56.279381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:56.279381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:56.285797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:56.288707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.289398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.290080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.290708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.291305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.292211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.530457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:56.543773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48e0ea46-01a6-4c9d-9ba5-692bb45903a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.435641 Aug 30 03:27:56.544361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 529/1083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:56 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:56.566316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd2e01a3-b420-4765-aee6-2273ffa377b5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-307998294", "metadata": {"": ""}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd2e01a3-b420-4765-aee6-2273ffa377b5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action HTTP/1.1 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 106 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-307998294", "metadata": {"": ""}}} Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-307998294', 'metadata': {'': ''}}}} Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'': ''} Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:56.570926 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:56.575418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:56.579192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd2e01a3-b420-4765-aee6-2273ffa377b5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:56.580652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd2e01a3-b420-4765-aee6-2273ffa377b5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action" status: 400 len: 170 microversion: 2.1 time: 0.019109 Aug 30 03:27:56.582597 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 530/1084] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Aug 30 03:27:56 2022] POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action => generated 170 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:56.593377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:56.594737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:56.603259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.604116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.604802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.605836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.606508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.607145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.614181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:56.623798 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-29e1ed17-6fa6-40e8-b947-0bd7f98185a8 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1462 microversion: 2.1 time: 0.355140 Aug 30 03:27:56.624648 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 555/1085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:56 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1462 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:56.649439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-083e2f66-3c3f-4800-8619-dcba62e79ba6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'create', calling method: .version_select at 0x7f897b6e3430>, body: {"keypair": {"name": "tempest-keypair-1557553466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyHpkRNfgIV0DUZNLKrvXjSVsqe5j/rFWlEEGeDONs6r8ujmEzlCoqLfWn+Zdiz6ZbXMSpuYynMWbeCII5Y2pi5SdpfOt5+AWKP/8OzoGDaYXhGlVLIjaefYhSqHYvb1w=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:56.677023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-083e2f66-3c3f-4800-8619-dcba62e79ba6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:27:56.684033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-083e2f66-3c3f-4800-8619-dcba62e79ba6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for user 948d18cc663b48028570132678823b93 and project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:27:56.748327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-083e2f66-3c3f-4800-8619-dcba62e79ba6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102770 Aug 30 03:27:56.749583 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 556/1086] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:27:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:56.842688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:56.852075 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01c47014-c9ea-401b-8e09-ac97a98f3611 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.264879 Aug 30 03:27:56.853337 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 531/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:56 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:56.882149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:56.882784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:56.904289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.904947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.905419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:56.916664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:56.918858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:56.919329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.151675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:57.152703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:57.164420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:57.171509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.172330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.173003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.174077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.174694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.176024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.178299 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3072f71-5f8d-4286-bedc-361b4314d84d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.301667 Aug 30 03:27:57.191504 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 557/1088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:56 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:57.203746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccc83242-72eb-4a8e-aae0-c0113ba536eb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1853951382", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccc83242-72eb-4a8e-aae0-c0113ba536eb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action HTTP/1.1 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 619 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1853951382", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1853951382', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:27:57.209602 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:27:57.213278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:57.218510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccc83242-72eb-4a8e-aae0-c0113ba536eb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:57.219713 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccc83242-72eb-4a8e-aae0-c0113ba536eb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action" status: 400 len: 938 microversion: 2.1 time: 0.020466 Aug 30 03:27:57.220599 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 558/1089] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Aug 30 03:27:57 2022] POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:57.231214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:57.231838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:57.243296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.243747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.244318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.245794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.246416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.247262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.432834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:57.447927 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5a54f89-5b50-41d4-aa42-21fde751a040 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.298293 Aug 30 03:27:57.449071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 532/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:57 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:57.462466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:57.462466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:57.466510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.467016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.467549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.472505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.473253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.474005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.592264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:57.604730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:57.606044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07a6baac-0dd0-4ad1-9598-0dd75df7d174 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1284 microversion: 2.1 time: 0.154629 Aug 30 03:27:57.607963 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 533/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:57 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:57.626001 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc76412b-417b-4ead-a9ef-5da7a844b762 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.397853 Aug 30 03:27:57.627053 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 559/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:57 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:57.651640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:57.652309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:57.666938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.670007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.670467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:57.673735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:57.674371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:57.674699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:58.472153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:58.473453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:58.485118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:58.486215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:58.486518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:58.488269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:58.490598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:58.491330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:58.492199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:58.497506 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-35206e13-fa14-428a-a51f-9b8c8e121539 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.849950 Aug 30 03:27:58.510894 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 534/1093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:57 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:58.544714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74af3664-129c-452d-b747-16902395bd50 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74af3664-129c-452d-b747-16902395bd50 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action HTTP/1.1 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 285 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:58.552189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74af3664-129c-452d-b747-16902395bd50 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:58.555722 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74af3664-129c-452d-b747-16902395bd50 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action" status: 400 len: 619 microversion: 2.1 time: 0.022651 Aug 30 03:27:58.566475 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 535/1094] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Aug 30 03:27:58 2022] POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:27:58.578719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:58.579623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:58.589102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:58.590170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:58.590800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:58.591729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:58.592182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:58.592685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:58.933913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:58.942254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-86ebe90e-ad62-4753-8989-634498d761ea tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.476748 Aug 30 03:27:58.942831 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 560/1095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:58 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:27:58.947659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:58.948271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:58.954698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:58.955191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:58.955814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:58.956704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:58.957158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:58.957605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.039683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:59.048405 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59883521-a1a7-420b-838d-a4fc6d2fae7d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.479793 Aug 30 03:27:59.048977 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 536/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:58 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:59.069392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:59.079096 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-056e742b-ff69-4a90-b67b-9eb1f9747731 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1290 microversion: 2.1 time: 0.134978 Aug 30 03:27:59.079981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 561/1097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:58 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:59.107138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:59.107763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:59.115093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.117529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.117972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.119716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.120091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.120697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.125919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:27:59.252616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b268206b-7b31-40ba-ad99-25c8befaa724 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:59.262920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b268206b-7b31-40ba-ad99-25c8befaa724 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.212832 Aug 30 03:27:59.264780 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 537/1098] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:27:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:27:59.462610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:27:59.470324 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-051e2943-2b95-4640-8e74-884521870de4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.389572 Aug 30 03:27:59.471175 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 562/1099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:59 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:27:59.493092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1446933771"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:59.496059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:59.503488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.504317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.505422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.506379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.506991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.507590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.765209 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49ec4e8c-8458-4fc6-b954-6ba5f3a70328 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action" status: 202 len: 0 microversion: 2.1 time: 0.276842 Aug 30 03:27:59.771037 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 538/1100] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:27:59 2022] POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:27:59.786646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-924620378"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:27:59.792207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:59.808089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.808994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.810984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.827380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.842811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.846531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.923907 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Cannot 'createImage' instance a28b0ad0-b499-4791-863b-3e38658f5822 while it is in task_state image_snapshot_pending Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action HTTP/1.1 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 84 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-924620378"}} Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'createImage' instance a28b0ad0-b499-4791-863b-3e38658f5822 while it is in task_state image_snapshot_pending Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-924620378'}}} Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a28b0ad0-b499-4791-863b-3e38658f5822 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:27:59.925860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a28b0ad0-b499-4791-863b-3e38658f5822 while it is in task_state image_snapshot_pending Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a28b0ad0-b499-4791-863b-3e38658f5822 while it is in task_state image_snapshot_pending Aug 30 03:27:59.930595 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:27:59.932862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 409 to user: Cannot 'createImage' instance a28b0ad0-b499-4791-863b-3e38658f5822 while it is in task_state image_snapshot_pending {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:27:59.933926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b0814a5-29ef-4c0f-804c-375a7ac204dc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action" status: 409 len: 167 microversion: 2.1 time: 0.156976 Aug 30 03:27:59.934898 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 563/1101] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:27:59 2022] POST /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822/action => generated 167 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:27:59.944576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a14359b3-4a47-419a-83af-e4e30c714873 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '.version_select at 0x7f897b554e50>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:59.969862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:27:59.970641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:27:59.981750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.982884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.983335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:27:59.984876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:27:59.985577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:27:59.986232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.225419 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a14359b3-4a47-419a-83af-e4e30c714873 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/images/26bcd048-6884-41b9-9b8b-41ba64b0a1e6" status: 204 len: 0 microversion: 2.1 time: 0.285830 Aug 30 03:28:00.225988 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 539/1102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:59 2022] DELETE /compute/v2.1/images/26bcd048-6884-41b9-9b8b-41ba64b0a1e6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:00.243341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:00.244303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:00.266524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:00.266524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:00.266524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.267861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:00.268353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:00.269020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.316515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:00.323841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-41da7733-1f33-4bb1-b92b-ef4ce6ab0f6d tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.361117 Aug 30 03:28:00.324840 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 564/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:27:59 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:00.335152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-36c01033-e6af-4703-baab-d35e68da8191 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '.version_select at 0x7f897b8bc430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:00.346689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c01033-e6af-4703-baab-d35e68da8191 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:00.347302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c01033-e6af-4703-baab-d35e68da8191 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:00.348084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c01033-e6af-4703-baab-d35e68da8191 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.360450 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-36c01033-e6af-4703-baab-d35e68da8191 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.029763 Aug 30 03:28:00.361024 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 565/1104] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:28:00 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:00.379286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:00.380352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:00.388367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:00.388959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:00.389493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.390519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:00.390878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:00.391610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.625527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:00.633416 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e08202a8-e3fd-4db3-b190-7c719ff05d53 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.397828 Aug 30 03:28:00.634000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 540/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:00 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:00.639114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-258b6615-04bc-447e-92d1-584fd0cdefc0 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-912507521", "imageRef": "3e32f0dc-5add-407f-b545-cf8116fe35c6", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:00.663721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:00.672201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3300fdcb-0a05-4336-aec8-d207f1c7474c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1533 microversion: 2.1 time: 0.309838 Aug 30 03:28:00.672780 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 566/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:00 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1533 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:00.678974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6e7e0066-0716-433b-8370-6026997ce3fd req-79a674d6-bc60-4be8-b12d-81bbf3130dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b72f4f-bcde-4df9-9123-6cdf19f2df29", "name": "network-vif-plugged", "status": "completed", "tag": "ba7754ab-7f34-4c86-829f-90f32e6bc383"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:00.691410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6e7e0066-0716-433b-8370-6026997ce3fd req-79a674d6-bc60-4be8-b12d-81bbf3130dda service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:00.692160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6e7e0066-0716-433b-8370-6026997ce3fd req-79a674d6-bc60-4be8-b12d-81bbf3130dda service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:00.692831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6e7e0066-0716-433b-8370-6026997ce3fd req-79a674d6-bc60-4be8-b12d-81bbf3130dda service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:00.694899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-258b6615-04bc-447e-92d1-584fd0cdefc0 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:28:00.704766 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6e7e0066-0716-433b-8370-6026997ce3fd req-79a674d6-bc60-4be8-b12d-81bbf3130dda service nova] Creating event network-vif-plugged:ba7754ab-7f34-4c86-829f-90f32e6bc383 for instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 on n-h2-854924-5 Aug 30 03:28:00.710314 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6e7e0066-0716-433b-8370-6026997ce3fd req-79a674d6-bc60-4be8-b12d-81bbf3130dda service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036050 Aug 30 03:28:00.710840 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 567/1107] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:00.715979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-353fcb69-f6ad-4b85-b2a4-63005754c1b4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:00.723916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-353fcb69-f6ad-4b85-b2a4-63005754c1b4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011783 Aug 30 03:28:00.724500 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 568/1108] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:28:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:00.738063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-175d809d-ec16-426a-9466-4187617991a8 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-625638817", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:00.760907 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-175d809d-ec16-426a-9466-4187617991a8 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.027253 Aug 30 03:28:00.761717 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 569/1109] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Aug 30 03:28:00 2022] POST /compute/v2.1/flavors => generated 498 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:00.775180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a24b879f-2698-4d5c-b7ef-3d18cfd4cd3b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:00.783601 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a24b879f-2698-4d5c-b7ef-3d18cfd4cd3b tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012331 Aug 30 03:28:00.784739 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 570/1110] 10.222.0.30 () {58 vars in 1182 bytes} [Tue Aug 30 03:28:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:28:00.892889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1382801048", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "676f34d8-293a-43ac-b8a1-4e4163bcc8e4"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:00.953211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:28:01.215893 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-258b6615-04bc-447e-92d1-584fd0cdefc0 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-258b6615-04bc-447e-92d1-584fd0cdefc0 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] Request method failure captured: Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 142 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYO-gBS8zjttLNbI8Wwsa9yGJo04__AEvHvqVtQMN8QOmZLe0U8cwNFDOq-3h3remSLxY42FgjLgVjAg_sv42m48v12vGx2AVhnA_q0ozdDOiOecN25-u3Xy7CyFftrEGaHL8UlI_4AsFD9hNm6pFk6wKbKkqHfu-0Swyj8tepIuutQ Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 0564afd901474fdcaff9c650ecfc80ee Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsV2NegativeTest-840701245 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0564afd901474fdcaff9c650ecfc80ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0564afd901474fdcaff9c650ecfc80ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0564afd901474fdcaff9c650ecfc80ee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0564afd901474fdcaff9c650ecfc80ee"}]}] Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsV2NegativeTest-840701245 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 0564afd901474fdcaff9c650ecfc80ee Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-840701245 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsV2NegativeTest-840701245-project Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 80836414492d42439b7c8332f95092c7 Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsV2NegativeTest-840701245-project Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-912507521", "imageRef": "3e32f0dc-5add-407f-b545-cf8116fe35c6", "flavorRef": "452"}} Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: exception: Flavor's memory is too small for requested image. Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-912507521', 'imageRef': '3e32f0dc-5add-407f-b545-cf8116fe35c6', 'flavorRef': '452'}}} Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:01.218066 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-258b6615-04bc-447e-92d1-584fd0cdefc0 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-258b6615-04bc-447e-92d1-584fd0cdefc0 tempest-FlavorsV2NegativeTest-840701245 tempest-FlavorsV2NegativeTest-840701245-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.584333 Aug 30 03:28:01.223621 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 541/1111] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:00 2022] POST /compute/v2.1/servers => generated 93 bytes in 585 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:28:01.354996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:01.355506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:01.368584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.369258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.370169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.371060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.371924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.372506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.389901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:01.390410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:01.391065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:01.391933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:01.399534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:01.414001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.415236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.416448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.417512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.417984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.418565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.444109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:01.450380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for user 948d18cc663b48028570132678823b93 and project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:01.463580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:28:01.466174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:28:01.550574 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3dbf4f7-efc3-45e9-b667-01915c744886 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661819 Aug 30 03:28:01.551704 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 571/1112] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:28:01.557289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-09af7db4-2d56-43d0-98d1-0569249b17ef req-3fb5544e-9480-4cd2-8dbf-652dc5103c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7197b256-84d8-4e62-92fe-c7046da721a2", "tag": "00f5adbf-5868-4eb1-9d32-42deaca2158f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:01.575541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-09af7db4-2d56-43d0-98d1-0569249b17ef req-3fb5544e-9480-4cd2-8dbf-652dc5103c71 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.576810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-09af7db4-2d56-43d0-98d1-0569249b17ef req-3fb5544e-9480-4cd2-8dbf-652dc5103c71 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.577775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-09af7db4-2d56-43d0-98d1-0569249b17ef req-3fb5544e-9480-4cd2-8dbf-652dc5103c71 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.607008 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-09af7db4-2d56-43d0-98d1-0569249b17ef req-3fb5544e-9480-4cd2-8dbf-652dc5103c71 service nova] Creating event network-changed:00f5adbf-5868-4eb1-9d32-42deaca2158f for instance 7197b256-84d8-4e62-92fe-c7046da721a2 on n-h1-854924-5 Aug 30 03:28:01.607198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:01.610369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:01.618423 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5edf42ca-106e-466c-a892-2823d8f37b6f tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1315 microversion: 2.1 time: 0.273713 Aug 30 03:28:01.622014 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-09af7db4-2d56-43d0-98d1-0569249b17ef req-3fb5544e-9480-4cd2-8dbf-652dc5103c71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068243 Aug 30 03:28:01.624671 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 572/1113] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:01.633108 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 542/1114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:01 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:01.633541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c31101cd-a88a-42be-b75b-f6207cd59a17 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:01.634312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c31101cd-a88a-42be-b75b-f6207cd59a17 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:01.655964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:01.656662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:01.680297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.680901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.681404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.682120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.682585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.682998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.731548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c31101cd-a88a-42be-b75b-f6207cd59a17 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:01.742188 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c31101cd-a88a-42be-b75b-f6207cd59a17 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1279 microversion: 2.1 time: 0.116000 Aug 30 03:28:01.745524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 573/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:01 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:01.750546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:01.752010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:01.761614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.762606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.763601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:01.764291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:01.765313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:01.766100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.029993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:02.049565 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5186f76e-d780-4926-bbbb-d48be796ab47 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.398571 Aug 30 03:28:02.056977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:02.066341 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 543/1116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:01 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:02.073294 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c35b5c3c-c5c8-480d-92ce-2b4e1298568e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1533 microversion: 2.1 time: 0.328593 Aug 30 03:28:02.074425 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 574/1117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:01 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1533 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:02.639824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:02.640410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:02.647411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.647703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.648131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.648819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.649265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.649780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.762981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:02.763877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:02.770462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.771212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.771811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.772517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.773155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.773601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.817758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:02.834413 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d21c2feb-ba7e-4fa5-8a0b-d8ddd4c1c30a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1502 microversion: 2.1 time: 0.198230 Aug 30 03:28:02.835331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 544/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:02 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:02.848238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:02.856232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:02.856860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:02.858644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8bfabb6-10f4-4f9d-b951-008ffe069e5c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1331 microversion: 2.1 time: 0.099416 Aug 30 03:28:02.859301 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 575/1119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:02 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:02.861992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:02.864540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.865057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.865581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.866297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.866757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.867181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.938738 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9bb209c7-4292-4ac3-a7cb-f6f3929c4bf1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.086467 Aug 30 03:28:02.939370 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 545/1120] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Aug 30 03:28:02 2022] DELETE /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29/os-server-password => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:28:02.948548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:02.949048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:02.956173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.956670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.957136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.958006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:02.958570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:02.959004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:02.985056 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31cb3042-e337-4cfd-8577-162a8d7065f6 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.040437 Aug 30 03:28:02.985692 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 576/1121] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Aug 30 03:28:02 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29/os-server-password => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:28:02.997386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:02.997990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:03.005099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.005931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.006574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.007387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.007906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.008400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.036915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:28:03.075027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:03.075766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:03.084847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.085493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.086247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.087058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.087528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.088130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.134835 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31d3ed2d-6c21-46fe-bac4-53e39ae83b42 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 204 len: 0 microversion: 2.1 time: 0.142033 Aug 30 03:28:03.135754 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 546/1122] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:02 2022] DELETE /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:03.143984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:03.144994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:03.151879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.152981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.153627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.154802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.155284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.155716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.292313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:03.300866 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9328dd5c-7c40-47eb-8837-fababfcd2c92 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.230366 Aug 30 03:28:03.301485 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 577/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:03 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:03.306498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:03.307107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:03.313382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.314066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.314504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.315212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.315703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.316321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.375022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:03.385412 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-994a077b-26cd-417b-87cc-2e5c6549121d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1533 microversion: 2.1 time: 0.247422 Aug 30 03:28:03.396328 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 547/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:03 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1533 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:03.461634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:03.470306 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10cc5d3a-8f89-4823-aab0-f18d03b884f2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1508 microversion: 2.1 time: 0.167248 Aug 30 03:28:03.470989 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 578/1125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:03 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:03.884716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:03.885327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:03.892320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.892802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.893236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:03.895980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:03.895980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:03.895980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.256922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:04.265702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50ac5abe-b5d4-4cc8-99fd-e1b8062170c1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1331 microversion: 2.1 time: 0.384773 Aug 30 03:28:04.266480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 548/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:03 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1331 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:04.322623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:04.323407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:04.334846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:04.335369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:04.338183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.339414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:04.340023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:04.340664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.411682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:04.412305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:04.419130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:04.419895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:04.420491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.421198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:04.421817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:04.422243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.739862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:04.748870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c2304342-2266-4e1d-a101-6930e6117394 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.430498 Aug 30 03:28:04.749482 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 579/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:04 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:04.755004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:04.755868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:04.763708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:04.765414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:04.766422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.767382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:04.767852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:04.768314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:04.801028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:04.813506 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-042fb527-ce02-46bb-9bfd-c9cfbc78ced0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1533 microversion: 2.1 time: 0.408639 Aug 30 03:28:04.814455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 549/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:04 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1533 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:05.287112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:05.288484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:05.295756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:05.296440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:05.297039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:05.297942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:05.298637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:05.299225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:05.318612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:05.339539 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7bfdf26c-cc8f-4bb3-af47-ef95b7df184a tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1508 microversion: 2.1 time: 0.587306 Aug 30 03:28:05.341009 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 580/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:04 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:05.504024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:05.511819 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4855072d-3edf-41ba-a0c7-39ec54f52c64 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1331 microversion: 2.1 time: 0.228498 Aug 30 03:28:05.512421 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 550/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:05 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1331 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:05.771571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:05.772481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:05.779812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:05.780600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:05.781197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:05.782244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:05.782933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:05.783592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:05.843251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:05.844119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:05.846215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:05.851232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:05.869087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:05.871648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:05.872472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:05.873518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:05.874433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:05.875081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:06.531984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:06.540674 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-71a0c649-259b-4c5f-9d27-0bcb9a43c915 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.772948 Aug 30 03:28:06.543110 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 581/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:05 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:06.549335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:06.550717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:06.558688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:06.559894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:06.560875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:06.561902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:06.562647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:06.563281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:06.564688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:06.600286 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81f222e2-3581-4d8c-b1e8-8ecbe6da526b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1539 microversion: 2.1 time: 0.767521 Aug 30 03:28:06.613991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:06.614863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:06.615510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:06.616181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lazy-loading 'fault' on Instance uuid 74b72f4f-bcde-4df9-9123-6cdf19f2df29 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:28:06.621949 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 551/1132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:05 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1539 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:06.631945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-23f4d2f4-b73e-443f-8254-100762c15051 req-b964e11b-d0a4-4e9b-afb7-54fdcc719499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b72f4f-bcde-4df9-9123-6cdf19f2df29", "name": "network-vif-deleted", "tag": "ba7754ab-7f34-4c86-829f-90f32e6bc383"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:06.644810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-23f4d2f4-b73e-443f-8254-100762c15051 req-b964e11b-d0a4-4e9b-afb7-54fdcc719499 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:06.645381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-23f4d2f4-b73e-443f-8254-100762c15051 req-b964e11b-d0a4-4e9b-afb7-54fdcc719499 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:06.646027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-23f4d2f4-b73e-443f-8254-100762c15051 req-b964e11b-d0a4-4e9b-afb7-54fdcc719499 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:06.659541 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-23f4d2f4-b73e-443f-8254-100762c15051 req-b964e11b-d0a4-4e9b-afb7-54fdcc719499 service nova] Creating event network-vif-deleted:ba7754ab-7f34-4c86-829f-90f32e6bc383 for instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 on n-h2-854924-5 Aug 30 03:28:06.668397 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-23f4d2f4-b73e-443f-8254-100762c15051 req-b964e11b-d0a4-4e9b-afb7-54fdcc719499 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044381 Aug 30 03:28:06.670171 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 552/1133] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:06.677735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:06.679021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:06.692705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:06.693870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:06.696056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:06.697899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:06.699528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:06.701050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:07.131604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fc34b15187a45249edac6ee63c4a2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e65f15e1e4d0b953c83c266e55f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:07.144631 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7958b5a-4cc2-4f60-980a-6fd9ca530ef2 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 200 len: 1305 microversion: 2.1 time: 0.600105 Aug 30 03:28:07.158613 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 582/1134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:06 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 1305 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:07.167629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9f283900-3ff5-4b2f-ae16-d1f5c0f45e33 req-6b5945c1-1f6b-420b-bc41-48d66d23e93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28b0ad0-b499-4791-863b-3e38658f5822", "name": "network-vif-plugged", "status": "completed", "tag": "90baf28f-1f7a-4337-a8cc-136ca27b642a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:07.168669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:07.180637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9f283900-3ff5-4b2f-ae16-d1f5c0f45e33 req-6b5945c1-1f6b-420b-bc41-48d66d23e93c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:07.182022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9f283900-3ff5-4b2f-ae16-d1f5c0f45e33 req-6b5945c1-1f6b-420b-bc41-48d66d23e93c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:07.183039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9f283900-3ff5-4b2f-ae16-d1f5c0f45e33 req-6b5945c1-1f6b-420b-bc41-48d66d23e93c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:07.187632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1d79370-8f84-42fa-a066-2bafc9b0a4c7 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1337 microversion: 2.1 time: 0.515013 Aug 30 03:28:07.188495 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 553/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:06 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1337 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:07.209889 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9f283900-3ff5-4b2f-ae16-d1f5c0f45e33 req-6b5945c1-1f6b-420b-bc41-48d66d23e93c service nova] Creating event network-vif-plugged:90baf28f-1f7a-4337-a8cc-136ca27b642a for instance a28b0ad0-b499-4791-863b-3e38658f5822 on n-h1-854924-5 Aug 30 03:28:07.217242 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9f283900-3ff5-4b2f-ae16-d1f5c0f45e33 req-6b5945c1-1f6b-420b-bc41-48d66d23e93c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057016 Aug 30 03:28:07.218571 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 583/1136] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:07.564860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:07.567032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:07.577005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:07.577872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:07.578475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:07.579440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:07.580140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:07.580728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:07.629324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:07.630218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:07.638274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:07.638944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:07.639483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:07.640317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:07.640877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:07.641428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:08.065017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:08.073093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-daf910b4-80b7-4f9d-8a0b-ca5a667b4962 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.512195 Aug 30 03:28:08.080685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:08.090987 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 554/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:07 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:08.093486 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-586e0b51-b0fa-4091-8c61-7ce12011b4b1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1539 microversion: 2.1 time: 0.468722 Aug 30 03:28:08.101080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 584/1138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:07 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1539 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:08.172024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:08.172890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] [instance: 74b72f4f-bcde-4df9-9123-6cdf19f2df29] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:08.180028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:08.180784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:08.181318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:08.182138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:08.182714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:08.183237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:08.200438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] HTTP exception thrown: Instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 could not be found. Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Request method failure captured: Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 HTTP/1.1 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOwthY3Ss1oLVoEvXycKC4nzeL7TucI3CjYWWGj1b_H9UXEHGZN8PE2fdH-7u_d2epJsf7U5xbhHlYnWp7-FMmSR6X0u6Pyq7yv6oyqqVnNqg19khmMF8dDsQzdAmNS1dJH0QEOXEoDxFaDqAwPiXcX4D-RMPspAxiwTFohK7F4hd4 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ed0e65f15e1e4d0b953c83c266e55f87 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerPasswordTestJSON-70548746 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed0e65f15e1e4d0b953c83c266e55f87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ed0e65f15e1e4d0b953c83c266e55f87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ed0e65f15e1e4d0b953c83c266e55f87", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ed0e65f15e1e4d0b953c83c266e55f87"}]}] Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerPasswordTestJSON-70548746 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ed0e65f15e1e4d0b953c83c266e55f87 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerPasswordTestJSON-70548746 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerPasswordTestJSON-70548746-project Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 5fc34b15187a45249edac6ee63c4a2c9 Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerPasswordTestJSON-70548746-project Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 could not be found. Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '74b72f4f-bcde-4df9-9123-6cdf19f2df29'} Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 could not be found. Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 could not be found. Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:08.202670 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 could not be found. Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] Returning 404 to user: Instance 74b72f4f-bcde-4df9-9123-6cdf19f2df29 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:08.209568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4384e2d7-0ecb-45b2-9b1a-4be28552dba1 tempest-ServerPasswordTestJSON-70548746 tempest-ServerPasswordTestJSON-70548746-project] 10.222.0.30 "GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29" status: 404 len: 111 microversion: 2.1 time: 0.038132 Aug 30 03:28:08.213576 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 555/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:08 2022] GET /compute/v2.1/servers/74b72f4f-bcde-4df9-9123-6cdf19f2df29 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:08.213908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:08.214673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:08.222940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:08.223441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:08.224993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:08.224993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:08.225396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:08.225851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:08.504602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:08.519073 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e9ace16-6181-4be2-b6b7-9730997b961f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.311521 Aug 30 03:28:08.520006 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 585/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:08 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:09.104275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:09.106304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:09.119599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:09.120997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:09.138538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.140543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.142137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.144080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.144974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.146413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.147653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.148122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.148837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.150929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.153942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.156688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.171925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:09.606358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:09.610075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:09.630209 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a7d9996b-fb23-4c72-8792-8addca5ad89d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.535295 Aug 30 03:28:09.634462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 556/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:09 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:09.635397 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a42de91-937b-4a8c-b73c-737c9d407096 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1539 microversion: 2.1 time: 0.518526 Aug 30 03:28:09.638796 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 586/1142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:09 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1539 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:09.654088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:09.655033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d574e8f2-ef85-4bb2-84ac-c7afe9c79fcb req-566787ef-b1cc-45a5-8e7d-80271542fd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:09.658304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:09.682454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.683998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.685281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d574e8f2-ef85-4bb2-84ac-c7afe9c79fcb req-566787ef-b1cc-45a5-8e7d-80271542fd50 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.685883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.687799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d574e8f2-ef85-4bb2-84ac-c7afe9c79fcb req-566787ef-b1cc-45a5-8e7d-80271542fd50 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.688086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.688627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d574e8f2-ef85-4bb2-84ac-c7afe9c79fcb req-566787ef-b1cc-45a5-8e7d-80271542fd50 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.689209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.691284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.716511 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d574e8f2-ef85-4bb2-84ac-c7afe9c79fcb req-566787ef-b1cc-45a5-8e7d-80271542fd50 service nova] Creating event network-changed:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:28:09.733652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d574e8f2-ef85-4bb2-84ac-c7afe9c79fcb req-566787ef-b1cc-45a5-8e7d-80271542fd50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096659 Aug 30 03:28:09.734831 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 557/1143] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:09.828242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-88a39bca-3606-4c42-84e9-9e347aaf8177 req-fe57aedf-eb6d-47f8-b2f6-3406e5a2ab2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7197b256-84d8-4e62-92fe-c7046da721a2", "name": "network-vif-plugged", "status": "completed", "tag": "00f5adbf-5868-4eb1-9d32-42deaca2158f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:09.840623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88a39bca-3606-4c42-84e9-9e347aaf8177 req-fe57aedf-eb6d-47f8-b2f6-3406e5a2ab2d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:09.841516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88a39bca-3606-4c42-84e9-9e347aaf8177 req-fe57aedf-eb6d-47f8-b2f6-3406e5a2ab2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:09.842174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88a39bca-3606-4c42-84e9-9e347aaf8177 req-fe57aedf-eb6d-47f8-b2f6-3406e5a2ab2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:09.857905 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-88a39bca-3606-4c42-84e9-9e347aaf8177 req-fe57aedf-eb6d-47f8-b2f6-3406e5a2ab2d service nova] Creating event network-vif-plugged:00f5adbf-5868-4eb1-9d32-42deaca2158f for instance 7197b256-84d8-4e62-92fe-c7046da721a2 on n-h1-854924-5 Aug 30 03:28:09.864313 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-88a39bca-3606-4c42-84e9-9e347aaf8177 req-fe57aedf-eb6d-47f8-b2f6-3406e5a2ab2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042673 Aug 30 03:28:09.865655 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 558/1144] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:28:09.979563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:09.987797 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e84e6530-64bd-4722-b0ee-f31c4516ba48 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.347568 Aug 30 03:28:09.988390 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 587/1145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:09 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:10.656337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:10.657043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:10.658041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:10.659255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:10.665451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:10.666241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:10.666682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:10.666948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:10.667542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:10.667676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:10.671119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:10.671275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:10.671420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:10.671508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:10.671508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:10.671508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:10.672436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:10.912806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:10.925705 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c6ca82d-cc3b-43c3-9be0-a7e018c2231f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.276275 Aug 30 03:28:10.926932 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 559/1146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:10 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:10.929134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:10.948087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b050e3d-a379-40e9-94f9-e1c5837298a4 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1539 microversion: 2.1 time: 0.294769 Aug 30 03:28:10.949083 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 588/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:10 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:11.008642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:11.009558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:11.016269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:11.017001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:11.017678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:11.018584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:11.019199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:11.019783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:11.293629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:11.305091 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-111050fe-f193-42f6-bc85-9abadbe898be tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.300323 Aug 30 03:28:11.310507 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 560/1148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:11 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:11.949884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:11.950690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:11.952354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=20 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:11.953906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=16 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:11.969308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:11.970270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:11.976994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:11.977612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:11.978274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:11.979154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:11.980277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:11.980884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:11.981009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:11.981796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:11.982135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:11.982846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:11.983297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:11.983728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:12.671607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:12.683195 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3032ad12-c07a-4315-baec-c46417357e28 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1539 microversion: 2.1 time: 0.717477 Aug 30 03:28:12.683869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 561/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:11 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1539 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:12.696600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:12.708462 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0374b8a4-f214-4c0a-b2f1-ff52995b41cf tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.762587 Aug 30 03:28:12.709741 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 589/1150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:11 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:12.714481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:12.715373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:12.722626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:12.723400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:12.724028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:12.724933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:12.725488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:12.726000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:12.890028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-549245067", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b65aef74-d72b-4c52-acc3-b7f6f301faa7"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:13.002494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] validate_networks() for [('b65aef74-d72b-4c52-acc3-b7f6f301faa7', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:28:13.041538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:13.055308 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7eb2d234-ce40-4130-98e5-a39844bd7be3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.344225 Aug 30 03:28:13.057419 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 590/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:12 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:13.595158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:13.595583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:13.596054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:13.596504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:13.596914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:13.613669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:13.615706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:13.616328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:13.617629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:13.619094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:13.619703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:13.660379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Getting quotas for project fb047b401d424ae298aa305e270c6bd0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:13.666361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Getting quotas for user 25d8eb58d3ba4c68b12408b713484d49 and project fb047b401d424ae298aa305e270c6bd0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:13.708251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:13.709319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:13.719274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:28:13.726099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:13.727090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:13.727865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:13.729746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:28:13.730220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:13.731873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:13.738058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:13.861375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1ab65506-826c-4fb5-89d2-5cc42c0d0ce7 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161180 Aug 30 03:28:13.869726 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 562/1152] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:28:13.891079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:13.906815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:13.918918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:13.924874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:13.925868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:13.927135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:13.930167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:13.930612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:14.218082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:14.234875 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-131ab6b9-febf-401c-a2c6-3a4650daf132 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1534 microversion: 2.1 time: 0.533916 Aug 30 03:28:14.235473 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 591/1153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:13 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1534 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:14.256116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-048959f1-1991-48bf-8be8-0a758f7449e6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:14.257003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-048959f1-1991-48bf-8be8-0a758f7449e6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:14.264964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:14.405424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-048959f1-1991-48bf-8be8-0a758f7449e6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:14.413564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-048959f1-1991-48bf-8be8-0a758f7449e6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1223 microversion: 2.1 time: 0.162554 Aug 30 03:28:14.416385 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 592/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:14 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:14.449739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:14.450826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:14.468275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:14.469048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:14.469747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:14.473013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:14.474129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:14.474793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:14.491362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:14.500360 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-989b9b8f-04a2-4ba9-a052-b9e937bab7c1 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1332 microversion: 2.1 time: 0.629400 Aug 30 03:28:14.501321 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 563/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:13 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1332 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:14.689326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:14.714051 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b931329-f2d6-4304-9eac-80094cb8d346 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.272161 Aug 30 03:28:14.723153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 593/1156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:14 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:15.028275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:15.028603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:15.042263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.043172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.044120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.045272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.046008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.046975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.107573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:28:15.228632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2b9092e-021c-4993-8aba-ebe41050f566 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 204 len: 0 microversion: 2.1 time: 0.204298 Aug 30 03:28:15.229432 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 564/1157] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:15 2022] DELETE /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:15.238452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:15.239715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:15.253128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.253664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.254172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.255318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.256322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.257102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.257235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:15.258023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:15.264359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.264844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.265531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.266460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.267109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.267723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.570838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:15.579867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:15.599072 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-148b9190-8055-4849-9d3d-07c13ee4d283 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1521 microversion: 2.1 time: 0.346516 Aug 30 03:28:15.600485 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 565/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:15 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:15.612876 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e806b440-52b7-4911-ae56-b186823bb74f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1713 microversion: 2.1 time: 0.379715 Aug 30 03:28:15.618237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:15.626574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 594/1159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:15 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1713 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:15.626682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:15.634161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:15.642446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:15.645168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.645688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.646322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.647062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.647496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.647920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.658999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.665013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.666927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.668263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.668972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.669987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.788809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:15.801735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bfa3a4f-125a-4fac-990c-e66ad66e174f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1275 microversion: 2.1 time: 0.200024 Aug 30 03:28:15.802938 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 566/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:15 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:15.820976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:15.821569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:15.831979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.832736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.833486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.834871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:15.835020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:15.835507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:15.872284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:28:16.045494 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76745c61-49bd-4bec-b494-fe57533dbba8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 204 len: 0 microversion: 2.1 time: 0.237938 Aug 30 03:28:16.046784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 567/1161] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:15 2022] DELETE /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:16.055306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:16.056002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:16.063475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:16.073487 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05f5d46f-8e79-4fa1-8ea7-49f8765479dd tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1535 microversion: 2.1 time: 0.445638 Aug 30 03:28:16.079018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.079510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.079939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.080667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.081133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.081574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.084589 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 595/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:15 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1535 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:16.241763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1664980861", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": "none"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:16.312441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:16.312855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:16.313921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:16.314573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:16.315259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:16.319614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:16.326992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.327753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.328340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.329152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.329322 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01f84194-89d8-4f61-a385-84ab5ed91608 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.281122 Aug 30 03:28:16.329799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.334560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.334762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 568/1163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:16 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:16.345468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:16.346088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:16.354636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.355381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.356066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.356930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.357601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.358244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.365153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Getting quotas for project 8753912264dd4e9fa111725e10eb63db. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:16.373540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Getting quotas for user dbc44fe2821a40fbacbd309be08f8dba and project 8753912264dd4e9fa111725e10eb63db. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:16.388200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:28:16.390628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: e8a038b6-2515-451b-8655-3dff1280d29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:28:16.443815 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6be123f5-d75e-48a5-b2c5-22e69227b046 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.357735 Aug 30 03:28:16.444727 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 596/1164] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:28:16.449710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fc6d844a-0750-46f8-83ad-e91659ac96d4 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'create', calling method: .version_select at 0x7f897b9abf70>, body: {"pool": "21bf2f3d-b99c-4490-94eb-bf6494e7e47d"} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:16.760277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:16.769627 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-24acff4f-c436-4ac2-8d78-230d85026117 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1527 microversion: 2.1 time: 0.433731 Aug 30 03:28:16.781898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 569/1165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:16 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1527 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:16.789303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bd8194c6-be55-4d56-aed2-6dfd1935f09f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:16.790292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bd8194c6-be55-4d56-aed2-6dfd1935f09f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: e8a038b6-2515-451b-8655-3dff1280d29c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:16.877554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd8194c6-be55-4d56-aed2-6dfd1935f09f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:16.886677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd8194c6-be55-4d56-aed2-6dfd1935f09f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:16.888256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd8194c6-be55-4d56-aed2-6dfd1935f09f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:16.889425 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bd8194c6-be55-4d56-aed2-6dfd1935f09f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c" status: 200 len: 1278 microversion: 2.47 time: 0.106335 Aug 30 03:28:16.890221 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 570/1166] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:16 2022] GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:16.896145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:16.896755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:16.903258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.903726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.904330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:16.905421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:16.906022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:16.906595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:17.267124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:17.277706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7df85e2f-96c7-4495-8dd6-da4728663d8c tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1713 microversion: 2.1 time: 0.386259 Aug 30 03:28:17.278289 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 571/1167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:16 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1713 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:17.296847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:17.297833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:17.303983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:17.304469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:17.304892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:17.311234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:17.311234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:17.311234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:17.801684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:17.828639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-44650b44-d372-4711-af01-2898ee7b036c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.535084 Aug 30 03:28:17.831317 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 572/1168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:17 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:17.851534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-435629749", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": "none"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:17.952017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:17.952507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:17.953671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:17.953671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:17.953879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:17.976814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:17.977507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:17.977760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:17.978493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:17.978945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:17.979535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:18.000337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Getting quotas for project 8753912264dd4e9fa111725e10eb63db. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:18.005543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Getting quotas for user dbc44fe2821a40fbacbd309be08f8dba and project 8753912264dd4e9fa111725e10eb63db. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:18.015682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:18.019734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:28:18.022305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:28:18.076666 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9d70d8f-7ebc-4a0f-a110-63022a7e6205 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.243133 Aug 30 03:28:18.077308 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 573/1169] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 245 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:28:18.082669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:18.083459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:18.091346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:18.092140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:18.092738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:18.093639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:18.094257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:18.094840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:18.452599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:18.457907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:18.467190 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a98697ed-e599-47ed-bdd0-81c847a046a0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.388473 Aug 30 03:28:18.468673 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 574/1170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:18 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:18.476266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:18.476885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:18.488241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:18.489097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:18.490162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:18.491835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:18.492445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:18.493026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:19.362730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:19.371708 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea066853-7817-482a-9a51-1cf2473c1839 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1527 microversion: 2.1 time: 0.901690 Aug 30 03:28:19.372646 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 575/1171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:18 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1527 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:19.377657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-87f32607-5371-4489-a252-ccc64c447b5c req-99528fb4-1f31-406d-8099-4aa5e76dd8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "name": "network-vif-plugged", "status": "completed", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:19.388691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-87f32607-5371-4489-a252-ccc64c447b5c req-99528fb4-1f31-406d-8099-4aa5e76dd8c7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:19.389180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-87f32607-5371-4489-a252-ccc64c447b5c req-99528fb4-1f31-406d-8099-4aa5e76dd8c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:19.389662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-87f32607-5371-4489-a252-ccc64c447b5c req-99528fb4-1f31-406d-8099-4aa5e76dd8c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:19.404638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-87f32607-5371-4489-a252-ccc64c447b5c req-99528fb4-1f31-406d-8099-4aa5e76dd8c7 service nova] Creating event network-vif-plugged:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:28:19.410743 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-87f32607-5371-4489-a252-ccc64c447b5c req-99528fb4-1f31-406d-8099-4aa5e76dd8c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036497 Aug 30 03:28:19.411333 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 576/1172] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:19.416569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:19.419022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:19.426008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:19.426502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:19.426930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:19.427630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:19.428082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:19.428531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:19.593271 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6c2ee501-fab3-4ad3-943c-5a5aeb882a71 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "PUT /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 991 microversion: 2.47 time: 0.180634 Aug 30 03:28:19.595368 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 577/1173] 10.222.0.30 () {62 vars in 1297 bytes} [Tue Aug 30 03:28:19 2022] PUT /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 991 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:28:19.607612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:19.609965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:19.633469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:19.634289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:19.635091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:19.635915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:19.636471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:19.636990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.194132 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fc6d844a-0750-46f8-83ad-e91659ac96d4 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.747970 Aug 30 03:28:20.194746 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 597/1174] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:28:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:20.201205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:20.202764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:20.209699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.210320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.210826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.211610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.212136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.212629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.301916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:20.311194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f121fe1-46c9-43c6-a81a-cecb227730b8 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1713 microversion: 2.1 time: 0.712655 Aug 30 03:28:20.311776 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 578/1175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:19 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1713 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:20.329849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:20.330469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:20.337015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.337554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.337993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.338694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.339146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.339575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.689488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:20.702378 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1a6d8fb-043b-4651-b236-34008ded0932 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.506104 Aug 30 03:28:20.717253 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 598/1176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:20 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:20.723408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:20.724269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:20.730926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.731422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.731858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.732562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.733016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.733463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.811010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:20.833927 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee9a2b87-f3f3-4608-9cdd-3ec946ddb81b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1379 microversion: 2.1 time: 0.507766 Aug 30 03:28:20.835239 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 579/1177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:20 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1379 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:20.842255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'action', calling method: .version_select at 0x7f8981bf3b80>, body: {"addFloatingIp": {"address": "172.25.1.139"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:20.845434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:20.855677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.857028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.857440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.858539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:20.859881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:20.859881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:20.953914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:28:20.954340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquired lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:28:20.984824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:20.994261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:20.995745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:20.997429 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-787dafb7-139f-4248-b9bf-756d92064a44 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1337 microversion: 2.47 time: 0.278488 Aug 30 03:28:20.998157 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 599/1178] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:20 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1337 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:21.003845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:21.004677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:21.011424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.011932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.012368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.013065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.014006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.014603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.141290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:21.160316 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-44df3752-32e1-48cc-a909-6b1277479f2c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 200 len: 1485 microversion: 2.1 time: 0.160824 Aug 30 03:28:21.165922 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 600/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:20 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 1485 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:21.178130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-bcae7f1e-2f92-4fa8-9754-116347026792 req-aa20b6ed-b6d8-4608-9ee1-d632d3547289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:21.189290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bcae7f1e-2f92-4fa8-9754-116347026792 req-aa20b6ed-b6d8-4608-9ee1-d632d3547289 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.191440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bcae7f1e-2f92-4fa8-9754-116347026792 req-aa20b6ed-b6d8-4608-9ee1-d632d3547289 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.191950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bcae7f1e-2f92-4fa8-9754-116347026792 req-aa20b6ed-b6d8-4608-9ee1-d632d3547289 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.203908 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-bcae7f1e-2f92-4fa8-9754-116347026792 req-aa20b6ed-b6d8-4608-9ee1-d632d3547289 service nova] Creating event network-changed:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:28:21.209226 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-bcae7f1e-2f92-4fa8-9754-116347026792 req-aa20b6ed-b6d8-4608-9ee1-d632d3547289 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041595 Aug 30 03:28:21.209968 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 601/1180] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:21.333365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:21.334194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:21.348435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.349278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.350542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.351352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.352015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.352540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.786911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5daf93738ce4ea2941438e615625fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6815ed26b67b481aa4213a7f99653625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:21.796776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b0b4762-43a7-44a4-97b1-09a9f6d258e9 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 200 len: 1645 microversion: 2.1 time: 0.467902 Aug 30 03:28:21.798058 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 602/1181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:21 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 1645 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:21.804360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:21.804991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:21.812474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.813248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.813783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.814686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.815202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.815687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.844406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:28:21.947877 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4181d20c-e846-4dbc-8742-b20ce6436cc1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 204 len: 0 microversion: 2.1 time: 0.148090 Aug 30 03:28:21.952266 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 603/1182] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:21 2022] DELETE /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:21.960141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-01910327-d2b6-4755-89fc-64fa935e7def req-f2af2263-f846-40dd-8ca3-72966ba11d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28b0ad0-b499-4791-863b-3e38658f5822", "name": "network-vif-unplugged", "status": "completed", "tag": "90baf28f-1f7a-4337-a8cc-136ca27b642a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:21.972475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-01910327-d2b6-4755-89fc-64fa935e7def req-f2af2263-f846-40dd-8ca3-72966ba11d85 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:21.973390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-01910327-d2b6-4755-89fc-64fa935e7def req-f2af2263-f846-40dd-8ca3-72966ba11d85 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:21.973763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-01910327-d2b6-4755-89fc-64fa935e7def req-f2af2263-f846-40dd-8ca3-72966ba11d85 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:21.987275 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-01910327-d2b6-4755-89fc-64fa935e7def req-f2af2263-f846-40dd-8ca3-72966ba11d85 service nova] Creating event network-vif-unplugged:90baf28f-1f7a-4337-a8cc-136ca27b642a for instance a28b0ad0-b499-4791-863b-3e38658f5822 on n-h1-854924-5 Aug 30 03:28:21.993620 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-01910327-d2b6-4755-89fc-64fa935e7def req-f2af2263-f846-40dd-8ca3-72966ba11d85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039251 Aug 30 03:28:21.994245 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 604/1183] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:21.999957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:22.000676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:22.008058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:22.008559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:22.009159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:22.009918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:22.010513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:22.010944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:22.019790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:22.383953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:22.392649 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cbff56ce-a1fd-44cb-8c99-eeb23bc67d0f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.397189 Aug 30 03:28:22.394166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 605/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:21 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:22.399179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:22.399799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:22.407213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:22.407213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:22.407213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:22.407570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:22.407869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:22.408294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:22.697522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:22.706926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3eb4266f-c4aa-4205-b6e7-684f7fd52601 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1529 microversion: 2.1 time: 0.311591 Aug 30 03:28:22.716027 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 606/1185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:22 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1529 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:22.716027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:22.716027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:22.724287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:22.725162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:22.725880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:22.726820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:22.727959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:22.728396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:22.976400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:22.988623 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dc1e640-304e-4741-a8f7-60aedca66be2 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1666 microversion: 2.1 time: 0.279661 Aug 30 03:28:22.989991 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 607/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:22 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1666 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:22.995358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:22.996150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:23.010363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.011247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.011996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.013128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.013891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.014556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.111749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:23.121207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:23.123072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:23.124250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-55dc9267-6136-4681-a859-2777cb895484 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1335 microversion: 2.47 time: 0.133045 Aug 30 03:28:23.125152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 608/1187] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:22 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:23.130356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:23.134449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:23.143954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.144551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.145095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.145932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.146462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.146962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.162489 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 HTTP/1.1 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822'} Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.164216 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5bb6029a-faa7-42f2-bdfa-b7c70999648d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 404 len: 111 microversion: 2.1 time: 0.039455 Aug 30 03:28:23.169203 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 609/1188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:23 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:23.171004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:23.171855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:23.185518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.186262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.186708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.187575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.188045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.188484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.211990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:28:23.504983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:23.529775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d268aace-1717-4587-8eb6-c874e31d5bd6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1529 microversion: 2.1 time: 0.362331 Aug 30 03:28:23.532980 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 610/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:23 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1529 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:23.542257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:23.542876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:23.552431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.552890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.553338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.554288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.554893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.555522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.582936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 HTTP/1.1 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2e068f47-c7bd-474d-b436-30eea982b5c1'} Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.584814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:23.591521 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:23.594565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:23.595689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a3521f1-25cb-4401-a32c-01538a00ec20 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 404 len: 111 microversion: 2.1 time: 0.060868 Aug 30 03:28:23.597438 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 611/1190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:23 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:23.605494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb6e3fa1-f017-4021-8ebe-9fbf9b410e4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'create', calling method: .version_select at 0x7f897b96dd30>, body: {"keypair": {"name": "tempest-keypair-1437134313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLuTOTc8XGzFWV5oeVu5f+MZugw5tpgNYVQSXOt1MDWrcTqyOSTNkOmUnT6pE3mKZ7667TS9zBSUhQ4U5MfaUixkZ4922O3+5NUHjJB24x5g8NMf4GPDqg4OW5TEWcDgw=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:23.634835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bb6e3fa1-f017-4021-8ebe-9fbf9b410e4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:23.644785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bb6e3fa1-f017-4021-8ebe-9fbf9b410e4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for user 7957bda6b3f3422a94f08752db13ddec and project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:23.681786 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb6e3fa1-f017-4021-8ebe-9fbf9b410e4e tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082845 Aug 30 03:28:23.682473 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 612/1191] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:28:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:23.695236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28b0ad0-b499-4791-863b-3e38658f5822", "name": "network-vif-deleted", "tag": "90baf28f-1f7a-4337-a8cc-136ca27b642a"}, {"server_uuid": "2e068f47-c7bd-474d-b436-30eea982b5c1", "name": "network-vif-deleted", "tag": "ac777799-c1ff-4dbd-9182-bc46eb01ccd2"}, {"name": "network-changed", "server_uuid": "7197b256-84d8-4e62-92fe-c7046da721a2", "tag": "00f5adbf-5868-4eb1-9d32-42deaca2158f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:23.709829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.710572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.710744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.728241 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Creating event network-vif-deleted:90baf28f-1f7a-4337-a8cc-136ca27b642a for instance a28b0ad0-b499-4791-863b-3e38658f5822 on n-h1-854924-5 Aug 30 03:28:23.728807 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Creating event network-vif-deleted:ac777799-c1ff-4dbd-9182-bc46eb01ccd2 for instance 2e068f47-c7bd-474d-b436-30eea982b5c1 on n-h1-854924-5 Aug 30 03:28:23.729490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] Creating event network-changed:00f5adbf-5868-4eb1-9d32-42deaca2158f for instance 7197b256-84d8-4e62-92fe-c7046da721a2 on n-h1-854924-5 Aug 30 03:28:23.743835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-628223a6-c785-4e83-a488-bc04868157a7 req-230ada98-c914-46c1-a48e-910c282e355d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.053101 Aug 30 03:28:23.744788 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 613/1192] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:23.753979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:23.754703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:23.762722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.763333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.763784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:23.764606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:23.765072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:23.765665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:24.545646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:24.571520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c33db3c4-325f-4f9e-984c-fd5834fad60f tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.824268 Aug 30 03:28:24.573225 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 614/1193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:23 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:24.578745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1af56e12-6882-42ba-a1b9-1ee27f42bb8d tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:24.640103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1af56e12-6882-42ba-a1b9-1ee27f42bb8d tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/676f34d8-293a-43ac-b8a1-4e4163bcc8e4" status: 202 len: 0 microversion: 2.1 time: 0.065291 Aug 30 03:28:24.641530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 615/1194] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:24 2022] DELETE /compute/v2.1/flavors/676f34d8-293a-43ac-b8a1-4e4163bcc8e4 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:24.652544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:24.653056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:24.672098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:24.673031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:24.673978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:24.675626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:24.676199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:24.677227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:24.699476 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 HTTP/1.1 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'add6aa5a-222e-4a38-9ce7-2903c6125cb7'} Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:24.702671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:24.710890 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:24.713245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:24.715641 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0eab5483-50df-4a27-a4f2-228b65db2a46 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 404 len: 111 microversion: 2.1 time: 0.072468 Aug 30 03:28:24.716430 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 616/1195] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:24 2022] DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:24.729690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:24.731363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:24.738002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:24.738829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:24.739469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:24.740368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:24.741039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:24.741508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:24.882069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Updating instance_info_cache with network_info: [{"id": "00f5adbf-5868-4eb1-9d32-42deaca2158f", "address": "fa:16:3e:9a:4d:e8", "network": {"id": "4d44ede8-8b68-4f52-ac64-6d4a055c5efe", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-375672404-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "90d0d07546b84c74a0bb83559f246788", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00f5adbf-58", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:28:24.905580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Releasing lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:28:24.907514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c77239d-a0ee-4353-be6c-b7541b84070a tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action" status: 202 len: 0 microversion: 2.1 time: 4.070448 Aug 30 03:28:24.909582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 580/1196] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:20 2022] POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action => generated 0 bytes in 4074 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:28:24.915538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:24.916449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:24.929203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:24.930237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:24.930866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:24.931915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:24.933206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:24.933927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.010587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:25.023717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2928412e-6b46-45d0-bb77-57e8a14ab366 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1666 microversion: 2.1 time: 0.305882 Aug 30 03:28:25.024911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 617/1197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:24 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1666 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:25.030671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-06c3ad74-55d2-4e56-b59e-ac18f1d671f8 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:25.062079 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-06c3ad74-55d2-4e56-b59e-ac18f1d671f8 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.035556 Aug 30 03:28:25.070683 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 618/1198] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:28:25 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:25.071427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:25.078011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:25.078637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:25.083131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:25.084738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:25.087311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.087808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.088430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.089303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.089945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.090562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.100132 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3830facf-abee-41c7-a423-9810d713f607 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1356 microversion: 2.47 time: 0.189004 Aug 30 03:28:25.101403 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 581/1199] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:24 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:25.107065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07ed4c21-0cf3-4296-8147-129a67a0345f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'create', calling method: .version_select at 0x7f897b48dd30>, body: {"pool": "21bf2f3d-b99c-4490-94eb-bf6494e7e47d"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:25.125674 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 HTTP/1.1 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'add6aa5a-222e-4a38-9ce7-2903c6125cb7'} Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:25.128643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:25.133571 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8b31ea5-e787-4a9a-b13d-9872f8c1825f tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 404 len: 111 microversion: 2.1 time: 0.058131 Aug 30 03:28:25.136215 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 619/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:25 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:25.141590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:25.144703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:25.152990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.153525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.154279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.155087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.155622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.156062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.256910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:25.265133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Old instance type tempest-test_resize_flavor_-625638817, new instance type m1.heat {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 03:28:25.273168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:25.273830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:25.274541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:25.275018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:25.275518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:25.430161 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d76745d5-7f3c-418f-adcb-9d174f2480ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d/action" status: 202 len: 0 microversion: 2.1 time: 0.292459 Aug 30 03:28:25.432999 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 620/1201] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:25 2022] POST /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:25.440479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:25.446591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:25.455556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.456450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.457144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.458152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.459706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.460430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.571991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:25.573575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:25.574300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:25.578397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:25.579103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:25.666435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:25.668973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:25.693859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.696554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.697152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.702930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.702930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.703133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.805741 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3fedc541-85ca-4a93-b41f-e9859474eec5 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "POST /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595/action" status: 202 len: 1078 microversion: 2.47 time: 0.369771 Aug 30 03:28:25.823901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 621/1202] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:28:25 2022] POST /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595/action => generated 1078 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 03:28:25.832152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7fafdcf-b252-4fd3-8b8b-1bf99661f870 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '.version_select at 0x7f897b9833a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:25.907322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7fafdcf-b252-4fd3-8b8b-1bf99661f870 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806602623" status: 202 len: 0 microversion: 2.1 time: 0.082688 Aug 30 03:28:25.912586 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 622/1203] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806602623 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:25.920580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:25.921781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:25.932378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.934070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.934070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:25.934865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:25.935819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:25.936069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:26.250116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:26.259045 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-596e4fba-3123-4179-ba86-93a71625341b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1538 microversion: 2.1 time: 0.346978 Aug 30 03:28:26.271440 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 623/1204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:25 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1538 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:26.276698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:26.277321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:26.284312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:26.285294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:26.285974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:26.287024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:26.287651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:26.288268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:26.356507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:26.758906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:26.775494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6cdec03e-0ba2-4f09-ab37-e2694fcce121 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.502064 Aug 30 03:28:26.796256 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 624/1205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:26 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:26.805977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:26.821380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:26.826751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:26.827395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:26.828124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:26.828938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:26.829656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:26.830054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:26.990655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:26.994626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:27.003610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:27.007275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:27.009905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f2dbb14-50a0-42c8-9823-b8cbca1deb56 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.212335 Aug 30 03:28:27.016823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 625/1206] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:26 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:27.035146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:27.035984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:27.044726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:27.045633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:27.047986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:27.049911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:27.050652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:27.052497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:27.134854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:27.135583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:27.136791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:27.137425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lazy-loading 'fault' on Instance uuid aab6cf50-c7ee-404c-9c2d-a858aaf86c39 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:28:27.212131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1638ffc8b0478d875ad0f4b79e333f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0664f994b4485a88a343742c1ec9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:27.230521 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-535b300b-05fa-476d-b17c-8276ae540e77 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 200 len: 1316 microversion: 2.1 time: 0.210355 Aug 30 03:28:27.231658 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 626/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:27 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:27.239746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:27.240385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:27.246885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:27.248137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:27.248587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:27.249938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:27.250406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:27.250835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:27.698241 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-daa33385-6057-473c-ac50-b932e03ca722 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1814 microversion: 2.1 time: 0.464148 Aug 30 03:28:27.699868 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 627/1208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:27 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1814 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:27.704449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-557cb84a-37b1-4ab8-853c-f358c85fbec5 req-2188fff6-7e55-4fb0-aeff-f7916f10bb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab6cf50-c7ee-404c-9c2d-a858aaf86c39", "name": "network-vif-deleted", "tag": "f1cda62b-b470-4e44-a6d5-06ee7393c4e1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:27.726385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-557cb84a-37b1-4ab8-853c-f358c85fbec5 req-2188fff6-7e55-4fb0-aeff-f7916f10bb85 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:27.727607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-557cb84a-37b1-4ab8-853c-f358c85fbec5 req-2188fff6-7e55-4fb0-aeff-f7916f10bb85 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:27.727607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-557cb84a-37b1-4ab8-853c-f358c85fbec5 req-2188fff6-7e55-4fb0-aeff-f7916f10bb85 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:27.740627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-557cb84a-37b1-4ab8-853c-f358c85fbec5 req-2188fff6-7e55-4fb0-aeff-f7916f10bb85 service nova] Creating event network-vif-deleted:f1cda62b-b470-4e44-a6d5-06ee7393c4e1 for instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 on n-h2-854924-5 Aug 30 03:28:27.745861 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-557cb84a-37b1-4ab8-853c-f358c85fbec5 req-2188fff6-7e55-4fb0-aeff-f7916f10bb85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044824 Aug 30 03:28:27.746970 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 628/1209] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:27.758620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-68154094", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:27.829607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] validate_networks() for [('9377aef6-2466-46d9-91da-27a2f4acb097', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:28:27.991594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:28.014698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=14 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:28.715228 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07ed4c21-0cf3-4296-8147-129a67a0345f tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.612479 Aug 30 03:28:28.715898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 582/1210] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:28:25 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:28.722311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:28.722936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:28.729437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:28.729868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:28.730301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:28.731041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:28.731494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:28.731911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.070161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:29.078139 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-454c6403-ef47-4b95-ad27-b2e3d0bb4668 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1538 microversion: 2.1 time: 0.361063 Aug 30 03:28:29.078728 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 583/1211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:28 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1538 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:29.084502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.091110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.091862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.092461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.093375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.094174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.094605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.120948 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd18f329-1703-4676-b942-4d11d78be3e4 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040987 Aug 30 03:28:29.121600 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 584/1212] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:29.126921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.128159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.135950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.137066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.139049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.141141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.141730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.142550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.175929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:29.176937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:29.176937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:29.177288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:29.177728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:29.196479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.197264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.197987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.199704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.200589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.201491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.228389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:29.233796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for user 7957bda6b3f3422a94f08752db13ddec and project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:29.247595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:28:29.250164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:28:29.299942 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5376f727-c564-4193-a9c8-a68fb0c620b6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.548764 Aug 30 03:28:29.307097 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 629/1213] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:28:29.312188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.313054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.320627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.321457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.323171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.324083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.326601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.327250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.353070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:29.373492 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d26b7ec-9722-4907-afda-131628838592 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.250539 Aug 30 03:28:29.378319 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 585/1214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:29.392151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f08c704e-aa2d-48f6-bb56-bfd39b45f324 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.419807 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f08c704e-aa2d-48f6-bb56-bfd39b45f324 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1943945915" status: 202 len: 0 microversion: 2.1 time: 0.040175 Aug 30 03:28:29.420647 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 586/1215] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:28:29 2022] DELETE /compute/v2.1/flavors/1943945915 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:29.428884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.429781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] [instance: aab6cf50-c7ee-404c-9c2d-a858aaf86c39] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.436523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:29.448846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.449368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.450260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:29.452098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:29.452801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.454206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.455341 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b9f0d82-2af5-4a11-a1ff-8b4f9761306e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.146906 Aug 30 03:28:29.456020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.456757 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 630/1216] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:29.457451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.465614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'action', calling method: .version_select at 0x7f8982097ca0>, body: {"addFloatingIp": {"address": "172.25.1.5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:29.484559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.491179 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] HTTP exception thrown: Instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 could not be found. Aug 30 03:28:29.492381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.492964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.493691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Request method failure captured: Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 HTTP/1.1 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOT5sfvRI0R-98PX0VYLmoAO_sdFD1dfzoXeXnbXCbpwES1m8vTVoscZrCAcy-2lfGXszJkcOItK67PkfaIze1cXiqmgfeXSnACMSbMKf2uLh73USTcS70PE1eHENkg_EgOg-ZNYYf4gmgKABVl7agW_omqdZ3IKLUySuWqLoj-tmM Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd0664f994b4485a88a343742c1ec9bf Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestFqdnHostnames-1148398840 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd0664f994b4485a88a343742c1ec9bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd0664f994b4485a88a343742c1ec9bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd0664f994b4485a88a343742c1ec9bf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd0664f994b4485a88a343742c1ec9bf"}]}] Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestFqdnHostnames-1148398840 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd0664f994b4485a88a343742c1ec9bf Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1148398840 Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestFqdnHostnames-1148398840-project Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0d1638ffc8b0478d875ad0f4b79e333f Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestFqdnHostnames-1148398840-project Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 could not be found. Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'aab6cf50-c7ee-404c-9c2d-a858aaf86c39'} Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 could not be found. Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 could not be found. Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.494341 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 could not be found. Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Returning 404 to user: Instance aab6cf50-c7ee-404c-9c2d-a858aaf86c39 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-883279b9-32aa-40d2-98cd-c89ab8bca1f1 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39" status: 404 len: 111 microversion: 2.1 time: 0.073982 Aug 30 03:28:29.499783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 587/1217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/servers/aab6cf50-c7ee-404c-9c2d-a858aaf86c39 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:29.502975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.503797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.504513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.507180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f034282-556c-4cbf-af81-1cf55684d260 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.508489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f034282-556c-4cbf-af81-1cf55684d260 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.599146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f034282-556c-4cbf-af81-1cf55684d260 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:29.612300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:28:29.612759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquired lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:28:29.622649 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f034282-556c-4cbf-af81-1cf55684d260 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1223 microversion: 2.1 time: 0.122166 Aug 30 03:28:29.623445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 588/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:29.640276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16ffcb77-32e2-4ae7-b48b-8e098fe1d0f1 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.664049 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16ffcb77-32e2-4ae7-b48b-8e098fe1d0f1 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.039417 Aug 30 03:28:29.664711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 589/1219] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:29.672549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d57e1f1-e112-4c60-9fbd-2a7597baca73 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] Calling method '.version_select at 0x7f897b48d820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.712841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d57e1f1-e112-4c60-9fbd-2a7597baca73 tempest-ServersTestFqdnHostnames-1148398840 tempest-ServersTestFqdnHostnames-1148398840-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546993434" status: 202 len: 0 microversion: 2.1 time: 0.044891 Aug 30 03:28:29.715992 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 590/1220] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546993434 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:29.729901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b662bf2c-ae10-4fe6-978a-a8635f9646a3 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.778189 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b662bf2c-ae10-4fe6-978a-a8635f9646a3 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1007162536" status: 202 len: 0 microversion: 2.1 time: 0.060883 Aug 30 03:28:29.780081 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 591/1221] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:28:29 2022] DELETE /compute/v2.1/flavors/1007162536 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:29.795494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68826971-3314-42ca-a17d-7a8e71d50677 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.819433 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68826971-3314-42ca-a17d-7a8e71d50677 tempest-ServersWithSpecificFlavorTestJSON-289336924 tempest-ServersWithSpecificFlavorTestJSON-289336924-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027705 Aug 30 03:28:29.820854 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 592/1222] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:29.850293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.851053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.858194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.858826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.859369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.860223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.861049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.861648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.878058 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 HTTP/1.1 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2e068f47-c7bd-474d-b436-30eea982b5c1'} Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:29.880054 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.884058 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.886415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:29.887530 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-242e1440-bf85-4af8-94c1-528caaabfd41 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 404 len: 111 microversion: 2.1 time: 0.041648 Aug 30 03:28:29.888705 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 593/1223] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:29 2022] DELETE /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:29.900188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.901239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: 2e068f47-c7bd-474d-b436-30eea982b5c1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.910450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.911329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.912012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.913064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.913789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.914496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.930023 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 HTTP/1.1 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2e068f47-c7bd-474d-b436-30eea982b5c1'} Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.931967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. Aug 30 03:28:29.935935 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.938683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance 2e068f47-c7bd-474d-b436-30eea982b5c1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:29.943075 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0b30ac2-07d3-4624-9115-2c10f135adc2 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1" status: 404 len: 111 microversion: 2.1 time: 0.044648 Aug 30 03:28:29.943075 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 594/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/servers/2e068f47-c7bd-474d-b436-30eea982b5c1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:29.950022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:29.950919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:29.958266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.959119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.959953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.961762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:29.963121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:29.964078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:29.983381 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 HTTP/1.1 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'add6aa5a-222e-4a38-9ce7-2903c6125cb7'} Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:29.985412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:29.990784 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:29.993008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:29.994344 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f773f6b-8aca-42ab-bda8-5107bfb23f14 tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 404 len: 111 microversion: 2.1 time: 0.048882 Aug 30 03:28:29.995512 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 595/1225] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:29 2022] DELETE /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:28:30.007971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:30.011731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] [instance: add6aa5a-222e-4a38-9ce7-2903c6125cb7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:30.025413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.027993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.028826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.035443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.037127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.038777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.056267 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] HTTP exception thrown: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Request method failure captured: Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 HTTP/1.1 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYLUMB8uFadGUD9uokYVn5RKYTLTlORZE5p6NVBJkdgJmGWI7C9LUKaDmA-a3Luf0dpPihDPTF-kTBMjzBb-V9gFvrwNbQ84K0EfsJmX0RuWvfRZ6MiYL-mVd75G0UxPvh0xq8tVcXJpWhasKrOCMiPiYeIYROGgnv2oCLZKVs7t5j0 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6815ed26b67b481aa4213a7f99653625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6815ed26b67b481aa4213a7f99653625", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6815ed26b67b481aa4213a7f99653625"}]}] Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 6815ed26b67b481aa4213a7f99653625 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d5daf93738ce4ea2941438e615625fe6 Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-785913634-project Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'add6aa5a-222e-4a38-9ce7-2903c6125cb7'} Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.057929 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] Returning 404 to user: Instance add6aa5a-222e-4a38-9ce7-2903c6125cb7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ccfa5457-81f9-467e-9222-658862bfcc7d tempest-ServersWithSpecificFlavorTestJSON-785913634 tempest-ServersWithSpecificFlavorTestJSON-785913634-project] 10.222.0.30 "GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7" status: 404 len: 111 microversion: 2.1 time: 0.059347 Aug 30 03:28:30.063280 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 596/1226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:29 2022] GET /compute/v2.1/servers/add6aa5a-222e-4a38-9ce7-2903c6125cb7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:30.112522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:30.113824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:30.126586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.128717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.134346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.136616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.138681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.139889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.311035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d.", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:28:30.311633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Releasing lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:28:30.312576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.312576 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Request method failure captured: Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action HTTP/1.1 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 44 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO6leb55NjvVT_ZtSM26N1_xxfi5Dexz6Mq0FmV3keLkGQeNuyUMIaXUnMeHHVCUvXI8abJXje0aSGBxM45uxAl535GKIuvRuVqg3GrFkkKVSdm4y-7DhyEKV-0tbv5L1fEcNqxoy1K7QbN4I5p2esLmJOwtgqf1e8vEwRoq1xtpvc Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90d0d07546b84c74a0bb83559f246788", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}] Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: dc24d80f6a294faea61cfb309f438bdd Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: {"addFloatingIp": {"address": "172.25.1.5"}} Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7197b256-84d8-4e62-92fe-c7046da721a2', 'body': {'addFloatingIp': {'address': '172.25.1.5'}}} Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:28:30.326002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] Aug 30 03:28:30.331322 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:30.338237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Returning 400 to user: Cannot associate floating IP 172.25.1.5 (7189063b-7da0-425c-b9c5-7da5c40855a6) with port 00f5adbf-5868-4eb1-9d32-42deaca2158f using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 21bf2f3d-b99c-4490-94eb-bf6494e7e47d. Aug 30 03:28:30.338237 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-ccd0300e-645d-4462-ac26-715a2ffa81c5'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:30.338237 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9063820-b7f9-44e3-b9ad-1e992571a3e3 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action" status: 400 len: 379 microversion: 2.1 time: 0.875121 Aug 30 03:28:30.338237 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 631/1227] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:29 2022] POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action => generated 379 bytes in 878 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:28:30.341834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-77b64650-4345-47a6-accc-d2b91109a8de req-8b2d30d7-d06f-4220-905c-21bc212d21c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "name": "network-vif-plugged", "status": "completed", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:30.381663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-77b64650-4345-47a6-accc-d2b91109a8de req-8b2d30d7-d06f-4220-905c-21bc212d21c7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.382147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-77b64650-4345-47a6-accc-d2b91109a8de req-8b2d30d7-d06f-4220-905c-21bc212d21c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.382580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-77b64650-4345-47a6-accc-d2b91109a8de req-8b2d30d7-d06f-4220-905c-21bc212d21c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.400956 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-77b64650-4345-47a6-accc-d2b91109a8de req-8b2d30d7-d06f-4220-905c-21bc212d21c7 service nova] Creating event network-vif-plugged:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:28:30.405335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:30.409100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-77b64650-4345-47a6-accc-d2b91109a8de req-8b2d30d7-d06f-4220-905c-21bc212d21c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071441 Aug 30 03:28:30.413839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 632/1228] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:30.415543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-385db43f-8b60-4e68-a3c7-ed6b87d0d329 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.308221 Aug 30 03:28:30.416467 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 597/1229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:30 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:30.420607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f0cdc32-66ed-4da4-95af-04277a228c32 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '.version_select at 0x7f897bf78790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:30.421703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:30.422335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:30.429372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.430365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.431280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.432426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.433612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.434511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.833583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:30.844414 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d44066b-c307-4957-b820-ffad41dcb2ec tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.426758 Aug 30 03:28:30.845008 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 598/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:30 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:30.863450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:30.864087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:30.880110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.880110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.880537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:30.881257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:30.881743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:30.882167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:31.039883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:31.051170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:31.053643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:31.054969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36daa353-6b7c-420a-81c0-e7ec169e5b2c tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.208995 Aug 30 03:28:31.061535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 599/1231] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:30 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:31.066440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:31.067080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:31.075351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:31.079951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:31.079951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:31.079951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:31.079951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:31.084364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:31.265496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:31.280236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-589113ca-be45-47e4-8c09-96f79dbb8813 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1275 microversion: 2.1 time: 0.222890 Aug 30 03:28:31.281028 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 600/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:31 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:31.441793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:31.442818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:31.449802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:31.450664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:31.451510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:31.453020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:31.454695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:31.456235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:31.945929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:31.974521 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-173c3e59-fb04-4d63-a629-462538daf8aa tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.538044 Aug 30 03:28:31.976383 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 601/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:31 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:31.982956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:31.983910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:31.992251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:31.993118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:31.994075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:31.995303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:31.996063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:31.996768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:32.030551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:32.469409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:32.480435 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-615bb70e-67d5-4e91-aff9-e2475a006c5e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1323 microversion: 2.1 time: 0.501424 Aug 30 03:28:32.481927 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 602/1234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:31 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:32.491172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38379dfc-375d-4490-b8d7-7ee51db16674", "device": "/dev/xvdb"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:32.504816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:32.512281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:32.512894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:32.513232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:32.514183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:32.514641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:32.515061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:32.849533 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d4b5ee3-cff8-43c5-938e-fde22d6aafc1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "POST /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362498 Aug 30 03:28:32.850771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 603/1235] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:28:32 2022] POST /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:32.878442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:32.893980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:32.909308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:32.909979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:32.910553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:32.911376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:32.911943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:32.912629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:33.202922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:33.223150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:33.224643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:33.246135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2b2dadc9-4c6f-4e3b-84f6-7cc693c531ef tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.380162 Aug 30 03:28:33.247524 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 604/1236] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:32 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:33.252862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:33.253514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:33.259855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:33.260357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:33.260782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:33.270974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:33.271476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:33.272133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:33.291731 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f0cdc32-66ed-4da4-95af-04277a228c32 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/7189063b-7da0-425c-b9c5-7da5c40855a6" status: 202 len: 0 microversion: 2.1 time: 2.875962 Aug 30 03:28:33.294683 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 633/1237] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:28:30 2022] DELETE /compute/v2.1/os-floating-ips/7189063b-7da0-425c-b9c5-7da5c40855a6 => generated 0 bytes in 2880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:33.302204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:33.303196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:33.317687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:33.318215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:33.318622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:33.319326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:33.329149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:33.330031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:33.514488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:33.530616 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e8088e17-2fc4-478a-ab14-9242d543547d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1281 microversion: 2.1 time: 0.281855 Aug 30 03:28:33.531224 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 605/1238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:33 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:33.537161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'action', calling method: .version_select at 0x7f8981fc43a0>, body: {"removeFloatingIp": {"address": "172.25.1.139"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:34.062578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:34.073255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:34.079860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.081070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.081558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.082281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.082804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.087919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.098621 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e0eb94f-0717-4a0d-9aa4-304a6ebce376 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.802485 Aug 30 03:28:34.102209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 634/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:33 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:34.122686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:34.124712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:34.136013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.136800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.138121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.139188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.140238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.140967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.734012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:34.746565 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfd3fc83-88ef-4a21-9773-0faa3cdfb348 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1520 microversion: 2.1 time: 0.631166 Aug 30 03:28:34.747427 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 635/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:34 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1520 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:34.762146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:34.763226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:34.777540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.778250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.778871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.779748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.780486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.781074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.937699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:34.952425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:34.953964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:34.955219 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a820cc0-81e1-4025-85dc-dd13b930b02f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.197793 Aug 30 03:28:34.955861 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 636/1241] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:34 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:34.966482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:34.974323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:34.985536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.986302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.987501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:34.988438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:34.989836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:34.993998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:35.072556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:28:35.073840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquired lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:28:35.657407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:35.670122 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10aaa56a-0fc4-4dc7-9375-b07a718115cb tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.707350 Aug 30 03:28:35.685481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 637/1242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:34 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:35.696912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b77798ad-ea0e-4d9a-b543-d959a788090e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'create', calling method: .version_select at 0x7f897bb23700>, body: {"pool": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:38.744287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:28:39.102126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:39.214774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:39.241773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=18 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:39.617052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:41.315191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Updating instance_info_cache with network_info: [{"id": "00f5adbf-5868-4eb1-9d32-42deaca2158f", "address": "fa:16:3e:9a:4d:e8", "network": {"id": "4d44ede8-8b68-4f52-ac64-6d4a055c5efe", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-375672404-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "90d0d07546b84c74a0bb83559f246788", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00f5adbf-58", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:28:41.329903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Releasing lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:28:41.331094 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-655b894d-9992-41e2-bad8-642ec6ea27ba tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action" status: 202 len: 0 microversion: 2.1 time: 7.798918 Aug 30 03:28:41.332184 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 606/1243] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:33 2022] POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action => generated 0 bytes in 7800 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:28:41.337897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:41.338515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:41.345863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:41.346353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:41.346975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:41.347881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:41.348339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:41.348957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:41.673711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:41.686005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-32235bbc-bb05-44e1-bc9f-fa8d46309f88 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.351280 Aug 30 03:28:41.694120 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 607/1244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:41 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:41.703463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:41.705843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:41.724830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:41.725475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:41.726014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:41.726838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:41.727360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:41.727862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:41.857928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:41.867352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:41.869268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:41.870734 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62bb855d-3a1d-49b5-8304-3e3eee236201 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.174965 Aug 30 03:28:41.871524 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 608/1245] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:41 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:41.880998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:41.882519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:41.890912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:41.892083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:41.893425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:41.901240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:41.901752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:41.902361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:42.087748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:42.102906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78a68814-c55e-4e06-a4b6-3439f30be139 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.228075 Aug 30 03:28:42.103041 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 609/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:41 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:42.112043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6c8b44e3-0868-47aa-81ab-3ed6e622e199 req-b29917fb-1765-4d3e-9635-22b31973b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7197b256-84d8-4e62-92fe-c7046da721a2", "tag": "00f5adbf-5868-4eb1-9d32-42deaca2158f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:42.143658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6c8b44e3-0868-47aa-81ab-3ed6e622e199 req-b29917fb-1765-4d3e-9635-22b31973b1ab service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:42.144644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6c8b44e3-0868-47aa-81ab-3ed6e622e199 req-b29917fb-1765-4d3e-9635-22b31973b1ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:42.145080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6c8b44e3-0868-47aa-81ab-3ed6e622e199 req-b29917fb-1765-4d3e-9635-22b31973b1ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:42.160472 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6c8b44e3-0868-47aa-81ab-3ed6e622e199 req-b29917fb-1765-4d3e-9635-22b31973b1ab service nova] Creating event network-changed:00f5adbf-5868-4eb1-9d32-42deaca2158f for instance 7197b256-84d8-4e62-92fe-c7046da721a2 on n-h1-854924-5 Aug 30 03:28:42.169755 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6c8b44e3-0868-47aa-81ab-3ed6e622e199 req-b29917fb-1765-4d3e-9635-22b31973b1ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065396 Aug 30 03:28:42.175163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 610/1247] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:42.181519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf03e1c4-e680-4414-a358-bf1c9b9a58c6 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '.version_select at 0x7f897b75b550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:42.961030 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b77798ad-ea0e-4d9a-b543-d959a788090e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.274020 Aug 30 03:28:42.962692 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 638/1248] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:28:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:42.968052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:42.969322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:42.992685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:42.997226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:42.998792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.001972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.003948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.006250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.327393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:43.340087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9072a1a5-8bdd-4139-98a4-cc10ab4b9db1 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.375952 Aug 30 03:28:43.349399 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 639/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:42 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:43.349399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:43.349399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:43.355707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.355707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.355707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.356267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.356746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.357164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.446289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:43.458059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:43.460284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:43.462686 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-994dee06-bc62-4f2b-b2cf-6d49141be704 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.119880 Aug 30 03:28:43.464012 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 640/1250] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:43 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:43.468718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:43.469642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:43.479870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.481916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.482616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.484490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.485251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.485989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.747773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:43.759884 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-878dd2cb-e07d-445a-84fc-2626ab6c5987 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.294127 Aug 30 03:28:43.762531 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 641/1251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:43 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:43.764909 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf03e1c4-e680-4414-a358-bf1c9b9a58c6 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/ca17ffd9-c2e4-4ba9-a4fd-cd0e7fad79c0" status: 202 len: 0 microversion: 2.1 time: 1.588088 Aug 30 03:28:43.765565 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 611/1252] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:28:42 2022] DELETE /compute/v2.1/os-floating-ips/ca17ffd9-c2e4-4ba9-a4fd-cd0e7fad79c0 => generated 0 bytes in 1590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:43.776776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2038321568", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b65aef74-d72b-4c52-acc3-b7f6f301faa7"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:43.778210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db364c5a-43be-4234-840b-3071d6956147 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db364c5a-43be-4234-840b-3071d6956147 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Request method failure captured: Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action HTTP/1.1 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 34 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYO6leb55NjvVT_ZtSM26N1_xxfi5Dexz6Mq0FmV3keLkGQeNuyUMIaXUnMeHHVCUvXI8abJXje0aSGBxM45uxAl535GKIuvRuVqg3GrFkkKVSdm4y-7DhyEKV-0tbv5L1fEcNqxoy1K7QbN4I5p2esLmJOwtgqf1e8vEwRoq1xtpvc Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90d0d07546b84c74a0bb83559f246788", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}] Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: dc24d80f6a294faea61cfb309f438bdd Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: {"addFloatingIp": {"address": ""}} Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7197b256-84d8-4e62-92fe-c7046da721a2', 'body': {'addFloatingIp': {'address': ''}}} Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi '' Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:28:43.785819 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 03:28:43.790617 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:43.794809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db364c5a-43be-4234-840b-3071d6956147 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:43.795870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db364c5a-43be-4234-840b-3071d6956147 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action" status: 400 len: 142 microversion: 2.1 time: 0.024136 Aug 30 03:28:43.796962 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 612/1253] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:43 2022] POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:28:43.808660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:43.813060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:43.833920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.835414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.836031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.837632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:43.838328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:43.839181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:43.868621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] validate_networks() for [('b65aef74-d72b-4c52-acc3-b7f6f301faa7', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:28:43.882333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:28:43.883039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquired lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:28:44.466004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Releasing lock "refresh_cache-7197b256-84d8-4e62-92fe-c7046da721a2" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:28:44.466593 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] HTTP exception thrown: floating IP not found Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Request method failure captured: Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action HTTP/1.1 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 41 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYO6leb55NjvVT_ZtSM26N1_xxfi5Dexz6Mq0FmV3keLkGQeNuyUMIaXUnMeHHVCUvXI8abJXje0aSGBxM45uxAl535GKIuvRuVqg3GrFkkKVSdm4y-7DhyEKV-0tbv5L1fEcNqxoy1K7QbN4I5p2esLmJOwtgqf1e8vEwRoq1xtpvc Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90d0d07546b84c74a0bb83559f246788", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}] Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: dc24d80f6a294faea61cfb309f438bdd Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: exception: floating IP not found Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7197b256-84d8-4e62-92fe-c7046da721a2', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 30 03:28:44.469767 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Returning 404 to user: floating IP not found {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:44.475994 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-625abb52-41ab-4c66-bcc3-46a5bce9111b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action" status: 404 len: 67 microversion: 2.1 time: 0.669238 Aug 30 03:28:44.479685 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 613/1254] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:43 2022] POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action => generated 67 bytes in 677 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:28:44.719713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:28:44.720767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:28:44.721421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:28:44.722534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:28:44.723131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:28:44.735320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:44.736089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:44.737590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:44.739081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:44.739923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:44.740513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:44.761787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c847d018-fa1e-4580-bcb2-31470b823854 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-238336936", "ram": 512, "vcpus": 1, "disk": 10, "id": 1716211895, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:44.765539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Getting quotas for project fb047b401d424ae298aa305e270c6bd0. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:44.773079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Getting quotas for user 25d8eb58d3ba4c68b12408b713484d49 and project fb047b401d424ae298aa305e270c6bd0. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:44.784569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c847d018-fa1e-4580-bcb2-31470b823854 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.304482 Aug 30 03:28:44.785235 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 614/1255] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:44 2022] POST /compute/v2.1/flavors => generated 415 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:44.790240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-7455e49c-a5e3-408c-be83-f14440cdf00b req-9c730ce3-f33e-4fca-bc6f-764936d25357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79be592-c64a-4cb8-9db1-6890405a2fd8", "tag": "0a000025-e0bf-4422-8915-cf072f010da4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:44.794732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:28:44.796927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:44.797850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:28:44.802882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7455e49c-a5e3-408c-be83-f14440cdf00b req-9c730ce3-f33e-4fca-bc6f-764936d25357 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:44.803663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7455e49c-a5e3-408c-be83-f14440cdf00b req-9c730ce3-f33e-4fca-bc6f-764936d25357 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:44.804093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7455e49c-a5e3-408c-be83-f14440cdf00b req-9c730ce3-f33e-4fca-bc6f-764936d25357 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:44.817894 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-7455e49c-a5e3-408c-be83-f14440cdf00b req-9c730ce3-f33e-4fca-bc6f-764936d25357 service nova] Creating event network-changed:0a000025-e0bf-4422-8915-cf072f010da4 for instance e79be592-c64a-4cb8-9db1-6890405a2fd8 on n-h1-854924-5 Aug 30 03:28:44.822935 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-7455e49c-a5e3-408c-be83-f14440cdf00b req-9c730ce3-f33e-4fca-bc6f-764936d25357 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036368 Aug 30 03:28:44.823532 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 615/1256] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:44.828710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:44.829436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:44.836752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:44.837515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:44.838107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:44.838997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:44.839607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:44.840267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:44.871099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-056396f0-d930-47b5-9e18-5f44f9991df0 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106971 Aug 30 03:28:44.873793 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 642/1257] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:28:44.899688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-632cd025-6d2e-45fb-91eb-49425e979014 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Action: 'action', calling method: .version_select at 0x7f8981fbcc10>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.041875 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-632cd025-6d2e-45fb-91eb-49425e979014 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-632cd025-6d2e-45fb-91eb-49425e979014 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Request method failure captured: Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action HTTP/1.1 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 44 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO6leb55NjvVT_ZtSM26N1_xxfi5Dexz6Mq0FmV3keLkGQeNuyUMIaXUnMeHHVCUvXI8abJXje0aSGBxM45uxAl535GKIuvRuVqg3GrFkkKVSdm4y-7DhyEKV-0tbv5L1fEcNqxoy1K7QbN4I5p2esLmJOwtgqf1e8vEwRoq1xtpvc Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90d0d07546b84c74a0bb83559f246788", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}] Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: dc24d80f6a294faea61cfb309f438bdd Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: exception: Floating IP not found for address 0.0.0.0. Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7197b256-84d8-4e62-92fe-c7046da721a2', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 30 03:28:45.046278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 30 03:28:45.056150 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.062707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-632cd025-6d2e-45fb-91eb-49425e979014 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.067958 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-632cd025-6d2e-45fb-91eb-49425e979014 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action" status: 404 len: 88 microversion: 2.1 time: 0.182177 Aug 30 03:28:45.076848 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 643/1258] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:44 2022] POST /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2/action => generated 88 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:28:45.082014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.082638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:45.103216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.103689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.104120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.104821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.105491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.106070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.207772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.209548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.219850 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a50184e9-15aa-48fb-a694-ce1458beb248 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.395119 Aug 30 03:28:45.220446 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 616/1259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:44 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:45.230118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.233815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.236020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-abbfe1c0-536e-44b0-8f74-6b477e1c8850 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.157795 Aug 30 03:28:45.238095 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 644/1260] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:45 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:45.255008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.255733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:45.265074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.277233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.278050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.281657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.282342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.282952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.422629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23596aa9-04c9-438e-a5de-66ef9c193726 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.435625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-23596aa9-04c9-438e-a5de-66ef9c193726 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] HTTP exception thrown: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23596aa9-04c9-438e-a5de-66ef9c193726 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Request method failure captured: Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/flavors/1716211895/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYPqwiSHyMQUm9r_t9IhyggdBFyFHbxfg0agTawRPQm1fdD6VdMre3giU4OrElCUypEJ2w9-3obfWZQrNgwqK62HMnOQJKPjy9wTQ-8ea4b-H5hnOWjmGpE5BSsDRYEuQuxrFybdJbNFCpxBo1sx6kRXmW1udoW5jzfew-CaHT9qZ9M Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d218c216d9b9498a8170089df8e4b56c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}] Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: ab822811ba61416a90938bb54dd970c4 Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: exception: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'flavor_id': '1716211895', 'id': 'hw:cpu_thread_policy'} Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.437623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.442376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23596aa9-04c9-438e-a5de-66ef9c193726 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Returning 404 to user: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.442376 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23596aa9-04c9-438e-a5de-66ef9c193726 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] 10.222.0.30 "GET /compute/v2.1/flavors/1716211895/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.199353 Aug 30 03:28:45.445161 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 645/1261] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:28:45 2022] GET /compute/v2.1/flavors/1716211895/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:45.449955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-627c3c6d-40c9-4552-9428-27c334b53689 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.450563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-627c3c6d-40c9-4552-9428-27c334b53689 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:45.540113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-627c3c6d-40c9-4552-9428-27c334b53689 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.547114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-627c3c6d-40c9-4552-9428-27c334b53689 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1224 microversion: 2.1 time: 0.100922 Aug 30 03:28:45.547940 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 646/1262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:45 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:45.554446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.554930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:45.561265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.562042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.562629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.563497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.564109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.565521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.573619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.584261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b8c2100-95e6-4f41-a29b-6b234fba67ff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.349376 Aug 30 03:28:45.585387 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 617/1263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:45 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:45.590872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f27b50e-dfce-4110-ac12-25c3a1a18922 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.595649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f27b50e-dfce-4110-ac12-25c3a1a18922 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'ab822811ba61416a90938bb54dd970c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd218c216d9b9498a8170089df8e4b56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.598404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f27b50e-dfce-4110-ac12-25c3a1a18922 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Request method failure captured: Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/flavors/1716211895/os-extra_specs HTTP/1.1 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 66 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPqwiSHyMQUm9r_t9IhyggdBFyFHbxfg0agTawRPQm1fdD6VdMre3giU4OrElCUypEJ2w9-3obfWZQrNgwqK62HMnOQJKPjy9wTQ-8ea4b-H5hnOWjmGpE5BSsDRYEuQuxrFybdJbNFCpxBo1sx6kRXmW1udoW5jzfew-CaHT9qZ9M Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d218c216d9b9498a8170089df8e4b56c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}] Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ab822811ba61416a90938bb54dd970c4 Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '1716211895', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:28:45.598744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 03:28:45.602770 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.605809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f27b50e-dfce-4110-ac12-25c3a1a18922 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.607003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f27b50e-dfce-4110-ac12-25c3a1a18922 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] 10.222.0.30 "POST /compute/v2.1/flavors/1716211895/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020264 Aug 30 03:28:45.612138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 618/1264] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Aug 30 03:28:45 2022] POST /compute/v2.1/flavors/1716211895/os-extra_specs => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:45.620352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34a8c964-9e18-4c0b-a811-310d4f6a2399 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.664832 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34a8c964-9e18-4c0b-a811-310d4f6a2399 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1716211895/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050952 Aug 30 03:28:45.666537 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 619/1265] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Aug 30 03:28:45 2022] POST /compute/v2.1/flavors/1716211895/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:28:45.676983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddcca341-b851-4155-8ef4-48b8599735e8 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.679174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ddcca341-b851-4155-8ef4-48b8599735e8 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'ab822811ba61416a90938bb54dd970c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd218c216d9b9498a8170089df8e4b56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddcca341-b851-4155-8ef4-48b8599735e8 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Request method failure captured: Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPqwiSHyMQUm9r_t9IhyggdBFyFHbxfg0agTawRPQm1fdD6VdMre3giU4OrElCUypEJ2w9-3obfWZQrNgwqK62HMnOQJKPjy9wTQ-8ea4b-H5hnOWjmGpE5BSsDRYEuQuxrFybdJbNFCpxBo1sx6kRXmW1udoW5jzfew-CaHT9qZ9M Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d218c216d9b9498a8170089df8e4b56c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}] Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ab822811ba61416a90938bb54dd970c4 Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '1716211895', 'id': 'hw:numa_nodes'} Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.680969 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddcca341-b851-4155-8ef4-48b8599735e8 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.685605 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddcca341-b851-4155-8ef4-48b8599735e8 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010438 Aug 30 03:28:45.687572 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 620/1266] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:28:45 2022] DELETE /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:28:45.693294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3eda633-ee0d-484b-a7a3-e6352fb2611d tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.721855 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3eda633-ee0d-484b-a7a3-e6352fb2611d tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1716211895/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033079 Aug 30 03:28:45.727890 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee1a63b2-0902-403e-acb1-4a1dd4f35e70 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 204 len: 0 microversion: 2.1 time: 0.171130 Aug 30 03:28:45.727890 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 647/1267] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:28:45 2022] DELETE /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:45.729511 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 621/1268] 10.222.0.30 () {60 vars in 1224 bytes} [Tue Aug 30 03:28:45 2022] POST /compute/v2.1/flavors/1716211895/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:28:45.734799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15a07749-eb25-4f37-86a6-84a2257d9935 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.739442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-15a07749-eb25-4f37-86a6-84a2257d9935 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'ab822811ba61416a90938bb54dd970c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd218c216d9b9498a8170089df8e4b56c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:45.740948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15a07749-eb25-4f37-86a6-84a2257d9935 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Request method failure captured: Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 22 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPqwiSHyMQUm9r_t9IhyggdBFyFHbxfg0agTawRPQm1fdD6VdMre3giU4OrElCUypEJ2w9-3obfWZQrNgwqK62HMnOQJKPjy9wTQ-8ea4b-H5hnOWjmGpE5BSsDRYEuQuxrFybdJbNFCpxBo1sx6kRXmW1udoW5jzfew-CaHT9qZ9M Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d218c216d9b9498a8170089df8e4b56c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d218c216d9b9498a8170089df8e4b56c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d218c216d9b9498a8170089df8e4b56c"}]}] Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d218c216d9b9498a8170089df8e4b56c Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ab822811ba61416a90938bb54dd970c4 Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: {"hw:numa_nodes": "1"} Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '1716211895', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 03:28:45.741611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 03:28:45.746673 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.747649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:45.748605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15a07749-eb25-4f37-86a6-84a2257d9935 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.749984 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-15a07749-eb25-4f37-86a6-84a2257d9935 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009 tempest-FlavorsExtraSpecsNegativeTestJSON-1990687009-project] 10.222.0.30 "PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019014 Aug 30 03:28:45.755234 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 622/1269] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Aug 30 03:28:45 2022] PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:45.758666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.759172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.759612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.760714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f97d5df9-734a-404a-b9b3-d5cbd49a0d28 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.762565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:45.763041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:45.763661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:45.769074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f97d5df9-734a-404a-b9b3-d5cbd49a0d28 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] HTTP exception thrown: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f97d5df9-734a-404a-b9b3-d5cbd49a0d28 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Request method failure captured: Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/flavors/1716211895/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPrhFqLdbhNP4xD5olRXZA5Ik5r0HJOMWNbtVqeRVRzwZeATh40ba9gOjGS6KHQfouZWycizOcZfM37VKC-Fam5j02FujuzeBE1nnUn47enZu85GZKMBDjrAFtF9NhOWKzF8KHxS3OeE3bRmIePGR4DmT0vjyany_Uy_vJukncqEQM Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 0c01f11d243144f3822bc2ad3db014fe Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c01f11d243144f3822bc2ad3db014fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c01f11d243144f3822bc2ad3db014fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c01f11d243144f3822bc2ad3db014fe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c01f11d243144f3822bc2ad3db014fe"}]}] Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 0c01f11d243144f3822bc2ad3db014fe Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0b0cdb5270934298b25641074e6cd0b4 Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: exception: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '1716211895', 'id': 'hw:cpu_thread_policy'} Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. Aug 30 03:28:45.770620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.775172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f97d5df9-734a-404a-b9b3-d5cbd49a0d28 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Returning 404 to user: Flavor 1716211895 has no extra specs with key hw:cpu_thread_policy. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.775172 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f97d5df9-734a-404a-b9b3-d5cbd49a0d28 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1716211895/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015780 Aug 30 03:28:45.776930 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 623/1270] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:28:45 2022] DELETE /compute/v2.1/flavors/1716211895/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:45.782208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23514fee-9844-432d-bafd-f9f3ab5bb3f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.785622 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-23514fee-9844-432d-bafd-f9f3ab5bb3f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23514fee-9844-432d-bafd-f9f3ab5bb3f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Request method failure captured: Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 27 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPrhFqLdbhNP4xD5olRXZA5Ik5r0HJOMWNbtVqeRVRzwZeATh40ba9gOjGS6KHQfouZWycizOcZfM37VKC-Fam5j02FujuzeBE1nnUn47enZu85GZKMBDjrAFtF9NhOWKzF8KHxS3OeE3bRmIePGR4DmT0vjyany_Uy_vJukncqEQM Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 0c01f11d243144f3822bc2ad3db014fe Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c01f11d243144f3822bc2ad3db014fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c01f11d243144f3822bc2ad3db014fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c01f11d243144f3822bc2ad3db014fe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c01f11d243144f3822bc2ad3db014fe"}]}] Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 0c01f11d243144f3822bc2ad3db014fe Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0b0cdb5270934298b25641074e6cd0b4 Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: {"hw:cpu_policy": "shared"} Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: exception: Request body and URI mismatch Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '1716211895', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 30 03:28:45.786974 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.791246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23514fee-9844-432d-bafd-f9f3ab5bb3f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.791246 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23514fee-9844-432d-bafd-f9f3ab5bb3f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010647 Aug 30 03:28:45.793752 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 624/1271] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Aug 30 03:28:45 2022] PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:28:45.797511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:45.799953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-779ac27d-72c5-4db0-9fde-203ba2289fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-779ac27d-72c5-4db0-9fde-203ba2289fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Request method failure captured: Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 49 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPrhFqLdbhNP4xD5olRXZA5Ik5r0HJOMWNbtVqeRVRzwZeATh40ba9gOjGS6KHQfouZWycizOcZfM37VKC-Fam5j02FujuzeBE1nnUn47enZu85GZKMBDjrAFtF9NhOWKzF8KHxS3OeE3bRmIePGR4DmT0vjyany_Uy_vJukncqEQM Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 0c01f11d243144f3822bc2ad3db014fe Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c01f11d243144f3822bc2ad3db014fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c01f11d243144f3822bc2ad3db014fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c01f11d243144f3822bc2ad3db014fe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c01f11d243144f3822bc2ad3db014fe"}]}] Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 0c01f11d243144f3822bc2ad3db014fe Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0b0cdb5270934298b25641074e6cd0b4 Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'flavor_id': '1716211895', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance: Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:28:45.805438 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-779ac27d-72c5-4db0-9fde-203ba2289fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:45.810452 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-779ac27d-72c5-4db0-9fde-203ba2289fbb tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012132 Aug 30 03:28:45.812781 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 625/1272] 10.222.0.30 () {60 vars in 1265 bytes} [Tue Aug 30 03:28:45 2022] PUT /compute/v2.1/flavors/1716211895/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:28:45.819230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d8b30b1-740c-4e0c-94af-b64f249f5ab7 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.841176 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d8b30b1-740c-4e0c-94af-b64f249f5ab7 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1716211895" status: 202 len: 0 microversion: 2.1 time: 0.028510 Aug 30 03:28:45.841959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 626/1273] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:28:45 2022] DELETE /compute/v2.1/flavors/1716211895 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:45.850198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9803cab7-4f94-4389-b3dd-073a1807418f tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:45.876245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9803cab7-4f94-4389-b3dd-073a1807418f tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622 tempest-FlavorsExtraSpecsNegativeTestJSON-1203524622-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029883 Aug 30 03:28:45.877981 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 627/1274] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:28:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:46.008889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:46.020319 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-314d4465-1bf9-4ef0-bd74-cbce68da58a5 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1541 microversion: 2.1 time: 0.290388 Aug 30 03:28:46.021617 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 648/1275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:45 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1541 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:46.252927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:46.255449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:46.265142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:46.265782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:46.274871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.282568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.283131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.284398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.288803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.291783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.295082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.295700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.296270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.299832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.300333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.305677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.461218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:46.480130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:46.498912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:46.507279 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dd02df76-41fa-42a1-a820-2f9bbdc52e61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.244451 Aug 30 03:28:46.509528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 649/1276] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:46 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:28:46.569903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:46.571871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:46.586526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.593102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.594559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.596661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.597218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.597688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.708121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:46.726698 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d16dfca-90d7-4658-8ef5-f333a873344f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1543 microversion: 2.1 time: 0.486306 Aug 30 03:28:46.728143 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 628/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:46 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1543 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:46.760482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:46.763960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:46.775904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.776743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.777388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.778362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.778987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.779627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.877303 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6768dac6-581e-4be7-83df-ea078442823c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1860 microversion: 2.1 time: 0.313330 Aug 30 03:28:46.896170 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 650/1278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:46 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1860 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:46.902143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:46.902759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:46.911933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.912434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.912872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.913612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.914071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.914371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:46.914834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.934131 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02de5c20-241b-4502-80b0-551727f21abe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1276 microversion: 2.1 time: 0.204688 Aug 30 03:28:46.949794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 629/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:46 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:46.955220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:46.963151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:46.978891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.979469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.980070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:46.980905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:46.981688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:46.982253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:47.025815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lazy-loading 'flavor' on Instance uuid 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:28:47.043242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Going to try to live migrate instance to n-h1-854924-5 {{(pid=122168) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:28:47.080716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:47.220000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:47.232648 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-187e1e26-c9ff-4126-924b-40e7bf5b3f00 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.333901 Aug 30 03:28:47.237542 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 651/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:46 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:47.250869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:47.253401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:47.267086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:47.270088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:47.270983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:47.272744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:47.273753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:47.275063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:47.901138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:47.912489 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4468198-9f69-4701-8ccf-b52fb1cb4273 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1541 microversion: 2.1 time: 0.677023 Aug 30 03:28:47.918004 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 652/1281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:47 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1541 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:47.933803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:47.945318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:47.959398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:47.960022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:47.960543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:47.962526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:47.963002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:47.963430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:48.561741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:48.578210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:48.581704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:48.583660 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0204f8b7-2b93-4719-a970-23bbe36a3e3d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.664248 Aug 30 03:28:48.589756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 653/1282] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:47 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:48.595906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:48.596527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:48.598897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:48.605782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:48.606332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:48.606772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:48.607648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:48.608289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:48.608717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.082533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:49.135406 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4de2d424-f58f-4d46-a55f-bed7fe9c49f2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1542 microversion: 2.1 time: 0.544392 Aug 30 03:28:49.136055 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 654/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:48 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1542 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:49.155748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:49.156478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:49.201548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.202262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.202736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.203512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.203982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.204469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.383915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:49.392266 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-291a3b80-0c50-4e06-ad4d-2a9ac03d6a81 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1282 microversion: 2.1 time: 0.246786 Aug 30 03:28:49.393492 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 655/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:49 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:49.398253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:49.398865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:49.405635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.406137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.406579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.407356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.407831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.408282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.811949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:49.831185 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2baee83a-1734-4e04-87f3-943e35e24b1f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.435444 Aug 30 03:28:49.832391 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 656/1285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:49 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:49.842606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6d8f214b-3d75-4672-a5af-c1f91643fae5 req-8b78b7a9-35c3-4aa3-99f7-7327b618b356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79be592-c64a-4cb8-9db1-6890405a2fd8", "name": "network-vif-plugged", "status": "completed", "tag": "0a000025-e0bf-4422-8915-cf072f010da4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:49.856081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6d8f214b-3d75-4672-a5af-c1f91643fae5 req-8b78b7a9-35c3-4aa3-99f7-7327b618b356 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.858035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6d8f214b-3d75-4672-a5af-c1f91643fae5 req-8b78b7a9-35c3-4aa3-99f7-7327b618b356 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.859153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6d8f214b-3d75-4672-a5af-c1f91643fae5 req-8b78b7a9-35c3-4aa3-99f7-7327b618b356 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.877509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6d8f214b-3d75-4672-a5af-c1f91643fae5 req-8b78b7a9-35c3-4aa3-99f7-7327b618b356 service nova] Creating event network-vif-plugged:0a000025-e0bf-4422-8915-cf072f010da4 for instance e79be592-c64a-4cb8-9db1-6890405a2fd8 on n-h1-854924-5 Aug 30 03:28:49.883460 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6d8f214b-3d75-4672-a5af-c1f91643fae5 req-8b78b7a9-35c3-4aa3-99f7-7327b618b356 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049578 Aug 30 03:28:49.884347 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 657/1286] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:49.891474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:49.893828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:49.902908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.903843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.904714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:49.906274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:49.906982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:49.907802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.044626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:50.078611 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f2f42a94-a7a5-4032-8e3b-467430aff38d tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1499 microversion: 2.1 time: 0.188058 Aug 30 03:28:50.102164 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 658/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:49 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1499 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:50.113979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:50.114886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:50.123611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.124347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.124771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.125572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.127493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.127493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.434375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:50.449168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:50.489438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:50.492718 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5386e9b-619a-4e79-8921-9ce5ab4bf8f3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.387263 Aug 30 03:28:50.496038 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 659/1288] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:50 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:50.506791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3736b3fd-1e08-4372-a2ef-464a4aae5dc9 req-9f3e0ef6-fc2b-42a7-b325-fc1a6f9c6ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7197b256-84d8-4e62-92fe-c7046da721a2", "name": "network-vif-deleted", "tag": "00f5adbf-5868-4eb1-9d32-42deaca2158f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:50.523528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3736b3fd-1e08-4372-a2ef-464a4aae5dc9 req-9f3e0ef6-fc2b-42a7-b325-fc1a6f9c6ab4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.524264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3736b3fd-1e08-4372-a2ef-464a4aae5dc9 req-9f3e0ef6-fc2b-42a7-b325-fc1a6f9c6ab4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.525021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3736b3fd-1e08-4372-a2ef-464a4aae5dc9 req-9f3e0ef6-fc2b-42a7-b325-fc1a6f9c6ab4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.556837 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3736b3fd-1e08-4372-a2ef-464a4aae5dc9 req-9f3e0ef6-fc2b-42a7-b325-fc1a6f9c6ab4 service nova] Creating event network-vif-deleted:00f5adbf-5868-4eb1-9d32-42deaca2158f for instance 7197b256-84d8-4e62-92fe-c7046da721a2 on n-h1-854924-5 Aug 30 03:28:50.568172 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3736b3fd-1e08-4372-a2ef-464a4aae5dc9 req-9f3e0ef6-fc2b-42a7-b325-fc1a6f9c6ab4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069587 Aug 30 03:28:50.569104 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 660/1289] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:50.576803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:50.578454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:50.587895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.588691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.589518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.590446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.591249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.591582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.717384 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ad7a5d7c-8d2f-4d95-8828-91b12a135b6d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/action" status: 202 len: 0 microversion: 2.1 time: 3.766079 Aug 30 03:28:50.718648 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 630/1290] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:46 2022] POST /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/action => generated 0 bytes in 3768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:50.724666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:50.725287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:50.741333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.743969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.744433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.745181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:50.745679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:50.746116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:50.953628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:50.971602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-469e2892-faba-4bdd-b2a9-bb485ba8d084 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1542 microversion: 2.1 time: 0.392549 Aug 30 03:28:50.972384 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 661/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:50 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1542 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:50.989874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:50.991419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:51.006660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.010120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.010709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.011692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.013999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.017111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.246734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:51.258045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7033bef3-4514-4722-abbe-b2833de6d396 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 0.537473 Aug 30 03:28:51.259559 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 631/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:50 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:51.268595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:51.269698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:51.279756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.280769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.282024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.283474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.284213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.285002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.533982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:51.542401 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0115df05-f7fe-498e-a1d9-851f8ba2baa1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.568831 Aug 30 03:28:51.558319 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 662/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:50 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:51.566240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:51.567209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:51.580288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.582904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.583791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.585034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.586271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.587112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.647819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:51.651941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:51.652487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:51.653897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lazy-loading 'fault' on Instance uuid 7197b256-84d8-4e62-92fe-c7046da721a2 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:28:52.048209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.061112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.071418 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04572e75-41d5-4f4f-b9c6-64d041546af8 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1322 microversion: 2.1 time: 0.511297 Aug 30 03:28:52.071841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3af11f1-f67a-4525-9caa-445f5be9f2aa tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.810757 Aug 30 03:28:52.073632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 632/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:51 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:52.087688 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 663/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:51 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:52.090406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:52.098965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:52.108274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:52.113779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:52.126818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.128358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.133889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.134829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.135455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.135960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.136983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.137512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.137945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.138651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.139106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.139528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.318546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.327647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.329411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.331364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8aea7a05-c92f-40d6-a658-1b4b544663a4 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.256573 Aug 30 03:28:52.347124 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 633/1296] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:52 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:52.360863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:52.361572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:52.374919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.375703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.376341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.377133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.377643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.378078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.607345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.619015 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b89870d-5e52-4cdb-a2a2-e6617a33234e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1474 microversion: 2.1 time: 0.527054 Aug 30 03:28:52.619623 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 664/1297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:52 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1474 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:52.634633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "name": "network-vif-unplugged", "status": "completed", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:52.658077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.658835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.659281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.694993 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Creating event network-vif-unplugged:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:28:52.702345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Instance 222d5dbb-c43e-4cc4-9381-865142def69d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:28:52.712740 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088119 Aug 30 03:28:52.713379 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 665/1298] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:52.714927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:52.716415 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6dc610c5-dc2f-4bda-852b-9c81c0c99cfd req-bba00f26-5cfd-40e4-878a-9dbe07b00e49 service nova] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001717 Aug 30 03:28:52.717153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 666/1299] 10.222.0.30 () {56 vars in 886 bytes} [Tue Aug 30 03:28:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 03:28:52.724294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:52.725273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:52.734439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.734930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.735618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.736379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:52.736827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:52.737440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:52.763095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:52.846963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:52.857129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f2560e3-086d-401f-a36f-cb1320f4c291 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 0.508362 Aug 30 03:28:52.869741 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 634/1300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:52 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:53.100007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:53.100960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:53.113844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.114350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.114791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.115509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.115967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.116404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.189261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:53.198828 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61bc6dfa-60bb-4361-9fed-f4617e5bccae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.480184 Aug 30 03:28:53.200376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 667/1301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:52 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:53.207274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:53.209876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:53.224611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.225405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.226316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.227215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.227666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.228092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.274785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.275358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.275962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.276428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lazy-loading 'fault' on Instance uuid 7197b256-84d8-4e62-92fe-c7046da721a2 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:28:53.378929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:53.387371 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2f332ad4-0876-4116-b2c3-9e3271c7d241 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1322 microversion: 2.1 time: 0.183699 Aug 30 03:28:53.387965 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 668/1302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:53 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:53.396015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:53.396869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:53.405907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.406601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.409004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.409971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.410591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.411376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.591962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:53.614538 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07c71794-3547-4e66-8772-4128d221c945 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1323 microversion: 2.1 time: 0.524461 Aug 30 03:28:53.615141 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 635/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:53 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1323 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:53.620174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-92b6753d-3d1e-4c2b-bfa8-e03ad1abde34 req-8a93dd4a-6926-45a9-a117-ea6de55abe5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6", "tag": "43775ac9-f1bf-4946-87df-a42b0f232a21"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:53.629199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:53.631908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-92b6753d-3d1e-4c2b-bfa8-e03ad1abde34 req-8a93dd4a-6926-45a9-a117-ea6de55abe5e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.632600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-92b6753d-3d1e-4c2b-bfa8-e03ad1abde34 req-8a93dd4a-6926-45a9-a117-ea6de55abe5e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.633224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-92b6753d-3d1e-4c2b-bfa8-e03ad1abde34 req-8a93dd4a-6926-45a9-a117-ea6de55abe5e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.656507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-92b6753d-3d1e-4c2b-bfa8-e03ad1abde34 req-8a93dd4a-6926-45a9-a117-ea6de55abe5e service nova] Creating event network-changed:43775ac9-f1bf-4946-87df-a42b0f232a21 for instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 on n-h2-854924-5 Aug 30 03:28:53.657891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:53.659820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:53.665176 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-92b6753d-3d1e-4c2b-bfa8-e03ad1abde34 req-8a93dd4a-6926-45a9-a117-ea6de55abe5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048599 Aug 30 03:28:53.665803 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-89ae061d-09de-4bac-9345-eda1241b0a61 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.272793 Aug 30 03:28:53.666354 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 636/1304] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:28:53.666926 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 669/1305] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:53 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:53.687023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:53.687601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:53.710748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.713614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.714399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.716228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.719472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.721663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.879310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:53.880285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:53.888163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.889224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.890794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:53.893806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:53.895129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:53.898114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.259610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:54.281407 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d33f858-7631-4fdb-8a90-aae3fb19db39 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1474 microversion: 2.1 time: 0.613052 Aug 30 03:28:54.283792 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 637/1306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:53 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1474 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:54.290910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:54.291802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:54.301036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.301576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.302008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.302712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.303155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.303576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.463489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:54.474307 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a04e36c3-ee86-42a9-9b18-1d019f5694f1 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 0.599218 Aug 30 03:28:54.475550 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 670/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:53 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:54.480429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:54.482359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:54.508500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.510303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.510865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.511915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.512407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.529308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.587974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.588709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.589411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.590121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lazy-loading 'fault' on Instance uuid 7197b256-84d8-4e62-92fe-c7046da721a2 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:28:54.752744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:54.776926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc24d80f6a294faea61cfb309f438bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d0d07546b84c74a0bb83559f246788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:54.790062 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0cb8ada1-c4ee-49ef-bd8f-123536c16860 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 200 len: 1322 microversion: 2.1 time: 0.313012 Aug 30 03:28:54.790977 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 671/1308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:54 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:54.806983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:54.808742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:54.815995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.816677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.817281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:54.818017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:54.818615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:54.819037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.186244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:55.201806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8103392-8a9e-41d2-98e7-2fe683b6266c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.916057 Aug 30 03:28:55.202704 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 638/1309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:54 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:55.210737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:55.212799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:55.234271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.235382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.236971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.237903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.239058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.239597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.384187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:55.394556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:55.396039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:55.397419 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70f3406e-4717-4653-84c7-e869d0d37480 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.192694 Aug 30 03:28:55.398334 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 639/1310] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:55 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:55.418448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:55.420100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:55.427902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.428440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.429657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.430583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.431037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.431618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.472971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:55.503800 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27483588-ca54-4500-87bb-78cf0b589757 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1520 microversion: 2.1 time: 0.704594 Aug 30 03:28:55.504659 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 672/1311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:54 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1520 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:55.529781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:55.530792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:55.540030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.540784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.541531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.546250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.547088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.548033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.549300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:28:55.782229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:55.797051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b2cea6a-fa69-4d09-8aa5-c67cbeb99753 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1471 microversion: 2.1 time: 0.382472 Aug 30 03:28:55.799593 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 640/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:55 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:55.808071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:55.809252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:55.823795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.824918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.826804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:55.828200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:55.829087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:55.829933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.008521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:56.023142 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aff379e5-ee3f-45f7-b566-c42fa5086f84 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 0.507911 Aug 30 03:28:56.037552 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 673/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:55 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:56.044829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:56.045955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] [instance: 7197b256-84d8-4e62-92fe-c7046da721a2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:56.054265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.054964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.055399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.056096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.056541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.057155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.125514 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] HTTP exception thrown: Instance 7197b256-84d8-4e62-92fe-c7046da721a2 could not be found. Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Request method failure captured: Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 HTTP/1.1 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYO6leb55NjvVT_ZtSM26N1_xxfi5Dexz6Mq0FmV3keLkGQeNuyUMIaXUnMeHHVCUvXI8abJXje0aSGBxM45uxAl535GKIuvRuVqg3GrFkkKVSdm4y-7DhyEKV-0tbv5L1fEcNqxoy1K7QbN4I5p2esLmJOwtgqf1e8vEwRoq1xtpvc Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90d0d07546b84c74a0bb83559f246788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90d0d07546b84c74a0bb83559f246788", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90d0d07546b84c74a0bb83559f246788"}]}] Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 90d0d07546b84c74a0bb83559f246788 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: dc24d80f6a294faea61cfb309f438bdd Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7197b256-84d8-4e62-92fe-c7046da721a2 could not be found. Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7197b256-84d8-4e62-92fe-c7046da721a2'} Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7197b256-84d8-4e62-92fe-c7046da721a2 could not be found. Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7197b256-84d8-4e62-92fe-c7046da721a2 could not be found. Aug 30 03:28:56.127803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7197b256-84d8-4e62-92fe-c7046da721a2 could not be found. Aug 30 03:28:56.132913 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:56.134150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] Returning 404 to user: Instance 7197b256-84d8-4e62-92fe-c7046da721a2 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:56.134989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80a9e77e-52dd-4ae0-bec1-ffbd5f8b6a6b tempest-FloatingIPsAssociationNegativeTestJSON-2119255711 tempest-FloatingIPsAssociationNegativeTestJSON-2119255711-project] 10.222.0.30 "GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2" status: 404 len: 111 microversion: 2.1 time: 0.096102 Aug 30 03:28:56.139456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 674/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:56 2022] GET /compute/v2.1/servers/7197b256-84d8-4e62-92fe-c7046da721a2 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:28:56.150991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:56.151624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:56.170823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.172912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.174266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.175282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.176134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.176784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.203854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:56.215216 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f722e3cf-0194-46cb-925b-bda5c5118ec0 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1520 microversion: 2.1 time: 0.412871 Aug 30 03:28:56.217743 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 641/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:55 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:56.238624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:56.240822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:56.252639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.253402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.254078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.255109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.255799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.256783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.258053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.258233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.260795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.261964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.268443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.269245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.304387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:28:56.310687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for user 948d18cc663b48028570132678823b93 and project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:28:56.561361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ebf57655-658f-450f-bb90-cf3554cfce23 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d/action" status: 202 len: 0 microversion: 2.1 time: 0.416808 Aug 30 03:28:56.567344 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 675/1316] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:56 2022] POST /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:28:56.591625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1239186693"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:56.594497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:56.615861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.616725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.617390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.618313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.618837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.619384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.935534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:56.936285 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7867e6b6-8185-4354-90c1-aa79cf521b2f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8/action" status: 202 len: 0 microversion: 2.1 time: 0.357853 Aug 30 03:28:56.938427 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 676/1317] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:28:56 2022] POST /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:28:56.951477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7a2a904-70f6-42fa-a329-2e02b8296b55 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.716695 Aug 30 03:28:56.956657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:56.958430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:56.967100 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 642/1318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:56 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:28:56.975560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.978126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.978803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:56.979828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:56.982761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:56.983745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:56.984522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:56.984736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:57.003754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:57.007763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:57.012158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:57.013532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:57.014362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:57.015126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:57.294614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:57.305588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:57.319622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:57.321883 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec85f4cf-ae8b-4577-aa6d-48e7eee55e2e tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1365 microversion: 2.47 time: 0.379678 Aug 30 03:28:57.322751 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 677/1319] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:56 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:28:57.351036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f974fc5-442e-4689-939f-14474f4d68f8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '.version_select at 0x7f897b96d9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:57.607308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:57.620612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94b87733-ba55-401c-8994-70a281777758 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1470 microversion: 2.1 time: 0.643141 Aug 30 03:28:57.622386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 643/1320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:56 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:57.641151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:57.641818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:57.667486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:57.668003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:57.670632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:57.672988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:57.673529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:57.676768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:57.684964 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f974fc5-442e-4689-939f-14474f4d68f8 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6" status: 204 len: 0 microversion: 2.1 time: 0.345718 Aug 30 03:28:57.686025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 678/1321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:57 2022] DELETE /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:28:57.696194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7b763ad-9f2d-49dc-bb19-2fdd5641a389 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '.version_select at 0x7f8983d88550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:57.740573 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b7b763ad-9f2d-49dc-bb19-2fdd5641a389 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Image not found. Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7b763ad-9f2d-49dc-bb19-2fdd5641a389 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6 HTTP/1.1 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '153c669a-10e3-42e6-88d2-2cb7e80fb8a6'} Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 153c669a-10e3-42e6-88d2-2cb7e80fb8a6 Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:28:57.750202 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 153c669a-10e3-42e6-88d2-2cb7e80fb8a6 could not be found. Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:28:57.755813 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:28:57.766254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7b763ad-9f2d-49dc-bb19-2fdd5641a389 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:28:57.766254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7b763ad-9f2d-49dc-bb19-2fdd5641a389 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6" status: 404 len: 62 microversion: 2.1 time: 0.073600 Aug 30 03:28:57.766254 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 679/1322] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:28:57 2022] GET /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:28:58.034458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-549321262", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e825369c-6e70-4f2e-ba05-faa2023b62c8"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:28:58.161585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] validate_networks() for [('e825369c-6e70-4f2e-ba05-faa2023b62c8', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:28:58.187745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:58.201954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-092bdc32-47b8-4200-a3d6-15a6da74248c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 0.579241 Aug 30 03:28:58.202797 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 644/1323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:57 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:58.219581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:58.221652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:58.231815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:58.241241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:58.242539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:58.243614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:58.244233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:58.244844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:58.598755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:58.608833 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5f34bc52-ff2a-46d4-866c-a66de078c7ac tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1532 microversion: 2.1 time: 0.404077 Aug 30 03:28:58.609329 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 645/1324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:58 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1532 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:58.624277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:58.624898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:58.651808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:58.652312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:58.652939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:58.656351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:58.657013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:58.657833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:59.609295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:28:59.618554 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6fa6c66-bf17-498f-8f2e-79904c243bc8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 1.008045 Aug 30 03:28:59.621865 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 646/1325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:28:58 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:28:59.637665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:28:59.638467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:28:59.667648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:59.668282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:59.668844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:59.669735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:28:59.670309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:28:59.671028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:28:59.718561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:00.075963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:00.101051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:00.102802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:00.109238 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17f85103-5e5e-4348-9847-65163b5da0b6 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1371 microversion: 2.47 time: 0.483878 Aug 30 03:29:00.110844 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 647/1326] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:28:59 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1371 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:00.139349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:00.141816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:00.175895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:00.182604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:00.183183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:00.184052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:00.184717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:00.185440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:00.343360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:00.343964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:00.344429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:00.345551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:00.346018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:00.360202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:00.360701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:00.361182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:00.361954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:00.362469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:00.362897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:00.407831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Getting quotas for project 187cc2094c9e447bb11ec96cfb435250. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:00.419818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Getting quotas for user 8f22f6d58f11485cb29ad1f529e78103 and project 187cc2094c9e447bb11ec96cfb435250. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:00.482295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Going to run 2 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:29:00.494559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 9f247548-d0aa-45c1-a035-03b59130dcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:00.645399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=9f247548-d0aa-45c1-a035-03b59130dcf9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:00.878859 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-014e0eb9-5974-46cd-9a8e-fb776cacc645 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.104899 Aug 30 03:29:00.880277 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 680/1327] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:29:00.894767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:00.900599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:00.920886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:00.924278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:00.932928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:00.945915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:00.946649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:00.947137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:00.947576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:00.953788 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-83b4ff8f-465e-48cd-bb22-01e35d6480bf tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1470 microversion: 2.1 time: 0.838786 Aug 30 03:29:00.957063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 648/1328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:00 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1470 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:00.996427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:00.998881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:01.030860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:01.031480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:01.039442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:01.040730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:01.047907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:01.048685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.111487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.128129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16388338-5a7b-4412-8d6f-c99c452f92a5 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1538 microversion: 2.1 time: 1.156279 Aug 30 03:29:02.129014 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 649/1329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:00 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1538 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:02.130388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.136370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:02.137405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:02.146279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.147102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.147714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.148638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.149270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.149869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.150163 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de64b09c-5243-47c0-b333-657deb5df2ad tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 1.264003 Aug 30 03:29:02.165368 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 681/1330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:00 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:02.185122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:02.229796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.230804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Searching by: {'deleted': False, 'project_id': '187cc2094c9e447bb11ec96cfb435250'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:29:02.281581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.282388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.283140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.284234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.284983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.285694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.328253 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7d6a3270-8b54-4a43-bb74-a2f595ed3390 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.166379 Aug 30 03:29:02.329495 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 682/1331] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:29:02 2022] GET /compute/v2.1/servers => generated 675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:02.338618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:02.339866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:02.349958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.350806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.351785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.353826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.354653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.355454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.365498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:02.495437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.512676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.518399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.519933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f11ece8-bedc-45a8-b0ff-fe5492a2542f tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1356 microversion: 2.47 time: 0.189113 Aug 30 03:29:02.524042 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 683/1332] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:02 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:02.545739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "name": "network-vif-plugged", "status": "completed", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:02.592354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.592864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.596357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.634709 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] Creating event network-vif-plugged:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:29:02.656979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] Instance 222d5dbb-c43e-4cc4-9381-865142def69d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:29:02.711151 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-709684e2-b261-423a-b689-2ac39415b699 req-2e8f7458-25bb-4559-95ea-235ca5380988 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178144 Aug 30 03:29:02.717155 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 684/1333] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:02.729191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:02.733008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:02.733841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:02.750914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d187237a-098f-4caf-b30b-d6049deeb891 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.620502 Aug 30 03:29:02.758154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.759654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.760289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.761254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:02.763367 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 650/1334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:02 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:02.766235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:02.769617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:02.800774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1d371b0-e9d6-4724-a329-0ae29e2077f4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:02.801439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1d371b0-e9d6-4724-a329-0ae29e2077f4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:03.181807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1d371b0-e9d6-4724-a329-0ae29e2077f4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:03.190943 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1d371b0-e9d6-4724-a329-0ae29e2077f4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1219 microversion: 2.1 time: 0.411449 Aug 30 03:29:03.197699 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 651/1335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:02 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1219 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:03.222883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:03.242327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:03.245913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Searching by: {'deleted': False, 'project_id': '8753912264dd4e9fa111725e10eb63db'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:29:03.264057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:03.270788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:03.272388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:03.276440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:03.279642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:03.280744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:03.663534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:29:03.771545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:03.819266 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a355ee2-3c1c-4227-9ba6-48d5b5ab55ed tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1536 microversion: 2.1 time: 1.097106 Aug 30 03:29:03.846182 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 685/1336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:02 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1536 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:03.860555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:03.862631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:03.891119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:03.892973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:03.893745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:03.895965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:03.898689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:03.899531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:03.935484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:03.954365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:03.962015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:03.962771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:04.002612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:04.004442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:04.065996 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54e8d228-591f-4643-b261-9865f428485a tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.850930 Aug 30 03:29:04.067067 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 652/1337] 10.222.0.30 () {60 vars in 1187 bytes} [Tue Aug 30 03:29:03 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:04.072500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:04.073509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:04.092691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:04.098081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:04.100526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:04.101542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:04.105082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:04.108577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:05.255465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:05.270843 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f339d8e1-e17f-467b-9d6b-496f3726367f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1538 microversion: 2.1 time: 1.421490 Aug 30 03:29:05.273036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 686/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:03 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1538 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:05.287286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:05.288079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:05.294816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:05.311161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:05.311879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:05.312562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:05.313760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:05.315077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:05.317467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:05.323032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:05.336393 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f55136a-afd9-4221-9d62-0a13d9e8103d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 1.268028 Aug 30 03:29:05.344641 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 653/1339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:04 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:05.362953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:05.364007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:05.393854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:05.396225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:05.398925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:05.403881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:05.409464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:05.412837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:05.601261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:05.857491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:05.879873 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-88c0b3f9-2d3f-43ec-ad31-aecb320bef42 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 204 len: 0 microversion: 2.47 time: 0.533401 Aug 30 03:29:05.881482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 654/1340] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:29:05 2022] DELETE /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:29:05.892691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:05.898325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:05.920750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:05.921306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:05.921921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:05.922898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:05.923963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:05.924650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.006418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:06.019146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c433a0b5-0c69-40de-a4ae-4e865ef4ae8f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.743662 Aug 30 03:29:06.022025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 687/1341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:05 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:06.030706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:06.036206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:06.042718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.043493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.044153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.045371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.046146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.046897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.230504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:06.245294 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c57b81b-c978-4829-919d-cd3bb6a307ae tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1277 microversion: 2.1 time: 0.360842 Aug 30 03:29:06.247227 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 655/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:05 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:06.363265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6e34b04f-4870-4618-84a8-0f566ee01778 req-ca2b3d66-70fe-49ff-8bff-eaed0bef8d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6", "name": "network-vif-plugged", "status": "completed", "tag": "43775ac9-f1bf-4946-87df-a42b0f232a21"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:06.379574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6e34b04f-4870-4618-84a8-0f566ee01778 req-ca2b3d66-70fe-49ff-8bff-eaed0bef8d4d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.379574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6e34b04f-4870-4618-84a8-0f566ee01778 req-ca2b3d66-70fe-49ff-8bff-eaed0bef8d4d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.379574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6e34b04f-4870-4618-84a8-0f566ee01778 req-ca2b3d66-70fe-49ff-8bff-eaed0bef8d4d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.419427 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6e34b04f-4870-4618-84a8-0f566ee01778 req-ca2b3d66-70fe-49ff-8bff-eaed0bef8d4d service nova] Creating event network-vif-plugged:43775ac9-f1bf-4946-87df-a42b0f232a21 for instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 on n-h2-854924-5 Aug 30 03:29:06.434443 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6e34b04f-4870-4618-84a8-0f566ee01778 req-ca2b3d66-70fe-49ff-8bff-eaed0bef8d4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164737 Aug 30 03:29:06.435058 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 656/1343] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:06.445104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:06.445939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:06.460866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.461847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.462546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.465639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.468283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.481680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.656757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:06.678326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:06.679982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:06.681237 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4cb2dcf7-1f18-4442-a4be-810b8225abae tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1362 microversion: 2.47 time: 0.245008 Aug 30 03:29:06.682054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 657/1344] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:06 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:06.719656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:06.720859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:06.742610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.743119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.743559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.744283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.744877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.745315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.877307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:06.895895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a11d1f1-154d-491d-91b2-af42bbc4d801 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1536 microversion: 2.1 time: 0.868957 Aug 30 03:29:06.897152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 688/1345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:06 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1536 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:06.909878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:06.910948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:06.926508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.930130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.930973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:06.936889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:06.937798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:06.938479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.281407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:07.298001 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0a0c8b08-e780-43f8-9fe3-db5d58822108 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1520 microversion: 2.1 time: 0.592970 Aug 30 03:29:07.300273 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 658/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:06 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1520 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:07.313941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:07.316672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:07.333940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.334831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.336706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.338323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.341727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.342420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.541216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:07.563937 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b95707f-61fa-452d-ab90-92aa711a736e tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1324 microversion: 2.1 time: 0.665181 Aug 30 03:29:07.565261 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 689/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:06 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1324 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:07.570700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:07.571774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:07.592582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.593201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.593876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.594884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.595241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.595892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.764189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:07.786766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:07.786964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-abd06c5e-6187-49cf-b888-f90652f08c8e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.484350 Aug 30 03:29:07.792433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 659/1348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:07 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:07.806540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:07.808965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:07.814361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae15d520-5cfa-4015-873a-c44f8463c5d4 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1277 microversion: 2.1 time: 0.247346 Aug 30 03:29:07.816186 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 690/1349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:07 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:07.835402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:07.835614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.837656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:07.840096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.840793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.841551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.849545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.850155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.863153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.866213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.868382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.872040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:07.875383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:07.876379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:07.960914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:08.110090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:08.136933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:08.144158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:08.146598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccaa4021-811d-4c28-8bcc-c3d688e20ff3 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1362 microversion: 2.47 time: 0.328681 Aug 30 03:29:08.167043 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 691/1350] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:07 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:08.179489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:08.181698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:08.194103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:08.195183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:08.195826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:08.196786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:08.211255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:08.213555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:08.262521 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8bf79f78-3e06-4a35-b573-e804e57b8f38 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 204 len: 0 microversion: 2.1 time: 0.468724 Aug 30 03:29:08.266924 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 660/1351] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:07 2022] DELETE /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:08.289245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:08.290930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:08.315228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:08.315730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:08.316159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:08.317244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:08.317882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:08.318467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:08.381846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:09.289594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:09.310086 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-acdf3b67-b370-4493-9a18-0d9ddd6bea1a tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1526 microversion: 2.1 time: 1.034915 Aug 30 03:29:09.314384 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 661/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:08 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1526 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:09.321952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:09.323873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:09.347152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.347954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.348626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.349580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.350221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.350809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.404737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:09.463445 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92c72a37-efcd-4c81-8703-a3c4d3652cfe tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1536 microversion: 2.1 time: 1.294732 Aug 30 03:29:09.520587 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 692/1353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:08 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1536 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:09.520587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "name": "network-vif-unplugged", "status": "completed", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:09.535349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.536404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.537016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.584560 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] Creating event network-vif-unplugged:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:29:09.600856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] Instance 222d5dbb-c43e-4cc4-9381-865142def69d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:29:09.632199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-05a306cd-5693-41a3-a2d6-b5a2ced535a4 req-3607a87f-a706-4b41-b6c8-4852a8790ba9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148225 Aug 30 03:29:09.633138 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 693/1354] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:09.652349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:09.653101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:09.678413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.679407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.679859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.680609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.681642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.682229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.733043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:09.746438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a4dd21e5-4f1d-4b8d-8b09-84e20611e090 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 200 len: 1520 microversion: 2.1 time: 0.430603 Aug 30 03:29:09.762922 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 662/1355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:09 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:09.783887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:09.784542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:09.804889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.805428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.809722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.810712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:09.812470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:09.815424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:09.978316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:09.992724 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-806c91b1-ef39-4728-8a7c-6c58e170bd5c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1277 microversion: 2.1 time: 0.228703 Aug 30 03:29:09.993336 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 663/1356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:09 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:10.008194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:10.010344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:10.032946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.033850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.034303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.035040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.038223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.040410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.158324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:10.197892 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9fdea5f5-a203-4da6-98b6-dde9027d93bb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.541569 Aug 30 03:29:10.204097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.205154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.205611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.206059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lazy-loading 'fault' on Instance uuid f75adecf-47ae-4254-91a6-40a3f05c0595 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:10.210540 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 694/1357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:09 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:10.222109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.199"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:10.224716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:10.253177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.256504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.259353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.260526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.261173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.261870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.321766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:10.331035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:10.332483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:10.334393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:29:10.339095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquired lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:29:10.345929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07488d1a-7085-48b5-95ae-d06ab7650e83 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 200 len: 1367 microversion: 2.47 time: 0.339386 Aug 30 03:29:10.347159 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 664/1358] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:09 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:10.365914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:10.366815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:10.393464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.394227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.397449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.398402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:10.399021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:10.400525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:10.442527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:11.703322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:11.717225 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48c0ff6e-e22a-48bd-a59a-a6a7d37c47fc tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1526 microversion: 2.1 time: 1.365165 Aug 30 03:29:11.718562 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 665/1359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:10 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1526 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:11.733427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:11.734569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:11.748916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:11.749691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:11.750486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:11.752204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:11.752858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:11.753543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:12.178250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:12.235578 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7cde866b-56d1-472a-bb47-88dadc32261d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1529 microversion: 2.1 time: 0.514286 Aug 30 03:29:12.242063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 666/1360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:11 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1529 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:12.254693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:12.256018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:12.272628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:12.273483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:12.276658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:12.277607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:12.278423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:12.279043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:12.309714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=7 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:12.896472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:12.921672 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4035e24d-12ea-4a8c-92c2-5c2a28396fd8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.673712 Aug 30 03:29:12.926945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 667/1361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:12 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:12.950427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:12.951826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:12.988499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:12.989529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:12.990197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:12.991230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:12.992265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:12.992858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.346887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:13.357475 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-485e1f2b-77b1-4ae4-8482-eb64e0a5bd3b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.423157 Aug 30 03:29:13.364096 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 668/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:12 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:13.382941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:13.383924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: f75adecf-47ae-4254-91a6-40a3f05c0595] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:13.397854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.398756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.399409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.401153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.402823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.403552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.458542 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] HTTP exception thrown: Instance f75adecf-47ae-4254-91a6-40a3f05c0595 could not be found. Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Request method failure captured: Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 HTTP/1.1 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPPO-dfmLg9uytRfNowhfadBThM65aSQl_pZsOC8BbiI2kbWLDwT2UbGDciz88uZb1MekFL748gfKvLt1a1PbVREZe-g5HHPxUe6SmoEdFo8Y_YfUlMCk08otkaHciCgTvh3JnlP-iWT2wYNc0x0CfssVkKFVnWhSbzAI9lbeS_Al8 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8753912264dd4e9fa111725e10eb63db Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerShowV247Test-1453317179 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8753912264dd4e9fa111725e10eb63db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8753912264dd4e9fa111725e10eb63db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8753912264dd4e9fa111725e10eb63db", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8753912264dd4e9fa111725e10eb63db"}]}] Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerShowV247Test-1453317179 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8753912264dd4e9fa111725e10eb63db Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerShowV247Test-1453317179 Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerShowV247Test-1453317179-project Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: dbc44fe2821a40fbacbd309be08f8dba Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerShowV247Test-1453317179-project Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f75adecf-47ae-4254-91a6-40a3f05c0595 could not be found. Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f75adecf-47ae-4254-91a6-40a3f05c0595'} Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75adecf-47ae-4254-91a6-40a3f05c0595 could not be found. Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75adecf-47ae-4254-91a6-40a3f05c0595 could not be found. Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:13.464166 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75adecf-47ae-4254-91a6-40a3f05c0595 could not be found. Aug 30 03:29:13.469495 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:13.472160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Returning 404 to user: Instance f75adecf-47ae-4254-91a6-40a3f05c0595 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:13.473451 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a96216fc-5ee3-4811-9bd8-247d28501236 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595" status: 404 len: 111 microversion: 2.47 time: 0.107843 Aug 30 03:29:13.478142 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 669/1363] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:13 2022] GET /compute/v2.1/servers/f75adecf-47ae-4254-91a6-40a3f05c0595 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:29:13.485427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79be592-c64a-4cb8-9db1-6890405a2fd8", "name": "network-vif-plugged", "status": "completed", "tag": "0a000025-e0bf-4422-8915-cf072f010da4"}, {"server_uuid": "e79be592-c64a-4cb8-9db1-6890405a2fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "0a000025-e0bf-4422-8915-cf072f010da4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:13.494320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:13.506965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.509589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.510221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.535625 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] Creating event network-vif-plugged:0a000025-e0bf-4422-8915-cf072f010da4 for instance e79be592-c64a-4cb8-9db1-6890405a2fd8 on n-h1-854924-5 Aug 30 03:29:13.536544 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] Creating event network-vif-unplugged:0a000025-e0bf-4422-8915-cf072f010da4 for instance e79be592-c64a-4cb8-9db1-6890405a2fd8 on n-h1-854924-5 Aug 30 03:29:13.543129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-61ae3ed9-d8f3-49a1-8ec0-b7e8e2fb3564 req-47b552d3-7b48-4bea-aaa9-0bda810df2d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.063648 Aug 30 03:29:13.545261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 670/1364] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:13.554197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:13.557016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:13.567812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.568598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.569700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.570863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.571667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.572292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.900333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:13.911330 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7970d48d-a0cf-4cf4-a01e-ac2ff91f87ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1529 microversion: 2.1 time: 0.364356 Aug 30 03:29:13.912708 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 671/1365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:13 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1529 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:13.922457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:13.926232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:13.931331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:13.947338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.948160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.948900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:13.950534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:13.951362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:13.952003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:14.006738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:14.006984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:14.007614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:14.008234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lazy-loading 'fault' on Instance uuid e79be592-c64a-4cb8-9db1-6890405a2fd8 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:14.096952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:14.105744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c072a5a9-f356-42b5-87d2-e13ff84d6241 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 200 len: 1313 microversion: 2.1 time: 0.191630 Aug 30 03:29:14.106517 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 672/1366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:13 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:14.243173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Building network info cache for instance {{(pid=122167) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:29:14.374619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-73ffae15-610e-48df-a07a-f1cee26d999c req-daa1a50d-eaf1-498f-8a94-9c574f6f20f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79be592-c64a-4cb8-9db1-6890405a2fd8", "name": "network-vif-deleted", "tag": "0a000025-e0bf-4422-8915-cf072f010da4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:14.397647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-73ffae15-610e-48df-a07a-f1cee26d999c req-daa1a50d-eaf1-498f-8a94-9c574f6f20f7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:14.398057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-73ffae15-610e-48df-a07a-f1cee26d999c req-daa1a50d-eaf1-498f-8a94-9c574f6f20f7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:14.398693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-73ffae15-610e-48df-a07a-f1cee26d999c req-daa1a50d-eaf1-498f-8a94-9c574f6f20f7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:14.411003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-73ffae15-610e-48df-a07a-f1cee26d999c req-daa1a50d-eaf1-498f-8a94-9c574f6f20f7 service nova] Creating event network-vif-deleted:0a000025-e0bf-4422-8915-cf072f010da4 for instance e79be592-c64a-4cb8-9db1-6890405a2fd8 on n-h1-854924-5 Aug 30 03:29:14.417259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-73ffae15-610e-48df-a07a-f1cee26d999c req-daa1a50d-eaf1-498f-8a94-9c574f6f20f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308775 Aug 30 03:29:14.418110 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 673/1367] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:14.424618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:14.425521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: e8a038b6-2515-451b-8655-3dff1280d29c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:14.437402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:14.441071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:14.441755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:14.444873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:14.445740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:14.447035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:14.482112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: e8a038b6-2515-451b-8655-3dff1280d29c] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:14.614612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0aba9b0b-6e97-486f-b7d8-67803de2b25d tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c" status: 204 len: 0 microversion: 2.47 time: 0.194085 Aug 30 03:29:14.616229 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 674/1368] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:29:14 2022] DELETE /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:29:14.630633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:14.632188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:14.646097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:14.647744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:14.649085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:14.651281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:14.652704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:14.653781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:15.536212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:15.552570 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-35e6ba75-6205-4d28-a113-31f58b529af5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.933458 Aug 30 03:29:15.553308 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 675/1369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:14 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:15.566910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ba9c6c5-ff5e-47e9-aea3-8ac9f8545dbd tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:15.586281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8ba9c6c5-ff5e-47e9-aea3-8ac9f8545dbd tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] HTTP exception thrown: Flavor 676f34d8-293a-43ac-b8a1-4e4163bcc8e4 could not be found. Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ba9c6c5-ff5e-47e9-aea3-8ac9f8545dbd tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Request method failure captured: Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/flavors/676f34d8-293a-43ac-b8a1-4e4163bcc8e4 HTTP/1.1 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYM2f1bjHkRMouQ9lOPcF2dns0bODFHu15sKZwEJjZn1TqpT9Kfw_JTz1D5VFIQLo6Jz5fbQHRTiXSLcF2Zx-3GscMiCVVXBLMrQ0fOI4mQ9xz9Vuth73B_JgUttPcxNmFCWEYN6p9J5OtD45noz7x8A1N9_ONBpPeq1kAWW3DXrreM Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ab7314d94504457abb9dcdc58a4774d7 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MigrationsAdminTest-1768224814 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ab7314d94504457abb9dcdc58a4774d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ab7314d94504457abb9dcdc58a4774d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ab7314d94504457abb9dcdc58a4774d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ab7314d94504457abb9dcdc58a4774d7"}]}] Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MigrationsAdminTest-1768224814 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ab7314d94504457abb9dcdc58a4774d7 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MigrationsAdminTest-1768224814 Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MigrationsAdminTest-1768224814-project-admin Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0132d42b469b433b9ef6a21e0d2c868e Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MigrationsAdminTest-1768224814-project-admin Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: exception: Flavor 676f34d8-293a-43ac-b8a1-4e4163bcc8e4 could not be found. Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '676f34d8-293a-43ac-b8a1-4e4163bcc8e4'} Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 676f34d8-293a-43ac-b8a1-4e4163bcc8e4 could not be found. Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 676f34d8-293a-43ac-b8a1-4e4163bcc8e4 could not be found. Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:15.588712 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 676f34d8-293a-43ac-b8a1-4e4163bcc8e4 could not be found. Aug 30 03:29:15.593599 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:15.595681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ba9c6c5-ff5e-47e9-aea3-8ac9f8545dbd tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Returning 404 to user: Flavor 676f34d8-293a-43ac-b8a1-4e4163bcc8e4 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:15.596715 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8ba9c6c5-ff5e-47e9-aea3-8ac9f8545dbd tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/676f34d8-293a-43ac-b8a1-4e4163bcc8e4" status: 404 len: 109 microversion: 2.1 time: 0.042022 Aug 30 03:29:15.598016 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 676/1370] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:15 2022] DELETE /compute/v2.1/flavors/676f34d8-293a-43ac-b8a1-4e4163bcc8e4 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:16.088100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ebf1ae86-a196-43fe-bfe8-9b2f07299d77 req-50db6f5d-d19b-4ffb-8a7b-e3ae02eaa7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:16.106710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ebf1ae86-a196-43fe-bfe8-9b2f07299d77 req-50db6f5d-d19b-4ffb-8a7b-e3ae02eaa7d4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.107473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ebf1ae86-a196-43fe-bfe8-9b2f07299d77 req-50db6f5d-d19b-4ffb-8a7b-e3ae02eaa7d4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.108109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ebf1ae86-a196-43fe-bfe8-9b2f07299d77 req-50db6f5d-d19b-4ffb-8a7b-e3ae02eaa7d4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.128846 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ebf1ae86-a196-43fe-bfe8-9b2f07299d77 req-50db6f5d-d19b-4ffb-8a7b-e3ae02eaa7d4 service nova] Creating event network-changed:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:29:16.141064 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ebf1ae86-a196-43fe-bfe8-9b2f07299d77 req-50db6f5d-d19b-4ffb-8a7b-e3ae02eaa7d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.540223 Aug 30 03:29:16.143309 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 677/1371] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:16.152825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:16.153743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:16.155170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Updating instance_info_cache with network_info: [{"id": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd", "address": "fa:16:3e:ba:b3:54", "network": {"id": "b65aef74-d72b-4c52-acc3-b7f6f301faa7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1025503046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb047b401d424ae298aa305e270c6bd0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5be08b3-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:29:16.164656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.165451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.166471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.167427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.168724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.169318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.200569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Releasing lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:29:16.202629 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1d57aa3-12ab-487c-81d1-51464e267132 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action" status: 202 len: 0 microversion: 2.1 time: 5.990549 Aug 30 03:29:16.204372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 695/1372] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:10 2022] POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action => generated 0 bytes in 5993 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:29:16.213677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:16.225747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: e8a038b6-2515-451b-8655-3dff1280d29c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:16.247324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.248850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.249698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.251053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.252420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.254172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.339730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:16.350566 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d507f725-310e-4676-b781-f4538c9ae6d2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.205827 Aug 30 03:29:16.361660 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 678/1373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:16 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:16.367088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:16.367088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:16.377102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.377621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.378059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.378763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.379221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.379638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.401140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:16.406763 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 HTTP/1.1 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e79be592-c64a-4cb8-9db1-6890405a2fd8'} Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:16.409793 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e15ca563-c468-4c4d-a718-3715a71c028f tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 404 len: 111 microversion: 2.1 time: 0.056286 Aug 30 03:29:16.414967 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 679/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:16 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:16.421946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:16.424259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc44fe2821a40fbacbd309be08f8dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8753912264dd4e9fa111725e10eb63db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:16.425517 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34c6cee0-c9e8-4238-991f-d5f2f6fb6f90 tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c" status: 200 len: 1363 microversion: 2.47 time: 0.218954 Aug 30 03:29:16.426404 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 696/1375] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:16 2022] GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:16.430634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5e37a6dc-ae41-45de-b3c7-dedad39f582a req-829f3691-5509-4fa5-a166-e443e3d92246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "name": "network-vif-plugged", "status": "completed", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:16.431085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1900286991", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:16.443443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e37a6dc-ae41-45de-b3c7-dedad39f582a req-829f3691-5509-4fa5-a166-e443e3d92246 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.445069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e37a6dc-ae41-45de-b3c7-dedad39f582a req-829f3691-5509-4fa5-a166-e443e3d92246 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.445920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e37a6dc-ae41-45de-b3c7-dedad39f582a req-829f3691-5509-4fa5-a166-e443e3d92246 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.452838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:16.462818 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5e37a6dc-ae41-45de-b3c7-dedad39f582a req-829f3691-5509-4fa5-a166-e443e3d92246 service nova] Creating event network-vif-plugged:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:29:16.470238 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5e37a6dc-ae41-45de-b3c7-dedad39f582a req-829f3691-5509-4fa5-a166-e443e3d92246 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057239 Aug 30 03:29:16.471247 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 680/1376] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:16.526600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:29:16.624134 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e660c21f-b281-4be0-a0c8-b318f1106d11 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.151406 Aug 30 03:29:16.627678 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 681/1377] 10.222.0.30 () {58 vars in 1128 bytes} [Tue Aug 30 03:29:16 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 03:29:16.635603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.199"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:16.638564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:16.653868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.654377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.654824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.655534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:16.656284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:16.656714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:16.702699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "refresh_cache-fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:29:16.717831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquired lock "refresh_cache-fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:29:17.362864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:17.363400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:17.363736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:17.364140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:17.364544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:17.377385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:17.378126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:17.378713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:17.379599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:17.380246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:17.380819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:17.417439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:17.424364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Getting quotas for user 948d18cc663b48028570132678823b93 and project e4d288410e5b49e39dd44da7e2b4d223. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:17.444238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:29:17.446725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:17.504342 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8d0d8ae-ea71-4878-86a5-f1b3c4fbad63 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076784 Aug 30 03:29:17.505871 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 697/1378] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:29:17.510580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-caf964e1-d2d7-41d3-932f-2c75ead3ea44 req-ba68b24d-d522-4535-a364-74c0ad0727f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9343551-a616-475f-877b-ac7e8f1bab14", "tag": "64f437d6-cdc3-4c9b-b0c7-45e026838ec0"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:17.522187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-caf964e1-d2d7-41d3-932f-2c75ead3ea44 req-ba68b24d-d522-4535-a364-74c0ad0727f9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:17.523070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-caf964e1-d2d7-41d3-932f-2c75ead3ea44 req-ba68b24d-d522-4535-a364-74c0ad0727f9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:17.523691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-caf964e1-d2d7-41d3-932f-2c75ead3ea44 req-ba68b24d-d522-4535-a364-74c0ad0727f9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:17.547647 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-caf964e1-d2d7-41d3-932f-2c75ead3ea44 req-ba68b24d-d522-4535-a364-74c0ad0727f9 service nova] Creating event network-changed:64f437d6-cdc3-4c9b-b0c7-45e026838ec0 for instance e9343551-a616-475f-877b-ac7e8f1bab14 on n-h1-854924-5 Aug 30 03:29:17.556613 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-caf964e1-d2d7-41d3-932f-2c75ead3ea44 req-ba68b24d-d522-4535-a364-74c0ad0727f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049387 Aug 30 03:29:17.558038 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 698/1379] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:17.563489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:17.564215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:17.573186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:17.574164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:17.574806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:17.575737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:17.576343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:17.576909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:18.163039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:18.176455 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70cebf7f-302b-4990-b4bc-9e76026fa460 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.616717 Aug 30 03:29:18.177065 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 699/1380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:17 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:18.187912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1260993665", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:18.284522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] validate_networks() for [('9377aef6-2466-46d9-91da-27a2f4acb097', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:29:19.571849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:19.572726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:19.572923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:19.573233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:19.573672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:19.587873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:19.588365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:19.588803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:19.589609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:19.590057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:19.590487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:19.630274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:19.636671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Getting quotas for user 7957bda6b3f3422a94f08752db13ddec and project 8c0c2eb009d0418bba5a2aef20febc55. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:19.668393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:29:19.671457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:19.745876 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-02064947-0a72-4a8d-bf69-637113dd242d tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.564868 Aug 30 03:29:19.753726 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 700/1381] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:29:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:29:19.758892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dcdb136-888f-448e-8429-04e9324ad3ed tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Calling method '.version_select at 0x7f897bd118b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:19.831722 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9dcdb136-888f-448e-8429-04e9324ad3ed tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] HTTP exception thrown: Image not found. Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dcdb136-888f-448e-8429-04e9324ad3ed tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Request method failure captured: Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQLTULgQvVJ1ovq2kanUHMQvqRnks_MYBDSYgCX9_kdSwV_EKD_1EaPukBKxpMIv_adkQ2Ew9Jpxdp8qmfcXZ-LwF3NdFR3SL4mLr9GKg67lFviHiZcSCSxe12wkuKbpjrAFtWvEU-pZaNJjrbCT88BcKm0sI67XvkleQFVK-tDRy0 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd3225b194584dcc851eeb48cdea41d4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}] Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 52c80c080219426db6932b8f921397aa Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '-1'} Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.834098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dcdb136-888f-448e-8429-04e9324ad3ed tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9dcdb136-888f-448e-8429-04e9324ad3ed tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.080640 Aug 30 03:29:19.839287 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 701/1382] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 30 03:29:19 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:19.845886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:19.846425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:19.857737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:19.869573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:19.870079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:19.870972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:19.871667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:19.872367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:20.344538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:20.348082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:20.363540 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4a15d91-3bf1-412a-abc9-b120d11300c6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.519297 Aug 30 03:29:20.379432 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 702/1383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:19 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:20.394156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:20.396148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] [instance: e8a038b6-2515-451b-8655-3dff1280d29c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:20.415335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:20.416651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:20.417323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:20.418301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:20.419380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:20.420290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:20.438977 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] HTTP exception thrown: Instance e8a038b6-2515-451b-8655-3dff1280d29c could not be found. Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Request method failure captured: Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c HTTP/1.1 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYPPO-dfmLg9uytRfNowhfadBThM65aSQl_pZsOC8BbiI2kbWLDwT2UbGDciz88uZb1MekFL748gfKvLt1a1PbVREZe-g5HHPxUe6SmoEdFo8Y_YfUlMCk08otkaHciCgTvh3JnlP-iWT2wYNc0x0CfssVkKFVnWhSbzAI9lbeS_Al8 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8753912264dd4e9fa111725e10eb63db Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerShowV247Test-1453317179 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8753912264dd4e9fa111725e10eb63db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8753912264dd4e9fa111725e10eb63db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8753912264dd4e9fa111725e10eb63db", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8753912264dd4e9fa111725e10eb63db"}]}] Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerShowV247Test-1453317179 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8753912264dd4e9fa111725e10eb63db Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerShowV247Test-1453317179 Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerShowV247Test-1453317179-project Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: dbc44fe2821a40fbacbd309be08f8dba Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerShowV247Test-1453317179-project Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e8a038b6-2515-451b-8655-3dff1280d29c could not be found. Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e8a038b6-2515-451b-8655-3dff1280d29c'} Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a038b6-2515-451b-8655-3dff1280d29c could not be found. Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a038b6-2515-451b-8655-3dff1280d29c could not be found. Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:20.441473 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a038b6-2515-451b-8655-3dff1280d29c could not be found. Aug 30 03:29:20.445838 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:20.447738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] Returning 404 to user: Instance e8a038b6-2515-451b-8655-3dff1280d29c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:20.448835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea43a25f-9a48-4272-a2a3-ff98dad3e82b tempest-ServerShowV247Test-1453317179 tempest-ServerShowV247Test-1453317179-project] 10.222.0.30 "GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c" status: 404 len: 111 microversion: 2.47 time: 0.066035 Aug 30 03:29:20.450589 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 703/1384] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:20 2022] GET /compute/v2.1/servers/e8a038b6-2515-451b-8655-3dff1280d29c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:29:20.472752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:20.473821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:20.487141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:20.489085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:20.489846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:20.491349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:20.492330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:20.492975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:20.753129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:20.762059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7aa2c5f-b940-4d28-9b1f-b25bf23b23ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1271 microversion: 2.1 time: 0.310117 Aug 30 03:29:20.766175 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 704/1385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:20 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:20.790058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6752c1e4-38d1-4924-928b-d7d0f9fe62ff req-ca7ec291-7b62-49b0-a7c3-cb801a452895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f247548-d0aa-45c1-a035-03b59130dcf9", "tag": "97e76ee9-89b8-4e47-bc3a-81ccb5f00d5c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:20.819652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6752c1e4-38d1-4924-928b-d7d0f9fe62ff req-ca7ec291-7b62-49b0-a7c3-cb801a452895 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:20.820439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6752c1e4-38d1-4924-928b-d7d0f9fe62ff req-ca7ec291-7b62-49b0-a7c3-cb801a452895 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:20.821031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6752c1e4-38d1-4924-928b-d7d0f9fe62ff req-ca7ec291-7b62-49b0-a7c3-cb801a452895 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:20.845934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6752c1e4-38d1-4924-928b-d7d0f9fe62ff req-ca7ec291-7b62-49b0-a7c3-cb801a452895 service nova] Creating event network-changed:97e76ee9-89b8-4e47-bc3a-81ccb5f00d5c for instance 9f247548-d0aa-45c1-a035-03b59130dcf9 on n-h1-854924-5 Aug 30 03:29:20.855019 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6752c1e4-38d1-4924-928b-d7d0f9fe62ff req-ca7ec291-7b62-49b0-a7c3-cb801a452895 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075691 Aug 30 03:29:20.855631 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 705/1386] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:21.192189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2050285030", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "790c575c-89a4-4f37-8094-cadf2b9c79fa"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:21.312443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] validate_networks() for [('790c575c-89a4-4f37-8094-cadf2b9c79fa', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:29:21.948774 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.neutron [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] re-assign floating IP 172.25.1.199 from instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc Aug 30 03:29:22.045065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:29:22.717153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:22.717741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:22.718960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:22.719388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:22.720331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:22.743727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:22.744920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:22.746516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:22.747521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:22.749899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:22.750631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:22.786608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:22.792962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for user 90a88f0a70ca48f59450dae1c9165417 and project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:22.810036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:29:22.813202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:22.894126 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec0f7bba-3ed4-481d-8c30-6c4929ea3ddb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.035366 Aug 30 03:29:22.895554 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 706/1387] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:29:22.918187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:22.934476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:22.957602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:22.959378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:22.961870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:22.964416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:22.965182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:22.965857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:23.531801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:23.545670 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd514f86-5c9d-48dd-995f-7edccfa8ef79 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.636245 Aug 30 03:29:23.546279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 707/1388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:22 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:23.581978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:23.588174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:23.604728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:23.605233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:23.605724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:23.606389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:23.606838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:23.619073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:23.804394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:23.814565 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5b14bb1-6c1f-4655-b3f5-bc42a7a7b8a2 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1277 microversion: 2.1 time: 0.250643 Aug 30 03:29:23.829785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 708/1389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:23 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:23.840626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bc606e3-3810-49c2-89a1-b9b2cbb58826 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Calling method '.version_select at 0x7f8983cbd820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:23.875724 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2bc606e3-3810-49c2-89a1-b9b2cbb58826 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] HTTP exception thrown: Image not found. Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bc606e3-3810-49c2-89a1-b9b2cbb58826 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Request method failure captured: Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/6b537e29-f989-48d6-9cbb-1017cede322j HTTP/1.1 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQLTULgQvVJ1ovq2kanUHMQvqRnks_MYBDSYgCX9_kdSwV_EKD_1EaPukBKxpMIv_adkQ2Ew9Jpxdp8qmfcXZ-LwF3NdFR3SL4mLr9GKg67lFviHiZcSCSxe12wkuKbpjrAFtWvEU-pZaNJjrbCT88BcKm0sI67XvkleQFVK-tDRy0 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd3225b194584dcc851eeb48cdea41d4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}] Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 52c80c080219426db6932b8f921397aa Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '6b537e29-f989-48d6-9cbb-1017cede322j'} Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b537e29-f989-48d6-9cbb-1017cede322j to delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b537e29-f989-48d6-9cbb-1017cede322j could not be found. Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:23.878050 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:23.882293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:23.885363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bc606e3-3810-49c2-89a1-b9b2cbb58826 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:23.886786 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2bc606e3-3810-49c2-89a1-b9b2cbb58826 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] 10.222.0.30 "DELETE /compute/v2.1/images/6b537e29-f989-48d6-9cbb-1017cede322j" status: 404 len: 62 microversion: 2.1 time: 0.055900 Aug 30 03:29:23.893982 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 709/1390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:23 2022] DELETE /compute/v2.1/images/6b537e29-f989-48d6-9cbb-1017cede322j => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:23.901440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:23.902086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:23.911871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:23.912856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:23.913562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:23.914636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:23.915370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:23.915985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:24.441492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:24.470972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ffc1a76-7bbb-49e0-938b-96faaaa966ab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.574042 Aug 30 03:29:24.479798 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 710/1391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:23 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:24.507266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:24.510719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:24.534296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:24.540056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:24.540888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:24.542674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:24.544413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:24.549219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:24.950947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Updating instance_info_cache with network_info: [{"id": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd", "address": "fa:16:3e:ba:b3:54", "network": {"id": "b65aef74-d72b-4c52-acc3-b7f6f301faa7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1025503046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb047b401d424ae298aa305e270c6bd0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5be08b3-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:29:24.978321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:29:25.400585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:25.416072 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-706349db-51a9-4ecc-ad2c-da2c11269e8c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1313 microversion: 2.1 time: 0.932841 Aug 30 03:29:25.418248 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 711/1392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:24 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1313 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:25.627518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-564221274", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": "none"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:25.743545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:25.744926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:25.746259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:25.748911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:25.749733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:25.771639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:25.774643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:25.776292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:25.777372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:25.778572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:25.782682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:25.812601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Getting quotas for project 816296d7440240cdbae8ba9162757306. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:25.830033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Getting quotas for user bd790113d61c4d3ebd08ebb7d097caf6 and project 816296d7440240cdbae8ba9162757306. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:25.847969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:29:25.850323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:25.864141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:25.933868 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca0f00b0-889f-4138-a22e-06c09d007f76 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.513559 Aug 30 03:29:25.934443 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 712/1393] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:29:25.950838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:25.951512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:25.968707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:25.969188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:25.969662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:25.970427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:25.970952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:25.971303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:26.170916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:26.183470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:26.185185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:26.187436 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6191dc5e-88c6-4914-a819-ab2a3895c6d6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1332 microversion: 2.25 time: 0.249825 Aug 30 03:29:26.189163 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 713/1394] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:25 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1332 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:26.195023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}, {"name": "network-changed", "server_uuid": "fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6", "tag": "43775ac9-f1bf-4946-87df-a42b0f232a21"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:26.208247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:26.209003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:26.209665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:26.226618 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] Creating event network-changed:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:29:26.227439 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] Creating event network-changed:43775ac9-f1bf-4946-87df-a42b0f232a21 for instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 on n-h2-854924-5 Aug 30 03:29:26.238346 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-80d223e9-c820-47f5-8c94-931c92bbddc0 req-b3c627c0-e29e-4473-9289-7d3e617c8625 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046451 Aug 30 03:29:26.239869 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 714/1395] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:26.247356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-37cba437-9b75-4988-9927-8fee7f62f0f6 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Calling method '.version_select at 0x7f8983c9b430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:26.273879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-37cba437-9b75-4988-9927-8fee7f62f0f6 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] HTTP exception thrown: Image not found. Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-37cba437-9b75-4988-9927-8fee7f62f0f6 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Request method failure captured: Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/f6b756a1-fb96-415c-815c-12cef2e7cb4d1 HTTP/1.1 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQLTULgQvVJ1ovq2kanUHMQvqRnks_MYBDSYgCX9_kdSwV_EKD_1EaPukBKxpMIv_adkQ2Ew9Jpxdp8qmfcXZ-LwF3NdFR3SL4mLr9GKg67lFviHiZcSCSxe12wkuKbpjrAFtWvEU-pZaNJjrbCT88BcKm0sI67XvkleQFVK-tDRy0 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd3225b194584dcc851eeb48cdea41d4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}] Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 52c80c080219426db6932b8f921397aa Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f6b756a1-fb96-415c-815c-12cef2e7cb4d1'} Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f6b756a1-fb96-415c-815c-12cef2e7cb4d1 to delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6b756a1-fb96-415c-815c-12cef2e7cb4d1 could not be found. Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:26.276677 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:26.281581 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:26.287001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-37cba437-9b75-4988-9927-8fee7f62f0f6 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:26.288670 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-37cba437-9b75-4988-9927-8fee7f62f0f6 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] 10.222.0.30 "DELETE /compute/v2.1/images/f6b756a1-fb96-415c-815c-12cef2e7cb4d1" status: 404 len: 62 microversion: 2.1 time: 0.046997 Aug 30 03:29:26.290148 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 715/1396] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:26 2022] DELETE /compute/v2.1/images/f6b756a1-fb96-415c-815c-12cef2e7cb4d1 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:26.298491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-39eb69f7-f4cc-4acd-8010-71e37095d97b req-fba0f641-efbb-43d9-8c19-582aff54563d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ab56e1-fa28-4a76-8f7c-f21ad1acd129", "name": "network-vif-unplugged", "status": "completed", "tag": "e30cbadc-95e2-4ab6-9a62-fbf45745804c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:26.322558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39eb69f7-f4cc-4acd-8010-71e37095d97b req-fba0f641-efbb-43d9-8c19-582aff54563d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:26.322708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39eb69f7-f4cc-4acd-8010-71e37095d97b req-fba0f641-efbb-43d9-8c19-582aff54563d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:26.323502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39eb69f7-f4cc-4acd-8010-71e37095d97b req-fba0f641-efbb-43d9-8c19-582aff54563d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:26.340336 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-39eb69f7-f4cc-4acd-8010-71e37095d97b req-fba0f641-efbb-43d9-8c19-582aff54563d service nova] Creating event network-vif-unplugged:e30cbadc-95e2-4ab6-9a62-fbf45745804c for instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 on n-h2-854924-5 Aug 30 03:29:26.345998 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-39eb69f7-f4cc-4acd-8010-71e37095d97b req-fba0f641-efbb-43d9-8c19-582aff54563d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054331 Aug 30 03:29:26.347164 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 716/1397] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:26.355320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:26.356269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:26.367424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:26.368224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:26.368933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:26.370251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:26.370883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:26.371607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:26.646408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:26.777617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:26.797762 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-839ce599-91bc-42bb-9446-d243d1b7803d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.444318 Aug 30 03:29:26.799714 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 717/1398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:26 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:26.806932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:26.807813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:26.815464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:26.816057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:26.816562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:26.817494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:26.817948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:26.818370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.018350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Updating instance_info_cache with network_info: [{"id": "43775ac9-f1bf-4946-87df-a42b0f232a21", "address": "fa:16:3e:d7:12:02", "network": {"id": "b65aef74-d72b-4c52-acc3-b7f6f301faa7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1025503046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb047b401d424ae298aa305e270c6bd0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap43775ac9-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:29:27.033410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Releasing lock "refresh_cache-fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:29:27.034866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68319b7a-bb39-4ce9-a0ba-fb64f5dc2a5d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6/action" status: 202 len: 0 microversion: 2.1 time: 10.405491 Aug 30 03:29:27.039755 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 682/1399] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:16 2022] POST /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6/action => generated 0 bytes in 10410 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:29:27.054153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:27.054891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:27.062921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.064059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.064829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.065904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.066600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.067251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.167192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:27.177021 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b60d5889-124b-4c33-9390-5bd1a82d3ad1 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.374888 Aug 30 03:29:27.195344 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 718/1400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:26 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:27.201467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:27.202078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:27.209900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.211575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.211575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.212351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.212351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.212780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.378549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:27.384855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:27.391220 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-00eab2b6-2b6a-4cc8-9855-87668caf7269 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.349871 Aug 30 03:29:27.406337 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 683/1401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:27 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:27.412742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6adc2f2-ac34-4a57-b1ad-8ddc15818717 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Calling method '.version_select at 0x7f897be11040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:27.426813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:27.428618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:27.430015 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5f2bca0-9ae9-4ffd-95dc-cae50a345f05 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1329 microversion: 2.54 time: 0.233594 Aug 30 03:29:27.432827 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 719/1402] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:27 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1329 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:27.437406 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e6adc2f2-ac34-4a57-b1ad-8ddc15818717 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] HTTP exception thrown: Image not found. Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6adc2f2-ac34-4a57-b1ad-8ddc15818717 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Request method failure captured: Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/images/tempest-invalid-73994752 HTTP/1.1 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYQLTULgQvVJ1ovq2kanUHMQvqRnks_MYBDSYgCX9_kdSwV_EKD_1EaPukBKxpMIv_adkQ2Ew9Jpxdp8qmfcXZ-LwF3NdFR3SL4mLr9GKg67lFviHiZcSCSxe12wkuKbpjrAFtWvEU-pZaNJjrbCT88BcKm0sI67XvkleQFVK-tDRy0 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd3225b194584dcc851eeb48cdea41d4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}] Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 52c80c080219426db6932b8f921397aa Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'tempest-invalid-73994752'} Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-73994752 to delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-73994752 could not be found. Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.441193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6adc2f2-ac34-4a57-b1ad-8ddc15818717 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e6adc2f2-ac34-4a57-b1ad-8ddc15818717 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-73994752" status: 404 len: 62 microversion: 2.1 time: 0.035009 Aug 30 03:29:27.445916 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 684/1403] 10.222.0.30 () {58 vars in 1200 bytes} [Tue Aug 30 03:29:27 2022] DELETE /compute/v2.1/images/tempest-invalid-73994752 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:27.447855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.199"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:27.453163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:27.455533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:27.461889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.462374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.462803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.463493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.464103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.464671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.859323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:27.875256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.876895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.877379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.878111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.879060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.879513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.912351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:27.925099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3efbb44-16e3-4000-a568-1ea1a99094d9 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1313 microversion: 2.1 time: 0.490351 Aug 30 03:29:27.929130 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 720/1404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:27 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:27.941105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:27.943983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:27.954167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.955413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.956048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:27.956932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:27.957573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:27.958185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:28.600598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:28.609519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:28.611894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:28.613137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93957f52-c938-4454-9d2f-a553688037c9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1362 microversion: 2.25 time: 0.682185 Aug 30 03:29:28.613947 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 721/1405] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:27 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:28.620944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c0f9641-56e1-431e-887e-a21a9bde6263 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Calling method '.version_select at 0x7f8983cf40d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:28.646461 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2c0f9641-56e1-431e-887e-a21a9bde6263 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] HTTP exception thrown: Image not found. Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c0f9641-56e1-431e-887e-a21a9bde6263 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Request method failure captured: Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/5a19ed90-0cd1-4131-bf21-d96f870b7c10 HTTP/1.1 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQLTULgQvVJ1ovq2kanUHMQvqRnks_MYBDSYgCX9_kdSwV_EKD_1EaPukBKxpMIv_adkQ2Ew9Jpxdp8qmfcXZ-LwF3NdFR3SL4mLr9GKg67lFviHiZcSCSxe12wkuKbpjrAFtWvEU-pZaNJjrbCT88BcKm0sI67XvkleQFVK-tDRy0 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd3225b194584dcc851eeb48cdea41d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd3225b194584dcc851eeb48cdea41d4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd3225b194584dcc851eeb48cdea41d4"}]}] Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: bd3225b194584dcc851eeb48cdea41d4 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-686550215 Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 52c80c080219426db6932b8f921397aa Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-686550215-project Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '5a19ed90-0cd1-4131-bf21-d96f870b7c10'} Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a19ed90-0cd1-4131-bf21-d96f870b7c10 to delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a19ed90-0cd1-4131-bf21-d96f870b7c10 could not be found. Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:28.648804 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c0f9641-56e1-431e-887e-a21a9bde6263 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c0f9641-56e1-431e-887e-a21a9bde6263 tempest-ImagesDeleteNegativeTestJSON-686550215 tempest-ImagesDeleteNegativeTestJSON-686550215-project] 10.222.0.30 "DELETE /compute/v2.1/images/5a19ed90-0cd1-4131-bf21-d96f870b7c10" status: 404 len: 62 microversion: 2.1 time: 0.034476 Aug 30 03:29:28.654917 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 722/1406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:28 2022] DELETE /compute/v2.1/images/5a19ed90-0cd1-4131-bf21-d96f870b7c10 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:28.668154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:28.669559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:28.693947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:28.694457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:28.694897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:28.695611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:28.696078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:28.696508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:28.700489 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] HTTP exception thrown: Floating IP 172.25.1.199 is not associated with instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc. Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Request method failure captured: Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action HTTP/1.1 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 49 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPLlrKNfA6E5n2_obootapjMwkEGwdEh0W-wshHyZN6LAoVD1TfOK_w2v67IWud2PSnOx0oo5MwWTjRLw81RfwLpGUMo0N8pnilQC7ZRrcXcvNJZgSYoGj-2iCE_wdmUmfhZ62rR8EkzTimvfbRuMUf_i12dFN4eTXyItG7GD7yX5c Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb047b401d424ae298aa305e270c6bd0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}] Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25d8eb58d3ba4c68b12408b713484d49 Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: {"removeFloatingIp": {"address": "172.25.1.199"}} Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: exception: Floating IP 172.25.1.199 is not associated with instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc. Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c22cc48a-84e5-4d92-8772-fa4d1cd82ebc', 'body': {'removeFloatingIp': {'address': '172.25.1.199'}}} Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.199 is not associated with instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc. Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.199 is not associated with instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc. Aug 30 03:29:28.703516 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:28.709779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Returning 409 to user: Floating IP 172.25.1.199 is not associated with instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:28.710854 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb425d08-a4ad-41a3-8772-5466b0da368d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action" status: 409 len: 146 microversion: 2.1 time: 1.266850 Aug 30 03:29:28.711628 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 685/1407] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:27 2022] POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action => generated 146 bytes in 1268 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:28.716604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d06e7f76-2373-4a29-9e6c-30b78116d924 req-61ba6592-336a-4420-bcd7-f127865d8345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9343551-a616-475f-877b-ac7e8f1bab14", "name": "network-vif-plugged", "status": "completed", "tag": "64f437d6-cdc3-4c9b-b0c7-45e026838ec0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:28.743577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d06e7f76-2373-4a29-9e6c-30b78116d924 req-61ba6592-336a-4420-bcd7-f127865d8345 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:28.744408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d06e7f76-2373-4a29-9e6c-30b78116d924 req-61ba6592-336a-4420-bcd7-f127865d8345 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:28.744837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d06e7f76-2373-4a29-9e6c-30b78116d924 req-61ba6592-336a-4420-bcd7-f127865d8345 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:28.756982 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d06e7f76-2373-4a29-9e6c-30b78116d924 req-61ba6592-336a-4420-bcd7-f127865d8345 service nova] Creating event network-vif-plugged:64f437d6-cdc3-4c9b-b0c7-45e026838ec0 for instance e9343551-a616-475f-877b-ac7e8f1bab14 on n-h1-854924-5 Aug 30 03:29:28.771895 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d06e7f76-2373-4a29-9e6c-30b78116d924 req-61ba6592-336a-4420-bcd7-f127865d8345 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058676 Aug 30 03:29:28.777318 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 686/1408] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:28.786375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:28.786994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:28.793364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:28.793758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:28.794191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:28.794883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:28.795321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:28.795925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:28.949778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:28.960021 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1c8a8b3-d7ac-4bc6-a7aa-74a63d61fdfe tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.307460 Aug 30 03:29:28.976265 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 723/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:28 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:28.981294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ab56e1-fa28-4a76-8f7c-f21ad1acd129", "tag": "e30cbadc-95e2-4ab6-9a62-fbf45745804c"}, {"name": "network-changed", "server_uuid": "8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81", "tag": "bccaf1c7-13e7-4503-bce9-4f0db1080a87"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:28.995098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:28.995954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:28.996622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.013394 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] Creating event network-changed:e30cbadc-95e2-4ab6-9a62-fbf45745804c for instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 on n-h2-854924-5 Aug 30 03:29:29.013995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] Creating event network-changed:bccaf1c7-13e7-4503-bce9-4f0db1080a87 for instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 on n-h1-854924-5 Aug 30 03:29:29.023998 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-badc8f5e-bbf3-4bd2-84e9-42cb5f23cdf9 req-eb0186f5-6225-43cc-bc56-619afdcd8213 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046241 Aug 30 03:29:29.025301 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 724/1410] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:29.033290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:29.034677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:29.043636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:29.044508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.045461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.046146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.047073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.048349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.049409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.057750 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dde3d2ee-e305-4510-a9e4-d3915664daff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.276744 Aug 30 03:29:29.058624 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 687/1411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:28 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:29.063945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:29.065433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:29.074285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.075794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.077204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.078012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.078489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.078923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.206782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:29.216553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:29.218520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:29.220596 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0550b9f-47dc-447f-9331-ba32aec5bf58 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1335 microversion: 2.54 time: 0.160086 Aug 30 03:29:29.222046 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 688/1412] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:29 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:29.226906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fece5e3e-f124-462d-b6e7-8cf266c56cd6 req-153f5e10-e013-408f-b964-d4f99f7e2e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:29.236925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fece5e3e-f124-462d-b6e7-8cf266c56cd6 req-153f5e10-e013-408f-b964-d4f99f7e2e94 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.237814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fece5e3e-f124-462d-b6e7-8cf266c56cd6 req-153f5e10-e013-408f-b964-d4f99f7e2e94 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.238439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fece5e3e-f124-462d-b6e7-8cf266c56cd6 req-153f5e10-e013-408f-b964-d4f99f7e2e94 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.251114 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fece5e3e-f124-462d-b6e7-8cf266c56cd6 req-153f5e10-e013-408f-b964-d4f99f7e2e94 service nova] Creating event network-changed:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h2-854924-5 Aug 30 03:29:29.256213 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fece5e3e-f124-462d-b6e7-8cf266c56cd6 req-153f5e10-e013-408f-b964-d4f99f7e2e94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Aug 30 03:29:29.256809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 689/1413] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:29.262205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.199"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:29.352241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:29.361920 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61a0a6f2-9f3c-4ad9-b33c-ff14ac1a0aaf tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.335062 Aug 30 03:29:29.362881 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 725/1414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:29 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:29.367458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:29.368069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:29.374506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.375004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.375447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.377010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.377521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.377957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.497616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:29.505984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.506710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.507329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.508360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.509120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.509755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.650400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:29.679459 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df212394-43a1-4fbd-bdf5-189f46d7d4a6 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1313 microversion: 2.1 time: 0.315412 Aug 30 03:29:29.686468 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 726/1415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:29 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:29.692472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:29.709041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:29.726935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.729925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.730489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.731303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:29.733450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:29.733998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:29.742254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:29.938079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "refresh_cache-fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:29:29.939281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquired lock "refresh_cache-fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:29:30.047264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.056740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.058233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.059500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af71bc9b-e15d-4e55-a9f8-6a780caaeb6a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1362 microversion: 2.25 time: 0.371399 Aug 30 03:29:30.073446 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 727/1416] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:29 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:30.073446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:30.073446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:30.074472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.075151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.075903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.076953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.077622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.078224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.434708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.445726 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5b86282d-f148-4d3c-885e-10a35c6d7448 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.383869 Aug 30 03:29:30.450032 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 728/1417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:30 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:30.455149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:30.455951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:30.462808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.463758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.464093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.464790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.465249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.465721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.762748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.778495 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5fca7785-22b4-4f11-a7fa-1ac91f42078b tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.327168 Aug 30 03:29:30.793577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 729/1418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:30 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:30.799814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:30.800699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:30.807983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.808657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.809265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.810137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.810964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.811615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.905745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.917820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.919279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:30.920310 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-443ecdad-d758-4ab3-908e-a9bfdf72f895 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1335 microversion: 2.54 time: 0.125433 Aug 30 03:29:30.921065 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 730/1419] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:30 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:30.944464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:30.945528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:30.952534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.953252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.953698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:30.955252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:30.955658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:30.956416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:31.133125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:29:31.200745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:31.214369 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3066e2b3-e92a-4479-a47d-44af47548c29 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.278978 Aug 30 03:29:31.215252 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 731/1420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:30 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:31.221887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:31.223211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:31.231977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:31.233449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:31.234137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:31.235143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:31.236773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:31.237515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:31.793796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:31.809766 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84c69a8a-19ca-4f53-8579-bb7eff065fc5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1313 microversion: 2.1 time: 0.593226 Aug 30 03:29:31.810544 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 732/1421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:31 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:31.829760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-51288fb0-2578-44a1-84a2-1728b7479c13 req-a0d708be-c27e-4640-a7cc-0224cb46a096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f247548-d0aa-45c1-a035-03b59130dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "97e76ee9-89b8-4e47-bc3a-81ccb5f00d5c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:31.840812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-51288fb0-2578-44a1-84a2-1728b7479c13 req-a0d708be-c27e-4640-a7cc-0224cb46a096 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:31.841628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-51288fb0-2578-44a1-84a2-1728b7479c13 req-a0d708be-c27e-4640-a7cc-0224cb46a096 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:31.842690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-51288fb0-2578-44a1-84a2-1728b7479c13 req-a0d708be-c27e-4640-a7cc-0224cb46a096 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:31.856927 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-51288fb0-2578-44a1-84a2-1728b7479c13 req-a0d708be-c27e-4640-a7cc-0224cb46a096 service nova] Creating event network-vif-plugged:97e76ee9-89b8-4e47-bc3a-81ccb5f00d5c for instance 9f247548-d0aa-45c1-a035-03b59130dcf9 on n-h1-854924-5 Aug 30 03:29:31.863793 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-51288fb0-2578-44a1-84a2-1728b7479c13 req-a0d708be-c27e-4640-a7cc-0224cb46a096 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039428 Aug 30 03:29:31.864912 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 733/1422] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:31.871748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:31.872630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:31.880646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:31.881144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:31.881634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:31.882358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:31.882814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:31.883515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.498894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:32.512901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:32.514396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:32.515570 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b5c9e5fd-555c-476b-a687-edf52c016744 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1362 microversion: 2.25 time: 0.649188 Aug 30 03:29:32.518754 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 734/1423] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:31 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:32.533525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e24b12d-79a3-4fdd-9fc8-30791e62f08a", "tag": "263f9f5b-1548-443a-a9b6-b190ef1ff56d"}, {"name": "network-changed", "server_uuid": "fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6", "tag": "43775ac9-f1bf-4946-87df-a42b0f232a21"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:32.554896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.555365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.555794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.572313 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] Creating event network-changed:263f9f5b-1548-443a-a9b6-b190ef1ff56d for instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a on n-h1-854924-5 Aug 30 03:29:32.572821 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] Creating event network-changed:43775ac9-f1bf-4946-87df-a42b0f232a21 for instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 on n-h2-854924-5 Aug 30 03:29:32.584830 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b62b0c25-88e7-4e2a-8d5e-c328d44fb9a7 req-07f6d2b6-cddc-40a4-9aeb-438473581144 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064351 Aug 30 03:29:32.585993 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 735/1424] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:32.592449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:32.593229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:32.600497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.601156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.601820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.602536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.602991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.603410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.804998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Updating instance_info_cache with network_info: [{"id": "43775ac9-f1bf-4946-87df-a42b0f232a21", "address": "fa:16:3e:d7:12:02", "network": {"id": "b65aef74-d72b-4c52-acc3-b7f6f301faa7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1025503046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb047b401d424ae298aa305e270c6bd0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap43775ac9-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:29:32.821115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Releasing lock "refresh_cache-fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:29:32.823240 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-010c836e-45ae-4d3a-84a9-22a652ef9e5c tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6/action" status: 202 len: 0 microversion: 2.1 time: 3.564576 Aug 30 03:29:32.824740 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 690/1425] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:29 2022] POST /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6/action => generated 0 bytes in 3567 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:29:32.832274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:32.833364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:32.842350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.843439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.844079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.845568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.846190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.846833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.870092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:32.880218 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-39c52822-285d-4671-bb04-bc43ddd194e7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1319 microversion: 2.1 time: 0.292540 Aug 30 03:29:32.898208 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 736/1426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:32 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:32.919865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:32.921046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:32.934982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.935771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.936412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:32.937530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:32.938147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:32.939077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.163546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:33.178177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:33.180765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:33.182541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93c0b116-f63f-4d21-a2b4-3e184193d064 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1356 microversion: 2.54 time: 0.282913 Aug 30 03:29:33.183428 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 737/1427] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:32 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1356 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:33.227786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:33.228887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:33.238980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.239749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.240618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.241959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.242865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.243727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.326258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:33.336285 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f8d41727-a869-4a50-a582-2e78786d4817 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.509947 Aug 30 03:29:33.350717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 691/1428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:32 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:33.357091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:33.357744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:33.367472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.367987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.368417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.369315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.374300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.374869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.513471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:33.531262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0b19074-3889-4aa1-9725-5d27e033b942 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.323781 Aug 30 03:29:33.537600 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 738/1429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:33 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:33.556691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:33.557376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:33.565230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.566031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.566426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.567243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.568037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.568676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.603586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:33.689745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:33.723057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-20e7a5be-faf7-4476-ba8a-9e9d20ebee73 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1313 microversion: 2.1 time: 0.371439 Aug 30 03:29:33.727695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 692/1430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:33 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:33.750355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-521bcc95-e490-4848-82b1-048864ec1e4b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Action: 'create', calling method: .version_select at 0x7f897b7b0940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1747310173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmPZHTjOEE+ASw8OD+Li7kKJ1l7Z4xRBW0u2ulBQx5m98BskWoNJ5VHydVM47VwA6QJ24plrnD/M0Ai42BvCkO1BfNfyHCPMGGB/R3aqSJGLhu97LTvSiybyjB9kenZBg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:33.771028 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7c7b6b7-e170-4d9c-9b0a-31222a757d3d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 204 len: 0 microversion: 2.1 time: 0.231477 Aug 30 03:29:33.771741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-521bcc95-e490-4848-82b1-048864ec1e4b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Getting quotas for project 816296d7440240cdbae8ba9162757306. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:33.781774 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 739/1431] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:33 2022] DELETE /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:33.781774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:33.781774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:33.789300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-521bcc95-e490-4848-82b1-048864ec1e4b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Getting quotas for user bd790113d61c4d3ebd08ebb7d097caf6 and project 816296d7440240cdbae8ba9162757306. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:33.789582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.789903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.790337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.791131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.791474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.791891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.825240 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-521bcc95-e490-4848-82b1-048864ec1e4b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.093360 Aug 30 03:29:33.826216 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 693/1432] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:29:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:29:33.831431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.199"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:33.849604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:33.858037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.858535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.858975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.859683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:33.860150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:33.861109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:33.897916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:29:33.898716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquired lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:29:34.154828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:34.169769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:34.172696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:34.175555 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd524f3b-55e1-4bef-bb06-0bbf250879cc tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1362 microversion: 2.25 time: 0.400498 Aug 30 03:29:34.176662 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 740/1433] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:33 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:34.188154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1747310173", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:34.193573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:34.201322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.202093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.202804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.204287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.205777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.206351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.304084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:34.304410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:34.304882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:34.305293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:34.305734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:34.396298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:34.419948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:34.427956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.428800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.429683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.430650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.431455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.432115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.464177 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ef03f29-09ba-4eee-a311-62c472e11341 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "POST /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab/action" status: 202 len: 1139 microversion: 2.54 time: 0.286351 Aug 30 03:29:34.465435 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 741/1434] 10.222.0.30 () {62 vars in 1320 bytes} [Tue Aug 30 03:29:34 2022] POST /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab/action => generated 1139 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 03:29:34.486351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-720a4838-33ae-4090-8947-e9e35b6de6b6 req-ef5fad2d-7a2d-449e-8dcc-4f35d280232b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "name": "network-vif-plugged", "status": "completed", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:34.497830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-720a4838-33ae-4090-8947-e9e35b6de6b6 req-ef5fad2d-7a2d-449e-8dcc-4f35d280232b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.498703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-720a4838-33ae-4090-8947-e9e35b6de6b6 req-ef5fad2d-7a2d-449e-8dcc-4f35d280232b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.499515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-720a4838-33ae-4090-8947-e9e35b6de6b6 req-ef5fad2d-7a2d-449e-8dcc-4f35d280232b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.513511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-720a4838-33ae-4090-8947-e9e35b6de6b6 req-ef5fad2d-7a2d-449e-8dcc-4f35d280232b service nova] Creating event network-vif-plugged:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h2-854924-5 Aug 30 03:29:34.520176 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-720a4838-33ae-4090-8947-e9e35b6de6b6 req-ef5fad2d-7a2d-449e-8dcc-4f35d280232b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053323 Aug 30 03:29:34.521847 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 742/1435] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:34.527375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:34.528175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:34.536918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.537510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.537954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.538723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.539937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.540383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.960405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:34.969573 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e94bc33b-c651-45bd-ac98-7c34ea7fe1e3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 200 len: 1507 microversion: 2.1 time: 0.446359 Aug 30 03:29:34.971166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 743/1436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:34 2022] GET /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:34.976392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:34.977276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:34.985086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.985905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.986535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:34.987532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:34.988187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:34.988774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:35.666980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:35.676291 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fff61a18-e9ec-432e-b69f-63d591192d07 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.703684 Aug 30 03:29:35.676959 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 744/1437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:34 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:35.681490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:35.682161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:35.688231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:35.688810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:35.689358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:35.690613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:35.690613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:35.691537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:35.798762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:35.813667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:35.822797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:35.824320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:35.825539 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-02e1dab4-c22d-4623-905c-9258b34e4e16 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.147540 Aug 30 03:29:35.826113 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 745/1438] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:35 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:35.831397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:35.832010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:35.838120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:35.838837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:35.839437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:35.840314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:35.840929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:35.841546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:35.842175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=24 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:36.275348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:36.284736 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6f0f14cb-aae2-43cc-9903-11a8e8fc0db9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.457337 Aug 30 03:29:36.285823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 746/1439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:35 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:36.290909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:36.291805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:36.298356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:36.299296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:36.300049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:36.301082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:36.301690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:36.302229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:36.798662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:36.810146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-56c70c21-490d-41f9-905f-c591bbff0483 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1313 microversion: 2.1 time: 0.522346 Aug 30 03:29:36.811725 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 747/1440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:36 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:36.820925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:36.846661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 9f247548-d0aa-45c1-a035-03b59130dcf9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:36.857754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:36.858844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:36.861791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:36.862946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:36.863748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:36.864566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:37.472207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:29:37.574340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:37.584542 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e110fb2-5598-4a77-9d58-f6dd1a5c3acf tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/9f247548-d0aa-45c1-a035-03b59130dcf9" status: 200 len: 1319 microversion: 2.1 time: 0.771425 Aug 30 03:29:37.607259 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 748/1441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:36 2022] GET /compute/v2.1/servers/9f247548-d0aa-45c1-a035-03b59130dcf9 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:37.642424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:37.643735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:37.653856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:37.656190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:37.656190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:37.657551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:37.658534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:37.659079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:38.021042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:38.074759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:38.077605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:38.079794 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94d4062a-c58f-4b0d-bef1-139226be73db tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1362 microversion: 2.25 time: 0.458744 Aug 30 03:29:38.086699 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 749/1442] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:37 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:38.108488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:38.125388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:38.138843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:38.139930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:38.141058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:38.142665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:38.143779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:38.144667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.022116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:39.038652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e57080db-ac7b-402b-94a0-a0e1ed3a2162 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.949675 Aug 30 03:29:39.053376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 750/1443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:38 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:39.053376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:39.053376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:39.069805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.070519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.070972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.071731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.072189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.072608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.234533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:39.251878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:39.255029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:39.257239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec56e082-496a-4df5-8662-f9cb291936b2 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.216028 Aug 30 03:29:39.258416 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 751/1444] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:39 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:39.265907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f4f0e0c7-31c3-4057-9cd6-2f2a161a612b req-cb003335-00b0-4143-987e-2d3b86c71a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81", "name": "network-vif-plugged", "status": "completed", "tag": "bccaf1c7-13e7-4503-bce9-4f0db1080a87"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:39.282656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f4f0e0c7-31c3-4057-9cd6-2f2a161a612b req-cb003335-00b0-4143-987e-2d3b86c71a04 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.283461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f4f0e0c7-31c3-4057-9cd6-2f2a161a612b req-cb003335-00b0-4143-987e-2d3b86c71a04 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.288158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f4f0e0c7-31c3-4057-9cd6-2f2a161a612b req-cb003335-00b0-4143-987e-2d3b86c71a04 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.318295 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f4f0e0c7-31c3-4057-9cd6-2f2a161a612b req-cb003335-00b0-4143-987e-2d3b86c71a04 service nova] Creating event network-vif-plugged:bccaf1c7-13e7-4503-bce9-4f0db1080a87 for instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 on n-h1-854924-5 Aug 30 03:29:39.334084 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f4f0e0c7-31c3-4057-9cd6-2f2a161a612b req-cb003335-00b0-4143-987e-2d3b86c71a04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074025 Aug 30 03:29:39.335473 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 752/1445] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:39.342166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:39.343499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:39.371131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.389162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.389756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.390575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.392241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.400353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.608902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Updating instance_info_cache with network_info: [{"id": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd", "address": "fa:16:3e:ba:b3:54", "network": {"id": "b65aef74-d72b-4c52-acc3-b7f6f301faa7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1025503046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb047b401d424ae298aa305e270c6bd0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5be08b3-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:29:39.646452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Releasing lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:29:39.653870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d6409d1-9a5f-49a7-863a-b11e7015ffe6 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action" status: 202 len: 0 microversion: 2.1 time: 5.820299 Aug 30 03:29:39.660023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 694/1446] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:33 2022] POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action => generated 0 bytes in 5831 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:29:39.695551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-dd3020ed-2ef6-4c3e-9fd3-ab42055ad7a2 req-0b08d4c7-8cfd-43b5-ad19-47da61552574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6", "name": "network-vif-deleted", "tag": "43775ac9-f1bf-4946-87df-a42b0f232a21"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:39.713101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dd3020ed-2ef6-4c3e-9fd3-ab42055ad7a2 req-0b08d4c7-8cfd-43b5-ad19-47da61552574 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.714028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dd3020ed-2ef6-4c3e-9fd3-ab42055ad7a2 req-0b08d4c7-8cfd-43b5-ad19-47da61552574 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.714648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dd3020ed-2ef6-4c3e-9fd3-ab42055ad7a2 req-0b08d4c7-8cfd-43b5-ad19-47da61552574 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.737424 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-dd3020ed-2ef6-4c3e-9fd3-ab42055ad7a2 req-0b08d4c7-8cfd-43b5-ad19-47da61552574 service nova] Creating event network-vif-deleted:43775ac9-f1bf-4946-87df-a42b0f232a21 for instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 on n-h2-854924-5 Aug 30 03:29:39.749980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-dd3020ed-2ef6-4c3e-9fd3-ab42055ad7a2 req-0b08d4c7-8cfd-43b5-ad19-47da61552574 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080626 Aug 30 03:29:39.751495 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 695/1447] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:39.757503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:39.759412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:39.769457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.770436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.771112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:39.772190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:39.776414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:39.779009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:40.234690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:40.274762 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-845a5119-a902-4332-bebc-e1a43ea624ae tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.937967 Aug 30 03:29:40.276235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 753/1448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:39 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:40.282241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:40.283673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 9f247548-d0aa-45c1-a035-03b59130dcf9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:40.292413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:40.293819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:40.294506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:40.296197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:40.296987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:40.298258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:40.365619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:40.378128 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5fde5be4-b5aa-4fc1-b365-c4d71f9159cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1463 microversion: 2.1 time: 0.625198 Aug 30 03:29:40.378731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 696/1449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:39 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1463 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:40.390158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:40.393831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:40.409519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:40.410270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:40.410913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:40.412358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:40.413163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:40.413944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:40.870001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:40.877925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:40.884475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:40.894630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:40.896701 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db8643f1-98d1-4770-ad47-850b939d5bf6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1362 microversion: 2.25 time: 0.516716 Aug 30 03:29:40.898331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 697/1450] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:40 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:40.906433 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04ae37c0-0839-4540-b83c-085bebf2caea tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/9f247548-d0aa-45c1-a035-03b59130dcf9" status: 200 len: 1508 microversion: 2.1 time: 0.628900 Aug 30 03:29:40.913468 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 754/1451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:40 2022] GET /compute/v2.1/servers/9f247548-d0aa-45c1-a035-03b59130dcf9 => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:40.914740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:40.915366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:40.915507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c63486f5-1949-4d1f-934c-346741c29dbe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '.version_select at 0x7f897bca61f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:40.943070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:40.944433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:40.945565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:40.947527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:40.948555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:40.949743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.738681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:41.751654 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-09a26933-7d9a-4e1a-81f0-14c222bac182 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.842139 Aug 30 03:29:41.752257 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 755/1452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:40 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:41.757276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:41.758185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:41.764300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.764780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.765208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.765929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.766931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.767364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.773918 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c63486f5-1949-4d1f-934c-346741c29dbe tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/c698d9ea-a83d-45ad-b25e-7a36e43f92fe" status: 200 len: 185 microversion: 2.1 time: 0.873638 Aug 30 03:29:41.774515 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 698/1453] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:29:40 2022] GET /compute/v2.1/os-floating-ips/c698d9ea-a83d-45ad-b25e-7a36e43f92fe => generated 185 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:41.779265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:41.779840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:41.787084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.787581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.788049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.788750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.789201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.789671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.852012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:41.862314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:41.864093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:41.865565 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ce84cbb-ce35-4a67-9525-0af5a3d4c7fb tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.111998 Aug 30 03:29:41.866689 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 756/1454] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:41 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:41.871723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:41.872217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 9f247548-d0aa-45c1-a035-03b59130dcf9] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:41.876604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:41.880227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.883948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.885284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.886522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.887187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.887832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.919633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 9f247548-d0aa-45c1-a035-03b59130dcf9] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:41.953506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:41.970217 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9b2ff4d-ca5f-43a2-a054-05f8d68827c6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1614 microversion: 2.1 time: 0.194481 Aug 30 03:29:41.971083 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 699/1455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:41 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1614 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:41.976510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:41.977465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:41.983597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:41.986050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.986643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.987360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:41.988358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:41.988991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:41.989615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:42.025196 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-28c234d7-43e3-41ba-b038-1a0aa63077d1 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f247548-d0aa-45c1-a035-03b59130dcf9" status: 204 len: 0 microversion: 2.1 time: 0.156936 Aug 30 03:29:42.026239 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 757/1456] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:41 2022] DELETE /compute/v2.1/servers/9f247548-d0aa-45c1-a035-03b59130dcf9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:42.192738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dcb13e8-3033-449a-a335-5ebd0ab6fc17 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f8983cc4700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-582174775", "description": "tempest-description-1645464644"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:42.308752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:42.318387 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-565e992b-ba83-4316-bcc6-22349f69868f tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.345936 Aug 30 03:29:42.319413 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 700/1457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:41 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:42.324499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.199"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:42.544601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:42.553453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:42.555106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:42.555655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:42.556539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:42.557096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:42.557847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:42.567274 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0dcb13e8-3033-449a-a335-5ebd0ab6fc17 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.536464 Aug 30 03:29:42.568071 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 758/1458] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:42.574019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0d7292c0-f6ab-46c3-96e8-2855d17348d6 req-629d7da5-8de0-4099-9836-0ba7f9d9b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:42.595510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0d7292c0-f6ab-46c3-96e8-2855d17348d6 req-629d7da5-8de0-4099-9836-0ba7f9d9b3c4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:42.596094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0d7292c0-f6ab-46c3-96e8-2855d17348d6 req-629d7da5-8de0-4099-9836-0ba7f9d9b3c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:42.596734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0d7292c0-f6ab-46c3-96e8-2855d17348d6 req-629d7da5-8de0-4099-9836-0ba7f9d9b3c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:42.608526 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0d7292c0-f6ab-46c3-96e8-2855d17348d6 req-629d7da5-8de0-4099-9836-0ba7f9d9b3c4 service nova] Creating event network-changed:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:29:42.622711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0d7292c0-f6ab-46c3-96e8-2855d17348d6 req-629d7da5-8de0-4099-9836-0ba7f9d9b3c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052759 Aug 30 03:29:42.623795 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 759/1459] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:42.629263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:42.630114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:42.639785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:42.642187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:42.642946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:42.644515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:42.645213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:42.645861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:43.001922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:29:43.002505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquired lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:29:43.010448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:43.023943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:43.025411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:43.026611 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3212ba2e-d433-407c-b3fd-e74f57cab207 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1557 microversion: 2.25 time: 0.401557 Aug 30 03:29:43.027172 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 760/1460] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:42 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1557 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:43.031950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:43.032878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:43.039221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:43.040065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:43.040731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:43.041686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:43.042371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:43.043012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:43.144428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0132d42b469b433b9ef6a21e0d2c868e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7314d94504457abb9dcdc58a4774d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:43.145045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] flavor_id is None. Assuming migration. {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 03:29:43.145522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 03:29:43.523253 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27919f4b-9034-48ad-bb32-8a1f2f965da6 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372/action" status: 202 len: 0 microversion: 2.1 time: 0.494550 Aug 30 03:29:43.525394 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 761/1461] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:43 2022] POST /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:29:43.532832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:43.533449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:43.545060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:43.548499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:43.549433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:43.550993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:43.554728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:43.554913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:43.626928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: e9343551-a616-475f-877b-ac7e8f1bab14] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:43.783804 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-453331e7-529b-4707-857a-db5e8beaadaa tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14" status: 204 len: 0 microversion: 2.1 time: 0.255704 Aug 30 03:29:43.785515 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 762/1462] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:43 2022] DELETE /compute/v2.1/servers/e9343551-a616-475f-877b-ac7e8f1bab14 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:43.800216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:43.808195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7167aaa8-b19d-4db4-99be-de0cf0c5bc48 req-e0ad41c6-6ab0-41aa-b300-a21bd2da4756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e24b12d-79a3-4fdd-9fc8-30791e62f08a", "name": "network-vif-plugged", "status": "completed", "tag": "263f9f5b-1548-443a-a9b6-b190ef1ff56d"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:43.822409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7167aaa8-b19d-4db4-99be-de0cf0c5bc48 req-e0ad41c6-6ab0-41aa-b300-a21bd2da4756 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:43.822888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7167aaa8-b19d-4db4-99be-de0cf0c5bc48 req-e0ad41c6-6ab0-41aa-b300-a21bd2da4756 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:43.823318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7167aaa8-b19d-4db4-99be-de0cf0c5bc48 req-e0ad41c6-6ab0-41aa-b300-a21bd2da4756 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:43.841367 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7167aaa8-b19d-4db4-99be-de0cf0c5bc48 req-e0ad41c6-6ab0-41aa-b300-a21bd2da4756 service nova] Creating event network-vif-plugged:263f9f5b-1548-443a-a9b6-b190ef1ff56d for instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a on n-h1-854924-5 Aug 30 03:29:43.849504 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7167aaa8-b19d-4db4-99be-de0cf0c5bc48 req-e0ad41c6-6ab0-41aa-b300-a21bd2da4756 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059568 Aug 30 03:29:43.850528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 763/1463] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:43.857009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15f424de-8640-4d6c-9d6a-d0f5f3db6eb2 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f8983c04af0>, body: {"security_group_rule": {"parent_group_id": "376b6bca-3e43-4560-8445-e35c4351ee5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:44.763473 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-15f424de-8640-4d6c-9d6a-d0f5f3db6eb2 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.911689 Aug 30 03:29:44.764878 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 764/1464] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:29:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:44.770962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:44.771992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:44.787399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:44.788502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:44.789168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:44.790173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:44.790870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:44.791555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:44.867763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:29:45.323324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:45.337305 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-afa0149e-e4eb-4bc2-85be-7cb32a6c7287 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1325 microversion: 2.1 time: 0.570722 Aug 30 03:29:45.345553 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 765/1465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:44 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1325 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:45.358285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:45.359626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:45.369791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:45.370500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:45.371103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:45.372220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:45.372894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:45.373680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:45.568007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:45.578235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:45.586068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:45.589981 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-87b666e8-758d-4729-97b9-c09a7b9a63de tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.240450 Aug 30 03:29:45.590643 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 766/1466] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:45 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:45.865400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:45.867231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:45.892481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:45.893001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:45.897162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:45.898216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:45.898708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:45.899152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:46.204523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:46.217729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6517de0d-5509-4fdf-a6ca-6b908ed7d915 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 2050 microversion: 2.25 time: 0.623596 Aug 30 03:29:46.218349 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 767/1467] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:45 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 2050 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:46.223344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:46.224071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:46.230067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:46.230669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:46.231200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:46.231983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:46.232497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:46.232982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:46.238970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Updating instance_info_cache with network_info: [{"id": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd", "address": "fa:16:3e:ba:b3:54", "network": {"id": "b65aef74-d72b-4c52-acc3-b7f6f301faa7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1025503046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb047b401d424ae298aa305e270c6bd0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5be08b3-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:29:46.256284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Releasing lock "refresh_cache-c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:29:46.257504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae3fb45e-040d-4fa2-afab-f8a4ac186fbd tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action" status: 202 len: 0 microversion: 2.1 time: 3.936764 Aug 30 03:29:46.259287 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 701/1468] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:29:42 2022] POST /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc/action => generated 0 bytes in 3939 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:29:46.266970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:46.267829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:46.276835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:46.277322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:46.278000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:46.279022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:46.279580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:46.280064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:46.704809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:46.710331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:46.715178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-141aa22d-b358-4494-a761-071728fb92d1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1719 microversion: 2.1 time: 0.495609 Aug 30 03:29:46.731179 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 768/1469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:46 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1719 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:46.738493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-623776982", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e825369c-6e70-4f2e-ba05-faa2023b62c8"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:46.739854 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a7ef109-dffc-4f3b-96d5-ffb4c0d348b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1472 microversion: 2.1 time: 0.477613 Aug 30 03:29:46.749434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 702/1470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:46 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:46.759179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94828796-51b2-4ca2-b997-33319178d9ad tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b318e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2115691392", "description": "tempest-description-78964291"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:46.811266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] validate_networks() for [('e825369c-6e70-4f2e-ba05-faa2023b62c8', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:29:47.445866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94828796-51b2-4ca2-b997-33319178d9ad tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.692694 Aug 30 03:29:47.446466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 703/1471] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:47.454401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fc55d0fd-9d2d-4324-b4f9-3ec1a03e0d52 req-7083b2e5-43fc-4d95-b4ad-e375031f47d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:47.464279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fc55d0fd-9d2d-4324-b4f9-3ec1a03e0d52 req-7083b2e5-43fc-4d95-b4ad-e375031f47d8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:47.464753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fc55d0fd-9d2d-4324-b4f9-3ec1a03e0d52 req-7083b2e5-43fc-4d95-b4ad-e375031f47d8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:47.465395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fc55d0fd-9d2d-4324-b4f9-3ec1a03e0d52 req-7083b2e5-43fc-4d95-b4ad-e375031f47d8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:47.478332 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fc55d0fd-9d2d-4324-b4f9-3ec1a03e0d52 req-7083b2e5-43fc-4d95-b4ad-e375031f47d8 service nova] Creating event network-changed:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:29:47.483560 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fc55d0fd-9d2d-4324-b4f9-3ec1a03e0d52 req-7083b2e5-43fc-4d95-b4ad-e375031f47d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035845 Aug 30 03:29:47.484173 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 704/1472] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:47.489781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0fcecc30-4598-4964-ab5d-8531efba0fa5 req-937ac7ac-3de3-4259-a80a-be307959a8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f247548-d0aa-45c1-a035-03b59130dcf9", "name": "network-vif-deleted", "tag": "97e76ee9-89b8-4e47-bc3a-81ccb5f00d5c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:47.514047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0fcecc30-4598-4964-ab5d-8531efba0fa5 req-937ac7ac-3de3-4259-a80a-be307959a8fa service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:47.514789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0fcecc30-4598-4964-ab5d-8531efba0fa5 req-937ac7ac-3de3-4259-a80a-be307959a8fa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:47.515403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0fcecc30-4598-4964-ab5d-8531efba0fa5 req-937ac7ac-3de3-4259-a80a-be307959a8fa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:47.530164 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0fcecc30-4598-4964-ab5d-8531efba0fa5 req-937ac7ac-3de3-4259-a80a-be307959a8fa service nova] Creating event network-vif-deleted:97e76ee9-89b8-4e47-bc3a-81ccb5f00d5c for instance 9f247548-d0aa-45c1-a035-03b59130dcf9 on n-h1-854924-5 Aug 30 03:29:47.536253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0fcecc30-4598-4964-ab5d-8531efba0fa5 req-937ac7ac-3de3-4259-a80a-be307959a8fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050541 Aug 30 03:29:47.536866 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 705/1473] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:47.543526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:47.544433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:47.551982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:47.552509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:47.552949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:47.553680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:47.554134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:47.554552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.248196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:48.270005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1e550d4-a6d9-44d2-a4fc-963fc6bb6ba8 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 2050 microversion: 2.25 time: 0.731708 Aug 30 03:29:48.270601 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 706/1474] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:47 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 2050 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:48.275662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:48.276192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:48.285336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.285922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.286611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.287612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.289103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.289798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.306023 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] HTTP exception thrown: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Request method failure captured: Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 HTTP/1.1 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPLlrKNfA6E5n2_obootapjMwkEGwdEh0W-wshHyZN6LAoVD1TfOK_w2v67IWud2PSnOx0oo5MwWTjRLw81RfwLpGUMo0N8pnilQC7ZRrcXcvNJZgSYoGj-2iCE_wdmUmfhZ62rR8EkzTimvfbRuMUf_i12dFN4eTXyItG7GD7yX5c Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb047b401d424ae298aa305e270c6bd0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}] Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25d8eb58d3ba4c68b12408b713484d49 Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6'} Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:48.308021 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Returning 404 to user: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9dbd7b58-2d28-48f3-94dc-607365257d6d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 404 len: 111 microversion: 2.1 time: 0.037720 Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 707/1475] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:48 2022] DELETE /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:48.315815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:48.321728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.322214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.322649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.323342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.323795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.324217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.365654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:29:48.367578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:29:48.368501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:29:48.369271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:29:48.370360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:29:48.417391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.429789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.432979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.434357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.435134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.435872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.509604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Getting quotas for project 187cc2094c9e447bb11ec96cfb435250. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:29:48.520584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Getting quotas for user 8f22f6d58f11485cb29ad1f529e78103 and project 187cc2094c9e447bb11ec96cfb435250. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:29:48.549459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Going to run 2 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:29:48.552295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:48.620395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=819267e5-842b-448c-9469-230929e39b3a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:29:48.757941 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c0d9d70-808b-4a9a-bda9-ea9b5b10de85 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.025324 Aug 30 03:29:48.758735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 769/1476] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:29:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 2027 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:29:48.763542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:48.772860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:48.780126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.780928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.782459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.783647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:48.784396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:48.786024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:48.854442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:48.864780 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43cb9742-7739-4b7b-982e-d7a7469108a6 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1523 microversion: 2.1 time: 0.553734 Aug 30 03:29:48.878933 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 708/1477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:48 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:48.894494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6f843c2-7b82-4ee1-8c49-e8932f25698a tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b7aab80>, body: {"security_group_rule": {"parent_group_id": "6eb8281c-4a4b-4aa9-a9ee-3417f937fff4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:49.001314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:49.009766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:49.011304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:49.012577 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fdba8b66-a136-4664-b060-63ea58d3b791 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.252724 Aug 30 03:29:49.013456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 770/1478] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:48 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:49.021523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.022490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:49.028941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.029480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.030093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.030998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.031629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.032603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.538948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:49.561989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7740922-85bc-45a5-9c18-38051b0ccd44 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1709 microversion: 2.1 time: 0.547115 Aug 30 03:29:49.584276 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 771/1479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:49 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1709 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:49.592119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.593293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:49.601525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.602401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.603073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.604014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.604716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.605427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.653851 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6f843c2-7b82-4ee1-8c49-e8932f25698a tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.773654 Aug 30 03:29:49.654746 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 709/1480] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:29:48 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:49.661266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.675035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.678070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.678644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.679708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.680433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.681393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.709682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02d3a7f1-e2a5-4298-985b-0f7725c781ed tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.053636 Aug 30 03:29:49.710949 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 710/1481] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Aug 30 03:29:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:29:49.716039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.716966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:49.725133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.725907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.727318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.728447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.729155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.729848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.747284 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] HTTP exception thrown: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Request method failure captured: Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 HTTP/1.1 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYPLlrKNfA6E5n2_obootapjMwkEGwdEh0W-wshHyZN6LAoVD1TfOK_w2v67IWud2PSnOx0oo5MwWTjRLw81RfwLpGUMo0N8pnilQC7ZRrcXcvNJZgSYoGj-2iCE_wdmUmfhZ62rR8EkzTimvfbRuMUf_i12dFN4eTXyItG7GD7yX5c Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb047b401d424ae298aa305e270c6bd0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}] Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25d8eb58d3ba4c68b12408b713484d49 Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6'} Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:49.749553 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. Aug 30 03:29:49.754458 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:49.756440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Returning 404 to user: Instance fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:49.757477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b8d96e1-454a-4842-92e2-0f25b1075f9d tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6" status: 404 len: 111 microversion: 2.1 time: 0.045146 Aug 30 03:29:49.758166 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 711/1482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:49 2022] GET /compute/v2.1/servers/fa6be8ed-41d3-4ac5-8d4e-47b5c3455fc6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:49.764004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.768572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:49.769548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Searching by: {'deleted': False, 'project_id': '187cc2094c9e447bb11ec96cfb435250'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:29:49.775433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.776047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.776585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.777463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.778027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.778511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.786957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:49.801682 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-890bcfc3-7045-4fbf-9b7c-204fc3cb0b7d tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.215418 Aug 30 03:29:49.803043 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 772/1483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:49 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:49.809872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.811405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:49.818723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.819654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.820264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.821224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.821375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:29:49.821745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.822206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.853939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:49.868170 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ee07c38-8060-4af8-b8a4-eaaf63856f81 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.108518 Aug 30 03:29:49.869651 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 712/1484] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:29:49 2022] GET /compute/v2.1/servers => generated 671 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:49.890954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:49.892206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-90004ef2-4a0f-43f8-88e9-a377b0ab88ee req-97607f1a-897c-4c47-adc1-1c3f6a53cc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9343551-a616-475f-877b-ac7e8f1bab14", "name": "network-vif-deleted", "tag": "64f437d6-cdc3-4c9b-b0c7-45e026838ec0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:49.912969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-90004ef2-4a0f-43f8-88e9-a377b0ab88ee req-97607f1a-897c-4c47-adc1-1c3f6a53cc96 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.913576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-90004ef2-4a0f-43f8-88e9-a377b0ab88ee req-97607f1a-897c-4c47-adc1-1c3f6a53cc96 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.914246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-90004ef2-4a0f-43f8-88e9-a377b0ab88ee req-97607f1a-897c-4c47-adc1-1c3f6a53cc96 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.937717 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-90004ef2-4a0f-43f8-88e9-a377b0ab88ee req-97607f1a-897c-4c47-adc1-1c3f6a53cc96 service nova] Creating event network-vif-deleted:64f437d6-cdc3-4c9b-b0c7-45e026838ec0 for instance e9343551-a616-475f-877b-ac7e8f1bab14 on n-h1-854924-5 Aug 30 03:29:49.946655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-90004ef2-4a0f-43f8-88e9-a377b0ab88ee req-97607f1a-897c-4c47-adc1-1c3f6a53cc96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075162 Aug 30 03:29:49.956220 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 713/1485] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:49.967261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-364f8f08-153c-4694-9086-2bed2e4f6202 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '.version_select at 0x7f897bf33790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:49.972617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-364f8f08-153c-4694-9086-2bed2e4f6202 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:49.973601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-364f8f08-153c-4694-9086-2bed2e4f6202 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:49.974430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-364f8f08-153c-4694-9086-2bed2e4f6202 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:49.987411 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-364f8f08-153c-4694-9086-2bed2e4f6202 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2737 microversion: 2.1 time: 0.028610 Aug 30 03:29:49.999576 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 714/1486] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:29:49 2022] GET /compute/v2.1/os-migrations => generated 2737 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:50.002612 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d813d878-9d1e-43b3-8b6a-81ea10309188 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 204 len: 0 microversion: 2.1 time: 0.197065 Aug 30 03:29:50.003911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 773/1487] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:49 2022] DELETE /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:50.006163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffc9c021-e699-48e8-bcac-8aa4762c6927 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897bb53430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1832011221", "description": "tempest-description-214685577"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:50.012259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854924-5", "block_migration": "auto"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:50.017910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:50.025720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:50.026870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:50.028035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:50.030386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:50.031198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:50.032451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:50.068080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'flavor' on Instance uuid 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:50.084283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Going to try to live migrate instance to n-h2-854924-5 {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:29:50.240297 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffc9c021-e699-48e8-bcac-8aa4762c6927 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.239290 Aug 30 03:29:50.241320 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 715/1488] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:50.246104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca8b485b-da41-4dc8-a913-2ef718a024e2 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '.version_select at 0x7f897bab1700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:51.090487 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca8b485b-da41-4dc8-a913-2ef718a024e2 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/c698d9ea-a83d-45ad-b25e-7a36e43f92fe" status: 202 len: 0 microversion: 2.1 time: 0.847950 Aug 30 03:29:51.092004 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 716/1489] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:29:50 2022] DELETE /compute/v2.1/os-floating-ips/c698d9ea-a83d-45ad-b25e-7a36e43f92fe => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:29:51.098268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:51.099028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:51.106121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.107513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.108122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.108851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.109313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.109768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.240473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:51.249115 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-141f1275-6493-4405-8455-22c1f22d60c3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1277 microversion: 2.1 time: 0.155604 Aug 30 03:29:51.252945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 717/1490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:51 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:51.268790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:51.269766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:51.278875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.279492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.279846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.280548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.281001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.281442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.528149 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40002e75-12ef-4fed-85c6-a05b588265c9 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1860 microversion: 2.1 time: 0.273841 Aug 30 03:29:51.529025 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 718/1491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:51 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1860 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:51.534709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:51.535587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:51.542178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.542981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.543590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.544579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.545201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.546473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.790443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:51.800953 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec8419c2-ea88-4e41-991f-eb889e886305 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1529 microversion: 2.1 time: 0.270639 Aug 30 03:29:51.801568 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 719/1492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:51 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1529 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:51.807329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:51.808018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:51.814479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.815346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.816374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.817281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:51.817932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:51.818415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:51.937836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:51.949751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:51.951236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:51.952455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8a3c7fd-d8d1-4fa1-b008-cefeaf6003ff tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.149735 Aug 30 03:29:51.958814 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 720/1493] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:51 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:51.964686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-605632e0-86e1-48c7-9404-088a0b4d5dea tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b7a1700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1975266564", "description": "tempest-description-1790504739"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:52.294866 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f422de2e-b228-45e8-903c-4fe5aac0fb9e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81/action" status: 202 len: 0 microversion: 2.25 time: 2.289347 Aug 30 03:29:52.296222 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 774/1494] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:29:50 2022] POST /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81/action => generated 0 bytes in 2292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:52.302367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:52.303294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:52.312167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:52.313665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:52.314291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:52.315245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:52.315920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:52.316604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:52.516085 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-605632e0-86e1-48c7-9404-088a0b4d5dea tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.553155 Aug 30 03:29:52.518683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 721/1495] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:52.527581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:52.528720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:52.541159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:52.549470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:52.551461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:52.553009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:52.554375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:52.566022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:52.602341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:29:52.674253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:52.712612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e4f2ec24-3a5e-4f99-99eb-4473455724eb tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 204 len: 0 microversion: 2.1 time: 0.191609 Aug 30 03:29:52.713801 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 722/1496] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:52 2022] DELETE /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:29:52.721293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:52.722472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:52.730730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:52.731238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:52.731687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:52.732400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:52.732858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:52.733323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:53.151197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:53.163234 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3994a2af-deef-46f8-9be3-79607386a746 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.865608 Aug 30 03:29:53.166349 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 775/1497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:52 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:53.192427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:53.193300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:53.205103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:53.205924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:53.206466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:53.207257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:53.207926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:53.208581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:53.209018 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c6cfce27-f39b-496c-8006-87cbf018f93f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1860 microversion: 2.1 time: 0.493333 Aug 30 03:29:53.210148 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 723/1498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:52 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1860 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:53.234451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:53.237337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:53.258961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:53.259623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:53.261912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:53.264655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:53.265149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:53.265615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:53.646838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:53.655820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:53.657713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:53.659005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28286ae2-bff9-4bee-a6d7-95e112505423 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.447635 Aug 30 03:29:53.659855 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 724/1499] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:53 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:53.665835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-827bf490-7cd6-41fe-8872-808695b85bc0 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b240160>, body: {"security_group_rule": {"parent_group_id": "a839388d-d89f-4ed8-bbe4-e359020e8d0c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "42cadbc4-e607-40a8-afd1-4dcfbf5512a2"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:53.674817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:53.691796 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-006d6600-3b4f-4531-b110-e166c6404246 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1317 microversion: 2.1 time: 0.523880 Aug 30 03:29:53.692394 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 776/1500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:53 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:53.716792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:53.717925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:53.727150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:53.729661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:53.730204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:53.731175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:53.731709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:53.732224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.078869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:54.110736 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98ac384b-3b18-4672-b12e-8128fe23c9bc tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1526 microversion: 2.1 time: 0.398016 Aug 30 03:29:54.114739 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 777/1501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:53 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1526 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:54.139605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:54.140862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:54.147528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.148406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.149081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.150013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.150903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.151824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.196222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.196939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.197586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.198197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lazy-loading 'fault' on Instance uuid 7e24b12d-79a3-4fdd-9fc8-30791e62f08a {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:54.452876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957bda6b3f3422a94f08752db13ddec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0c2eb009d0418bba5a2aef20febc55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:54.472678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b13f6d07-a30c-4573-b4ea-4fce13c03e23 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 200 len: 1315 microversion: 2.1 time: 0.355059 Aug 30 03:29:54.475714 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 778/1502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:54 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:54.485715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:54.486745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:54.504630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.505394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.506913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.508311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.510058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.510586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.664042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:54.687165 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-827bf490-7cd6-41fe-8872-808695b85bc0 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.016091 Aug 30 03:29:54.687165 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 725/1503] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:29:53 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:54.687165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4d8e6fee-2b11-4897-8e93-318c6460a50d req-17f576b1-291a-4721-85ea-8df8593fe521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e24b12d-79a3-4fdd-9fc8-30791e62f08a", "name": "network-vif-deleted", "tag": "263f9f5b-1548-443a-a9b6-b190ef1ff56d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:54.687945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:54.691101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:54.692604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f8506e1-8c76-4da9-856b-a130a642e9ea tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.215820 Aug 30 03:29:54.694469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 779/1504] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:54 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:54.699419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d8e6fee-2b11-4897-8e93-318c6460a50d req-17f576b1-291a-4721-85ea-8df8593fe521 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.699947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:54.701467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:54.706738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d8e6fee-2b11-4897-8e93-318c6460a50d req-17f576b1-291a-4721-85ea-8df8593fe521 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.707741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d8e6fee-2b11-4897-8e93-318c6460a50d req-17f576b1-291a-4721-85ea-8df8593fe521 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.711958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.713117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.713815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.714827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.715515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.716177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.723019 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4d8e6fee-2b11-4897-8e93-318c6460a50d req-17f576b1-291a-4721-85ea-8df8593fe521 service nova] Creating event network-vif-deleted:263f9f5b-1548-443a-a9b6-b190ef1ff56d for instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a on n-h1-854924-5 Aug 30 03:29:54.728321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4d8e6fee-2b11-4897-8e93-318c6460a50d req-17f576b1-291a-4721-85ea-8df8593fe521 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048966 Aug 30 03:29:54.729729 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 726/1505] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:54.735776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c4400da7-fc32-4c27-973b-56082245058f req-211f8d6a-64e1-4f17-8fea-b08bb793368a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598bb3d4-cec1-4d4c-a029-b9e3a8a30adb", "tag": "c452296c-33e2-41f7-82af-608f8072d4d6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:54.747656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c4400da7-fc32-4c27-973b-56082245058f req-211f8d6a-64e1-4f17-8fea-b08bb793368a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.748692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c4400da7-fc32-4c27-973b-56082245058f req-211f8d6a-64e1-4f17-8fea-b08bb793368a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.749289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c4400da7-fc32-4c27-973b-56082245058f req-211f8d6a-64e1-4f17-8fea-b08bb793368a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.763118 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c4400da7-fc32-4c27-973b-56082245058f req-211f8d6a-64e1-4f17-8fea-b08bb793368a service nova] Creating event network-changed:c452296c-33e2-41f7-82af-608f8072d4d6 for instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb on n-h2-854924-5 Aug 30 03:29:54.790267 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c4400da7-fc32-4c27-973b-56082245058f req-211f8d6a-64e1-4f17-8fea-b08bb793368a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058159 Aug 30 03:29:54.794122 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 727/1506] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:54.807523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:54.808536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:54.831153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.831650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.832090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.833984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:54.834452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:54.834927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:54.878806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lazy-loading 'services' on Instance uuid 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:29:54.998059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-88e3c557-8980-4252-a072-9b58fc50bcea tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments/38379dfc-375d-4490-b8d7-7ee51db16674" status: 202 len: 0 microversion: 2.1 time: 0.301541 Aug 30 03:29:55.000070 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 780/1507] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:29:54 2022] DELETE /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments/38379dfc-375d-4490-b8d7-7ee51db16674 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:29:55.008248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:55.009328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:55.019375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.020271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.020942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.022470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.024079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.024961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.367171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:55.382039 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab8e48f2-6021-42fc-9be7-3040a1ed8933 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.582376 Aug 30 03:29:55.383432 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 728/1508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:54 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:55.385934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:55.390300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1951b633-a541-4200-b4bd-585a5b1ce48c tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b2bdca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1135185732", "description": "tempest-description-2084927794"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:55.404437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:55.406323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:55.407546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8eb7a54c-a915-467c-b611-8f603037d767 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.405224 Aug 30 03:29:55.408125 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 781/1509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:55 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:55.414142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:55.415321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:55.422114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.423411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.424077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.425862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.426526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.426958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.799363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:55.839626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3ad5cdb-10ca-441b-aa7e-d24fed0c6dc5 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1317 microversion: 2.1 time: 0.416536 Aug 30 03:29:55.842418 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 782/1510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:55 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:55.854418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:55.862441 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1951b633-a541-4200-b4bd-585a5b1ce48c tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.476814 Aug 30 03:29:55.862441 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 729/1511] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:55.867095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:55.867463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:55.868283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:55.879270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.880097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.880700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.881885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.882101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.882889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.883229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.883661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.886336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.888058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:55.888746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:55.891241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:55.990671 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba42ad16-0233-476e-8bbb-ab014bae9021 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144126 Aug 30 03:29:55.992233 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 783/1512] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:29:55 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:55.999135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.000188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: 7e24b12d-79a3-4fdd-9fc8-30791e62f08a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:56.008732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.009292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.010616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.011859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.012329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.012763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.034604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a could not be found. Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a HTTP/1.1 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a could not be found. Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7e24b12d-79a3-4fdd-9fc8-30791e62f08a'} Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a could not be found. Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a could not be found. Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.036301 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a could not be found. Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance 7e24b12d-79a3-4fdd-9fc8-30791e62f08a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:56.041183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10b348a0-ba45-4ec7-be3c-8afc6a1edaa9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a" status: 404 len: 111 microversion: 2.1 time: 0.044818 Aug 30 03:29:56.043669 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 784/1513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:55 2022] GET /compute/v2.1/servers/7e24b12d-79a3-4fdd-9fc8-30791e62f08a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:56.049746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.051140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:56.061590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.062130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.062883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.065924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.066548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.067208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.133820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d8eb58d3ba4c68b12408b713484d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb047b401d424ae298aa305e270c6bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:56.150027 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac897803-2c51-46c2-a9dd-84866e8f1d91 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 200 len: 1484 microversion: 2.1 time: 0.281454 Aug 30 03:29:56.157612 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 730/1514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:55 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 1484 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:56.168713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cf04d403-ddb8-4283-90a9-a3ad67b2f8e9 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b54d8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1617107613", "description": "tempest-description-1016638186"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:56.244190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:56.259066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:56.267902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:56.269610 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-066aa97e-6b01-4bcb-bf9e-1ec04111a1bd tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.225555 Aug 30 03:29:56.272376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 785/1515] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:56 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:56.289618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-387433da-f774-4fa1-94a6-1d320161c3ca tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '.version_select at 0x7f8983c04310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.323383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-387433da-f774-4fa1-94a6-1d320161c3ca tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Image not found. Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-387433da-f774-4fa1-94a6-1d320161c3ca tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6 HTTP/1.1 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '153c669a-10e3-42e6-88d2-2cb7e80fb8a6'} Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 153c669a-10e3-42e6-88d2-2cb7e80fb8a6 to delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 153c669a-10e3-42e6-88d2-2cb7e80fb8a6 could not be found. Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.325463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:56.330996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.334447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-387433da-f774-4fa1-94a6-1d320161c3ca tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:56.335525 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-387433da-f774-4fa1-94a6-1d320161c3ca tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6" status: 404 len: 62 microversion: 2.1 time: 0.058467 Aug 30 03:29:56.336092 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 786/1516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:56 2022] DELETE /compute/v2.1/images/153c669a-10e3-42e6-88d2-2cb7e80fb8a6 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:56.346487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.348329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:56.360830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.361647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.362309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.363231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.363854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.364705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.387036 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 HTTP/1.1 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e79be592-c64a-4cb8-9db1-6890405a2fd8'} Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:56.390019 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.395365 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.397448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:56.400649 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4be14a9f-6c96-45bf-ac62-73ac48038181 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 404 len: 111 microversion: 2.1 time: 0.057157 Aug 30 03:29:56.401749 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 787/1517] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:56 2022] DELETE /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:29:56.408672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.409644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:56.419015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.419701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.420316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.421755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.422939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.423595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.678877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:56.679798 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cf04d403-ddb8-4283-90a9-a3ad67b2f8e9 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.527914 Aug 30 03:29:56.681526 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 731/1518] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:56 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:56.684466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:56.689557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.703797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: e79be592-c64a-4cb8-9db1-6890405a2fd8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:56.706626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:56.713558 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30a38c25-464b-4d0f-b655-5bb83951178c tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.300802 Aug 30 03:29:56.714990 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 788/1519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:56 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:56.723351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:56.724479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:56.730926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:56.734120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.735526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.736164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.737657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.738140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.739339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.740039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.740799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.740938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.741672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:56.742181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:56.742576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:56.786133 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 HTTP/1.1 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e79be592-c64a-4cb8-9db1-6890405a2fd8'} Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.790326 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance e79be592-c64a-4cb8-9db1-6890405a2fd8 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:56.799777 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6dc18c34-7059-4672-b26d-07814f11727c tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8" status: 404 len: 111 microversion: 2.1 time: 0.112185 Aug 30 03:29:56.801829 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 732/1520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:56 2022] GET /compute/v2.1/servers/e79be592-c64a-4cb8-9db1-6890405a2fd8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:56.812446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0685253-f645-4c50-ae0c-32d367b9a236 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b254a60>, body: {"security_group_rule": {"parent_group_id": "11429629-f622-4bd9-953f-a03cd8d56217", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7c4b4d9e-e11e-4562-a710-dec5b4c0540b"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:57.139633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.149409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.151140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.152632 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5083c2f8-d1ee-4de9-8b9d-63543fc3012d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.436246 Aug 30 03:29:57.153264 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 789/1521] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:56 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:57.158702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22cc48a-84e5-4d92-8772-fa4d1cd82ebc", "name": "network-vif-deleted", "tag": "b5be08b3-ad1d-4703-a9d4-961ee1bc05fd"}, {"name": "network-changed", "server_uuid": "819267e5-842b-448c-9469-230929e39b3a", "tag": "65c21e95-559c-42e7-8ef7-1753a8409ed5"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:57.172260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.172876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.173215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.188945 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] Creating event network-vif-deleted:b5be08b3-ad1d-4703-a9d4-961ee1bc05fd for instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc on n-h2-854924-5 Aug 30 03:29:57.189480 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] Creating event network-changed:65c21e95-559c-42e7-8ef7-1753a8409ed5 for instance 819267e5-842b-448c-9469-230929e39b3a on n-h2-854924-5 Aug 30 03:29:57.196268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f19dc696-432e-4db8-bfcf-ede625362a93 req-d3424e7d-4ab5-43bd-807e-88f87e9ff5f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041078 Aug 30 03:29:57.198007 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 790/1522] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:57.204824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50bedeb4-0369-4f4b-a1d3-66d4dd8462b9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '.version_select at 0x7f8983c2a8b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.231374 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-50bedeb4-0369-4f4b-a1d3-66d4dd8462b9 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437134313" status: 202 len: 0 microversion: 2.1 time: 0.032352 Aug 30 03:29:57.233003 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 791/1523] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:29:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437134313 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:29:57.241488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.242695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:57.269873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.270412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.274352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.275503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.277590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.278068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.338274 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f0685253-f645-4c50-ae0c-32d367b9a236 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.532621 Aug 30 03:29:57.339214 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 733/1524] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:29:56 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:57.348144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81", "name": "network-vif-unplugged", "status": "completed", "tag": "bccaf1c7-13e7-4503-bce9-4f0db1080a87"}, {"name": "network-changed", "server_uuid": "8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81", "tag": "bccaf1c7-13e7-4503-bce9-4f0db1080a87"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:57.371810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.373143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.374263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.411151 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] Creating event network-vif-unplugged:bccaf1c7-13e7-4503-bce9-4f0db1080a87 for instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 on n-h1-854924-5 Aug 30 03:29:57.412048 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] Creating event network-changed:bccaf1c7-13e7-4503-bce9-4f0db1080a87 for instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 on n-h1-854924-5 Aug 30 03:29:57.421659 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-08dfef85-c360-47e6-9cc3-58b4aca2e9c3 req-07cf4366-0a8b-49d2-811a-173b8066905e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.079936 Aug 30 03:29:57.423461 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 734/1525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:57.430901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.433667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:57.440991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.441831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.442461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.443367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.443997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.444608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.459085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.467390 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7c0557b8-384d-441f-8fe1-598aaaf089d3 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1317 microversion: 2.1 time: 0.232770 Aug 30 03:29:57.470027 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 792/1526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:57 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:57.475460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.476306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] [instance: c22cc48a-84e5-4d92-8772-fa4d1cd82ebc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:57.483024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.483859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.496079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.496079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.496079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.496079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.496601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e1ff458-4d0a-44ee-bbab-96e8a5d35f92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065860 Aug 30 03:29:57.496713 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 735/1527] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:29:57 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:57.505900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.506952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:57.507554 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] HTTP exception thrown: Instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc could not be found. Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Request method failure captured: Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc HTTP/1.1 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYPLlrKNfA6E5n2_obootapjMwkEGwdEh0W-wshHyZN6LAoVD1TfOK_w2v67IWud2PSnOx0oo5MwWTjRLw81RfwLpGUMo0N8pnilQC7ZRrcXcvNJZgSYoGj-2iCE_wdmUmfhZ62rR8EkzTimvfbRuMUf_i12dFN4eTXyItG7GD7yX5c Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb047b401d424ae298aa305e270c6bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb047b401d424ae298aa305e270c6bd0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb047b401d424ae298aa305e270c6bd0"}]}] Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fb047b401d424ae298aa305e270c6bd0 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-74644670 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 25d8eb58d3ba4c68b12408b713484d49 Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-74644670-project Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc could not be found. Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c22cc48a-84e5-4d92-8772-fa4d1cd82ebc'} Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc could not be found. Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc could not be found. Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:57.509510 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc could not be found. Aug 30 03:29:57.515335 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:57.523404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.528109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] Returning 404 to user: Instance c22cc48a-84e5-4d92-8772-fa4d1cd82ebc could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:57.529115 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-691d101b-ccfd-4264-90b8-a15ea1974737 tempest-FloatingIPsAssociationTestJSON-74644670 tempest-FloatingIPsAssociationTestJSON-74644670-project] 10.222.0.30 "GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc" status: 404 len: 111 microversion: 2.1 time: 0.057883 Aug 30 03:29:57.532214 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 793/1528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:57 2022] GET /compute/v2.1/servers/c22cc48a-84e5-4d92-8772-fa4d1cd82ebc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:57.533641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.534540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.535514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.536287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.536967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.544723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a24a96eb-41ac-4c24-83c1-24dc1080dd45 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f8983b3a790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.674900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.685977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.688985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:57.690295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e513bc3-bf79-46ea-b196-457859e02b6f tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.192426 Aug 30 03:29:57.691405 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 736/1529] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:57 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:57.739837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:57.740787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:57.747732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.749580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.750899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:57.752600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:57.755667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:57.756509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.126096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:58.135863 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1e96c58-2691-45f7-9054-884147d4e6c2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.399835 Aug 30 03:29:58.136728 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 737/1530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:57 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:29:58.177223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:58.177872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:58.184658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:58.185473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:58.186119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.189934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:58.189934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:58.189934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.388264 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a24a96eb-41ac-4c24-83c1-24dc1080dd45 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7c4b4d9e-e11e-4562-a710-dec5b4c0540b" status: 202 len: 0 microversion: 2.1 time: 0.854727 Aug 30 03:29:58.393198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 794/1531] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:29:57 2022] DELETE /compute/v2.1/os-security-groups/7c4b4d9e-e11e-4562-a710-dec5b4c0540b => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:29:58.398830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-91e11f0f-5a29-4428-8a63-47576a4e5918 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f8983b935e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:58.472374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:58.526444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:58.539158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:58.541811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:58.548612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:58.558585 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8180072a-01dd-4304-9685-ab90fc65a707 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.385163 Aug 30 03:29:58.560044 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 738/1532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:58 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:58.565716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:58.567359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:58.582963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:58.583905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:58.585973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.586992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:58.591829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:58.592797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.602675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-91e11f0f-5a29-4428-8a63-47576a4e5918 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/11429629-f622-4bd9-953f-a03cd8d56217" status: 200 len: 248 microversion: 2.1 time: 0.207874 Aug 30 03:29:58.604710 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 795/1533] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:29:58 2022] GET /compute/v2.1/os-security-groups/11429629-f622-4bd9-953f-a03cd8d56217 => generated 248 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:58.620748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:58.623282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:58.632785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:58.633528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:58.634227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.635124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:58.635751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:58.636862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:58.682805 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d61d25f-0c78-4568-8c49-7f18f339abc2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075849 Aug 30 03:29:58.691278 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 796/1534] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:29:58 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:58.700243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84bafcf9-f14c-4d95-b003-e96b66ff088f tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f8983c040d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1894905355", "description": "tempest-description-95129979"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:59.164596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:59.198486 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff291709-6374-4b1b-a06a-a5b9b762819c tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1317 microversion: 2.1 time: 0.636122 Aug 30 03:29:59.202785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 739/1535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:58 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:59.216290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:59.217290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:59.241892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.242723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.245632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.246658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.254462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.255193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.313985 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84bafcf9-f14c-4d95-b003-e96b66ff088f tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.620265 Aug 30 03:29:59.315084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 797/1536] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:29:58 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:59.320688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d371b08-be8b-450c-8cd0-410bc53f3030 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '.version_select at 0x7f8983b3a040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:59.372028 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-6d371b08-be8b-450c-8cd0-410bc53f3030 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Image not found. Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d371b08-be8b-450c-8cd0-410bc53f3030 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/26bcd048-6884-41b9-9b8b-41ba64b0a1e6 HTTP/1.1 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '26bcd048-6884-41b9-9b8b-41ba64b0a1e6'} Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 26bcd048-6884-41b9-9b8b-41ba64b0a1e6 to delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26bcd048-6884-41b9-9b8b-41ba64b0a1e6 could not be found. Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:59.374364 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d371b08-be8b-450c-8cd0-410bc53f3030 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d371b08-be8b-450c-8cd0-410bc53f3030 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/images/26bcd048-6884-41b9-9b8b-41ba64b0a1e6" status: 404 len: 62 microversion: 2.1 time: 0.060361 Aug 30 03:29:59.382274 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 798/1537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:59 2022] DELETE /compute/v2.1/images/26bcd048-6884-41b9-9b8b-41ba64b0a1e6 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:29:59.390028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:59.390764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:59.399382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.399893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.400338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.402344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.402829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.403264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.448239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:59.470365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:59.472992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:59.475388 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-563824e1-9790-4dca-a0b6-044d3244b128 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.268877 Aug 30 03:29:59.497879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 740/1538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:59 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:29:59.528568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bbbf8d3b-325d-429e-b200-31a3f2a5812a tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897bb53a60>, body: {"security_group_rule": {"parent_group_id": "63e0118d-5228-460e-95b4-a68cec1e3456", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:29:59.621833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:29:59.639544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-000a2237-392b-4c91-9197-1f9e7ac9e431 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.258401 Aug 30 03:29:59.641523 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 799/1539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:29:59 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:29:59.647630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:59.648361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:59.665716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.666732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.667481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.668406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.669162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.669792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.690028 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 HTTP/1.1 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822'} Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:29:59.694035 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:29:59.699395 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:29:59.701307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:29:59.702393 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-738ef073-1bf4-424d-a913-4524c380c458 tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 404 len: 111 microversion: 2.1 time: 0.059247 Aug 30 03:29:59.707037 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 800/1540] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:29:59 2022] DELETE /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:29:59.712067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:59.712897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:59.719568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.720344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.720953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.721890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.722512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.723193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.792495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:29:59.931971 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bbbf8d3b-325d-429e-b200-31a3f2a5812a tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.432252 Aug 30 03:29:59.932582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 741/1541] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:29:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:29:59.939616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:29:59.948588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:29:59.957044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.966390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.967422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:29:59.968692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:29:59.970102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:29:59.970781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:00.040507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d61063e2-4fe6-424a-bb4f-08647321e27e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106837 Aug 30 03:30:00.047488 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 742/1542] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:29:59 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:00.052599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:00.053513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] [instance: a28b0ad0-b499-4791-863b-3e38658f5822] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:00.054957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:00.061071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:00.061873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:00.062512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:00.063444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:00.064333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:00.064946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:00.068890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:00.071852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:00.074520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31f76f56-df59-444f-8882-ecda92e4b4ce tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.366011 Aug 30 03:30:00.092452 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] HTTP exception thrown: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Request method failure captured: Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 HTTP/1.1 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYOhMu85uHYPXkTIRkbEbv4bMhOsfXmVKJRqCsfHc8nxbt9g8olgC8Oi15GoGWKHxtNy7XV2mohlT-xPg2_n-LEgvLvZk7TkEnxeyjXmS9ysaV9rCY25blSujl5nsUZADUANevi0H44PAF04BzjeCHAxCqGzF0Gaa25sMtyJE53naRQ Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c0c2eb009d0418bba5a2aef20febc55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c0c2eb009d0418bba5a2aef20febc55", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c0c2eb009d0418bba5a2aef20febc55"}]}] Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8c0c2eb009d0418bba5a2aef20febc55 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427 Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7957bda6b3f3422a94f08752db13ddec Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1392934427-project Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a28b0ad0-b499-4791-863b-3e38658f5822'} Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:00.094777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] Returning 404 to user: Instance a28b0ad0-b499-4791-863b-3e38658f5822 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56ddbe8e-5afa-4417-a0b6-a7a9c2c2bdff tempest-ImagesOneServerNegativeTestJSON-1392934427 tempest-ImagesOneServerNegativeTestJSON-1392934427-project] 10.222.0.30 "GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822" status: 404 len: 111 microversion: 2.1 time: 0.047568 Aug 30 03:30:00.104558 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 743/1543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:00 2022] GET /compute/v2.1/servers/a28b0ad0-b499-4791-863b-3e38658f5822 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:30:00.113766 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 801/1544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:29:59 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:00.118043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2530a38a-5dec-42eb-80a2-9663c4009f8f tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Action: 'create', calling method: .version_select at 0x7f897b262670>, body: {"security_group_rule": {"parent_group_id": "63e0118d-5228-460e-95b4-a68cec1e3456", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:00.224010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:00.224631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:00.231411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:00.232948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:00.233997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:00.235745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:00.236726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:00.237318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:00.728895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:00.753988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d07c1d5-6cbc-4298-b55a-e4a84b198bc2 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1317 microversion: 2.1 time: 0.530024 Aug 30 03:30:00.773232 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 802/1545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:00 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:30:00.786145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:00.790565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:00.808455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:00.809785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:00.810410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:00.811337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:00.811960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:00.812545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.139621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:01.152598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:01.160227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:01.162268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e04f0d15-03e5-4220-be07-5dd9b295f55d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.387861 Aug 30 03:30:01.163735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 803/1546] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:00 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:01.175179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:01.179246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:01.180638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2530a38a-5dec-42eb-80a2-9663c4009f8f tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.082666 Aug 30 03:30:01.182866 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 744/1547] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:30:00 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:01.190644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9ae7f5d7-9872-4fbe-b27a-52466a1d6ae0 req-7a7f5042-2b2d-4e3f-b366-00461d7ce675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598bb3d4-cec1-4d4c-a029-b9e3a8a30adb", "name": "network-vif-plugged", "status": "completed", "tag": "c452296c-33e2-41f7-82af-608f8072d4d6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:01.196410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.199190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.203060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.204376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.205278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.206066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.231128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9ae7f5d7-9872-4fbe-b27a-52466a1d6ae0 req-7a7f5042-2b2d-4e3f-b366-00461d7ce675 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.241178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9ae7f5d7-9872-4fbe-b27a-52466a1d6ae0 req-7a7f5042-2b2d-4e3f-b366-00461d7ce675 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.242420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9ae7f5d7-9872-4fbe-b27a-52466a1d6ae0 req-7a7f5042-2b2d-4e3f-b366-00461d7ce675 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.323265 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9ae7f5d7-9872-4fbe-b27a-52466a1d6ae0 req-7a7f5042-2b2d-4e3f-b366-00461d7ce675 service nova] Creating event network-vif-plugged:c452296c-33e2-41f7-82af-608f8072d4d6 for instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb on n-h2-854924-5 Aug 30 03:30:01.345177 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9ae7f5d7-9872-4fbe-b27a-52466a1d6ae0 req-7a7f5042-2b2d-4e3f-b366-00461d7ce675 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158597 Aug 30 03:30:01.347605 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 745/1548] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:01.359843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:01.364545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:01.373058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.374124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.374797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.376984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.377769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.378393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.471762 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f5bb039-95c7-4f84-8e13-8dc7ad35df47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121215 Aug 30 03:30:01.475260 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 746/1549] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:30:01 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:01.482946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:01.487903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:01.509196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.510074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.510736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.511702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.512335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.517400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.606684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:01.615939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-323f367b-d326-4e8e-b7f7-a70d70559fc3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.447344 Aug 30 03:30:01.623144 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 804/1550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:01 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:01.634536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5489d935-cc29-47a4-b6b1-b2b1b5403bff tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f8983d32a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:01.895812 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5489d935-cc29-47a4-b6b1-b2b1b5403bff tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/63e0118d-5228-460e-95b4-a68cec1e3456" status: 200 len: 663 microversion: 2.1 time: 0.271215 Aug 30 03:30:01.897164 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 805/1551] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:30:01 2022] GET /compute/v2.1/os-security-groups/63e0118d-5228-460e-95b4-a68cec1e3456 => generated 663 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:01.910178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:01.911168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:01.917802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.918614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.919175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:01.920204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:01.920707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:01.921597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.019557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.028742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.030640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.031881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d593895-5678-4f67-a167-aae365a382a5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.555381 Aug 30 03:30:02.032498 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 747/1552] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:01 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:02.045324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6260f8f7-39ec-423d-a014-1cd46086928a tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b26a1f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:02.464775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.491009 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-02d4fec0-66ab-4ca8-bab6-932689f6cbc7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1317 microversion: 2.1 time: 0.582428 Aug 30 03:30:02.491562 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 806/1553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:01 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:02.514350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:02.519444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:02.538102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:02.542977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:02.545245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.551563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:02.553439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:02.556349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.767760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.772223 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6260f8f7-39ec-423d-a014-1cd46086928a tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/a345aff7-2bee-4d29-9c3a-25e94be85d8a" status: 202 len: 0 microversion: 2.1 time: 0.732981 Aug 30 03:30:02.777514 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 748/1554] 10.222.0.30 () {58 vars in 1287 bytes} [Tue Aug 30 03:30:02 2022] DELETE /compute/v2.1/os-security-group-rules/a345aff7-2bee-4d29-9c3a-25e94be85d8a => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:02.807673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:02.814341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.817467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:02.818216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:02.821032 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aedb9728-c758-4ebf-9641-d48c867cb7fe tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.324083 Aug 30 03:30:02.823054 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 807/1555] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:02 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:02.830672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:02.832081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:02.832534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.833304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:02.833791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:02.834244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.834507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:02.836152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:02.847951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:02.849267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:02.850298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.851991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:02.852848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:02.854022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:02.911489 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59c90754-2420-4153-9b86-a704f25932db tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128367 Aug 30 03:30:02.912258 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 749/1556] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:30:02 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:30:02.917046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebeac653-134a-4adf-afec-96bc484e98c1 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b5628b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:03.721682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:03.737425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ffc9455f-a14f-42c9-83de-9bf65ef902ff tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.908717 Aug 30 03:30:03.738099 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 808/1557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:02 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:03.753249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:03.754644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:03.761983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:03.763006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:03.763673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:03.764864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:03.765592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:03.766131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:04.478092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ebeac653-134a-4adf-afec-96bc484e98c1 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/63e0118d-5228-460e-95b4-a68cec1e3456" status: 202 len: 0 microversion: 2.1 time: 1.563984 Aug 30 03:30:04.479119 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 750/1558] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:02 2022] DELETE /compute/v2.1/os-security-groups/63e0118d-5228-460e-95b4-a68cec1e3456 => generated 0 bytes in 1566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:04.488001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:04.488624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:04.514951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:04.525221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:04.525845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:04.526604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:04.527061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:04.527476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:04.533032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:04.542679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:04.556943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:04.558793 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dd392682-4593-4e26-855b-7a03aad4eaf5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.811692 Aug 30 03:30:04.586018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 809/1559] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:03 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:04.600120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-47b1183e-e6bc-493b-a085-be9c5439c188 req-da0d7f37-e373-4084-9c16-cb9adbdd8172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819267e5-842b-448c-9469-230929e39b3a", "name": "network-vif-plugged", "status": "completed", "tag": "65c21e95-559c-42e7-8ef7-1753a8409ed5"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:04.633211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:04.637084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-47b1183e-e6bc-493b-a085-be9c5439c188 req-da0d7f37-e373-4084-9c16-cb9adbdd8172 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:04.646182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-47b1183e-e6bc-493b-a085-be9c5439c188 req-da0d7f37-e373-4084-9c16-cb9adbdd8172 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:04.647026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-47b1183e-e6bc-493b-a085-be9c5439c188 req-da0d7f37-e373-4084-9c16-cb9adbdd8172 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:04.689639 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-47b1183e-e6bc-493b-a085-be9c5439c188 req-da0d7f37-e373-4084-9c16-cb9adbdd8172 service nova] Creating event network-vif-plugged:65c21e95-559c-42e7-8ef7-1753a8409ed5 for instance 819267e5-842b-448c-9469-230929e39b3a on n-h2-854924-5 Aug 30 03:30:04.697047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-47b1183e-e6bc-493b-a085-be9c5439c188 req-da0d7f37-e373-4084-9c16-cb9adbdd8172 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119177 Aug 30 03:30:04.698399 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 810/1560] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:04.712133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:04.717488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:04.729760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:04.731404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:04.732258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:04.733523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:04.734346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:04.735774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.004592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:05.020450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:05.021988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:05.023182 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2eeb3789-15a5-4997-a39e-0cd3afa53ce7 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.323209 Aug 30 03:30:05.024309 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 811/1561] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:04 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:05.040498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f8983b4e5e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:05.116176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:30:05.117252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Neutron security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:30:05.118172 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] HTTP exception thrown: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.118172 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Request method failure captured: Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-security-groups/7c4b4d9e-e11e-4562-a710-dec5b4c0540b HTTP/1.1 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQlXlUeLX5AaUYEsiiWveHY0TeuMOM3QQrtnlnOOTDLl7tOF6DJw-yN_I-3L31CEln8-YA-JoiVp3r_QRjLhTDk1aeR59iucUmCK_Q8WZx1oWpJfEZz3RUNUtFDB9lniwQrftBWM7EM0QMWvRRBzMGMYZHK7aF4AFI0qNRfJJsv9Pw Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: aae0d32d91f14c0abf78437dc6457690 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1992198339 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aae0d32d91f14c0abf78437dc6457690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aae0d32d91f14c0abf78437dc6457690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aae0d32d91f14c0abf78437dc6457690", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aae0d32d91f14c0abf78437dc6457690"}]}] Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1992198339 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: aae0d32d91f14c0abf78437dc6457690 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1992198339 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupRulesTestJSON-1992198339-project Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c36497b426bc4c80acc4aa8fadbf6611 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1992198339-project Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: exception: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7c4b4d9e-e11e-4562-a710-dec5b4c0540b'} Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:30:05.121336 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] Aug 30 03:30:05.128865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:05.139936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Returning 404 to user: Security group 7c4b4d9e-e11e-4562-a710-dec5b4c0540b does not exist Aug 30 03:30:05.139936 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-18493552-8606-40c5-82ad-669ffc83efb8'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:30:05.139936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0679e328-8b40-4829-91f6-054c513d39c7 tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7c4b4d9e-e11e-4562-a710-dec5b4c0540b" status: 404 len: 194 microversion: 2.1 time: 0.108767 Aug 30 03:30:05.141449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 812/1562] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:05 2022] DELETE /compute/v2.1/os-security-groups/7c4b4d9e-e11e-4562-a710-dec5b4c0540b => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:30:05.147151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:05.147823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:05.159366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:05.160263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:05.161016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.162415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:05.167749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:05.172358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:05.174482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.183916 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fa747482-bd74-4548-8e9b-e041d2e6b7bd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 200 len: 1505 microversion: 2.1 time: 0.703330 Aug 30 03:30:05.185686 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 751/1563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:04 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:05.194808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-75eebec6-c4bc-413e-b110-54c99e827d0c tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b50b5e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:05.513178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:05.551110 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bcd91300-aaeb-4b49-a81c-d3a60f6e927a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.388506 Aug 30 03:30:05.554628 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 813/1564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:05 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:05.563569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:05.567305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:05.587957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:05.590423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:05.592231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.594121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:05.596920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:05.598370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.749773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-75eebec6-c4bc-413e-b110-54c99e827d0c tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/11429629-f622-4bd9-953f-a03cd8d56217" status: 202 len: 0 microversion: 2.1 time: 0.562702 Aug 30 03:30:05.750891 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 752/1565] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:05 2022] DELETE /compute/v2.1/os-security-groups/11429629-f622-4bd9-953f-a03cd8d56217 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:05.757971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:05.758588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:05.783013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:05.783521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:05.783963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.784686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:05.785142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:05.785597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:05.835530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:05.850991 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d2d5364-535b-40c9-af82-2edb82f366ac tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 200 len: 1317 microversion: 2.1 time: 0.290045 Aug 30 03:30:05.853678 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 814/1566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:05 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:05.865485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94a2339a-f57b-4f01-802b-65c2dabb9dcf tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b006790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:06.064529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.104475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.106380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.107972 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64f32368-f404-4180-96b3-3ac87a99c98c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.355753 Aug 30 03:30:06.110025 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 753/1567] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:05 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:06.118006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:06.119194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:06.126274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:06.127100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:06.128861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:06.130101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:06.130797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:06.131438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:06.235903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.255846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.260009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.263791 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23ab0fc3-bcfc-45c5-9bb5-05a6f601cd69 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.151649 Aug 30 03:30:06.266866 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 754/1568] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:06 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:06.397545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94a2339a-f57b-4f01-802b-65c2dabb9dcf tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/42cadbc4-e607-40a8-afd1-4dcfbf5512a2" status: 202 len: 0 microversion: 2.1 time: 0.542311 Aug 30 03:30:06.402071 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 815/1569] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:05 2022] DELETE /compute/v2.1/os-security-groups/42cadbc4-e607-40a8-afd1-4dcfbf5512a2 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:06.409008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-923d58a0-f77b-432d-83bf-fd51b43998bc tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b279940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:06.581015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:06.582484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:06.599648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:06.609842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:06.609842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:06.609842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:06.609842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:06.609842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:06.644423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:06.886393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:06.897042 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0af78a54-41f9-48ff-97e9-78b922eeae2f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.323131 Aug 30 03:30:06.899014 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 816/1570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:06 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:06.904050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:06.904989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:06.933214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-923d58a0-f77b-432d-83bf-fd51b43998bc tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a839388d-d89f-4ed8-bbe4-e359020e8d0c" status: 202 len: 0 microversion: 2.1 time: 0.530674 Aug 30 03:30:06.934974 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 755/1571] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:06 2022] DELETE /compute/v2.1/os-security-groups/a839388d-d89f-4ed8-bbe4-e359020e8d0c => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:06.955367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d9ff0f-7f67-420b-b4a8-7536d7aa46cf tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b2bdca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:06.955623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:06.958301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:06.963427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:06.964520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:06.965225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:06.965905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:07.376495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.408617 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-630da2f0-8211-4ca8-bf02-97e1349846a0 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 200 len: 1317 microversion: 2.1 time: 0.508082 Aug 30 03:30:07.409229 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 817/1572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:06 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:07.433399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:07.434024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:07.450542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:07.451159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:07.456715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:07.460364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:07.462287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:07.464413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:07.496169 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64d9ff0f-7f67-420b-b4a8-7536d7aa46cf tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6eb8281c-4a4b-4aa9-a9ee-3417f937fff4" status: 202 len: 0 microversion: 2.1 time: 0.556553 Aug 30 03:30:07.497040 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 756/1573] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:06 2022] DELETE /compute/v2.1/os-security-groups/6eb8281c-4a4b-4aa9-a9ee-3417f937fff4 => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:30:07.505947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:07.507080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:07.535037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:07.541025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:07.542048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:07.543052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:07.543764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:07.544431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:07.732404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.763571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.767440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.768932 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-791a446a-3d2c-486d-8616-f747e1f7870d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1408 microversion: 2.54 time: 0.270802 Aug 30 03:30:07.782517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.787273 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 757/1574] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:07 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:07.796117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.798898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4414fa3f-2ec1-4182-83bf-f95754ebebee tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] Calling method '.version_select at 0x7f897b2bd160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:07.799404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:07.800751 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-43c2cbba-b09c-4541-9d8e-67a4043b6547 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1567 microversion: 2.25 time: 0.390489 Aug 30 03:30:07.801925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 818/1575] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:07 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1567 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:07.929023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:07.930447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:07.945637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:07.947059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:07.950095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:07.951605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:07.952401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:07.953129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:08.411156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:08.453285 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e108324-d6f7-4f67-98e7-acba0b590480 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 0.531633 Aug 30 03:30:08.455476 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 819/1576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:07 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:08.467722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:08.470234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:08.491600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:08.492474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:08.493324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:08.494339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:08.495019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:08.495911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:08.649699 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4414fa3f-2ec1-4182-83bf-f95754ebebee tempest-SecurityGroupRulesTestJSON-1992198339 tempest-SecurityGroupRulesTestJSON-1992198339-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/376b6bca-3e43-4560-8445-e35c4351ee5c" status: 202 len: 0 microversion: 2.1 time: 0.859493 Aug 30 03:30:08.651062 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 758/1577] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:30:07 2022] DELETE /compute/v2.1/os-security-groups/376b6bca-3e43-4560-8445-e35c4351ee5c => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:08.795178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:08.796324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:08.811694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:08.813431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:08.814181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:08.815214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:08.816578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:08.817371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:08.932883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:08.949370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:08.951996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:08.956569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a488c97a-63b1-4c66-9387-36257c25510b tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1414 microversion: 2.54 time: 0.162509 Aug 30 03:30:08.958898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 759/1578] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:08 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:30:08.974733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:08.985893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:09.001150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.002808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.003461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.006728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.013309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.013995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.120612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:09.132233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cbd5b22f-4c9d-45b0-90ec-8acf32819e3d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 200 len: 1505 microversion: 2.1 time: 0.675373 Aug 30 03:30:09.141664 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 820/1579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:08 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:09.167093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:09.167593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:09.182988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.184501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.186515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.188760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.192000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.192700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.332482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:30:09.525659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:09.541797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:09.551869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:09.553489 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c612d59-72c2-4d44-ba29-0d20e6399b85 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1557 microversion: 2.25 time: 0.593412 Aug 30 03:30:09.554657 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 760/1580] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:08 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1557 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:09.559763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:09.560557 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3eb507e8-0d49-4949-b5e1-c61183f072a7 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "DELETE /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 204 len: 0 microversion: 2.1 time: 0.394684 Aug 30 03:30:09.565661 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 821/1581] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:30:09 2022] DELETE /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:30:09.566603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:09.578920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.580042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.583934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.585140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.585661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.586331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.588151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:09.589114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:09.613394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.613999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.614445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.615183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.615631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.616050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.690762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:30:09.912625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1232c81f-e5b7-4686-973e-9d6e39c7c07f tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "DELETE /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 204 len: 0 microversion: 2.1 time: 0.345415 Aug 30 03:30:09.913228 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 822/1582] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:30:09 2022] DELETE /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:30:09.927625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ed6ca00-afa7-43e5-8c15-46ad1813513c tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '.version_select at 0x7f8983b4e9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:09.937052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ed6ca00-afa7-43e5-8c15-46ad1813513c tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.939071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ed6ca00-afa7-43e5-8c15-46ad1813513c tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.939992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ed6ca00-afa7-43e5-8c15-46ad1813513c tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:09.973730 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ed6ca00-afa7-43e5-8c15-46ad1813513c tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3629 microversion: 2.25 time: 0.058386 Aug 30 03:30:09.974885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 823/1583] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Aug 30 03:30:09 2022] GET /compute/v2.1/os-migrations => generated 3629 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:09.984142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:09.986830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:09.997882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:09.998915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:09.999568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:10.004331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:10.005877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:10.007748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:10.658610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:10.683359 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29d4d429-faec-499b-8297-777743d5970b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 1.127276 Aug 30 03:30:10.687671 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 761/1584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:09 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:10.698156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:10.699164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:10.706918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:10.708011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:10.708795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:10.709732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:10.710556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:10.711166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:10.916390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:10.937895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ee1eaae-602c-4afe-b3d9-d727c97ab780 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 200 len: 1511 microversion: 2.1 time: 0.959198 Aug 30 03:30:10.950680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:10.956733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 824/1585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:09 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 1511 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:10.966505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:10.977721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:10.979513 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c0fe355-589e-4775-a771-2e9e531457f3 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1414 microversion: 2.54 time: 0.290498 Aug 30 03:30:10.980799 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 762/1586] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:10 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1414 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:10.989113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:10.989775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:11.028595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:11.042702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:11.050951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:11.052937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:11.057962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:11.061386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:11.711087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:11.712256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:11.729312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:11.731934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:11.734471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:11.738829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:30:11.739706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:11.744545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:11.768204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:11.788511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de7e5e0d-5b28-4e48-ad6f-bf17d2997761 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 2050 microversion: 2.25 time: 0.811143 Aug 30 03:30:11.797374 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 825/1587] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:10 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 2050 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:12.069372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:12.071029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:12.106407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:12.106925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:12.113989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:12.114692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:12.117987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:12.118463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:13.067282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:13.075524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0bdaaa86-c181-45a4-8424-151ad3e624bd tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1477 microversion: 2.1 time: 1.368476 Aug 30 03:30:13.076098 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 763/1588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:11 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1477 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:13.095406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:13.104956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:13.121243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:13.126258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:13.126749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:13.127555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:13.128134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:13.128751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:13.196379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:13.206975 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42a7b654-4090-45df-b131-85761b187eb8 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 200 len: 1511 microversion: 2.1 time: 1.233373 Aug 30 03:30:13.212449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 826/1589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:11 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 1511 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:13.221829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-755513549", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "790c575c-89a4-4f37-8094-cadf2b9c79fa"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:13.295455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:13.304516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:13.307219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:13.308919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae78a698-2775-4be8-8446-409bb8e0dd43 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1414 microversion: 2.54 time: 0.226809 Aug 30 03:30:13.309891 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 764/1590] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:13 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1414 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:13.425985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] validate_networks() for [('790c575c-89a4-4f37-8094-cadf2b9c79fa', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:30:14.104673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:14.106010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:14.125931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:14.126879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:14.127502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:14.128497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:14.129409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:14.131502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:15.357451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:15.379168 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96f5a0ae-93cd-4a05-9f38-ff61e674d95a tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1476 microversion: 2.1 time: 1.280668 Aug 30 03:30:15.381515 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 765/1591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:14 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1476 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:30:15.399303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:15.404162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:15.430260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:15.431087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:15.432465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:15.434764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:15.435435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:15.436330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:15.862405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f22f6d58f11485cb29ad1f529e78103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187cc2094c9e447bb11ec96cfb435250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:15.898328 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-531674a0-eeab-4a81-ae29-e7d19589265d tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 200 len: 1469 microversion: 2.1 time: 0.508510 Aug 30 03:30:15.912470 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 766/1592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:15 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 1469 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:15.912470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:15.912470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:15.937561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:15.937860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:15.942058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:15.943322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:15.943973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:15.944977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:16.494295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:16.512480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:16.513966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:16.516933 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-078ae5a5-865b-4dad-b480-5cc1edbc4c59 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1399 microversion: 2.54 time: 0.616415 Aug 30 03:30:16.528944 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 767/1593] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:15 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1399 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:16.534728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "name": "network-vif-unplugged", "status": "completed", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:16.552573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:16.562544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:16.563600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:16.609070 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] Creating event network-vif-unplugged:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h1-854924-5 Aug 30 03:30:16.628046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] Instance 677f6c5a-7d93-42cd-981c-f39af153a372 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:30:16.650046 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-033687a3-c4b8-4d54-aa93-ca7c1697f1a4 req-8065c307-92d9-4632-9b42-219a8911b2c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119340 Aug 30 03:30:16.651163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 768/1594] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:16.656543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5e8e6313-03fd-402d-ae77-7f1a3d39691c req-8bcc5013-118f-43fd-9850-e0be8ad5abdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819267e5-842b-448c-9469-230929e39b3a", "name": "network-vif-deleted", "tag": "65c21e95-559c-42e7-8ef7-1753a8409ed5"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:16.669934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e8e6313-03fd-402d-ae77-7f1a3d39691c req-8bcc5013-118f-43fd-9850-e0be8ad5abdf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:16.670696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e8e6313-03fd-402d-ae77-7f1a3d39691c req-8bcc5013-118f-43fd-9850-e0be8ad5abdf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:16.671623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e8e6313-03fd-402d-ae77-7f1a3d39691c req-8bcc5013-118f-43fd-9850-e0be8ad5abdf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:16.686122 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5e8e6313-03fd-402d-ae77-7f1a3d39691c req-8bcc5013-118f-43fd-9850-e0be8ad5abdf service nova] Creating event network-vif-deleted:65c21e95-559c-42e7-8ef7-1753a8409ed5 for instance 819267e5-842b-448c-9469-230929e39b3a on n-h2-854924-5 Aug 30 03:30:16.692483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5e8e6313-03fd-402d-ae77-7f1a3d39691c req-8bcc5013-118f-43fd-9850-e0be8ad5abdf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039788 Aug 30 03:30:16.694615 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 769/1595] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:16.700865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a2a0b704-7566-4782-95c8-80077765685b req-58e828ef-9cb3-4c07-b6f4-1e609c8a5333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598bb3d4-cec1-4d4c-a029-b9e3a8a30adb", "name": "network-vif-deleted", "tag": "c452296c-33e2-41f7-82af-608f8072d4d6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:16.712992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a2a0b704-7566-4782-95c8-80077765685b req-58e828ef-9cb3-4c07-b6f4-1e609c8a5333 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:16.714218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a2a0b704-7566-4782-95c8-80077765685b req-58e828ef-9cb3-4c07-b6f4-1e609c8a5333 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:16.717037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a2a0b704-7566-4782-95c8-80077765685b req-58e828ef-9cb3-4c07-b6f4-1e609c8a5333 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:16.738665 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a2a0b704-7566-4782-95c8-80077765685b req-58e828ef-9cb3-4c07-b6f4-1e609c8a5333 service nova] Creating event network-vif-deleted:c452296c-33e2-41f7-82af-608f8072d4d6 for instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb on n-h2-854924-5 Aug 30 03:30:16.743926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a2a0b704-7566-4782-95c8-80077765685b req-58e828ef-9cb3-4c07-b6f4-1e609c8a5333 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047508 Aug 30 03:30:16.745291 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 770/1596] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:16.754623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:16.756055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:16.763516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:16.764269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:16.764861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:16.766384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:16.767002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:16.767587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.408232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:17.408872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:17.409109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:17.409578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:17.409980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:17.428439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.429162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.429837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.431306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.431306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.431559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.505678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:30:17.518464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for user 90a88f0a70ca48f59450dae1c9165417 and project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:30:17.534628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:30:17.538500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:30:17.564936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:17.573241 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-502b0cf3-7db6-4b93-bd4b-795cd48ddef3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1476 microversion: 2.1 time: 0.826512 Aug 30 03:30:17.577779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 771/1597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:16 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1476 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:17.582762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b15ebd1-6bb3-4229-8cab-cd1cd7e43a82 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '.version_select at 0x7f897b279820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:17.624481 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79f61618-6ced-4777-b566-0ede2bd57c72 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.406940 Aug 30 03:30:17.625693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 827/1598] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:30:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4412 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:30:17.632076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:17.633849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 819267e5-842b-448c-9469-230929e39b3a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:17.641623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.642431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.643341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.644285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.645018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.645864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.647952 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b15ebd1-6bb3-4229-8cab-cd1cd7e43a82 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1747310173" status: 204 len: 0 microversion: 2.54 time: 0.068950 Aug 30 03:30:17.652403 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 772/1599] 10.222.0.30 () {60 vars in 1319 bytes} [Tue Aug 30 03:30:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1747310173 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:30:17.657958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-365b97b6-67c9-418b-98a6-10dbd13409d1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:17.668995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-365b97b6-67c9-418b-98a6-10dbd13409d1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:17.676931 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] HTTP exception thrown: Instance 819267e5-842b-448c-9469-230929e39b3a could not be found. Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Request method failure captured: Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a HTTP/1.1 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYP5lKNEa0C2s-G5271lv4kT7tyUF5LmUdDm37_m6CIYxZyMtC9YjuGT0ArW68wlvId5U3NCgEMCswkcc514H5pJxxd69qVo-yYvANK_wElT-crM7oHluwdc10AOXa-lTHZSQ45ySBYpDJKpPcir4PmQzC612fPLB_w6fsdj6ulpslI Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 187cc2094c9e447bb11ec96cfb435250 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-MultipleCreateTestJSON-1010190111 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187cc2094c9e447bb11ec96cfb435250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/187cc2094c9e447bb11ec96cfb435250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_187cc2094c9e447bb11ec96cfb435250", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187cc2094c9e447bb11ec96cfb435250"}]}] Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-MultipleCreateTestJSON-1010190111 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 187cc2094c9e447bb11ec96cfb435250 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1010190111 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-MultipleCreateTestJSON-1010190111-project Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8f22f6d58f11485cb29ad1f529e78103 Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-MultipleCreateTestJSON-1010190111-project Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 819267e5-842b-448c-9469-230929e39b3a could not be found. Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '819267e5-842b-448c-9469-230929e39b3a'} Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819267e5-842b-448c-9469-230929e39b3a could not be found. Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819267e5-842b-448c-9469-230929e39b3a could not be found. Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:17.681873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819267e5-842b-448c-9469-230929e39b3a could not be found. Aug 30 03:30:17.687904 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.690997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Returning 404 to user: Instance 819267e5-842b-448c-9469-230929e39b3a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:30:17.692178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42d96291-b64d-475f-8796-f6eeb3739ffd tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a" status: 404 len: 111 microversion: 2.1 time: 0.064755 Aug 30 03:30:17.693293 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 828/1600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:17 2022] GET /compute/v2.1/servers/819267e5-842b-448c-9469-230929e39b3a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:30:17.702558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:17.703297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:17.711555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.712404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.713013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.713952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.714569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.715153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.751438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:30:17.835751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:17.903777 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb77c0f7-21d6-49f7-9b34-c9c504a0f50a tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "DELETE /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 204 len: 0 microversion: 2.54 time: 0.208552 Aug 30 03:30:17.904747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 829/1601] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:30:17 2022] DELETE /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:30:17.912600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:17.914124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] [instance: 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:17.921506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:17.932717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.934248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.935234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.936345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:17.937035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:17.937760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:17.966544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-365b97b6-67c9-418b-98a6-10dbd13409d1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:17.972509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] HTTP exception thrown: Instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb could not be found. Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Request method failure captured: Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb HTTP/1.1 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYP5lKNEa0C2s-G5271lv4kT7tyUF5LmUdDm37_m6CIYxZyMtC9YjuGT0ArW68wlvId5U3NCgEMCswkcc514H5pJxxd69qVo-yYvANK_wElT-crM7oHluwdc10AOXa-lTHZSQ45ySBYpDJKpPcir4PmQzC612fPLB_w6fsdj6ulpslI Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 187cc2094c9e447bb11ec96cfb435250 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-MultipleCreateTestJSON-1010190111 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187cc2094c9e447bb11ec96cfb435250"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/187cc2094c9e447bb11ec96cfb435250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_187cc2094c9e447bb11ec96cfb435250", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/187cc2094c9e447bb11ec96cfb435250"}]}] Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-MultipleCreateTestJSON-1010190111 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 187cc2094c9e447bb11ec96cfb435250 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1010190111 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-MultipleCreateTestJSON-1010190111-project Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8f22f6d58f11485cb29ad1f529e78103 Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-MultipleCreateTestJSON-1010190111-project Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb could not be found. Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '598bb3d4-cec1-4d4c-a029-b9e3a8a30adb'} Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb could not be found. Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb could not be found. Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:17.975071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb could not be found. Aug 30 03:30:17.981585 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:30:17.982525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] Returning 404 to user: Instance 598bb3d4-cec1-4d4c-a029-b9e3a8a30adb could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:30:17.983410 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c434824-b59a-4d44-a6d5-80deac661c41 tempest-MultipleCreateTestJSON-1010190111 tempest-MultipleCreateTestJSON-1010190111-project] 10.222.0.30 "GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb" status: 404 len: 111 microversion: 2.1 time: 0.077291 Aug 30 03:30:17.987569 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 830/1602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:17 2022] GET /compute/v2.1/servers/598bb3d4-cec1-4d4c-a029-b9e3a8a30adb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:30:17.987911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-365b97b6-67c9-418b-98a6-10dbd13409d1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:17.989191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-365b97b6-67c9-418b-98a6-10dbd13409d1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:17.990745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-365b97b6-67c9-418b-98a6-10dbd13409d1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1261 microversion: 2.25 time: 0.337114 Aug 30 03:30:17.991367 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 773/1603] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:17 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1261 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:18.003619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:18.004429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:18.020331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:18.021308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:18.021308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:18.028086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:18.033637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:18.034395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:18.260948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:18.283325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:18.285806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:18.287655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-040c213f-3e44-498c-806b-49ee3ea14c83 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1405 microversion: 2.54 time: 0.294961 Aug 30 03:30:18.292046 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 774/1604] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:17 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:18.359578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a0e9fd1-a147-4a07-89ce-e63600550a2f tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Action: 'create', calling method: .version_select at 0x7f897b023ca0>, body: {"pool": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:18.600869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:18.601684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:18.615726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:18.619052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:18.619826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:18.620786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:18.626253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:18.627133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:19.061506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.066429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:19.076841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d6d90b3-64db-4443-bf92-cdf84c0bb6b0 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1476 microversion: 2.1 time: 0.476603 Aug 30 03:30:19.079439 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 775/1605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:18 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:30:19.093711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:19.096571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:19.126526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:19.135123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:19.135621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:19.137811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:19.137959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:19.138403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:19.333278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.348718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.352286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.353808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc7988e4-a76e-4cbb-9f56-1e372eb3b57e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1313 microversion: 2.25 time: 0.272715 Aug 30 03:30:19.362609 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 776/1606] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:19 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:19.370984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:19.401805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:19.402751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:19.403395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:19.439113 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] Creating event network-changed:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h1-854924-5 Aug 30 03:30:19.451162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] Instance 677f6c5a-7d93-42cd-981c-f39af153a372 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:30:19.479403 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-63fe5729-d562-437e-8053-3b221b73df00 req-5593f68c-6219-48b7-8a40-ff40706d8a3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115437 Aug 30 03:30:19.481104 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 777/1607] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:19.511338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:19.512984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:19.525967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:19.544640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:19.552425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:19.555138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:19.556152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:19.556909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:19.782026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.804243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.809129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd790113d61c4d3ebd08ebb7d097caf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816296d7440240cdbae8ba9162757306', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:19.815108 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d42ea1e8-b47d-4a6b-b136-8a424dad4276 tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 200 len: 1405 microversion: 2.54 time: 0.326855 Aug 30 03:30:19.816000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 778/1608] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:19 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:20.106878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:20.109163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:20.133182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:20.136385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:20.141779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:20.150602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:20.151642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:20.153089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:21.074920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:21.114918 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce60969f-3429-4da2-a71b-c3420524c970 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1476 microversion: 2.1 time: 1.016037 Aug 30 03:30:21.117391 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 779/1609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:20 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1476 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:21.126024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:21.127101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:21.134977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:21.136548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:21.137259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:21.138459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:21.139214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:21.140542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:21.959956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:21.973707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:21.978424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:21.986693 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8a6adce-d7ed-4b45-a039-a351232baaab tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1319 microversion: 2.25 time: 0.867772 Aug 30 03:30:21.988284 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 780/1610] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:21 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1319 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:22.000702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:22.010355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] [instance: 11150514-e145-42a9-a868-3a77306052ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:22.019901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:22.030488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:22.031311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:22.032252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:22.033110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:22.033924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:22.056637 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] HTTP exception thrown: Instance 11150514-e145-42a9-a868-3a77306052ab could not be found. Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Request method failure captured: Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab HTTP/1.1 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYQSbN_-j8jZ2E5_APiMuSOI0qV3b0YYWpfKxjB5-d3EuTHyyQkq5LcMQ2sejchfF8jrNjmysO62hb--Axm8DrRqSF8tTjZChwKWZPJ9IQ1kzNr4SX13edvnQ8RE_t8ynRP-_PI8OO_MNfzAHMKbxs9Ra4gG17naZEB_XuLk7KyjaZ0 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.54 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 816296d7440240cdbae8ba9162757306 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerShowV254Test-670905665 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/816296d7440240cdbae8ba9162757306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/816296d7440240cdbae8ba9162757306"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_816296d7440240cdbae8ba9162757306", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/816296d7440240cdbae8ba9162757306"}]}] Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerShowV254Test-670905665 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 816296d7440240cdbae8ba9162757306 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerShowV254Test-670905665 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerShowV254Test-670905665-project Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: bd790113d61c4d3ebd08ebb7d097caf6 Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerShowV254Test-670905665-project Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 11150514-e145-42a9-a868-3a77306052ab could not be found. Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '11150514-e145-42a9-a868-3a77306052ab'} Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11150514-e145-42a9-a868-3a77306052ab could not be found. Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11150514-e145-42a9-a868-3a77306052ab could not be found. Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:30:22.069244 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11150514-e145-42a9-a868-3a77306052ab could not be found. Aug 30 03:30:22.075834 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:30:22.084142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] Returning 404 to user: Instance 11150514-e145-42a9-a868-3a77306052ab could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:30:22.089633 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-356344ae-227c-41cb-a281-fc2affec539d tempest-ServerShowV254Test-670905665 tempest-ServerShowV254Test-670905665-project] 10.222.0.30 "GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab" status: 404 len: 111 microversion: 2.54 time: 0.098273 Aug 30 03:30:22.092461 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 781/1611] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:21 2022] GET /compute/v2.1/servers/11150514-e145-42a9-a868-3a77306052ab => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:30:22.142379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:22.143765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:22.164549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:22.164925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:22.165375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:22.166093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:22.166543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:22.166965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:23.135524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:23.154383 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1477df88-9760-4993-aa09-b98062a18685 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1476 microversion: 2.1 time: 1.017220 Aug 30 03:30:23.158695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 782/1612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:22 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1476 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:30:23.172650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:23.173765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:23.184292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:23.185110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:23.186000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:23.188714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:23.189432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:23.193143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:23.400954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:23.416773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:23.418610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:23.419748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89604716-2ac8-4f76-b1a1-71eef189ea3a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1319 microversion: 2.25 time: 0.259803 Aug 30 03:30:23.420310 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 783/1613] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:23 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:24.192227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:24.193213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:24.207595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:24.208209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:24.208650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:24.209434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:24.210181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:24.210614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:24.823247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:24.835056 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-adadbbcc-1767-448c-9239-b39e2a336d36 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1474 microversion: 2.1 time: 0.655259 Aug 30 03:30:24.849416 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 784/1614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:24 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1474 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:24.849416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:24.849416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:24.863181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:24.863676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:24.866012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:24.870169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:24.870660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:24.871332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:25.807127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:25.817267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:25.818792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:25.820123 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c2847ac-66aa-49f4-9a75-dca8169f52b5 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.983023 Aug 30 03:30:25.826731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 785/1615] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:24 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:25.861924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:25.863200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:25.882437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:25.883055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:25.883741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:25.884670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:25.885423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:25.886080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:26.270665 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a0e9fd1-a147-4a07-89ce-e63600550a2f tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.279512 Aug 30 03:30:26.271928 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 831/1616] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:30:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:26.284291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d77aedcd-69ee-466a-8c91-f58fd5222df9 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Action: 'create', calling method: .version_select at 0x7f897afd40d0>, body: {"pool": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:27.193857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:27.212937 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98c42851-0b22-42d3-a07d-f990b006d564 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1474 microversion: 2.1 time: 1.354062 Aug 30 03:30:27.216265 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 786/1617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:25 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1474 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:27.237074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:27.241137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:27.245690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:27.263892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:27.264868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:27.295284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:27.296666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:27.301135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:27.303674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:27.457474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:27.528913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:27.971681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:27.971857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:28.367345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:28.384247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:28.390801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:28.392037 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d88311b1-80b5-4c4e-8127-01a8b68c6515 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 1.173399 Aug 30 03:30:28.392696 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 787/1618] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:27 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:28.751495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1580388369", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": "none"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:28.852937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:28.853381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:28.858435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:28.860551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:28.861166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:28.900401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:28.903072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:28.904701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:28.906470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:28.914151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:28.917503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:28.998365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Getting quotas for project ad31db4967994df3a0847a6242b7bde8. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:30:29.012739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Getting quotas for user 583bf63baaa446ba8fd2e7de76eba384 and project ad31db4967994df3a0847a6242b7bde8. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:30:29.058127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:30:29.069749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:30:29.229091 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86a19765-d51d-4517-b706-708ac981126a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.835387 Aug 30 03:30:29.233654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 788/1619] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:30:29.245486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:29.246120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:29.270280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:29.271056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:29.273813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:29.278044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:29.278844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:29.283463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:31.258765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:31.288858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7907a717-6f1f-4d22-b9ac-e59accc07b28 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1471 microversion: 2.1 time: 2.053445 Aug 30 03:30:31.289812 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 789/1620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:29 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1471 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:31.318051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:31.320084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:31.328648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:31.329253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:31.330423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:31.331425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:31.332728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:31.333424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:31.934038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:31.973596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:31.985067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:31.986980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f68a5217-12a2-4c0b-b074-d8c3d0e853f2 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1330 microversion: 2.57 time: 0.695920 Aug 30 03:30:32.010013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 790/1621] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:31 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1330 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:32.026956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:32.028220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:32.060826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:32.063935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:32.064852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:32.074900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:32.075274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:32.076881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:32.598396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:32.612552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:32.617940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:32.619129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c89ad352-0372-4187-bd01-707cba2e0d46 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.607516 Aug 30 03:30:32.624991 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 791/1622] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:32 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:32.633397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "name": "network-vif-plugged", "status": "completed", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:32.667341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:32.667891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:32.668347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:32.726227 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] Creating event network-vif-plugged:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h1-854924-5 Aug 30 03:30:32.746157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] Instance 677f6c5a-7d93-42cd-981c-f39af153a372 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:30:32.794928 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-270c8013-51c3-4d82-bc10-b478c79f3269 req-5d8a39f9-a582-4281-be8d-972873d32e89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168241 Aug 30 03:30:32.803130 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 792/1623] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:32.820046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:32.822273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:32.842367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:32.844924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:32.845435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:32.846200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:32.846666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:32.851866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:33.074248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:33.190481 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-395f25f8-2d56-4638-a7d1-86e7d68c6d6e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "POST /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372/action" status: 202 len: 0 microversion: 2.1 time: 0.383636 Aug 30 03:30:33.195210 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 793/1624] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:30:32 2022] POST /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:33.210629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6dcd4ccd-240f-444b-b9a8-97cc0b33a167 req-958fed8c-f8f3-4b89-a9a8-2fb091f72c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bfd063-daa2-4ee8-b1a5-de09b35fac42", "tag": "c235ea13-5e46-47b0-91e9-1f9f753d3ce4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:33.243814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6dcd4ccd-240f-444b-b9a8-97cc0b33a167 req-958fed8c-f8f3-4b89-a9a8-2fb091f72c2d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:33.245419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6dcd4ccd-240f-444b-b9a8-97cc0b33a167 req-958fed8c-f8f3-4b89-a9a8-2fb091f72c2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:33.245889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6dcd4ccd-240f-444b-b9a8-97cc0b33a167 req-958fed8c-f8f3-4b89-a9a8-2fb091f72c2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:33.281487 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6dcd4ccd-240f-444b-b9a8-97cc0b33a167 req-958fed8c-f8f3-4b89-a9a8-2fb091f72c2d service nova] Creating event network-changed:c235ea13-5e46-47b0-91e9-1f9f753d3ce4 for instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 on n-h1-854924-5 Aug 30 03:30:33.324192 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6dcd4ccd-240f-444b-b9a8-97cc0b33a167 req-958fed8c-f8f3-4b89-a9a8-2fb091f72c2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109643 Aug 30 03:30:33.327774 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 794/1625] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:33.352092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:33.352823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:33.371659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:33.372018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:33.372519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:33.373240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:33.373740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:33.374430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:34.191906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:34.209497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:34.217440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:34.218878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c80c2452-ccd4-4f32-87af-e8f14ba7ac1a tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1336 microversion: 2.57 time: 0.889890 Aug 30 03:30:34.226656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 795/1626] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:33 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1336 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:34.231590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:34.232715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:34.243254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:34.247910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:34.251044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:34.252276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:34.252942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:34.253741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:35.063653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:35.082749 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b5b752d-6620-45ae-b228-018cbfbc139e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1470 microversion: 2.1 time: 0.854715 Aug 30 03:30:35.087521 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 796/1627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:34 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1470 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:35.102243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:35.106668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:35.136089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:35.148601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:35.149613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:35.150725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:35.156644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:35.158998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:35.756213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d77aedcd-69ee-466a-8c91-f58fd5222df9 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.475809 Aug 30 03:30:35.758030 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 832/1628] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:30:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:35.832685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:35.847647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:35.849254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:35.851067 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1359408-4f0f-435c-b3fa-965437cabfeb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.761233 Aug 30 03:30:35.852051 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 797/1629] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:35 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:35.858051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:35.858807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:35.867736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:35.868653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:35.869791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:35.870821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:35.871513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:35.872659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:36.054394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:36.064996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:36.072194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:36.074380 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d73010f9-49e4-4862-9835-39a88738c985 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1357 microversion: 2.57 time: 0.220438 Aug 30 03:30:36.096444 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 798/1630] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:35 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:36.116570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8961d74b-1925-4ea6-8eed-e270a053a226 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Action: 'create', calling method: .version_select at 0x7f897b237b80>, body: {"pool": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:36.156540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-730585587", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "c3c572e2-1853-4936-b3b9-41559dfce242"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:36.268241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] validate_networks() for [('c3c572e2-1853-4936-b3b9-41559dfce242', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:30:37.764322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:37.765105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:37.767459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:37.768150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:37.768591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:37.795920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:37.796489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:37.798735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:37.800073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:37.802311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:37.803088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:37.865332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Getting quotas for project 78f6f018bcc44754a7bd658e9082d681. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:30:37.877972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Getting quotas for user 1ce8b9b338354504a8ba80d76ec16e79 and project 78f6f018bcc44754a7bd658e9082d681. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:30:37.914093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:30:37.936902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:30:38.036147 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d67d4038-9ec7-41ef-bf86-d464b25326df tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276711 Aug 30 03:30:38.037525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 833/1631] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:30:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:30:38.043487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:38.050099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:38.099659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:38.103755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:38.106073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:38.112732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:38.114782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:38.115584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:38.469032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:38.469481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:38.473753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:38.475685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:38.478580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:38.724524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:38.737104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:38.738454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:38.739200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:38.740688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:38.742931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:38.750138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:38.910836 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b77bad2d-f3e0-49e0-aa4e-a6d651630ae5 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "POST /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a/action" status: 202 len: 1138 microversion: 2.57 time: 0.857641 Aug 30 03:30:38.915628 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 834/1632] 10.222.0.30 () {62 vars in 1320 bytes} [Tue Aug 30 03:30:38 2022] POST /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a/action => generated 1138 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 03:30:38.938834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:38.941657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:38.953461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:38.955519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:38.956359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:38.957646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:38.959630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:38.961388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:38.962225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:39.031532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:40.552502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:40.561428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eb16e372-fa8f-43b9-b4b6-233ec66f50cb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1470 microversion: 2.1 time: 1.640161 Aug 30 03:30:40.567290 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 835/1633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:38 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1470 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:40.572511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:40.580132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:40.597170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:40.597767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:40.598212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:40.598919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:40.599451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:40.605040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:41.337863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:41.358419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:41.373622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:41.376144 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee8072c7-5fcf-495c-bdf8-28b3f7b0a883 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.807457 Aug 30 03:30:41.383804 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 836/1634] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:40 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:41.388963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:41.402404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:41.409688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:41.410438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:41.411081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:41.411952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:41.412573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:41.413161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:41.569203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:41.588302 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb2d5c75-6018-4057-942e-5e6a4ffae4c1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1276 microversion: 2.1 time: 0.200256 Aug 30 03:30:41.591766 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 837/1635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:41 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:41.606330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:41.609014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:41.632082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:41.633682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:41.637960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:41.639252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:41.639900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:41.641648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:42.186973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:42.226152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:42.239476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:42.244957 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a477f496-b172-4f42-877d-592daf75ce77 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.651427 Aug 30 03:30:42.252990 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 838/1636] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:41 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:42.670468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:42.672003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:42.682437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:42.683969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:42.684806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:42.686014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:42.687382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:42.688084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:43.426909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:43.436040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13799afe-8fec-414c-8c54-8e3b0fb4febb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1470 microversion: 2.1 time: 1.175937 Aug 30 03:30:43.443938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 839/1637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:42 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1470 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:43.462955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-583234461", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50cf9776-7fec-4e2a-bfd2-7cfd51c24288"}], "block_device_mapping_v2": [{"uuid": "55fde6aa-6f3e-4f1f-a28f-ff23e55e9c03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:43.631367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] validate_networks() for [('50cf9776-7fec-4e2a-bfd2-7cfd51c24288', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:30:43.803631 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8961d74b-1925-4ea6-8eed-e270a053a226 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.703972 Aug 30 03:30:43.816492 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 799/1638] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:30:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:43.831968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:43.837676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:43.871436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:43.876321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:43.877183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:43.878218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:43.879369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:43.886656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:44.476751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:44.494283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:44.506506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:44.508653 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2304d77f-07d9-4540-80ae-95d8dc072304 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.690618 Aug 30 03:30:44.509640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 800/1639] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:43 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:44.515401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:44.520171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:44.539795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:44.542558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:44.544341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:44.545618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:44.546828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:44.547436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:44.761952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:44.773808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-623afa69-8ee3-4bd8-9347-922895608532 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1274 microversion: 2.1 time: 0.262920 Aug 30 03:30:44.778520 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 801/1640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:44 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:44.797094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:44.798021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:44.820289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:44.820970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:44.824473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:44.825309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:44.827319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:44.827893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:45.036799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:45.037235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:45.037718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:45.038118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:45.038580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:45.051108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:45.060336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:45.061105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:45.061753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:45.062430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:45.064151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:45.064818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:45.065457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:45.067110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:45.070587 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5058a4e2-213e-4d12-8ac4-043dbd7f5b3d tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.290109 Aug 30 03:30:45.088007 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 802/1641] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:44 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:45.103845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86e15a56-3f15-4269-90e6-929c1c60699e tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Action: 'create', calling method: .version_select at 0x7f897b1fe9d0>, body: {"pool": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:45.117656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:30:45.129880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Getting quotas for user 15eb8a27991445a491ccce6ff650f32a and project ae15b112fcf0488aa618aedf7b310348. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:30:45.244601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:30:45.247303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='55fde6aa-6f3e-4f1f-a28f-ff23e55e9c03',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:30:45.649906 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b2e1cde5-6d38-40d9-9ca1-c8c1ca7c2be2 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201643 Aug 30 03:30:45.650933 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 840/1642] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:30:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:30:45.663557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:45.671916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:45.686102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:45.687801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:45.690197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:45.693534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:45.694241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:45.695837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:46.220749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:46.234898 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38a59890-00f2-47f3-9bd4-3e9856a3d9ee tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1470 microversion: 2.1 time: 0.580790 Aug 30 03:30:46.237398 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 841/1643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:45 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1470 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:46.247751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:46.248659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:46.266888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:46.267846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:46.268481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:46.270592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:46.271282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:46.271891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:46.682078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:46.697334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:46.708680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:46.714600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8e6eabf7-b82c-4240-ae4e-4d0c1f735bd7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.472335 Aug 30 03:30:46.717732 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 842/1644] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:46 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:46.728905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:46.742328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:46.783986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:46.787874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:46.788550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:46.789892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:46.797195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:46.798825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:47.140609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:47.159005 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3ddaf9b-7cdd-4ce1-9546-4d5a08b4a91c tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1094 microversion: 2.1 time: 0.437269 Aug 30 03:30:47.170687 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 843/1645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:46 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1094 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:47.185358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "name": "network-vif-unplugged", "status": "completed", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:47.223098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:47.223777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:47.224003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:47.251405 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] Creating event network-vif-unplugged:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h2-854924-5 Aug 30 03:30:47.260988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] Instance 677f6c5a-7d93-42cd-981c-f39af153a372 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 03:30:47.290614 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3ac22438-413b-490c-95cd-d48e34dde126 req-158ca3e9-e45a-468e-83a9-6dccadb1d77a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118425 Aug 30 03:30:47.293106 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 844/1646] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:47.310554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:47.311274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:47.346297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:47.349141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:47.354617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:47.365306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:47.366598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:47.369330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:47.777842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:47.786387 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-946b3be2-7558-4bac-a963-bf8d74214a4c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.480263 Aug 30 03:30:47.800551 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 845/1647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:47 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:47.806155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:47.807336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:47.815479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:47.816333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:47.817025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:47.818114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:47.818809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:47.819458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:48.011951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:48.026135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:48.029434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:48.034123 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d72714a3-e26d-43e0-bb5f-b80c8fecd430 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.232142 Aug 30 03:30:48.057994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 846/1648] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:47 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:48.066955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7a6b06c3-102e-4055-8d42-9f4f5d269bd5 req-4c5aefbd-6aab-4dc9-994e-a81a97bb9607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bfd063-daa2-4ee8-b1a5-de09b35fac42", "name": "network-vif-plugged", "status": "completed", "tag": "c235ea13-5e46-47b0-91e9-1f9f753d3ce4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:48.099968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7a6b06c3-102e-4055-8d42-9f4f5d269bd5 req-4c5aefbd-6aab-4dc9-994e-a81a97bb9607 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:48.101590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7a6b06c3-102e-4055-8d42-9f4f5d269bd5 req-4c5aefbd-6aab-4dc9-994e-a81a97bb9607 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:48.102250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7a6b06c3-102e-4055-8d42-9f4f5d269bd5 req-4c5aefbd-6aab-4dc9-994e-a81a97bb9607 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:48.123345 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7a6b06c3-102e-4055-8d42-9f4f5d269bd5 req-4c5aefbd-6aab-4dc9-994e-a81a97bb9607 service nova] Creating event network-vif-plugged:c235ea13-5e46-47b0-91e9-1f9f753d3ce4 for instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 on n-h1-854924-5 Aug 30 03:30:48.136162 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7a6b06c3-102e-4055-8d42-9f4f5d269bd5 req-4c5aefbd-6aab-4dc9-994e-a81a97bb9607 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073111 Aug 30 03:30:48.137210 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 847/1649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:48.152257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:48.153187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:48.166129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:48.172651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:48.173730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:48.174600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:48.175165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:48.175693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:49.076382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:49.092520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9bb9fe5d-b02c-4841-97f2-8130dd0fa223 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1470 microversion: 2.1 time: 0.953636 Aug 30 03:30:49.117921 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 848/1650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:48 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1470 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:49.126172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:49.126789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:49.146895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:49.147393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:49.147828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:49.148532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:49.148982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:49.149997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:49.653713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:49.658063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:49.674773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:49.680104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:49.685239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33cef1fb-9fe4-460a-ae61-34210172b042 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1361 microversion: 2.25 time: 0.564561 Aug 30 03:30:49.703177 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 849/1651] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:49 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:49.710971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:49.714701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:49.745385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:49.746585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:49.748742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:49.751615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:49.752489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:49.753173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:49.917302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:49.939707 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1a33fd9-b907-4c16-834a-1b7d953945b1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1168 microversion: 2.1 time: 0.247100 Aug 30 03:30:49.944394 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 850/1652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:49 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:49.977242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-069a87b5-03a6-4d82-9aee-24ce40658cad req-031b1874-ceae-40b8-9bc4-acd3c6b44dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96f51ee-f669-4f77-a214-7d75043e6f38", "tag": "1b74f4da-cae8-4341-acf9-3cb695b98c3a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:50.005972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-069a87b5-03a6-4d82-9aee-24ce40658cad req-031b1874-ceae-40b8-9bc4-acd3c6b44dad service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:50.018060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-069a87b5-03a6-4d82-9aee-24ce40658cad req-031b1874-ceae-40b8-9bc4-acd3c6b44dad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:50.022871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-069a87b5-03a6-4d82-9aee-24ce40658cad req-031b1874-ceae-40b8-9bc4-acd3c6b44dad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:50.055449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-069a87b5-03a6-4d82-9aee-24ce40658cad req-031b1874-ceae-40b8-9bc4-acd3c6b44dad service nova] Creating event network-changed:1b74f4da-cae8-4341-acf9-3cb695b98c3a for instance b96f51ee-f669-4f77-a214-7d75043e6f38 on n-h2-854924-5 Aug 30 03:30:50.076787 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-069a87b5-03a6-4d82-9aee-24ce40658cad req-031b1874-ceae-40b8-9bc4-acd3c6b44dad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126469 Aug 30 03:30:50.094600 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 851/1653] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:50.106843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:50.108645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:50.128114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:50.129046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:50.130328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:50.131510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:50.132182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:50.132953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:50.763216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:50.796256 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16965a26-6310-4b30-a77d-56ae429a86fa tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.699785 Aug 30 03:30:50.798936 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 852/1654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:50 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:50.808720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:50.819468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:50.842839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:50.844764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:50.846354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:50.851675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:50.856360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:50.857158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:50.979796 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86e15a56-3f15-4269-90e6-929c1c60699e tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.890256 Aug 30 03:30:50.981462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 803/1655] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:30:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:51.001100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a79af81a-43dd-47d3-ac3d-81b1ba9e2317 req-855f0f0c-5580-4c45-be13-a3cfcfb1b95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:51.080036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a79af81a-43dd-47d3-ac3d-81b1ba9e2317 req-855f0f0c-5580-4c45-be13-a3cfcfb1b95e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.081110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a79af81a-43dd-47d3-ac3d-81b1ba9e2317 req-855f0f0c-5580-4c45-be13-a3cfcfb1b95e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.081769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.082538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a79af81a-43dd-47d3-ac3d-81b1ba9e2317 req-855f0f0c-5580-4c45-be13-a3cfcfb1b95e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.118739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.123991 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a79af81a-43dd-47d3-ac3d-81b1ba9e2317 req-855f0f0c-5580-4c45-be13-a3cfcfb1b95e service nova] Creating event network-changed:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h2-854924-5 Aug 30 03:30:51.130310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.138600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e29e8390-1fc6-4b66-a90b-7e62711b44a3 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.336812 Aug 30 03:30:51.139407 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 853/1656] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:50 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:51.149494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:51.150046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:51.153528 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a79af81a-43dd-47d3-ac3d-81b1ba9e2317 req-855f0f0c-5580-4c45-be13-a3cfcfb1b95e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166214 Aug 30 03:30:51.154759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 804/1657] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:51.172241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:51.174186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.174922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.178590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:51.179318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.181938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.185792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.190785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.200652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.202676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.205194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.209880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.210591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.215838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.752252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.771653 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3f66dad0-efc8-446d-95d7-e040949dc750 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1470 microversion: 2.1 time: 0.629131 Aug 30 03:30:51.774161 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 854/1658] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:51 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1470 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:51.787430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:51.789318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:51.801170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.820765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.823234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.825262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:51.828145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.828931 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69e0fb39-4521-4fc5-b066-d574e6b83552 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1555 microversion: 2.25 time: 0.670607 Aug 30 03:30:51.837384 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 805/1659] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:51 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1555 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:51.837804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.837804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:51.837804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:51.837804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:51.850571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e03624fd-574c-410d-8d30-ea37f6596fb9 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897b1f7d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:52.373226 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e03624fd-574c-410d-8d30-ea37f6596fb9 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/d39e76c1-ce49-4483-829b-15802f86f427" status: 200 len: 142 microversion: 2.1 time: 0.541267 Aug 30 03:30:52.374110 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 806/1660] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:30:51 2022] GET /compute/v2.1/os-floating-ips/d39e76c1-ce49-4483-829b-15802f86f427 => generated 142 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:52.388315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:52.389724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:52.414575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:52.416568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:52.420109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:52.424271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:52.427289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:52.432697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:52.911118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:52.920682 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2620615a-ec81-49af-b9eb-abac79e307df tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1210 microversion: 2.1 time: 1.145370 Aug 30 03:30:52.925374 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 855/1661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:51 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1210 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:52.940096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:52.942087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:52.964214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:52.964731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:52.965184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:52.971929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:52.972533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:52.972991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:53.180850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:53.197150 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06af9860-4fde-4eee-91b2-5a72f294e206 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.820731 Aug 30 03:30:53.202969 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 807/1662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:52 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:53.236550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:53.237746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:53.251519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:53.252418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:53.253235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:53.254218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:53.255113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:53.255745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:53.258743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid d7bfd063-daa2-4ee8-b1a5-de09b35fac42 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:30:53.292001 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b6b4848-17e0-4eee-9974-3c969365c9c4 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 2047 microversion: 2.25 time: 0.363703 Aug 30 03:30:53.298276 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 856/1663] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:52 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 2047 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:53.306499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4c098d2-8ae1-4a88-9526-1d096c62be85 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897b0235e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:53.445574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:53.459612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:53.464836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:53.473735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b4e2904-7e5a-4976-9a9a-35673e205138 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.263894 Aug 30 03:30:53.475244 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 808/1664] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:53 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:53.488281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:53.489771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:53.506979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:53.507474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:53.512718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:53.514688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:53.517997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:53.518454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:55.082351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:55.149890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:55.324426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:55.353060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6900395-1dfa-41de-ab39-eaf13fdfb314 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1463 microversion: 2.1 time: 1.876472 Aug 30 03:30:55.354354 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 809/1665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:53 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1463 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:55.361827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:55.364575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:55.376858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:55.377906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:55.379232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:55.380570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:55.385106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:55.386045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:56.272949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid d7bfd063-daa2-4ee8-b1a5-de09b35fac42 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:30:56.301160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10b457db-8c6f-4733-848e-d3560571bc34 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 2047 microversion: 2.25 time: 0.945439 Aug 30 03:30:56.302252 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 810/1666] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:55 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 2047 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:56.308783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:56.309928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:56.318535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:56.319508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:56.320238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:56.336820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:56.338164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:56.338804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:56.853924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:56.862214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dcbc7285-2c61-40c3-834b-3071702aaaa5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1210 microversion: 2.1 time: 0.558259 Aug 30 03:30:56.862795 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 811/1667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:56 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1210 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:56.875765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-975732164", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "cc4a3cb9-9be2-4a7c-949f-99e4964f9beb"}, {"uuid": "63fc7cde-f797-4acf-895c-28dc48789a9e"}, {"uuid": "cc4a3cb9-9be2-4a7c-949f-99e4964f9beb"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:56.958589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] validate_networks() for [('cc4a3cb9-9be2-4a7c-949f-99e4964f9beb', None, None, None, None, None), ('63fc7cde-f797-4acf-895c-28dc48789a9e', None, None, None, None, None), ('cc4a3cb9-9be2-4a7c-949f-99e4964f9beb', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:30:57.357882 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4c098d2-8ae1-4a88-9526-1d096c62be85 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/d39e76c1-ce49-4483-829b-15802f86f427" status: 202 len: 0 microversion: 2.1 time: 4.058100 Aug 30 03:30:57.359989 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 857/1668] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:30:53 2022] DELETE /compute/v2.1/os-floating-ips/d39e76c1-ce49-4483-829b-15802f86f427 => generated 0 bytes in 4061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:30:57.367644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:57.368565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:57.386160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:57.387145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:57.392340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:57.393700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:57.394349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:57.394955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:57.819915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:57.832020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-95cc6341-1b4a-4160-888f-9ff1a0275d00 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.469901 Aug 30 03:30:57.832611 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 858/1669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:57 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:57.859900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:57.860428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:57.866992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:57.867624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:57.868254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:57.868974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:57.869620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:57.870041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:57.965520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:57.975458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:57.977759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:30:57.979267 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7923d9b-c9df-4449-a24e-f12c54030473 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.139785 Aug 30 03:30:57.979846 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 859/1670] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:30:57 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:30:57.985018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:57.985976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:57.993515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:57.994440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:57.995060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:57.996014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:57.996761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:57.997372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:58.559689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-767cba1a-f22e-47fe-b1d2-d481986c2be4 tempest-MigrationsAdminTest-1768224814 tempest-MigrationsAdminTest-1768224814-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1614 microversion: 2.1 time: 0.578587 Aug 30 03:30:58.565556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 860/1671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:57 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1614 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:30:58.587863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:58.592124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:58.592598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:58.593154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:58.594373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:58.594759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:58.595371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:58.609701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:58.627091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0f53e5e4-f156-4da2-8bc7-1f1375d2cf31 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058663 Aug 30 03:30:58.628342 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 861/1672] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Aug 30 03:30:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:30:58.633380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-639f97e3-9ba3-4498-ac64-58ea4a5bff72 req-73051390-38e9-4220-a81e-73b00c17ddce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd1f1d3-d61a-49d0-873a-e46452077453", "tag": "481ec842-15ee-4bd6-a3db-f69ed6a05458"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:58.644671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-639f97e3-9ba3-4498-ac64-58ea4a5bff72 req-73051390-38e9-4220-a81e-73b00c17ddce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:58.645453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-639f97e3-9ba3-4498-ac64-58ea4a5bff72 req-73051390-38e9-4220-a81e-73b00c17ddce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:58.645882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-639f97e3-9ba3-4498-ac64-58ea4a5bff72 req-73051390-38e9-4220-a81e-73b00c17ddce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:58.658380 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-639f97e3-9ba3-4498-ac64-58ea4a5bff72 req-73051390-38e9-4220-a81e-73b00c17ddce service nova] Creating event network-changed:481ec842-15ee-4bd6-a3db-f69ed6a05458 for instance 1bd1f1d3-d61a-49d0-873a-e46452077453 on n-h1-854924-5 Aug 30 03:30:58.664489 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-639f97e3-9ba3-4498-ac64-58ea4a5bff72 req-73051390-38e9-4220-a81e-73b00c17ddce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034451 Aug 30 03:30:58.667007 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 862/1673] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:30:58.744099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-297702299", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "4eee985d-aad4-44dc-ae5d-cdc320eebb65"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:30:58.813021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] validate_networks() for [('4eee985d-aad4-44dc-ae5d-cdc320eebb65', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:30:58.961065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:58.961652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:58.962408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:58.963011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:58.963525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:58.966199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:30:58.976447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:58.977399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:58.977768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:58.978478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:58.978929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:58.979544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:59.009747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Getting quotas for project 4b1a03c37eb24082bfd84f9e5da2e86e. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:30:59.016370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Getting quotas for user 15d26d112e044244b16a6e41093a3ebd and project 4b1a03c37eb24082bfd84f9e5da2e86e. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:30:59.034790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:30:59.044313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:30:59.112914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c561ddf7-87f4-46d3-8a5f-2500301e10bf tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.242605 Aug 30 03:30:59.114591 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 812/1674] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:30:59.120162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01568b23-51d3-4749-b699-4bd2eca8129a tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897bb53550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:59.593685 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01568b23-51d3-4749-b699-4bd2eca8129a tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.477676 Aug 30 03:30:59.594277 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 813/1675] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Aug 30 03:30:59 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:30:59.605280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:30:59.605930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:30:59.626472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:59.626971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:59.627408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:59.628133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:59.628596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:59.629027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:59.944826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:30:59.946001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:30:59.947093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:30:59.949998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:30:59.950811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:30:59.965663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:59.966446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:59.967051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:59.968217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:30:59.968849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:30:59.969471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:30:59.993370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:00.002276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Getting quotas for project ee369051f4c041239152dbbc5e29bc9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:00.013089 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e9325a9-5add-4e33-8d29-0d9b39626485 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1198 microversion: 2.1 time: 0.411244 Aug 30 03:31:00.014369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Getting quotas for user 6293437f7ced462b9c13100968c602b9 and project ee369051f4c041239152dbbc5e29bc9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:00.029365 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 814/1676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:30:59 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1198 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:00.034292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:31:00.038198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:31:00.056306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0900563a-f83f-4875-b5f7-7d8822e469b0 req-b4113420-3078-407c-8453-bf0ad13ccb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "name": "network-vif-plugged", "status": "completed", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:00.088557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0900563a-f83f-4875-b5f7-7d8822e469b0 req-b4113420-3078-407c-8453-bf0ad13ccb0b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.089260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0900563a-f83f-4875-b5f7-7d8822e469b0 req-b4113420-3078-407c-8453-bf0ad13ccb0b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.090667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0900563a-f83f-4875-b5f7-7d8822e469b0 req-b4113420-3078-407c-8453-bf0ad13ccb0b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.104617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:00.122733 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54f16524-badc-4343-8a3f-8c5da88170d4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454250 Aug 30 03:31:00.129766 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 863/1677] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:31:00.142373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:00.142832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:00.152988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.153843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.155306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.156216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.156694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.157175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.162614 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0900563a-f83f-4875-b5f7-7d8822e469b0 req-b4113420-3078-407c-8453-bf0ad13ccb0b service nova] Creating event network-vif-plugged:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h2-854924-5 Aug 30 03:31:00.196730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0900563a-f83f-4875-b5f7-7d8822e469b0 req-b4113420-3078-407c-8453-bf0ad13ccb0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164867 Aug 30 03:31:00.201532 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 815/1678] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:00.212812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:00.214230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:00.218657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:00.246456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.250738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.253212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.257260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.258415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.259814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.426291 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9d421d3b-5e6e-4943-8eb9-45ac65fb20b3 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "DELETE /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 204 len: 0 microversion: 2.1 time: 0.299809 Aug 30 03:31:00.430722 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 864/1679] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:00 2022] DELETE /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:00.440056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:00.441499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:00.452915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.453986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.455065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.456470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.457549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.463724 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23592e5d-4f23-47e5-8153-1b031d0cef96 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42/action" status: 202 len: 0 microversion: 2.25 time: 0.259759 Aug 30 03:31:00.467351 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 816/1680] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:31:00 2022] POST /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:00.470162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.491721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:00.492670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:00.507543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.508681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.513270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.514565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.515106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.515550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.649760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:00.692416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:00.701982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:00.709368 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f94678c4-412f-4c4c-bd60-86f037c533ff tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.238487 Aug 30 03:31:00.721579 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 817/1681] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:00 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:00.739129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:00.741878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:00.757108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.757803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.758392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.759614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:00.760495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:00.761493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:00.809580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:00.819564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c288a27c-9c35-413a-b813-80db4334dd21 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.386866 Aug 30 03:31:00.821006 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 865/1682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:00 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:00.828053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bd07e05-4666-4bc5-ac43-b2f148a13618 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897b02c820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:00.867960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:00.880372 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c93af19-8329-44f6-8321-32c1d33ef531 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1264 microversion: 2.1 time: 0.157501 Aug 30 03:31:00.884256 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 818/1683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:00 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:00.893272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-efc58c2b-6220-40e1-8770-e9e9729670a7 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:00.898045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-efc58c2b-6220-40e1-8770-e9e9729670a7 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:01.114075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-efc58c2b-6220-40e1-8770-e9e9729670a7 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:01.126027 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-efc58c2b-6220-40e1-8770-e9e9729670a7 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1216 microversion: 2.1 time: 0.240067 Aug 30 03:31:01.126678 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 819/1684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:00 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:01.141602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:01.142643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:01.151289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:01.153151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:01.154053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:01.155076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:01.156395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:01.157103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:01.337537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5bd07e05-4666-4bc5-ac43-b2f148a13618 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.514881 Aug 30 03:31:01.338563 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 866/1685] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:31:00 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:01.343884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:01.344515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:01.359035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:01.360054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:01.360745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:01.361615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:01.362257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:01.362962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:01.485755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:01.501041 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e455febb-ca88-4839-aa4f-15379ccfbe3e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 200 len: 1469 microversion: 2.1 time: 0.373029 Aug 30 03:31:01.502467 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 820/1686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:01 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:01.508613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:01.509769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:01.527437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:01.528480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:01.529315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:01.531009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:01.531734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:01.533473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:01.687272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid d7bfd063-daa2-4ee8-b1a5-de09b35fac42 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:01.710778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d40091ed-de63-448e-8eb9-f167289fa2e1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 2032 microversion: 2.25 time: 0.371077 Aug 30 03:31:01.711873 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 867/1687] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:01 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 2032 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:01.716715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fc01c05-71ff-4792-9e0d-5f340b0451ef tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897b006a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:02.000928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:02.014874 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2e04b54-36be-48c3-b9bf-91d9a3a7efe3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1198 microversion: 2.1 time: 0.510510 Aug 30 03:31:02.029053 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 821/1688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:01 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1198 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:02.035481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854924-5", "block_migration": "auto"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:02.038445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:02.047070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:02.047928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:02.049138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:02.050088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:02.050836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:02.052251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:02.090877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'flavor' on Instance uuid d7bfd063-daa2-4ee8-b1a5-de09b35fac42 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:02.107465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Going to try to live migrate instance to n-h2-854924-5 {{(pid=122168) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:31:03.707701 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f48c1238-0344-4593-a443-0d2bbf6a7d3b tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42/action" status: 202 len: 0 microversion: 2.25 time: 1.676460 Aug 30 03:31:03.712246 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 822/1689] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:31:02 2022] POST /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42/action => generated 0 bytes in 1682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:03.721917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:03.723197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:03.736553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:03.737144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:03.738028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:03.739167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:03.739857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:03.740494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:03.939143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:03.956865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:03.958663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:03.961142 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc59df1b-cb00-4091-bf9e-b452d9546d17 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1366 microversion: 2.57 time: 0.245406 Aug 30 03:31:03.962307 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 823/1690] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:03 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:03.982784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:03.984570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:04.000489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.003897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.006225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.007118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.009777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.010359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.577954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:04.586518 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df832620-267e-4c70-8c9e-532fa21ad19c tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.622843 Aug 30 03:31:04.587093 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 824/1691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:03 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:04.592384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:04.594087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:04.603026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.603701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.604203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.604928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.605401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.605823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.860297 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5fc01c05-71ff-4792-9e0d-5f340b0451ef tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/7b44b181-34c8-498b-ae87-1e093b816c5d" status: 202 len: 0 microversion: 2.1 time: 3.147088 Aug 30 03:31:04.861200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 868/1692] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:31:01 2022] DELETE /compute/v2.1/os-floating-ips/7b44b181-34c8-498b-ae87-1e093b816c5d => generated 0 bytes in 3148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:31:04.866764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:04.867702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:04.875845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.876651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.878211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.879176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.879653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.880088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.897631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:04.907716 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-19fe48ee-49ad-4543-b828-852e1b276ce6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1312 microversion: 2.1 time: 0.319227 Aug 30 03:31:04.908621 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 825/1693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:04 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:04.927079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8c1206a2-bc5e-48cf-a08b-46e23d200e7d req-7d54b9f5-e474-4e6e-83d0-170912b6ec1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f51ee-f669-4f77-a214-7d75043e6f38", "name": "network-vif-plugged", "status": "completed", "tag": "1b74f4da-cae8-4341-acf9-3cb695b98c3a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:04.937382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8c1206a2-bc5e-48cf-a08b-46e23d200e7d req-7d54b9f5-e474-4e6e-83d0-170912b6ec1b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.938141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8c1206a2-bc5e-48cf-a08b-46e23d200e7d req-7d54b9f5-e474-4e6e-83d0-170912b6ec1b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.938743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8c1206a2-bc5e-48cf-a08b-46e23d200e7d req-7d54b9f5-e474-4e6e-83d0-170912b6ec1b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.951303 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8c1206a2-bc5e-48cf-a08b-46e23d200e7d req-7d54b9f5-e474-4e6e-83d0-170912b6ec1b service nova] Creating event network-vif-plugged:1b74f4da-cae8-4341-acf9-3cb695b98c3a for instance b96f51ee-f669-4f77-a214-7d75043e6f38 on n-h2-854924-5 Aug 30 03:31:04.957702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8c1206a2-bc5e-48cf-a08b-46e23d200e7d req-7d54b9f5-e474-4e6e-83d0-170912b6ec1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Aug 30 03:31:04.958913 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 826/1694] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:04.964498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:04.965191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 677f6c5a-7d93-42cd-981c-f39af153a372] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:04.972682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.973177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.973651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.974360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:04.974812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:04.975241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:04.990548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] HTTP exception thrown: Instance 677f6c5a-7d93-42cd-981c-f39af153a372 could not be found. Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Request method failure captured: Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 HTTP/1.1 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYM1RQMkDl6nd4EqI4QWQYOJ0REVAiw-D5nHQx8TZp-tXV32Gk930Rp169iQzDtgZa86NkagUT8OXOgvp5gYP6CdlS2VXa_nsBT_YONWrWaQkcJj9gVL-kMxNCwaJKgC4WK0i1v_ctF5M2ckFzKPm_dezwnxpnn8MIX4gsk_Btf7bF4 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e4d288410e5b49e39dd44da7e2b4d223", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}] Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 948d18cc663b48028570132678823b93 Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 677f6c5a-7d93-42cd-981c-f39af153a372 could not be found. Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '677f6c5a-7d93-42cd-981c-f39af153a372'} Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677f6c5a-7d93-42cd-981c-f39af153a372 could not be found. Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677f6c5a-7d93-42cd-981c-f39af153a372 could not be found. Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:04.992289 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677f6c5a-7d93-42cd-981c-f39af153a372 could not be found. Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Returning 404 to user: Instance 677f6c5a-7d93-42cd-981c-f39af153a372 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d5c3b5a7-80dd-4193-9d1e-52a146f52642 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372" status: 404 len: 111 microversion: 2.1 time: 0.033518 Aug 30 03:31:04.997236 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 827/1695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:04 2022] GET /compute/v2.1/servers/677f6c5a-7d93-42cd-981c-f39af153a372 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:05.000111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:05.000817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:05.007051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.007551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.007979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:05.008686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.009139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.009755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:05.193988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:05.197738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:05.203428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bbf23a7c-653a-4048-88de-5f6724b51b11 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.340931 Aug 30 03:31:05.204652 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 869/1696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:04 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:05.210548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:05.211160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:05.220620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.221093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.221568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:05.222285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.222739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.223164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:05.362577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:05.370586 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6118df8c-29ae-4d98-9f9a-ab2205ff6494 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1198 microversion: 2.1 time: 0.374768 Aug 30 03:31:05.371453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 828/1697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:04 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1198 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:05.389118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-63453619-6531-456b-8673-d545049c6c99 req-6adf5f49-4935-4844-964e-151c231ba24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6c5a-7d93-42cd-981c-f39af153a372", "name": "network-vif-deleted", "tag": "ae3db62e-554c-4cb9-aac6-5d4208ed75b0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:05.399648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-63453619-6531-456b-8673-d545049c6c99 req-6adf5f49-4935-4844-964e-151c231ba24b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.400124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-63453619-6531-456b-8673-d545049c6c99 req-6adf5f49-4935-4844-964e-151c231ba24b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.400548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-63453619-6531-456b-8673-d545049c6c99 req-6adf5f49-4935-4844-964e-151c231ba24b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:05.412302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-63453619-6531-456b-8673-d545049c6c99 req-6adf5f49-4935-4844-964e-151c231ba24b service nova] Creating event network-vif-deleted:ae3db62e-554c-4cb9-aac6-5d4208ed75b0 for instance 677f6c5a-7d93-42cd-981c-f39af153a372 on n-h2-854924-5 Aug 30 03:31:05.417746 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-63453619-6531-456b-8673-d545049c6c99 req-6adf5f49-4935-4844-964e-151c231ba24b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Aug 30 03:31:05.418524 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 829/1698] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:05.424276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54fdb496-a914-4c37-9531-782afec23067 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897b1f71f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:05.663105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:05.677470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:05.680706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:05.682298 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3fca65f9-8517-4cf7-9e41-80ef5ca79b40 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 0.476410 Aug 30 03:31:05.683466 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 870/1699] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:05 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:05.690450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:05.691619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:05.699471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.700248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.700686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:05.702209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:05.702703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:05.703137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:06.173390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:06.183309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:06.185164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:06.186689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9555eef2-637a-4b65-a592-3b914226bf2f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1384 microversion: 2.57 time: 0.501899 Aug 30 03:31:06.187469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 871/1700] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:05 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1384 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:06.212188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:06.213115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:06.224265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:06.225683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:06.225683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:06.226882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:06.226882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:06.227399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:06.262538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:06.384135 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-053d7737-f9b4-4da6-bf71-29883424e663 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "DELETE /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 204 len: 0 microversion: 2.1 time: 0.179262 Aug 30 03:31:06.386395 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 872/1701] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:06 2022] DELETE /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:06.396176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:06.397193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:06.404701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:06.405990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:06.406541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:06.407756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:06.408112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:06.408554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:06.969322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:06.977720 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6da29e0-5ebe-4713-8c8b-9fb1a2a6995b tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1316 microversion: 2.1 time: 0.588151 Aug 30 03:31:06.978315 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 873/1702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:06 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:06.983933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:06.984811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:06.992395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:06.992900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:06.993532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:06.994059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:06.994521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:06.994949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.383057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:07.407784 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb469cc6-a02f-47a6-8b14-86cfac843795 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1312 microversion: 2.1 time: 0.426743 Aug 30 03:31:07.419189 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 874/1703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:06 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:07.419189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a43c608a-3132-4ae2-8761-d412482e893c req-e0f605ee-1f4b-4b4f-ae91-02798a51ecee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bfd063-daa2-4ee8-b1a5-de09b35fac42", "name": "network-vif-unplugged", "status": "completed", "tag": "c235ea13-5e46-47b0-91e9-1f9f753d3ce4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:07.425911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a43c608a-3132-4ae2-8761-d412482e893c req-e0f605ee-1f4b-4b4f-ae91-02798a51ecee service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.426492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a43c608a-3132-4ae2-8761-d412482e893c req-e0f605ee-1f4b-4b4f-ae91-02798a51ecee service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.426932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a43c608a-3132-4ae2-8761-d412482e893c req-e0f605ee-1f4b-4b4f-ae91-02798a51ecee service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.438939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a43c608a-3132-4ae2-8761-d412482e893c req-e0f605ee-1f4b-4b4f-ae91-02798a51ecee service nova] Creating event network-vif-unplugged:c235ea13-5e46-47b0-91e9-1f9f753d3ce4 for instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 on n-h1-854924-5 Aug 30 03:31:07.444954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a43c608a-3132-4ae2-8761-d412482e893c req-e0f605ee-1f4b-4b4f-ae91-02798a51ecee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034052 Aug 30 03:31:07.446194 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 875/1704] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:07.451169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:07.451869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:07.459606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.460109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.460680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.462110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.463524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.463967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.814733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:07.829047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b584df28-1276-45f9-8498-152bf415ef21 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.380150 Aug 30 03:31:07.830043 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 876/1705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:07 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:07.854793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:07.858923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:07.871808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.872487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.873037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.874284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.875256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.875930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.919077 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54fdb496-a914-4c37-9531-782afec23067 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/ad035e25-f98e-4d46-967d-0ea3f687eb97" status: 202 len: 0 microversion: 2.1 time: 2.499411 Aug 30 03:31:07.919668 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 830/1706] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:31:05 2022] DELETE /compute/v2.1/os-floating-ips/ad035e25-f98e-4d46-967d-0ea3f687eb97 => generated 0 bytes in 2501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:31:07.924992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:07.925765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:07.946887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.947396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.947840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:07.948789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:07.949462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:07.950080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.175256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.183981 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-abd3420b-255f-49a0-88e9-87b242eb618d tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1198 microversion: 2.1 time: 0.337074 Aug 30 03:31:08.184609 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 877/1707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:07 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1198 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:08.191527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:08.192145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:08.198432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.198932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.199379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.200136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.200595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.201025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.350340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.358925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a63bb05a-88ed-44fb-ba8e-7dc8d495d300 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1535 microversion: 2.1 time: 0.438109 Aug 30 03:31:08.359832 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 831/1708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:07 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1535 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:08.364650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:08.365257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:08.381387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.382033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.382584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.383555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.384086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.384586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.568886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.578763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.580832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.582305 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f0d2a940-e3a4-42f4-8f92-6f31b049722e tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1357 microversion: 2.57 time: 0.221530 Aug 30 03:31:08.602447 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 832/1709] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:08 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:08.610433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-882eb87d-2a92-447d-b660-9e345373755f req-5a818612-d3ae-49e6-bd91-81db656a2b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84", "tag": "739c3385-f03a-497a-acc4-fe87c924e940"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:08.620213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-882eb87d-2a92-447d-b660-9e345373755f req-5a818612-d3ae-49e6-bd91-81db656a2b36 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.620684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-882eb87d-2a92-447d-b660-9e345373755f req-5a818612-d3ae-49e6-bd91-81db656a2b36 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.621112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-882eb87d-2a92-447d-b660-9e345373755f req-5a818612-d3ae-49e6-bd91-81db656a2b36 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.633276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-882eb87d-2a92-447d-b660-9e345373755f req-5a818612-d3ae-49e6-bd91-81db656a2b36 service nova] Creating event network-changed:739c3385-f03a-497a-acc4-fe87c924e940 for instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 on n-h1-854924-5 Aug 30 03:31:08.638351 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-882eb87d-2a92-447d-b660-9e345373755f req-5a818612-d3ae-49e6-bd91-81db656a2b36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Aug 30 03:31:08.639230 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 833/1710] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:08.644611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e67a4cb4-7e9c-4674-adcd-6ca69617a9d3 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] Calling method '.version_select at 0x7f897b2780d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:08.744644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.754376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.755813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:08.756989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67047603-ab45-4da7-bc16-bb5fed43b08a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 0.569743 Aug 30 03:31:08.757581 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 878/1711] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:08 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:08.762386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:08.762996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:08.770937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.771559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.771999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.772702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:08.773673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:08.774096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:08.989213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:09.684014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:09.694197 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7d72a37a-f878-46bf-9637-ccd7aa2ccf75 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1506 microversion: 2.1 time: 0.935552 Aug 30 03:31:09.695417 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 879/1712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:08 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1506 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:09.700304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:09.701238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:09.711594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:09.712451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:09.713050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:09.714010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:09.714673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:09.715620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:09.984135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:10.026640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:10.218652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:10.231491 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79bf8e3f-6187-43f6-aaf1-cb86fe756ecd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1333 microversion: 2.1 time: 0.534789 Aug 30 03:31:10.232159 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 880/1713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:09 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1333 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:10.238334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:10.238615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:10.252351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:10.252868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:10.253328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:10.254124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:10.254604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:10.255049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:10.287633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:10.409430 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-093c84cd-4f3c-42d2-ad48-ec5abde44f9f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 204 len: 0 microversion: 2.57 time: 0.174206 Aug 30 03:31:10.413955 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 881/1714] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:10 2022] DELETE /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:31:10.422755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:10.424289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:10.434563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:10.436133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:10.436843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:10.437948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:10.438804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:10.440744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:10.862346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:10.871298 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77108c0b-6bdd-47d0-9019-996ab0245a7c tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.455734 Aug 30 03:31:10.871983 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 882/1715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:10 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:10.877395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:10.878173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:10.889303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:10.890882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:10.891537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:10.892488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:10.893205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:10.893871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.122034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:11.123073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.128650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:11.135025 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e67a4cb4-7e9c-4674-adcd-6ca69617a9d3 tempest-FloatingIPDetailsTestJSON-1158896785 tempest-FloatingIPDetailsTestJSON-1158896785-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/c8712d4a-4cff-4247-a1d9-99bf436ef704" status: 202 len: 0 microversion: 2.1 time: 2.494318 Aug 30 03:31:11.135208 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-81e2d35f-a672-4475-868c-c164de11a9dd tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1198 microversion: 2.1 time: 0.261886 Aug 30 03:31:11.135675 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 834/1716] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:31:08 2022] DELETE /compute/v2.1/os-floating-ips/c8712d4a-4cff-4247-a1d9-99bf436ef704 => generated 0 bytes in 2496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:31:11.145730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 883/1717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:10 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1198 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:11.145730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-744056e2-e009-4ae2-8d62-a98fbfe88320 req-42ade2e7-6b04-4d5a-b310-710e980752f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bfd063-daa2-4ee8-b1a5-de09b35fac42", "tag": "c235ea13-5e46-47b0-91e9-1f9f753d3ce4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:11.146229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.146229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.153111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-744056e2-e009-4ae2-8d62-a98fbfe88320 req-42ade2e7-6b04-4d5a-b310-710e980752f7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.153618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-744056e2-e009-4ae2-8d62-a98fbfe88320 req-42ade2e7-6b04-4d5a-b310-710e980752f7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.153860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.154048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-744056e2-e009-4ae2-8d62-a98fbfe88320 req-42ade2e7-6b04-4d5a-b310-710e980752f7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.154363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.154806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.155533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.156148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.156584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.162282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:11.169050 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-744056e2-e009-4ae2-8d62-a98fbfe88320 req-42ade2e7-6b04-4d5a-b310-710e980752f7 service nova] Creating event network-changed:c235ea13-5e46-47b0-91e9-1f9f753d3ce4 for instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 on n-h1-854924-5 Aug 30 03:31:11.175178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-744056e2-e009-4ae2-8d62-a98fbfe88320 req-42ade2e7-6b04-4d5a-b310-710e980752f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037835 Aug 30 03:31:11.176142 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 884/1718] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:11.181853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.182592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.190594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.191098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.191537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.192262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.192715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.193138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.227458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.228434 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ceab11ec-bf64-4346-b9aa-2144d2b6f2d1 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38/os-instance-actions/req-d67d4038-9ec7-41ef-bf86-d464b25326df" status: 200 len: 313 microversion: 2.1 time: 0.051414 Aug 30 03:31:11.229020 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 885/1719] 10.222.0.30 () {58 vars in 1419 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38/os-instance-actions/req-d67d4038-9ec7-41ef-bf86-d464b25326df => generated 313 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:11.233508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2d3c812f-95f3-40f2-9016-5539993a0964 req-eeb28e19-8727-4c14-9efa-c21aa3a7123d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd1f1d3-d61a-49d0-873a-e46452077453", "name": "network-vif-plugged", "status": "completed", "tag": "481ec842-15ee-4bd6-a3db-f69ed6a05458"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:11.243078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2d3c812f-95f3-40f2-9016-5539993a0964 req-eeb28e19-8727-4c14-9efa-c21aa3a7123d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.244186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2d3c812f-95f3-40f2-9016-5539993a0964 req-eeb28e19-8727-4c14-9efa-c21aa3a7123d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.244610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2d3c812f-95f3-40f2-9016-5539993a0964 req-eeb28e19-8727-4c14-9efa-c21aa3a7123d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.257800 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2d3c812f-95f3-40f2-9016-5539993a0964 req-eeb28e19-8727-4c14-9efa-c21aa3a7123d service nova] Creating event network-vif-plugged:481ec842-15ee-4bd6-a3db-f69ed6a05458 for instance 1bd1f1d3-d61a-49d0-873a-e46452077453 on n-h1-854924-5 Aug 30 03:31:11.262980 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2d3c812f-95f3-40f2-9016-5539993a0964 req-eeb28e19-8727-4c14-9efa-c21aa3a7123d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Aug 30 03:31:11.263578 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 886/1720] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:11.269240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.269975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.275341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.276234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.276942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.277173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.277879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.278330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.278749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.283655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aee6c2c5-139a-4e4a-b748-d271bf0fee92 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1493 microversion: 2.1 time: 0.146733 Aug 30 03:31:11.284260 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 835/1721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1493 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:11.302478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.303487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.309934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.310419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.310851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.312077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.312604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.313028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.410057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.418512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.419940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.421640 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d01decdb-936c-4a4a-a36f-cbfdc89de8e7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1363 microversion: 2.57 time: 0.123040 Aug 30 03:31:11.422204 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 836/1722] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:11.426698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ceb982f1-5357-45cd-88d8-bb2bf8bd2308 req-0b2a04c9-7121-4798-8e72-7d7fd78ef222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222d5dbb-c43e-4cc4-9381-865142def69d", "name": "network-vif-deleted", "tag": "a72f69f5-63f7-4714-a7b9-be19c2e74a60"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:11.437160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ceb982f1-5357-45cd-88d8-bb2bf8bd2308 req-0b2a04c9-7121-4798-8e72-7d7fd78ef222 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.437752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ceb982f1-5357-45cd-88d8-bb2bf8bd2308 req-0b2a04c9-7121-4798-8e72-7d7fd78ef222 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.438179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ceb982f1-5357-45cd-88d8-bb2bf8bd2308 req-0b2a04c9-7121-4798-8e72-7d7fd78ef222 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.450201 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ceb982f1-5357-45cd-88d8-bb2bf8bd2308 req-0b2a04c9-7121-4798-8e72-7d7fd78ef222 service nova] Creating event network-vif-deleted:a72f69f5-63f7-4714-a7b9-be19c2e74a60 for instance 222d5dbb-c43e-4cc4-9381-865142def69d on n-h1-854924-5 Aug 30 03:31:11.456102 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ceb982f1-5357-45cd-88d8-bb2bf8bd2308 req-0b2a04c9-7121-4798-8e72-7d7fd78ef222 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 Aug 30 03:31:11.456864 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 837/1723] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:11.462224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:11.464722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.471928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.472413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.472842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.473574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.474027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.474463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.540440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.550377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.551901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.553468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7413781f-b4a6-4acd-aedb-4afbd3910019 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 0.288767 Aug 30 03:31:11.555122 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 887/1724] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:11.556732 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2246a45-efa1-4138-ae09-3c1dd99614e9 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "POST /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38/action" status: 202 len: 0 microversion: 2.1 time: 0.097515 Aug 30 03:31:11.557573 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 838/1725] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:31:11 2022] POST /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:31:11.559559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.560443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.568599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.569463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.570217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.572816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.573527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.574158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.576065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.577603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.586191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.586962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.587641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.588340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.588793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.589259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.911167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.919321 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-000bea5e-850b-48a4-80b0-3d83f957455c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.364132 Aug 30 03:31:11.919898 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 888/1726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:11.925497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:11.926096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:11.929901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:11.939449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.939700 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bbd480b8-7bf6-4598-ab58-66f1ed02e8fe tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1508 microversion: 2.1 time: 0.368294 Aug 30 03:31:11.940407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.941153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.942115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:11.942811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:11.943537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:11.953305 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 839/1727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:12.163079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:12.163786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:12.171340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.171837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.172348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.173061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.173711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.174143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.268120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:12.280997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d10abd3a-d7ac-4578-881d-93edb876de8a tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.359367 Aug 30 03:31:12.282015 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 889/1728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:11 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:12.304461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:12.306017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:12.318873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.320046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.320774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.322075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.322766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.323436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.739553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:12.747515 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e7375e8-bc72-42ee-b48c-0ac000666ae4 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1493 microversion: 2.1 time: 0.447128 Aug 30 03:31:12.748106 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 890/1729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:12 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1493 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:31:12.755525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:12.756432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:12.763010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.763537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.763966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.765386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.765870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.766288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.809638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:12.810861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:12.812225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:12.812889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lazy-loading 'fault' on Instance uuid 0ebfef18-46d5-46ec-a4ad-78d21e47a53a {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:13.052937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.070261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.074396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '583bf63baaa446ba8fd2e7de76eba384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad31db4967994df3a0847a6242b7bde8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.075911 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-667811e3-286f-487d-8805-78f91bd97de7 tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 200 len: 1368 microversion: 2.57 time: 0.326113 Aug 30 03:31:13.076551 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 891/1730] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:12 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 1368 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:13.082697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:13.083811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:13.099653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.102073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.103375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.104662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.104979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.105652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.127906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.136540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b1299af-7479-4adb-938f-8f505cd99498 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1198 microversion: 2.1 time: 0.981389 Aug 30 03:31:13.145372 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 840/1731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:12 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1198 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:13.150634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:13.151963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:13.168693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.169433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.170026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.171451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.171959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.172383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.832772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.841123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.843259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.844542 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1ef31f41-86ea-4539-b6ee-89b2fdfdfd7a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 0.766721 Aug 30 03:31:13.845114 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 892/1732] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:13 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:13.849907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:13.850524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:13.856924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.857438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.857892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.858565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.859192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.859943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.872756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:13.882749 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-886a45ec-b238-48e2-a05d-0a8900a5c2e5 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.735943 Aug 30 03:31:13.894586 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 841/1733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:13 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:13.894586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:13.894586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:13.898870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.899537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.900346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:13.901379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:13.902073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:13.902911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.500753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:14.518160 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-535214da-abf6-4b1f-a049-14a402b9fedb tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1508 microversion: 2.1 time: 0.671761 Aug 30 03:31:14.518753 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 893/1734] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:13 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:14.523294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:14.523916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:14.534869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.535444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.536550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.537336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.537836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.538266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.591869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:14.594085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.595214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.595818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.596306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lazy-loading 'fault' on Instance uuid 222d5dbb-c43e-4cc4-9381-865142def69d {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:14.662082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:14.677999 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fede0efe-9e9b-42d3-acad-3d441db71fe4 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.791978 Aug 30 03:31:14.694809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 842/1735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:13 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:14.707093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:14.707577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] [instance: 0ebfef18-46d5-46ec-a4ad-78d21e47a53a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:14.719880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.720690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.721301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.724987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.726169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.726862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.752446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] HTTP exception thrown: Instance 0ebfef18-46d5-46ec-a4ad-78d21e47a53a could not be found. Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Request method failure captured: Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a HTTP/1.1 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRTVGCH3VNrS-YUS6A0trSqApgEL4FSTBchaVvA1StlHNxYdBoZG6KguKylrjecaOzyzrAsRC1YTV1N8-Gn3YmunCuWVvyZHk3kBoQ9bBIzM-a6v5DNSPHIPO4-G7Wh6Vx9tMFh8H8Kx7GU_kRcmJkHNPR1WCnntP1SR2dD4lv4LFg Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.57 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ad31db4967994df3a0847a6242b7bde8 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerShowV257Test-1102014242 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ad31db4967994df3a0847a6242b7bde8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ad31db4967994df3a0847a6242b7bde8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ad31db4967994df3a0847a6242b7bde8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ad31db4967994df3a0847a6242b7bde8"}]}] Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerShowV257Test-1102014242 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ad31db4967994df3a0847a6242b7bde8 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerShowV257Test-1102014242 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerShowV257Test-1102014242-project Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 583bf63baaa446ba8fd2e7de76eba384 Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerShowV257Test-1102014242-project Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0ebfef18-46d5-46ec-a4ad-78d21e47a53a could not be found. Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0ebfef18-46d5-46ec-a4ad-78d21e47a53a'} Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ebfef18-46d5-46ec-a4ad-78d21e47a53a could not be found. Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ebfef18-46d5-46ec-a4ad-78d21e47a53a could not be found. Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:14.755790 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ebfef18-46d5-46ec-a4ad-78d21e47a53a could not be found. Aug 30 03:31:14.762994 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:14.766231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] Returning 404 to user: Instance 0ebfef18-46d5-46ec-a4ad-78d21e47a53a could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:14.767303 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8ef2066e-04f7-4330-b819-586bcadae99f tempest-ServerShowV257Test-1102014242 tempest-ServerShowV257Test-1102014242-project] 10.222.0.30 "GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a" status: 404 len: 111 microversion: 2.57 time: 0.071733 Aug 30 03:31:14.768045 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 843/1736] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:14 2022] GET /compute/v2.1/servers/0ebfef18-46d5-46ec-a4ad-78d21e47a53a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:31:14.780429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:14.781489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:14.797480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.798314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.798924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.800257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.800905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.801542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.855810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:14.872604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb9af05f-cf29-4733-985d-fb27ae29a6e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 200 len: 1369 microversion: 2.1 time: 0.351447 Aug 30 03:31:14.878232 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 894/1737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:14 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 1369 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:14.886888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:14.890430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:14.912114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.916746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.919863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:14.922338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:14.923321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:14.924191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:15.750392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:15.762660 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23f44204-5b70-4ca9-a088-d62920e47831 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1381 microversion: 2.1 time: 0.992718 Aug 30 03:31:15.773676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 844/1738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:14 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1381 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:15.773676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:15.773676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:15.780661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:15.781615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:15.782365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:15.784135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:15.785741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:15.788287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:15.858739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:15.875812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:15.879244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:15.881858 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7edcc1ca-21a9-4b7d-a270-08ae2941f800 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 1.002215 Aug 30 03:31:15.893867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 895/1739] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:14 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:15.911572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:15.912205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:15.920013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:15.921650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:15.922266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:15.923188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:15.923829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:15.924422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.385096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:16.394086 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d57fc751-da31-44de-b753-27ea7a4d3839 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.628417 Aug 30 03:31:16.396904 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 845/1740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:15 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:16.410416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:16.411670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:16.425803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:16.426661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:16.427654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.429105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:16.429593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:16.430022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.505853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:16.525833 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-259fdccb-d911-4c55-89b4-30ae76f94ef0 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1506 microversion: 2.1 time: 0.629946 Aug 30 03:31:16.535150 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 896/1741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:15 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:16.838825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:16.839764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:16.847116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:16.847956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:16.848627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.849511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:16.850249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:16.850767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.919099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:16.928621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-642af23c-d5dd-4500-a371-d64d47f666a0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.530374 Aug 30 03:31:16.944193 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 846/1742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:16 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:16.950780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:16.951708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 222d5dbb-c43e-4cc4-9381-865142def69d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:16.960975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:16.961991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:16.962489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.963257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:16.963878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:16.964659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:16.983619 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] HTTP exception thrown: Instance 222d5dbb-c43e-4cc4-9381-865142def69d could not be found. Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Request method failure captured: Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d HTTP/1.1 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYM1RQMkDl6nd4EqI4QWQYOJ0REVAiw-D5nHQx8TZp-tXV32Gk930Rp169iQzDtgZa86NkagUT8OXOgvp5gYP6CdlS2VXa_nsBT_YONWrWaQkcJj9gVL-kMxNCwaJKgC4WK0i1v_ctF5M2ckFzKPm_dezwnxpnn8MIX4gsk_Btf7bF4 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e4d288410e5b49e39dd44da7e2b4d223", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}] Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 948d18cc663b48028570132678823b93 Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 222d5dbb-c43e-4cc4-9381-865142def69d could not be found. Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '222d5dbb-c43e-4cc4-9381-865142def69d'} Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222d5dbb-c43e-4cc4-9381-865142def69d could not be found. Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222d5dbb-c43e-4cc4-9381-865142def69d could not be found. Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:16.985294 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222d5dbb-c43e-4cc4-9381-865142def69d could not be found. Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Returning 404 to user: Instance 222d5dbb-c43e-4cc4-9381-865142def69d could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74c06c16-e78a-47f2-adfd-8fb1a36cdb6f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d" status: 404 len: 111 microversion: 2.1 time: 0.041063 Aug 30 03:31:16.991423 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 847/1743] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:16 2022] GET /compute/v2.1/servers/222d5dbb-c43e-4cc4-9381-865142def69d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:16.997556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-992b0cde-2f60-42df-b6d9-13b38974f0d4 req-2f5bfa2f-7891-4053-98d6-3744d4836691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "tag": "71b202ff-2ae5-4110-a1ab-3829ddd4de1c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:17.012311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-992b0cde-2f60-42df-b6d9-13b38974f0d4 req-2f5bfa2f-7891-4053-98d6-3744d4836691 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.012311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-992b0cde-2f60-42df-b6d9-13b38974f0d4 req-2f5bfa2f-7891-4053-98d6-3744d4836691 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.012311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-992b0cde-2f60-42df-b6d9-13b38974f0d4 req-2f5bfa2f-7891-4053-98d6-3744d4836691 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.024750 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-992b0cde-2f60-42df-b6d9-13b38974f0d4 req-2f5bfa2f-7891-4053-98d6-3744d4836691 service nova] Creating event network-changed:71b202ff-2ae5-4110-a1ab-3829ddd4de1c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:31:17.034706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-992b0cde-2f60-42df-b6d9-13b38974f0d4 req-2f5bfa2f-7891-4053-98d6-3744d4836691 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041407 Aug 30 03:31:17.035630 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 848/1744] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:17.046707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '.version_select at 0x7f897b16b3a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:17.048265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:17.056996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.058679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.060038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.065145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.066122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.066764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.137878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-143510e2-fbb2-4a0f-9669-0f660c8e0610 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.099437 Aug 30 03:31:17.147343 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 849/1745] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Aug 30 03:31:17 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:17.153236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:17.154112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:17.162315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.163279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.163898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.164773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.165419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.165996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.352236 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c7b568c0-2b4b-4343-9005-13128201fe35 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1532 microversion: 2.1 time: 0.814719 Aug 30 03:31:17.362585 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 897/1746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:16 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1532 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:17.367912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-74d71f92-8ecd-4d2c-a7a3-c8defb6fab32 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '.version_select at 0x7f8983c96940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:17.400598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-74d71f92-8ecd-4d2c-a7a3-c8defb6fab32 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557553466" status: 202 len: 0 microversion: 2.1 time: 0.035591 Aug 30 03:31:17.403193 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 898/1747] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557553466 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:31:17.422747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:17.425823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:17.439216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.439984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.440641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.443683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.444170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.444698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.506493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:17.647872 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10c6fd9b-040c-4e69-a00e-292d59d04444 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 204 len: 0 microversion: 2.1 time: 0.243081 Aug 30 03:31:17.654032 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 899/1748] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:17 2022] DELETE /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:17.689884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:17.691059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:17.707990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.708503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.711975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.713006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:17.715201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:17.717090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:17.779629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:18.041790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:18.057023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:18.069235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:18.071956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9224b2a-159f-433c-a75b-72355be6e9bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 0.921733 Aug 30 03:31:18.076062 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 850/1749] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:17 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:18.096299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:18.097222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:18.115525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:18.116242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:18.116800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:18.117426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:18.117884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:18.118981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:18.764178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b0cc658-fec4-44ea-92b2-82ebe74bf73f tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1532 microversion: 2.1 time: 1.103235 Aug 30 03:31:18.765737 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 900/1750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:17 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1532 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:18.771082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:18.772424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:18.782166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:18.783085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:18.783800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:18.788268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:18.789094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:18.789599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:18.977030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:18.986108 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a53a8b1c-64bb-4994-8555-f7d67dd15a1c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.899491 Aug 30 03:31:18.987047 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 851/1751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:18 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:18.997192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:18.997842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:19.006481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.007243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.007864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.008668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.009227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.009779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.336227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:19.352149 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec3a62d6-43c2-4366-aae5-3a859ee8e0dc tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1512 microversion: 2.1 time: 0.585507 Aug 30 03:31:19.352661 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 901/1752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:18 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1512 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:19.357750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8164527e-18e4-4378-b5f2-89dc1a227708 req-42edc431-b954-450e-9c74-76242bb20ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84", "name": "network-vif-plugged", "status": "completed", "tag": "739c3385-f03a-497a-acc4-fe87c924e940"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:19.371980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8164527e-18e4-4378-b5f2-89dc1a227708 req-42edc431-b954-450e-9c74-76242bb20ae0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.372667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8164527e-18e4-4378-b5f2-89dc1a227708 req-42edc431-b954-450e-9c74-76242bb20ae0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.373281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8164527e-18e4-4378-b5f2-89dc1a227708 req-42edc431-b954-450e-9c74-76242bb20ae0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.386900 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8164527e-18e4-4378-b5f2-89dc1a227708 req-42edc431-b954-450e-9c74-76242bb20ae0 service nova] Creating event network-vif-plugged:739c3385-f03a-497a-acc4-fe87c924e940 for instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 on n-h1-854924-5 Aug 30 03:31:19.392464 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8164527e-18e4-4378-b5f2-89dc1a227708 req-42edc431-b954-450e-9c74-76242bb20ae0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038308 Aug 30 03:31:19.393103 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 902/1753] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:19.399402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:19.403217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.403971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.404535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.405684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.406137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.406560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.433936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f618a3b0-8ab2-4c5f-9310-e61b2274044d tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038938 Aug 30 03:31:19.434672 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 903/1754] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:31:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:19.447350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:19.448086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:19.456327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.456327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.457240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.458152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.458152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.458686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.498364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:19.548361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:19.558744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1db9fbfd-af4a-43cc-a23e-b76e89581859 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.570302 Aug 30 03:31:19.559325 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 852/1755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:18 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:19.566245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:19.567348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:19.577197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.586520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.587085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.589682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.594272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.595116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.626646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:19.658359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6496185d-6b1c-48f8-8d4c-3b74038cb8c5 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 204 len: 0 microversion: 2.1 time: 0.221870 Aug 30 03:31:19.659655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 904/1756] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:19 2022] DELETE /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:19.666070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c9c607d-c696-4e0c-bf6a-282a4cd268ee tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897affe670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:19.733225 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c9c607d-c696-4e0c-bf6a-282a4cd268ee tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/236b0bb9-0f3e-4dfb-9074-de2ff3304ab7" status: 200 len: 350 microversion: 2.1 time: 0.071933 Aug 30 03:31:19.734152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 905/1757] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:31:19 2022] GET /compute/v2.1/os-volumes/236b0bb9-0f3e-4dfb-9074-de2ff3304ab7 => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:19.746249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854924-5", "block_migration": false, "disk_over_commit": false}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:19.750512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:19.770309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.770936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.771341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.772165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:19.772632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:19.773059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:19.804877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lazy-loading 'flavor' on Instance uuid 1bd1f1d3-d61a-49d0-873a-e46452077453 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:19.829297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Going to try to live migrate instance to n-h2-854924-5 {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:31:20.226021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:20.235827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:20.262003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:20.263224 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c99aec4-c46e-41b6-bfb3-2a39f40420ff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1565 microversion: 2.25 time: 0.701026 Aug 30 03:31:20.281314 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 853/1758] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:19 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1565 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:20.286365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:20.286988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:20.310913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:20.311449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:20.311873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:20.326737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:20.329225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:20.331616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:20.644475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:20.653757 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4810d2d4-06ab-445a-b232-271a587372eb tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1468 microversion: 2.1 time: 0.371848 Aug 30 03:31:20.665857 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 854/1759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:20 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:20.693370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9968f92b-4693-4de2-8568-40aba2ed3223 req-4b5f2564-7d68-4ae3-a02c-1fac2c9942d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f51ee-f669-4f77-a214-7d75043e6f38", "name": "network-vif-deleted", "tag": "1b74f4da-cae8-4341-acf9-3cb695b98c3a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:20.733762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9968f92b-4693-4de2-8568-40aba2ed3223 req-4b5f2564-7d68-4ae3-a02c-1fac2c9942d0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:20.736731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9968f92b-4693-4de2-8568-40aba2ed3223 req-4b5f2564-7d68-4ae3-a02c-1fac2c9942d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:20.737550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9968f92b-4693-4de2-8568-40aba2ed3223 req-4b5f2564-7d68-4ae3-a02c-1fac2c9942d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:20.764006 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9968f92b-4693-4de2-8568-40aba2ed3223 req-4b5f2564-7d68-4ae3-a02c-1fac2c9942d0 service nova] Creating event network-vif-deleted:1b74f4da-cae8-4341-acf9-3cb695b98c3a for instance b96f51ee-f669-4f77-a214-7d75043e6f38 on n-h2-854924-5 Aug 30 03:31:20.772091 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9968f92b-4693-4de2-8568-40aba2ed3223 req-4b5f2564-7d68-4ae3-a02c-1fac2c9942d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101515 Aug 30 03:31:20.773042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 855/1760] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:20.778539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:20.781178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:20.789213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:20.790207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:20.791184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:20.792143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:20.792882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:20.793647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:21.265071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:21.299656 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-663a110e-dd3f-4eaa-9033-9a646006a63c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.525051 Aug 30 03:31:21.325856 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 856/1761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:20 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:21.361001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c3496a4d-8bec-4cae-9702-179c2ef25151 req-b21c56bb-a25a-4195-93fb-f7c4b09f1640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "tag": "0de928a5-1183-4b56-bf15-e6239501fdba"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:21.384567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:21.394061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c3496a4d-8bec-4cae-9702-179c2ef25151 req-b21c56bb-a25a-4195-93fb-f7c4b09f1640 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:21.395432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c3496a4d-8bec-4cae-9702-179c2ef25151 req-b21c56bb-a25a-4195-93fb-f7c4b09f1640 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:21.396028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c3496a4d-8bec-4cae-9702-179c2ef25151 req-b21c56bb-a25a-4195-93fb-f7c4b09f1640 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:21.468384 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c3496a4d-8bec-4cae-9702-179c2ef25151 req-b21c56bb-a25a-4195-93fb-f7c4b09f1640 service nova] Creating event network-changed:0de928a5-1183-4b56-bf15-e6239501fdba for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:31:21.475805 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c3496a4d-8bec-4cae-9702-179c2ef25151 req-b21c56bb-a25a-4195-93fb-f7c4b09f1640 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147849 Aug 30 03:31:21.483372 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 857/1762] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:21.489170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:21.490839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:21.501957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:21.503060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:21.504200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:21.506797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:21.507481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:21.509827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:21.551935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:21.552796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:21.553414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:21.554396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lazy-loading 'fault' on Instance uuid b96f51ee-f669-4f77-a214-7d75043e6f38 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:21.678086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce8b9b338354504a8ba80d76ec16e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f6f018bcc44754a7bd658e9082d681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:21.699070 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-de224678-698a-4a6a-9cf8-da708268af74 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 200 len: 1306 microversion: 2.1 time: 0.212795 Aug 30 03:31:21.715961 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 858/1763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:21 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 1306 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:21.727724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:21.728695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:21.739686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:21.740403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:21.741002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:21.741968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:21.742598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:21.743215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.178745 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f3bffe1-c417-4d0e-a3e1-a2c30e154b8c tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453/action" status: 202 len: 0 microversion: 2.1 time: 2.443098 Aug 30 03:31:22.179651 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 906/1764] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:31:19 2022] POST /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453/action => generated 0 bytes in 2444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:31:22.184554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:22.185162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:22.192928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.193625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.194057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.194338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:22.194758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.195206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.195624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.206010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0042a60b-7303-4dd1-8082-470e775b678b tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1316 microversion: 2.1 time: 0.488062 Aug 30 03:31:22.207127 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 859/1765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:21 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:22.211794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:22.212626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:22.226941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.227593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.228057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.228757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.229208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.229648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.734817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:22.739143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:22.748696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d92b4513-e20f-4d53-99ad-f78e5e9e2a3b tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 200 len: 1468 microversion: 2.1 time: 0.540460 Aug 30 03:31:22.749289 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 860/1766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:22 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 1468 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:22.754549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:22.754773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:22.755595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:22.762023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:22.763206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.763903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.764910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.765645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.765841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b32bb91-2b62-4ab0-b93d-74cff73ecc47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1540 microversion: 2.25 time: 0.585384 Aug 30 03:31:22.766711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.767664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.778764 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 907/1767] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:22 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1540 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:22.792158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:22.792869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:22.802311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.802900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.803407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:22.804234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:22.804878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:22.805282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.166470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:23.177096 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aaf08d43-1154-4687-b825-01ec53ad8a38 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.426086 Aug 30 03:31:23.189373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 861/1768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:22 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:23.189373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb3984bc-fce8-427c-8674-6e17be8eddbd tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b1b3a60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:23.246739 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb3984bc-fce8-427c-8674-6e17be8eddbd tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1a45a92c-d860-4a28-9530-c137c3cbac3b" status: 200 len: 351 microversion: 2.1 time: 0.067546 Aug 30 03:31:23.248018 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 862/1769] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:31:23 2022] GET /compute/v2.1/os-volumes/1a45a92c-d860-4a28-9530-c137c3cbac3b => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:23.262269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:23.262877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] [instance: b96f51ee-f669-4f77-a214-7d75043e6f38] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:23.272154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.272896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.273575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.275134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.275996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.276724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.283856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:23.296841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e16259e-8994-4baa-acf8-14ed7eec1afd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.516761 Aug 30 03:31:23.298692 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] HTTP exception thrown: Instance b96f51ee-f669-4f77-a214-7d75043e6f38 could not be found. Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Request method failure captured: Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 HTTP/1.1 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRa1Xkcg1xQtZYkFDdhSUmwWbAWYCQjTaRMQEG8K9fhG6dpuOjA3kKxsD111VxhAQBtuL9nQB-5g8jWHAJDVzZPZaB-rldQnO7bAmgyaoESGNmbI_020MOvdjDAMi970wyJrvF-tl2wCKKp6CWQjLqm9IsiPywh6bSH4yJHP6YHfQA Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 78f6f018bcc44754a7bd658e9082d681 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceActionsTestJSON-182928895 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78f6f018bcc44754a7bd658e9082d681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78f6f018bcc44754a7bd658e9082d681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78f6f018bcc44754a7bd658e9082d681", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78f6f018bcc44754a7bd658e9082d681"}]}] Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceActionsTestJSON-182928895 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 78f6f018bcc44754a7bd658e9082d681 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceActionsTestJSON-182928895 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceActionsTestJSON-182928895-project Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 1ce8b9b338354504a8ba80d76ec16e79 Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceActionsTestJSON-182928895-project Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance b96f51ee-f669-4f77-a214-7d75043e6f38 could not be found. Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'b96f51ee-f669-4f77-a214-7d75043e6f38'} Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96f51ee-f669-4f77-a214-7d75043e6f38 could not be found. Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96f51ee-f669-4f77-a214-7d75043e6f38 could not be found. Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:23.301035 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96f51ee-f669-4f77-a214-7d75043e6f38 could not be found. Aug 30 03:31:23.307738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:23.308832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 908/1770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:22 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:23.309168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] Returning 404 to user: Instance b96f51ee-f669-4f77-a214-7d75043e6f38 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:23.310402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d94f17d3-b248-4345-a906-d3e53e6521e5 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '.version_select at 0x7f897afc0f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:23.311841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0455f38a-d21f-4f2c-8773-3d4a314f0ca3 tempest-InstanceActionsTestJSON-182928895 tempest-InstanceActionsTestJSON-182928895-project] 10.222.0.30 "GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38" status: 404 len: 111 microversion: 2.1 time: 0.060945 Aug 30 03:31:23.316990 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 863/1771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:23 2022] GET /compute/v2.1/servers/b96f51ee-f669-4f77-a214-7d75043e6f38 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:23.323634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:23.325326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:23.328634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d94f17d3-b248-4345-a906-d3e53e6521e5 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.332993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d94f17d3-b248-4345-a906-d3e53e6521e5 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.334109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d94f17d3-b248-4345-a906-d3e53e6521e5 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.334681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.335829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.337026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.338540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.339193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.339794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.350721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d94f17d3-b248-4345-a906-d3e53e6521e5 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3627 microversion: 2.25 time: 0.047695 Aug 30 03:31:23.352968 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 909/1772] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Aug 30 03:31:23 2022] GET /compute/v2.1/os-migrations => generated 3627 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:23.380991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:23.381720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:23.406159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.406976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.413297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:23.414439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:23.414926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:23.415374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.276569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:24.288114 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01792334-e341-4216-946c-6ff9d9357711 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1505 microversion: 2.1 time: 0.970408 Aug 30 03:31:24.291436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 864/1773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:23 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1505 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:24.299288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "tag": "2ec60260-9d16-43dd-a064-a573c75aa05c"}, {"server_uuid": "39a00fa0-ccdc-44ca-8b84-d0e21eaa69da", "name": "network-vif-deleted", "tag": "bb4b4044-487e-4c38-b707-a31e52f91c1f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:24.325109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.325865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.326504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.340262 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] Creating event network-changed:2ec60260-9d16-43dd-a064-a573c75aa05c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:31:24.341111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] Creating event network-vif-deleted:bb4b4044-487e-4c38-b707-a31e52f91c1f for instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da on n-h2-854924-5 Aug 30 03:31:24.353556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1e217b2b-62cc-4c67-8489-459dd1df8d59 req-6454dda1-4a83-4581-841f-cc6851589495 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059659 Aug 30 03:31:24.354772 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 865/1774] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:24.360622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:24.361680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:24.368342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.369128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.369791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.370739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.371403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.372030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.387073 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] HTTP exception thrown: Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da could not be found. Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Request method failure captured: Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da HTTP/1.1 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYM1RQMkDl6nd4EqI4QWQYOJ0REVAiw-D5nHQx8TZp-tXV32Gk930Rp169iQzDtgZa86NkagUT8OXOgvp5gYP6CdlS2VXa_nsBT_YONWrWaQkcJj9gVL-kMxNCwaJKgC4WK0i1v_ctF5M2ckFzKPm_dezwnxpnn8MIX4gsk_Btf7bF4 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e4d288410e5b49e39dd44da7e2b4d223", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}] Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 948d18cc663b48028570132678823b93 Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da could not be found. Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '39a00fa0-ccdc-44ca-8b84-d0e21eaa69da'} Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da could not be found. Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da could not be found. Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:24.389131 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da could not be found. Aug 30 03:31:24.394127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:24.396557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Returning 404 to user: Instance 39a00fa0-ccdc-44ca-8b84-d0e21eaa69da could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:24.397751 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06c89386-c13b-471e-b96f-aff832582f26 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da" status: 404 len: 111 microversion: 2.1 time: 0.041574 Aug 30 03:31:24.398841 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 866/1775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:24 2022] GET /compute/v2.1/servers/39a00fa0-ccdc-44ca-8b84-d0e21eaa69da => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:24.405379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:24.406504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:24.413910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.414783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.415703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.416846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.417711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.418584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.554709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid d7bfd063-daa2-4ee8-b1a5-de09b35fac42 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:24.605576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-232572f0-3bcf-4504-9063-6853d6b9474e tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 2032 microversion: 2.25 time: 1.240422 Aug 30 03:31:24.606279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 910/1776] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:23 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 2032 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:31:24.637066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:24.637561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:24.648064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.648559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.649891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.650994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.652020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.653502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.749534 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db141d49-9ef7-4d49-81b4-4309e39625e0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84/ips" status: 200 len: 109 microversion: 2.1 time: 0.130228 Aug 30 03:31:24.750662 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 911/1777] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:31:24 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84/ips => generated 109 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:24.755443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:24.756112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:24.769260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.769796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.770246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.770940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.771991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.771991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.798707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:24.831491 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e6abe148-c306-4107-b07e-7379e7592acb tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.425938 Aug 30 03:31:24.858371 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 867/1778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:24 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:24.871649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:24.873822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:24.898721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.900947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.902970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.904005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:24.906702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:24.908087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:24.962666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:25.089615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-519806e8-95bc-4b70-bc4e-9fa32cd7616e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 204 len: 0 microversion: 2.1 time: 0.226732 Aug 30 03:31:25.091144 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 868/1779] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:24 2022] DELETE /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:25.100712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16a5cde8-2436-47f5-bb9c-746fcd4a57fe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Action: 'create', calling method: .version_select at 0x7f897b165820>, body: {"keypair": {"name": "tempest-keypair-625714692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG78j9TPnT2l4TyENWGUSekJlnxEOPfQ3iO2PtO8H143soDoQf75nijNyQavFLgtLyXzDvAkEac9F0KYWC6mK3viyT10txSgAwqMYv2V774pYWxAf8MRUSzXtastuswwKg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:25.129464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-16a5cde8-2436-47f5-bb9c-746fcd4a57fe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for project 0e260d308f384ae5a6b7437e21055c75. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:25.138795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-16a5cde8-2436-47f5-bb9c-746fcd4a57fe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for user 90a88f0a70ca48f59450dae1c9165417 and project 0e260d308f384ae5a6b7437e21055c75. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:25.183083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16a5cde8-2436-47f5-bb9c-746fcd4a57fe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.089232 Aug 30 03:31:25.183872 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 869/1780] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:31:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:31:25.189042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:25.190277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:25.198036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.198772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.199327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.200164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.200711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.201232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.233899 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f81cccd-9125-4c9d-bf00-d33b930a6de1 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84/ips" status: 200 len: 109 microversion: 2.1 time: 0.048560 Aug 30 03:31:25.237528 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 870/1781] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:31:25 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:25.244793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:25.245635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:25.253097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.253808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.254372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.255183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.255776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.256303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.405620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:25.416908 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a818668-e1ca-44ad-aa0a-b863d055e03f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.665080 Aug 30 03:31:25.428524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 912/1782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:24 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:25.428524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-301edf42-8ad8-4110-b61e-ab9693536019 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f8983c840d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:25.477951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-301edf42-8ad8-4110-b61e-ab9693536019 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe" status: 200 len: 637 microversion: 2.1 time: 0.058347 Aug 30 03:31:25.478714 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 913/1783] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:31:25 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe => generated 637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:25.485668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:25.487646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:25.500194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.501127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.502064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.503115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.503880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.504411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.536185 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bcf84d46-0e7f-4893-af3b-8a8e64fd2d53 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84/ips/tempest-ServerAddressesTestJSON-1137981584-network" status: 200 len: 94 microversion: 2.1 time: 0.054932 Aug 30 03:31:25.545203 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 914/1784] 10.222.0.30 () {58 vars in 1401 bytes} [Tue Aug 30 03:31:25 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84/ips/tempest-ServerAddressesTestJSON-1137981584-network => generated 94 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:25.546466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a774cfb9-baa6-4e44-8090-e7d18eb1a16c tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f897afc3940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:25.582531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:25.617611 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe9af57a-2b3b-435c-8299-cecb17ac721e tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1468 microversion: 2.1 time: 0.377920 Aug 30 03:31:25.622517 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 871/1785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:25 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:25.647591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:25.694856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:25.713884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.716919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.718205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.721183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:25.721955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:25.724344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:25.728009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a774cfb9-baa6-4e44-8090-e7d18eb1a16c tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:25.737027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a774cfb9-baa6-4e44-8090-e7d18eb1a16c tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:25.817912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:25.904078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:25.985730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f410eb9e-5f8d-42fc-8183-ae80eb051505 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "DELETE /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 204 len: 0 microversion: 2.1 time: 0.353037 Aug 30 03:31:25.988661 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 872/1786] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:25 2022] DELETE /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:25.999662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:26.001254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:26.012466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:26.013209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:26.013724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:26.015194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:26.015567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:26.016264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:26.210206 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a774cfb9-baa6-4e44-8090-e7d18eb1a16c tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.671109 Aug 30 03:31:26.211397 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 915/1787] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:25 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:26.220947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:26.222816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:26.256509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:26.257908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:26.262019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:26.262980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:26.263617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:26.266523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:26.398529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:26.414745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-385c91ec-560b-47c5-894c-456d40dfa536 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.424273 Aug 30 03:31:26.421768 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 873/1788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:25 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:26.426995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1202bb7c-9f62-474b-99f3-ef483be50f3d tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b21e310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:26.517289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1202bb7c-9f62-474b-99f3-ef483be50f3d tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f457cf01-b2ea-43c8-b45c-6e8749d5c2c2" status: 200 len: 349 microversion: 2.1 time: 0.094006 Aug 30 03:31:26.518652 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 874/1789] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:31:26 2022] GET /compute/v2.1/os-volumes/f457cf01-b2ea-43c8-b45c-6e8749d5c2c2 => generated 349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:26.524264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8f2edcb1-33ad-4310-896d-004394971d9b tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f897b1b5af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:26.572248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:26.584077 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b9cb9c2-356c-4131-ae20-edf06ee961f3 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1511 microversion: 2.1 time: 0.371447 Aug 30 03:31:26.585985 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 916/1790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:26 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:26.616064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:26.616858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:26.644646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:26.658060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:26.658859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:26.659864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:26.660504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:26.661078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:26.906986 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8f2edcb1-33ad-4310-896d-004394971d9b tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "DELETE /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.386696 Aug 30 03:31:26.907916 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 875/1791] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Aug 30 03:31:26 2022] DELETE /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata/os_version => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:26.915554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08de8e99-7589-4aa2-adc6-f86d8608e840 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b163f70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:26.951418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:26.978711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f3ae336-972e-4e36-b7ff-88293cd6aa0c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.374832 Aug 30 03:31:26.997812 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 917/1792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:26 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:27.013693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:27.015964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:27.024266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:27.025534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:27.026193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:27.027155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:27.027805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:27.028433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:27.087171 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08de8e99-7589-4aa2-adc6-f86d8608e840 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.177503 Aug 30 03:31:27.097322 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 876/1793] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 30 03:31:26 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:27.102752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67d0b876-4135-4b0c-a441-fefc5015b0d5 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f897b11fb80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:27.189684 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67d0b876-4135-4b0c-a441-fefc5015b0d5 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 37 microversion: 2.1 time: 0.088682 Aug 30 03:31:27.198001 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 877/1794] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:31:27 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 37 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:27.209971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3300eef0-efb2-457a-b57f-6a2ee34b28b3 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b1633a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:27.332419 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3300eef0-efb2-457a-b57f-6a2ee34b28b3 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.131386 Aug 30 03:31:27.337204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:27.338157 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 878/1795] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:31:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:27.341588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:27.349080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fbd93ac1-f85b-45e2-8f1b-1818c9851759 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f897b1fb790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:27.352728 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03648b07-d61f-4f2d-bb1d-f565e53a660f tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1468 microversion: 2.1 time: 0.352746 Aug 30 03:31:27.365306 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 918/1796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:26 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:27.382558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0cfce750-5879-4750-aeac-cabd19b3a16e tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f8983c96160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:27.438537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-fbd93ac1-f85b-45e2-8f1b-1818c9851759 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:27.448279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-fbd93ac1-f85b-45e2-8f1b-1818c9851759 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:27.575994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0cfce750-5879-4750-aeac-cabd19b3a16e tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.197412 Aug 30 03:31:27.577723 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 919/1797] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 30 03:31:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:27.595579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:27.596414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:27.618133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:27.619004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:27.620091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:27.622336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:27.623355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:27.624535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:27.837334 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fbd93ac1-f85b-45e2-8f1b-1818c9851759 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.497738 Aug 30 03:31:27.838358 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 879/1798] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:27 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:27.860848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c6db37d-2650-480a-bb71-97d86f670088 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b1638b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:28.003914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c6db37d-2650-480a-bb71-97d86f670088 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.158003 Aug 30 03:31:28.004849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 880/1799] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:31:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:28.010195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:28.015109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:28.024991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:28.025624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:28.027045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:28.029228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:28.030769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:28.031502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:28.642772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:28.655675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a583cf5a-7f82-426b-ae08-e3996a1a6895 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 1.064876 Aug 30 03:31:28.656941 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 920/1800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:27 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:28.673553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e664b50-8be9-468e-a507-662f26f52b22 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f897afc0790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:28.719266 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e664b50-8be9-468e-a507-662f26f52b22 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.060872 Aug 30 03:31:28.721035 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 921/1801] 10.222.0.30 () {58 vars in 1290 bytes} [Tue Aug 30 03:31:28 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata/os_distro => generated 33 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:28.726148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:28.727069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:28.734847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:28.735752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:28.736431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:28.737447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:28.738140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:28.738791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:28.758065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:28.766610 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7d2bfda-abea-42bc-a35a-872e7a783feb tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1511 microversion: 2.1 time: 0.760543 Aug 30 03:31:28.780881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 881/1802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:28 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1511 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:28.780881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a3cc90c-4b14-4fdd-b22c-82e92c94412f tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b1631f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:28.905890 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a3cc90c-4b14-4fdd-b22c-82e92c94412f tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.130383 Aug 30 03:31:28.917297 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 882/1803] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:31:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:28.923200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:28.924018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:28.947541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:28.948377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:28.949074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:28.950188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:28.950904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:28.952116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:29.414823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:29.706198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:29.721238 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2dd65220-8c55-469d-a410-f21c70178492 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.998501 Aug 30 03:31:29.724688 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 922/1804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:28 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:29.739499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eace8d1c-0733-476d-9389-729a806620d2 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f8983c04700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:29.814535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-eace8d1c-0733-476d-9389-729a806620d2 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:29.822016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-eace8d1c-0733-476d-9389-729a806620d2 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:30.014601 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eace8d1c-0733-476d-9389-729a806620d2 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.287319 Aug 30 03:31:30.015870 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 923/1805] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:29 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:30.021420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c622e64c-91da-4aeb-b526-5c9c7c88acd6 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f8983b30670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:30.121316 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c622e64c-91da-4aeb-b526-5c9c7c88acd6 tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.103956 Aug 30 03:31:30.122599 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 924/1806] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:31:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:30.128874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:30.129641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:30.132416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:30.136500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:30.137001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:30.137469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:30.138470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:30.139916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:30.140555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:30.143761 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-633f55d7-57b9-4a8c-87d0-f79cc78273ba tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1468 microversion: 2.1 time: 1.224498 Aug 30 03:31:30.144967 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 883/1807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:28 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1468 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:30.150675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:30.151541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:30.159226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:30.160082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:30.160556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:30.161265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:30.162872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:30.163648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:30.776707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:30.795556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0eef37a-f739-4f95-a6c9-91349f4c79fa tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1511 microversion: 2.1 time: 0.649082 Aug 30 03:31:30.796139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:30.799126 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 884/1808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:30 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1511 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:30.808601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a93bbefa-e4fc-4180-96ce-508d6f192e62 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f897b1b5310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:30.822973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f89bcda7-d442-4c83-a8ea-d5c98af49d65 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.698933 Aug 30 03:31:30.824745 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 925/1809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:30 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:30.836256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-72002c90-8e6f-4954-827d-eac9c46662dd tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f8983c2a9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:30.895516 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a93bbefa-e4fc-4180-96ce-508d6f192e62 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.093473 Aug 30 03:31:30.896276 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 885/1810] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:31:30 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:31.019634 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-72002c90-8e6f-4954-827d-eac9c46662dd tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.188638 Aug 30 03:31:31.034674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 926/1811] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Aug 30 03:31:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:31.042690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:31.053401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:31.085597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:31.113297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:31.115692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:31.116680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:31.119354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:31.121032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:31.262197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bac0c126-6856-4a00-b27c-56a648c289e2 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-873485888", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:31.272260 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-bac0c126-6856-4a00-b27c-56a648c289e2 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] HTTP exception thrown: min_count must be <= max_count Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bac0c126-6856-4a00-b27c-56a648c289e2 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Request method failure captured: Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 183 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSSq-j3SijEZeQyOBDMlOUHMEIQUMRdHRCNb-iTJ07yDl3zzE4-DO0l41ISAFT7osD-Hbv30e4spol8nU7UYI6KDmi3GbmIHzgFTInRSqoXZEzCo5Bau1Xfasc_Sc7D6wYeVNB_kul5n4FRfk-S3VtnHsHSEWHlu0HB-ahNXqjPLVA Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cbbc953259f413c8e93bc39e1369b2d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}] Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d6d9289f8b464c45b0ac75c2b43d983f Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-873485888", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: exception: min_count must be <= max_count Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-873485888', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 30 03:31:31.276278 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.286303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bac0c126-6856-4a00-b27c-56a648c289e2 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Returning 400 to user: min_count must be <= max_count {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:31.288035 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bac0c126-6856-4a00-b27c-56a648c289e2 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.390578 Aug 30 03:31:31.288872 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 886/1812] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:30 2022] POST /compute/v2.1/servers => generated 74 bytes in 392 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:31:31.295147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edf2f9c9-5391-4838-ac78-0c3c9244b627 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f897b21eaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:31.371772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-edf2f9c9-5391-4838-ac78-0c3c9244b627 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:31.378350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-edf2f9c9-5391-4838-ac78-0c3c9244b627 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:31.381490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:31.390860 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2144ea55-d314-4bde-b8dc-7e05fee84c53 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.354544 Aug 30 03:31:31.391966 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 927/1813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:31 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:31.410755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-329468167", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "790c575c-89a4-4f37-8094-cadf2b9c79fa"}], "security_groups": [{"name": "tempest-securitygroup--976841738"}], "key_name": "tempest-keypair-625714692", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:31.560730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] validate_networks() for [('790c575c-89a4-4f37-8094-cadf2b9c79fa', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:31:31.575388 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edf2f9c9-5391-4838-ac78-0c3c9244b627 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.285193 Aug 30 03:31:31.576486 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 887/1814] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:31 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:31.583204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45c0ca77-b151-41b0-8e53-776f221d7d3d tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] Calling method '.version_select at 0x7f897b21e280>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:31.680696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45c0ca77-b151-41b0-8e53-776f221d7d3d tempest-VolumesTestJSON-872126909 tempest-VolumesTestJSON-872126909-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.103115 Aug 30 03:31:31.681278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 888/1815] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 03:31:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:31.686262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-06414f99-7798-42e0-9c11-308c2c770cb4 req-ccb6c302-eaba-49f2-8df5-5562d983775d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84", "name": "network-vif-deleted", "tag": "739c3385-f03a-497a-acc4-fe87c924e940"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:31.700570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-06414f99-7798-42e0-9c11-308c2c770cb4 req-ccb6c302-eaba-49f2-8df5-5562d983775d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:31.700963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-06414f99-7798-42e0-9c11-308c2c770cb4 req-ccb6c302-eaba-49f2-8df5-5562d983775d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:31.702002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-06414f99-7798-42e0-9c11-308c2c770cb4 req-ccb6c302-eaba-49f2-8df5-5562d983775d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:31.713606 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-06414f99-7798-42e0-9c11-308c2c770cb4 req-ccb6c302-eaba-49f2-8df5-5562d983775d service nova] Creating event network-vif-deleted:739c3385-f03a-497a-acc4-fe87c924e940 for instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 on n-h1-854924-5 Aug 30 03:31:31.720608 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-06414f99-7798-42e0-9c11-308c2c770cb4 req-ccb6c302-eaba-49f2-8df5-5562d983775d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037171 Aug 30 03:31:31.721379 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 889/1816] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:31.746131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:31.747729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:31.775962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:31.776462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:31.776906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:31.778782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:31.779247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:31.780466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:31.871808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:31.872670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:31.873370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:31.873946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lazy-loading 'fault' on Instance uuid 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:31.950359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:31.961926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51fcf8b8-5a4c-46a1-83e3-d1b61d3e5b30 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1302 microversion: 2.1 time: 0.234981 Aug 30 03:31:31.963909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 890/1817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:31 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1302 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:31.969742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e159cd19-f96d-4706-9dd8-b823870929b1 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1749342141", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "max_count": 0}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e159cd19-f96d-4706-9dd8-b823870929b1 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Request method failure captured: Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 168 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSSq-j3SijEZeQyOBDMlOUHMEIQUMRdHRCNb-iTJ07yDl3zzE4-DO0l41ISAFT7osD-Hbv30e4spol8nU7UYI6KDmi3GbmIHzgFTInRSqoXZEzCo5Bau1Xfasc_Sc7D6wYeVNB_kul5n4FRfk-S3VtnHsHSEWHlu0HB-ahNXqjPLVA Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cbbc953259f413c8e93bc39e1369b2d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}] Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d6d9289f8b464c45b0ac75c2b43d983f Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1749342141", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "max_count": 0}} Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1749342141', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'max_count': 0}}} Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 0 Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:31:31.977204 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 03:31:31.982270 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:31.984773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e159cd19-f96d-4706-9dd8-b823870929b1 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:31.985686 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e159cd19-f96d-4706-9dd8-b823870929b1 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020438 Aug 30 03:31:31.986827 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 891/1818] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:31:32.005820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e8b5d41-90a5-42bc-b95c-bb2c101f5b96 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f897b1361f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:32.073372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-2e8b5d41-90a5-42bc-b95c-bb2c101f5b96 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:32.079941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-2e8b5d41-90a5-42bc-b95c-bb2c101f5b96 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:32.222170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:31:32.223372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:31:32.224125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:31:32.224795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:31:32.225532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:31:32.248787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.249569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.250566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.252413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.253112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.253550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.287609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:32.294001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for user 90a88f0a70ca48f59450dae1c9165417 and project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:32.315757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:31:32.319506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:31:32.398941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:32.428958 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fc9d3685-eeef-4ec0-8e38-f59923651600 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.035506 Aug 30 03:31:32.435624 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 928/1819] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:31:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:31:32.435624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:32.435624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:32.444041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.444757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.445485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.446431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.447220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.447849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.482090 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e8b5d41-90a5-42bc-b95c-bb2c101f5b96 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 64 microversion: 2.1 time: 0.493701 Aug 30 03:31:32.483182 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 892/1820] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:31 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 64 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:32.489519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:32.490144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:32.491245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.491743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.492183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.492636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lazy-loading 'fault' on Instance uuid 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:32.497166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.498263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.499266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.500249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.500706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.501132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.540523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:32.550341 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0688f1a6-8c51-4ef6-9405-cce82cb23af0 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1306 microversion: 2.1 time: 0.118847 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 929/1821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:32 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-def98dc3-a508-42b1-853a-3f9d0c520d40 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-6242734", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "max_count": 2.5}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-def98dc3-a508-42b1-853a-3f9d0c520d40 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Request method failure captured: Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 167 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSSq-j3SijEZeQyOBDMlOUHMEIQUMRdHRCNb-iTJ07yDl3zzE4-DO0l41ISAFT7osD-Hbv30e4spol8nU7UYI6KDmi3GbmIHzgFTInRSqoXZEzCo5Bau1Xfasc_Sc7D6wYeVNB_kul5n4FRfk-S3VtnHsHSEWHlu0HB-ahNXqjPLVA Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cbbc953259f413c8e93bc39e1369b2d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}] Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d6d9289f8b464c45b0ac75c2b43d983f Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-6242734", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "max_count": 2.5}} Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-6242734', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'max_count': 2.5}}} Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:32.565383 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-def98dc3-a508-42b1-853a-3f9d0c520d40 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-def98dc3-a508-42b1-853a-3f9d0c520d40 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014639 Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 930/1822] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:32.580040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:32.594493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.595191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.595743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.596674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:32.597252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:32.597824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:32.805009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:32.816181 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e7c9dccf-2f65-41c2-9c74-da5d088d59d4 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.331943 Aug 30 03:31:32.817384 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 893/1823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:32 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:32.836699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed4e6e19-7b30-42bd-8d6e-73c3100adeff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:32.837628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed4e6e19-7b30-42bd-8d6e-73c3100adeff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:32.864062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:32.874782 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c154444-eb98-4aac-b9b2-11bfa15a636b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.302621 Aug 30 03:31:32.876733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 931/1824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:32 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:32.882418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4369cfdc-b3dd-478b-9552-0c9f309bfeec tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f8983c63af0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:32.910753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed4e6e19-7b30-42bd-8d6e-73c3100adeff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:32.929672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed4e6e19-7b30-42bd-8d6e-73c3100adeff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:32.931208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed4e6e19-7b30-42bd-8d6e-73c3100adeff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:32.934015 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed4e6e19-7b30-42bd-8d6e-73c3100adeff tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1284 microversion: 2.25 time: 0.113759 Aug 30 03:31:32.934706 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 894/1825] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:32 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:32.950705 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4369cfdc-b3dd-478b-9552-0c9f309bfeec tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 64 microversion: 2.1 time: 0.072484 Aug 30 03:31:32.951532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-281b1aa5-1aa4-432e-9369-6e4e463cc176 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-830479970", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 0}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:32.951693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 932/1826] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:31:32 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 64 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-281b1aa5-1aa4-432e-9369-6e4e463cc176 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Request method failure captured: Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 167 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSSq-j3SijEZeQyOBDMlOUHMEIQUMRdHRCNb-iTJ07yDl3zzE4-DO0l41ISAFT7osD-Hbv30e4spol8nU7UYI6KDmi3GbmIHzgFTInRSqoXZEzCo5Bau1Xfasc_Sc7D6wYeVNB_kul5n4FRfk-S3VtnHsHSEWHlu0HB-ahNXqjPLVA Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cbbc953259f413c8e93bc39e1369b2d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}] Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d6d9289f8b464c45b0ac75c2b43d983f Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-830479970", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 0}} Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-830479970', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'min_count': 0}}} Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 0 Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:31:32.957895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 03:31:32.964181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:32.965258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-362cdf9d-3888-4345-90e9-bd991be6804b tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f89800920d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:32.966896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-281b1aa5-1aa4-432e-9369-6e4e463cc176 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:32.968495 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-281b1aa5-1aa4-432e-9369-6e4e463cc176 tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.032498 Aug 30 03:31:32.974653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 895/1827] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:31:32.991246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:32.991876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:33.012040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.012999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.013639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.014439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.014903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.015344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.034445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-362cdf9d-3888-4345-90e9-bd991be6804b tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:33.040003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-362cdf9d-3888-4345-90e9-bd991be6804b tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:33.054735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:33.061938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.062953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.064133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.065930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lazy-loading 'fault' on Instance uuid 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:33.136401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:33.151875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2afd2014-43b5-404b-aab3-12827f1332e2 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1302 microversion: 2.1 time: 0.166261 Aug 30 03:31:33.152771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 896/1828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:32 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1302 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:33.159875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f170ee99-cb18-4dac-8055-22a62055209f tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-188765954", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 2.5}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f170ee99-cb18-4dac-8055-22a62055209f tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Request method failure captured: Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 169 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSSq-j3SijEZeQyOBDMlOUHMEIQUMRdHRCNb-iTJ07yDl3zzE4-DO0l41ISAFT7osD-Hbv30e4spol8nU7UYI6KDmi3GbmIHzgFTInRSqoXZEzCo5Bau1Xfasc_Sc7D6wYeVNB_kul5n4FRfk-S3VtnHsHSEWHlu0HB-ahNXqjPLVA Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cbbc953259f413c8e93bc39e1369b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cbbc953259f413c8e93bc39e1369b2d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cbbc953259f413c8e93bc39e1369b2d"}]}] Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 3cbbc953259f413c8e93bc39e1369b2d Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-652402428 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d6d9289f8b464c45b0ac75c2b43d983f Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-652402428-project Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-188765954", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 2.5}} Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-188765954', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'min_count': 2.5}}} Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:31:33.163851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 03:31:33.170387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:33.172843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f170ee99-cb18-4dac-8055-22a62055209f tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:33.173728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f170ee99-cb18-4dac-8055-22a62055209f tempest-MultipleCreateNegativeTestJSON-652402428 tempest-MultipleCreateNegativeTestJSON-652402428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019659 Aug 30 03:31:33.174487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 897/1829] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:31:33.479597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-362cdf9d-3888-4345-90e9-bd991be6804b tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.519706 Aug 30 03:31:33.480396 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 933/1830] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:32 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:31:33.493111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48ccc6e1-27fa-4327-a107-9c4f20a35596 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update', calling method: .version_select at 0x7f897b12f550>, body: {"meta": {"os_version": "alt"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:33.562150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-48ccc6e1-27fa-4327-a107-9c4f20a35596 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:33.572234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-48ccc6e1-27fa-4327-a107-9c4f20a35596 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:33.605545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:33.606114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:33.623162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.637892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.639121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.641890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.642147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.642597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.765754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.766590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.767391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.768477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lazy-loading 'fault' on Instance uuid 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:33.856743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:33.872359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-428bba58-777f-4bbc-b2ce-d03a59ad5f06 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1306 microversion: 2.1 time: 0.280645 Aug 30 03:31:33.874478 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 934/1831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:33 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1306 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:33.880741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4e62c1aa-091d-4f7e-9a85-6269ca5a2eb4 req-bda92a46-941d-4a1f-a82e-059c2c7fd60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de1eff5-6c6c-4c7f-80cf-67c968b17c6c", "name": "network-vif-deleted", "tag": "b052046b-e33c-43d9-83ca-4c6c2d1c1945"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:33.887742 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48ccc6e1-27fa-4327-a107-9c4f20a35596 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.400814 Aug 30 03:31:33.888545 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 898/1832] 10.222.0.30 () {60 vars in 1313 bytes} [Tue Aug 30 03:31:33 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata/os_version => generated 31 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:33.903409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:33.904471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4e62c1aa-091d-4f7e-9a85-6269ca5a2eb4 req-bda92a46-941d-4a1f-a82e-059c2c7fd60c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.905006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4e62c1aa-091d-4f7e-9a85-6269ca5a2eb4 req-bda92a46-941d-4a1f-a82e-059c2c7fd60c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.905476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4e62c1aa-091d-4f7e-9a85-6269ca5a2eb4 req-bda92a46-941d-4a1f-a82e-059c2c7fd60c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.905788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:33.914416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.915359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.916026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.917438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:33.918129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:33.918852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:33.922359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4e62c1aa-091d-4f7e-9a85-6269ca5a2eb4 req-bda92a46-941d-4a1f-a82e-059c2c7fd60c service nova] Creating event network-vif-deleted:b052046b-e33c-43d9-83ca-4c6c2d1c1945 for instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c on n-h1-854924-5 Aug 30 03:31:34.008538 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4e62c1aa-091d-4f7e-9a85-6269ca5a2eb4 req-bda92a46-941d-4a1f-a82e-059c2c7fd60c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130408 Aug 30 03:31:34.012730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 935/1833] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:34.031179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:34.034215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:34.069853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.070749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.072516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.073633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.074509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.075135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.497182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:34.507490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b7b702d-cf7a-4cdd-85ad-e61e46ccb3e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.610385 Aug 30 03:31:34.508357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 899/1834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:33 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:34.513380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12350945-3a5a-42bc-855d-c92e65200589 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f897b21e280>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:34.573871 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12350945-3a5a-42bc-855d-c92e65200589 tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 58 microversion: 2.1 time: 0.064091 Aug 30 03:31:34.574944 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 900/1835] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:31:34 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 58 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:34.580614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:34.581599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:34.588798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.589554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.590161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.591037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.591701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.592331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.625417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:34.634237 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5db803c5-2bcc-437a-996b-75b65931cf07 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.617198 Aug 30 03:31:34.648445 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 936/1836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:34 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:34.653848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:34.654760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:34.662014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.662885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.663514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.664406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.665029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.665706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.690292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:34.705793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.706556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.707262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.707877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lazy-loading 'fault' on Instance uuid 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:34.721635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:34.726781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:34.729459 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f139084-fa27-4c39-9641-8b23151bf98a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1344 microversion: 2.25 time: 0.153303 Aug 30 03:31:34.730229 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 901/1837] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:34 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:34.745126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6f49f31-0d50-4754-8b99-00814fafa80a tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'update_all', calling method: .version_select at 0x7f897b12f0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:34.841031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f6f49f31-0d50-4754-8b99-00814fafa80a tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:34.853610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f6f49f31-0d50-4754-8b99-00814fafa80a tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:34.899932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d18cc663b48028570132678823b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d288410e5b49e39dd44da7e2b4d223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:34.928252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e8537e3-da14-479f-bf14-306203278c99 tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 200 len: 1302 microversion: 2.1 time: 0.278171 Aug 30 03:31:34.944893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 937/1838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:34 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 1302 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:34.956420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:34.957412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:34.995840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.996385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.996829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:34.997709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:34.998099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:34.999139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:35.152299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:35.168990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:35.171611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:35.172363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lazy-loading 'fault' on Instance uuid 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:31:35.368388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6293437f7ced462b9c13100968c602b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee369051f4c041239152dbbc5e29bc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:35.379472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c5b1eb0-f95d-4874-9915-81e83812a07f tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 200 len: 1306 microversion: 2.1 time: 0.433231 Aug 30 03:31:35.395404 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 938/1839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:34 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 1306 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:35.413745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6f49f31-0d50-4754-8b99-00814fafa80a tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.678513 Aug 30 03:31:35.415463 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 902/1840] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:31:34 2022] PUT /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 61 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:35.427071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df279ff6-fa4c-4c51-9e59-6f626f9940cc tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Action: 'create', calling method: .version_select at 0x7f8983c96d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:35.508820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df279ff6-fa4c-4c51-9e59-6f626f9940cc tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:35.518936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df279ff6-fa4c-4c51-9e59-6f626f9940cc tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Getting quotas for user ac542c1bcaaf49638643e5898c8dcd20 and project bd9d1e33f16c4802a14b0b07698141ed. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:35.544816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:35.546560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:35.561757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:35.562620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:35.563234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:35.565267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:35.567608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:35.568596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.101801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:36.120740 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0bb6d9a-bb14-4607-a6bf-536f69ee5465 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.590561 Aug 30 03:31:36.124960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 903/1841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:35 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:31:36.133009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:36.133941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:36.142440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.143286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.143943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.144863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.145789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.146588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.188008 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df279ff6-fa4c-4c51-9e59-6f626f9940cc tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "POST /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 85 microversion: 2.1 time: 0.764812 Aug 30 03:31:36.189175 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 939/1842] 10.222.0.30 () {60 vars in 1281 bytes} [Tue Aug 30 03:31:35 2022] POST /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 85 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:36.195185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:36.196889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:36.213639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.216934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.218821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.219867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.223014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.224396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.432102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:36.442103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:36.448779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:36.454104 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84f81d92-54bd-49b5-8358-a60378b46ab1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1342 microversion: 2.25 time: 0.263589 Aug 30 03:31:36.455722 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 940/1843] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:36 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:36.475287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:36.475955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] [instance: 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:36.489044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.489600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.494344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.497142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.499471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.499947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.566936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] HTTP exception thrown: Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c could not be found. Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Request method failure captured: Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c HTTP/1.1 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYM1RQMkDl6nd4EqI4QWQYOJ0REVAiw-D5nHQx8TZp-tXV32Gk930Rp169iQzDtgZa86NkagUT8OXOgvp5gYP6CdlS2VXa_nsBT_YONWrWaQkcJj9gVL-kMxNCwaJKgC4WK0i1v_ctF5M2ckFzKPm_dezwnxpnn8MIX4gsk_Btf7bF4 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e4d288410e5b49e39dd44da7e2b4d223"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e4d288410e5b49e39dd44da7e2b4d223", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e4d288410e5b49e39dd44da7e2b4d223"}]}] Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e4d288410e5b49e39dd44da7e2b4d223 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-MigrationsAdminTest-1214842006 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 948d18cc663b48028570132678823b93 Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-MigrationsAdminTest-1214842006-project Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c could not be found. Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7de1eff5-6c6c-4c7f-80cf-67c968b17c6c'} Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c could not be found. Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c could not be found. Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:36.574814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c could not be found. Aug 30 03:31:36.582258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.590800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] Returning 404 to user: Instance 7de1eff5-6c6c-4c7f-80cf-67c968b17c6c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:36.599917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c05fcfc9-b701-4540-af67-aa46e4f782da tempest-MigrationsAdminTest-1214842006 tempest-MigrationsAdminTest-1214842006-project] 10.222.0.30 "GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c" status: 404 len: 111 microversion: 2.1 time: 0.139484 Aug 30 03:31:36.600336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:36.602252 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 941/1844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:36 2022] GET /compute/v2.1/servers/7de1eff5-6c6c-4c7f-80cf-67c968b17c6c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:36.619441 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-786316bf-9fcf-4003-a465-ab49e909e9b9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.486777 Aug 30 03:31:36.621797 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 904/1845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:36 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:36.628192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6844e08-6113-453c-b419-52ce67d1db7d tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] Calling method '.version_select at 0x7f8983c9bb80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:36.635709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:36.640261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] [instance: 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:36.663709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.667192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.668114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.671464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:36.673484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:36.674200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:36.717268 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] HTTP exception thrown: Instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 could not be found. Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Request method failure captured: Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 HTTP/1.1 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRwsvrW-bsTFVMCZehT0Kwy54qWNtpiNk4o-fRE8aSHsBLfFOoTvttQgRVut4L5arH4fiA26dE7PqtUlW9yz9DtcN2N4CZafLkCRDA5_BQuMpePWMoxqp14AgQEr9Tazv5UaWmecXegSlMcZ5RZk5XB-w4Ly2sCTvQ7Vdn0jSIUQnw Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ee369051f4c041239152dbbc5e29bc9c Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerAddressesTestJSON-761409081 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee369051f4c041239152dbbc5e29bc9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ee369051f4c041239152dbbc5e29bc9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ee369051f4c041239152dbbc5e29bc9c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ee369051f4c041239152dbbc5e29bc9c"}]}] Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerAddressesTestJSON-761409081 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ee369051f4c041239152dbbc5e29bc9c Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerAddressesTestJSON-761409081 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerAddressesTestJSON-761409081-project Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 6293437f7ced462b9c13100968c602b9 Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerAddressesTestJSON-761409081-project Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 could not be found. Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84'} Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 could not be found. Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 could not be found. Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:36.725029 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 could not be found. Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] Returning 404 to user: Instance 212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ecd47b60-3cf7-4b19-85a5-1cf0e2bd5ea8 tempest-ServerAddressesTestJSON-761409081 tempest-ServerAddressesTestJSON-761409081-project] 10.222.0.30 "GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84" status: 404 len: 111 microversion: 2.1 time: 0.107395 Aug 30 03:31:36.737982 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 905/1846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:36 2022] GET /compute/v2.1/servers/212fa4dd-7a0a-4ed0-b3a6-21d595fe3b84 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:36.743292 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6844e08-6113-453c-b419-52ce67d1db7d tempest-ImagesMetadataTestJSON-1838546717 tempest-ImagesMetadataTestJSON-1838546717-project] 10.222.0.30 "GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata" status: 200 len: 85 microversion: 2.1 time: 0.138683 Aug 30 03:31:36.751765 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 942/1847] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:31:36 2022] GET /compute/v2.1/images/58e50b98-e0db-44a3-b510-9c10041da0fe/metadata => generated 85 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:31:37.150504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:37.151465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:37.173973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:37.175760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:37.176205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:37.180624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:37.181167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:37.187857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:37.480763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:37.482039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:37.508262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:37.508974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:37.513427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:37.515018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:37.515772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:37.516454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:38.703574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:38.724922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:38.726934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:38.728586 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ca022d3-d0f3-4476-ab2a-8e10ed43752b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 1.253510 Aug 30 03:31:38.729376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 943/1848] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:37 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:38.745621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:38.746542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:38.765565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:38.766367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:38.768329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:38.772305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:38.780522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:38.784054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:39.109806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:39.120714 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b88cf7c2-8847-44b2-809f-fa099a1ebcab tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 1.974881 Aug 30 03:31:39.124143 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 906/1849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:37 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:39.363356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-78637429-616e-477a-beec-e5937e3d2bb3 req-2f71c1ff-c963-47cd-a285-e69c2cdef7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd1f1d3-d61a-49d0-873a-e46452077453", "name": "network-vif-unplugged", "status": "completed", "tag": "481ec842-15ee-4bd6-a3db-f69ed6a05458"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:39.390813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-78637429-616e-477a-beec-e5937e3d2bb3 req-2f71c1ff-c963-47cd-a285-e69c2cdef7cc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:39.394046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-78637429-616e-477a-beec-e5937e3d2bb3 req-2f71c1ff-c963-47cd-a285-e69c2cdef7cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:39.396390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-78637429-616e-477a-beec-e5937e3d2bb3 req-2f71c1ff-c963-47cd-a285-e69c2cdef7cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:39.439369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-78637429-616e-477a-beec-e5937e3d2bb3 req-2f71c1ff-c963-47cd-a285-e69c2cdef7cc service nova] Creating event network-vif-unplugged:481ec842-15ee-4bd6-a3db-f69ed6a05458 for instance 1bd1f1d3-d61a-49d0-873a-e46452077453 on n-h1-854924-5 Aug 30 03:31:39.468721 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-78637429-616e-477a-beec-e5937e3d2bb3 req-2f71c1ff-c963-47cd-a285-e69c2cdef7cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104987 Aug 30 03:31:39.470020 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 907/1850] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:39.613177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:39.632674 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d01ebb3f-4f31-4ae5-ba6e-9640d0f6020f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.897892 Aug 30 03:31:39.634914 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 944/1851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:38 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:39.761700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:39.762913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:39.786064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:39.788289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:39.789745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:39.796067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:39.798840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:39.800760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:40.147461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:40.150229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:40.168241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:40.177028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:40.178488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:40.183078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:40.187833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:40.189115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:40.318378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:40.331885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:40.342662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:40.344188 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b2dad73-9cb6-45cc-8b72-1251d5ab57f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 0.588466 Aug 30 03:31:40.345494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 908/1852] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:39 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:40.660204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:40.660822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:40.669157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:40.669686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:40.670660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:40.671370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:40.671824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:40.672245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:41.453227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:41.503069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e08a2a7e-7cd2-41c3-8e64-8669aadf24ac tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 1.360811 Aug 30 03:31:41.510415 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 945/1853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:40 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:31:41.536002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:41.541869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:41.557271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:41.558493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:41.561331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:41.562680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:41.563495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:41.564441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:41.664458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:42.037800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:42.055597 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b314c41-2fd5-4b2c-841a-3af02f111f03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 1.398668 Aug 30 03:31:42.056884 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 909/1854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:40 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:31:42.062488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-006a40a4-0b0f-4107-8136-c31f6068902e req-10d67716-ecc2-4e9f-aec0-a4d869a7d454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd1f1d3-d61a-49d0-873a-e46452077453", "tag": "481ec842-15ee-4bd6-a3db-f69ed6a05458"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:42.085687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-006a40a4-0b0f-4107-8136-c31f6068902e req-10d67716-ecc2-4e9f-aec0-a4d869a7d454 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:42.089146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-006a40a4-0b0f-4107-8136-c31f6068902e req-10d67716-ecc2-4e9f-aec0-a4d869a7d454 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:42.091134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-006a40a4-0b0f-4107-8136-c31f6068902e req-10d67716-ecc2-4e9f-aec0-a4d869a7d454 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:42.123277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:42.131065 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-006a40a4-0b0f-4107-8136-c31f6068902e req-10d67716-ecc2-4e9f-aec0-a4d869a7d454 service nova] Creating event network-changed:481ec842-15ee-4bd6-a3db-f69ed6a05458 for instance 1bd1f1d3-d61a-49d0-873a-e46452077453 on n-h1-854924-5 Aug 30 03:31:42.148006 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-006a40a4-0b0f-4107-8136-c31f6068902e req-10d67716-ecc2-4e9f-aec0-a4d869a7d454 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089481 Aug 30 03:31:42.154237 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 910/1855] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:42.211081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:42.225870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:42.231305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:42.235458 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35af4f3c-9b9e-4831-a1c7-53ee02fe685e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 0.721883 Aug 30 03:31:42.239215 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 946/1856] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:41 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:42.537130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:42.538300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:42.555582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:42.556481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:42.557161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:42.558249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:42.558943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:42.559745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:43.077776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:43.938878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:43.959867 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09e4b9da-8ef3-49be-ad1d-1b7451e0b0ee tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 1.425805 Aug 30 03:31:43.963713 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 911/1857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:42 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:43.967635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15513fc9-4509-421d-be7d-435d67301b4c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Calling method '.version_select at 0x7f8983cc4d30>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:43.976050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:43.978113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:43.998177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:44.001151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:44.002611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:44.004653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:44.006938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:44.007823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:44.417924 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-15513fc9-4509-421d-be7d-435d67301b4c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 371 microversion: 2.1 time: 1.345072 Aug 30 03:31:44.430132 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 947/1858] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:31:43 2022] GET /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 371 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:31:44.436441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:44.437778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:44.445083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:44.445967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:44.446597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:44.447969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:44.448644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:44.449474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:44.893459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=26 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:45.797036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:45.809331 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dcefa2a4-37bb-4618-91a5-9b8856021652 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 1.843280 Aug 30 03:31:45.811944 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 912/1859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:43 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:45.838762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9d0b49be-7ebf-4949-8c91-ea14736bf213 req-e2279719-f961-43a8-9a97-34b2330321a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc569f42-9c15-4496-b658-3d65b1c112cf", "tag": "412dd46c-5445-4790-a0c1-f64b221547a6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:45.861826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9d0b49be-7ebf-4949-8c91-ea14736bf213 req-e2279719-f961-43a8-9a97-34b2330321a3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:45.864470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9d0b49be-7ebf-4949-8c91-ea14736bf213 req-e2279719-f961-43a8-9a97-34b2330321a3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:45.867142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9d0b49be-7ebf-4949-8c91-ea14736bf213 req-e2279719-f961-43a8-9a97-34b2330321a3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:45.897954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9d0b49be-7ebf-4949-8c91-ea14736bf213 req-e2279719-f961-43a8-9a97-34b2330321a3 service nova] Creating event network-changed:412dd46c-5445-4790-a0c1-f64b221547a6 for instance dc569f42-9c15-4496-b658-3d65b1c112cf on n-h2-854924-5 Aug 30 03:31:45.910439 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9d0b49be-7ebf-4949-8c91-ea14736bf213 req-e2279719-f961-43a8-9a97-34b2330321a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085946 Aug 30 03:31:45.911681 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 913/1860] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:45.917173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3acd837e-9385-4ad0-9180-62b92db94977 req-b40d9efd-f135-4cd1-bf8e-01c36e71c90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-plugged", "status": "completed", "tag": "0de928a5-1183-4b56-bf15-e6239501fdba"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:45.929741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3acd837e-9385-4ad0-9180-62b92db94977 req-b40d9efd-f135-4cd1-bf8e-01c36e71c90b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:45.930515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3acd837e-9385-4ad0-9180-62b92db94977 req-b40d9efd-f135-4cd1-bf8e-01c36e71c90b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:45.931273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3acd837e-9385-4ad0-9180-62b92db94977 req-b40d9efd-f135-4cd1-bf8e-01c36e71c90b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:45.946760 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3acd837e-9385-4ad0-9180-62b92db94977 req-b40d9efd-f135-4cd1-bf8e-01c36e71c90b service nova] Creating event network-vif-plugged:0de928a5-1183-4b56-bf15-e6239501fdba for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:31:45.953711 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3acd837e-9385-4ad0-9180-62b92db94977 req-b40d9efd-f135-4cd1-bf8e-01c36e71c90b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040084 Aug 30 03:31:45.955072 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 914/1861] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:46.057837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1133238569", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:46.134569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:31:46.361732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:46.403061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:46.413649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:46.417389 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bf8267d-85bd-4492-a138-2478db05a1b1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 1.985555 Aug 30 03:31:46.418455 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 948/1862] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:44 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:46.444390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Action: 'update', calling method: .version_select at 0x7f8983d09310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:46.618684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:46.624115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:46.624806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:46.626050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:46.629038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:46.631680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:46.751285 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d1b2aae-7cc1-450e-b0c3-a7e1bcac474c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 328 microversion: 2.1 time: 0.330883 Aug 30 03:31:46.752872 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 949/1863] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:31:46 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 328 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:46.760105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:46.761280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:46.770475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:46.771604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:46.772415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:46.773592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:46.774524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:46.775715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:47.215108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:31:47.215915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:31:47.216081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:31:47.217465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:31:47.218785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:31:47.252785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:47.261238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:47.262182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:47.263703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:47.264767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:47.265724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:47.335858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Getting quotas for project 11a7139623854f1d85930bc0e9e4f1d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:47.357316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Getting quotas for user f6a16685a31c4a9db9bb468c0b8552ca and project 11a7139623854f1d85930bc0e9e4f1d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:47.384462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:31:47.387397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:31:47.512295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36dc44c8-dc2e-48a1-83fa-6d0beaee6ba3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553997 Aug 30 03:31:47.522316 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 915/1864] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:31:47.532932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:47.542242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:47.553643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:47.554829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:47.555509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:47.556481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:47.557201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:47.557873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:47.676769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:47.689378 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-28bf2646-1f9e-4d10-ab93-6116291bf7f7 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.933805 Aug 30 03:31:47.710576 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 950/1865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:46 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:48.316910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:48.327634 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cef5d164-7e79-4b39-9f7f-509a2d9c79b3 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.798612 Aug 30 03:31:48.331989 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 916/1866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:47 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:48.358924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:48.363191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:48.386855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:48.387977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:48.396306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-171452403", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:48.400906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:48.406210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:48.408169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:48.409046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:48.569876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:31:50.032593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:50.066443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:50.071461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:50.078323 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0623b804-4e9f-46c4-9729-0ce35b5efe32 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 1.737784 Aug 30 03:31:50.084191 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 917/1867] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:48 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:50.110989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:50.117878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:50.146377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.148936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.150551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.153602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.158637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.159415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.459593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:31:50.460145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:31:50.460615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:31:50.461021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:31:50.461509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:31:50.480456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=33 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:50.485189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.486206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.486890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.488988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.490681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.491566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.530393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Getting quotas for project 47c75c5f2a8c480ab3ddeb0f31b0cc1c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:50.539456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Getting quotas for user 10c8d5cfa9f64d79867aadd8f34d254d and project 47c75c5f2a8c480ab3ddeb0f31b0cc1c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:50.565266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.utils [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] cores quota exceeded for 47c75c5f2a8c480ab3ddeb0f31b0cc1c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122167) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 03:31:50.568776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Request method failure captured: Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 144 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSdTgpFBLbAozwoErfnBGcrqhRN9JpOR5HfdL5v0jiNHjE43Bit96AAOn4dE5iEKQ13l-RN0-i6iE7QNnsRJ4IbQiPPnA-Y5GDUmBrh2hbZx2uT8Yia0X8-Ep3bZI1jmKgpd7Ngwl8xfguKBwfEbf0eXJ7QCfMoqC0NZfOJ9dB6pIU Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47c75c5f2a8c480ab3ddeb0f31b0cc1c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}] Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 10c8d5cfa9f64d79867aadd8f34d254d Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-171452403", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-171452403', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452'}}} Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:31:50.574764 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 03:31:50.582404 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:31:50.590390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:50.590390 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7273e187-c9dc-4d23-94db-5eb3c361297b tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.877785 Aug 30 03:31:50.595170 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 951/1868] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:47 2022] POST /compute/v2.1/servers => generated 111 bytes in 2880 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:50.605947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-plugged", "status": "completed", "tag": "2ec60260-9d16-43dd-a064-a573c75aa05c"}, {"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-plugged", "status": "completed", "tag": "71b202ff-2ae5-4110-a1ab-3829ddd4de1c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:50.634368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.635310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.637116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.659116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] Creating event network-vif-plugged:2ec60260-9d16-43dd-a064-a573c75aa05c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:31:50.659874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] Creating event network-vif-plugged:71b202ff-2ae5-4110-a1ab-3829ddd4de1c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:31:50.666096 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d487c70e-3687-432a-b1a9-45ef40b11f53 req-328ce04c-b555-4cf3-a2c6-c084c72cfcab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072311 Aug 30 03:31:50.668952 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 952/1869] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:50.677945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:50.679063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:50.688080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.689820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.690580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.692169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:50.692751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:50.693286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:50.882180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:50.891249 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6a327555-d899-46ce-ac62-9a6c914344cc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1287 microversion: 2.1 time: 0.805150 Aug 30 03:31:50.901803 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 918/1870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:50 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1287 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:51.005523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-228da3cf-edff-46e1-8bbe-d881978d97f3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'create', calling method: .version_select at 0x7f897b134430>, body: {"keypair": {"name": "tempest-keypair-550249929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3L8Ko29wdDPSQxplAHqXxpdKp/AQZd/+pbYQaXX0rm5MjQrbOSr5bz/jm+tdLZd4w2919n0liuswxkRUThufhXsDHBQuzr4poXaQ9FTXzsi+CHF5KPqJl8mVjGySBqKg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:51.051663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-228da3cf-edff-46e1-8bbe-d881978d97f3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for project 34b80862ddfb408fb212f9bd047a292a. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:51.069171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-228da3cf-edff-46e1-8bbe-d881978d97f3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for user a681b194cdb24b6fbb49eb39711ffa1c and project 34b80862ddfb408fb212f9bd047a292a. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:51.125682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-228da3cf-edff-46e1-8bbe-d881978d97f3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.220849 Aug 30 03:31:51.133740 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 919/1871] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:31:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:51.146656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:51.147320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:51.162835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:51.164594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:51.165266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:51.166559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:51.167275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:51.167938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:51.373932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:51.396250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52b27732-146a-48f2-8973-2cadd07e9372 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.725422 Aug 30 03:31:51.396860 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 953/1872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:50 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:51.402489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Action: 'update', calling method: .version_select at 0x7f8983c849d0>, body: {"quota_set": {"cores": 20}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:51.679527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:51.687235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:51.687801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:51.692300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:51.692894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:51.693433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:51.785249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:51.825105 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2874bce8-080f-41de-ac76-2765b01b37ad tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 329 microversion: 2.1 time: 0.426664 Aug 30 03:31:51.827212 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 954/1873] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:31:51 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 329 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:51.836748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:51.837702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:51.847806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:51.848588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:51.849168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:51.850404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:51.851278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:51.852351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:52.029052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:52.043478 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05bf1f67-98fc-4be9-a556-74c5fbae27f6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.912835 Aug 30 03:31:52.047939 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 920/1874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:51 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:52.055918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b17f7885-464d-4697-bd07-63dbe2e54d6b tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Calling method '.version_select at 0x7f897b1655e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:52.300737 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b17f7885-464d-4697-bd07-63dbe2e54d6b tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 371 microversion: 2.1 time: 0.250943 Aug 30 03:31:52.309462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 921/1875] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:31:52 2022] GET /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:52.315704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:52.316999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:52.323935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:52.325171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:52.326014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:52.327895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:52.328963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:52.329876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:52.330407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:52.336468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:52.339078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:52.341519 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f3b6728-4572-4714-9a34-29a84b132fbb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 0.512429 Aug 30 03:31:52.361839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 955/1876] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:51 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:52.393044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Action: 'update', calling method: .version_select at 0x7f8983c9ba60>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:52.896664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:52.912933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:52.913589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:52.914429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:52.914896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:52.918164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:53.046101 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67e8a673-c323-42f3-95e7-982acee7c83c tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 328 microversion: 2.1 time: 0.666913 Aug 30 03:31:53.057415 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 956/1877] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:31:52 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 328 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:53.067613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:53.069291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:53.085512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:53.086901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:53.106145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:53.107633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:53.110493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:53.112197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:53.131035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:53.144368 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db9467af-4581-4f7f-a8b4-14d0333d06dc tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1317 microversion: 2.1 time: 0.832680 Aug 30 03:31:53.146794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 922/1878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:52 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1317 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:53.170560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-807e08c0-afd1-4274-b31a-12d2800e7c3e req-050e0c2d-fde3-4903-8e90-ed3099408a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc569f42-9c15-4496-b658-3d65b1c112cf", "name": "network-vif-plugged", "status": "completed", "tag": "412dd46c-5445-4790-a0c1-f64b221547a6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:53.192972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-807e08c0-afd1-4274-b31a-12d2800e7c3e req-050e0c2d-fde3-4903-8e90-ed3099408a91 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:53.193657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-807e08c0-afd1-4274-b31a-12d2800e7c3e req-050e0c2d-fde3-4903-8e90-ed3099408a91 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:53.194680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-807e08c0-afd1-4274-b31a-12d2800e7c3e req-050e0c2d-fde3-4903-8e90-ed3099408a91 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:53.217799 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-807e08c0-afd1-4274-b31a-12d2800e7c3e req-050e0c2d-fde3-4903-8e90-ed3099408a91 service nova] Creating event network-vif-plugged:412dd46c-5445-4790-a0c1-f64b221547a6 for instance dc569f42-9c15-4496-b658-3d65b1c112cf on n-h2-854924-5 Aug 30 03:31:53.225227 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-807e08c0-afd1-4274-b31a-12d2800e7c3e req-050e0c2d-fde3-4903-8e90-ed3099408a91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065246 Aug 30 03:31:53.232198 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 923/1879] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:53.259278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:53.262227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:53.294313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:53.296596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:53.297306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:53.298466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:53.299572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:53.304481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:54.136078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:54.157238 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d8d761f-2c1e-4879-b221-9dc1649db399 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1354 microversion: 2.1 time: 0.910414 Aug 30 03:31:54.158573 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 924/1880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:53 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1354 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:54.171485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-9496830", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:54.184805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:54.203829 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee4e5dfa-ce65-4387-aa00-17f0f4c79c02 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 1.144784 Aug 30 03:31:54.214201 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 957/1881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:53 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:54.223507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:54.230493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:54.240309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:54.242478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:54.243153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:54.247947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:54.249093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:54.250578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:54.286527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:31:55.510360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:55.526405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:55.528197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:55.536398 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-726c46a7-e0ad-415d-97d0-1465bf09bf4e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1409 microversion: 2.25 time: 1.320551 Aug 30 03:31:55.537288 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 958/1882] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:54 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1409 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:55.542501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a22f6152-e8e1-464e-bd09-048fe38ef7d7 req-b9c2742a-e4c2-4e9f-b86f-b9665475a390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:55.573064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a22f6152-e8e1-464e-bd09-048fe38ef7d7 req-b9c2742a-e4c2-4e9f-b86f-b9665475a390 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.573578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a22f6152-e8e1-464e-bd09-048fe38ef7d7 req-b9c2742a-e4c2-4e9f-b86f-b9665475a390 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.582896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a22f6152-e8e1-464e-bd09-048fe38ef7d7 req-b9c2742a-e4c2-4e9f-b86f-b9665475a390 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:55.607446 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a22f6152-e8e1-464e-bd09-048fe38ef7d7 req-b9c2742a-e4c2-4e9f-b86f-b9665475a390 service nova] Creating event network-changed:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:31:55.648557 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a22f6152-e8e1-464e-bd09-048fe38ef7d7 req-b9c2742a-e4c2-4e9f-b86f-b9665475a390 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105889 Aug 30 03:31:55.650540 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 959/1883] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:55.672754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:55.674222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:55.687757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.688628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.689279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:55.690480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.691689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.692303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:55.694338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:31:55.695102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:31:55.695896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:31:55.696649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:31:55.697131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:31:55.716982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.720392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.725146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:55.726691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.733073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.733865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:55.815673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Getting quotas for project 47c75c5f2a8c480ab3ddeb0f31b0cc1c. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:55.830521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Getting quotas for user 10c8d5cfa9f64d79867aadd8f34d254d and project 47c75c5f2a8c480ab3ddeb0f31b0cc1c. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:55.833923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:55.864949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.utils [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] instances quota exceeded for 47c75c5f2a8c480ab3ddeb0f31b0cc1c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122168) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 03:31:55.869074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Request method failure captured: Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 142 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSdTgpFBLbAozwoErfnBGcrqhRN9JpOR5HfdL5v0jiNHjE43Bit96AAOn4dE5iEKQ13l-RN0-i6iE7QNnsRJ4IbQiPPnA-Y5GDUmBrh2hbZx2uT8Yia0X8-Ep3bZI1jmKgpd7Ngwl8xfguKBwfEbf0eXJ7QCfMoqC0NZfOJ9dB6pIU Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47c75c5f2a8c480ab3ddeb0f31b0cc1c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}] Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 10c8d5cfa9f64d79867aadd8f34d254d Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-9496830", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-9496830', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452'}}} Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:31:55.872339 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 03:31:55.880607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:31:55.888010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:31:55.888010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b69f372-fdf6-4ba1-ab04-3159189b8d24 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.722853 Aug 30 03:31:55.888010 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 925/1884] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:54 2022] POST /compute/v2.1/servers => generated 119 bytes in 1725 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:31:55.893831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:55.894753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:55.904674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.905863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.907219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:55.908530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:55.909780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:55.910922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:56.112645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:56.123194 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c150b508-e1c1-44a5-9c40-d094f50cb48b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1317 microversion: 2.1 time: 0.471110 Aug 30 03:31:56.124075 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 960/1885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:55 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:56.130236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:56.131017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:56.142519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:56.143498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:56.144127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:56.145037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:56.145700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:56.146327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:56.326226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:56.340233 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4323a22-d739-4e2e-86ab-be68354a8ff8 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1805 microversion: 2.1 time: 0.450735 Aug 30 03:31:56.342656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 926/1886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:55 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1805 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:56.347826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Action: 'update', calling method: .version_select at 0x7f897b11f310>, body: {"quota_set": {"instances": 10}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:56.533909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:56.545196 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b6f28788-5008-45e9-96eb-e97c87dfcd62 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1391 microversion: 2.1 time: 0.419291 Aug 30 03:31:56.546848 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 961/1887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:56 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:56.555343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1858512914", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6a4f0d7-59ea-445f-abb0-b63795f79159"}], "security_groups": [{"name": "tempest-securitygroup--768483945"}], "key_name": "tempest-keypair-550249929", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:56.831998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:56.832623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:56.832926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:56.834264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:56.834748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:56.835176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:56.876801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] validate_networks() for [('e6a4f0d7-59ea-445f-abb0-b63795f79159', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:31:56.996668 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52572e17-b1b9-4e46-80e2-2729dfd44387 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 329 microversion: 2.1 time: 0.652502 Aug 30 03:31:57.001458 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 927/1888] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:31:56 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 329 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:57.025541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:57.026061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:57.046257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.049947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.050403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.051125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.051580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.055978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.093167 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8968acb7-f733-4106-9dc5-6ee0cf680a5f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce/ips" status: 200 len: 219 microversion: 2.1 time: 0.089562 Aug 30 03:31:57.094428 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 928/1889] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:31:57 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce/ips => generated 219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:57.102983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:57.103904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:57.116261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.117917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.118919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.119896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.120625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.121282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.469029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:57.494012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:57.498896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:57.503374 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-efc69422-dc43-4cbe-b55e-e09bf76e1145 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1603 microversion: 2.25 time: 0.406728 Aug 30 03:31:57.519527 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 929/1890] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:31:57 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1603 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:31:57.528050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71239ee4-5d84-4977-8f56-2ed049d843b4 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Calling method '.version_select at 0x7f897b1fe160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:57.877588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71239ee4-5d84-4977-8f56-2ed049d843b4 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 371 microversion: 2.1 time: 0.356862 Aug 30 03:31:57.878423 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 930/1891] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:31:57 2022] GET /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:57.887070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:31:57.887667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:31:57.887881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:31:57.888289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:31:57.889492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:31:57.892442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:57.893220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:57.901239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.901933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.902529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.903430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.904858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.905732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.906713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.907406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.907942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.908798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:57.909421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:57.910085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:57.938945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:31:57.942834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:31:57.950640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for user a681b194cdb24b6fbb49eb39711ffa1c and project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:31:57.971294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:31:57.974635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:31:58.098858 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4c7515a3-088d-4e7c-8c75-35242a4a9252 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.548617 Aug 30 03:31:58.101768 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 962/1892] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:31:58.116814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:58.118942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:58.119734 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ccd3ac77-39e3-45e7-987b-2f4f924e800b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "DELETE /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 204 len: 0 microversion: 2.1 time: 0.239293 Aug 30 03:31:58.128537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.129369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.130001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.130513 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 931/1893] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:31:57 2022] DELETE /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:31:58.131116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.131742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.132333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.138223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:58.139538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:58.147717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.148497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.149186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.150317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.151193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.152072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.338452 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3452d30-4a55-43cc-b14f-9e70a5a916f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.205825 Aug 30 03:31:58.339284 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 932/1894] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:31:58 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:31:58.345672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:58.346553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:58.364052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.367515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.367970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.368873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.370586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.374818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.431842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:31:58.628584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:58.649711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef9bbced-6be0-45c2-904b-de9bb99bc470 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1317 microversion: 2.1 time: 0.545403 Aug 30 03:31:58.651740 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 963/1895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:58 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:58.658349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Action: 'update', calling method: .version_select at 0x7f8983c9bdc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:58.787834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:58.804876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c945539-fe07-4a10-a2f2-2d232dc765e5 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1381 microversion: 2.1 time: 0.464353 Aug 30 03:31:58.808181 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 933/1896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:58 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1381 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:58.814046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:58.815091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:58.832403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.833061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.833709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.834706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.835810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.836510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.952253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:58.965566 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ef78f85-06f9-4cfb-baf8-1064d97fb880 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1242 microversion: 2.1 time: 0.156019 Aug 30 03:31:58.975739 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 934/1897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:58 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:58.975739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:58.975739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:58.981315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.982651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.982878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:58.983555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:58.984007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:58.984703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:59.218406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:59.219122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:59.219868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:59.221055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:59.222800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:59.223915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:59.327020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:31:59.346425 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d34a918-c517-40db-aba3-950c8abd3281 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1811 microversion: 2.1 time: 0.378770 Aug 30 03:31:59.353732 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 935/1898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:58 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1811 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:59.366980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b35f8b6-9628-4978-83d9-924a8ce12425 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '.version_select at 0x7f897b136820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:59.376389 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd0842cf-4ce1-4ac5-b29a-9c890f838a00 tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 325 microversion: 2.1 time: 0.723084 Aug 30 03:31:59.385204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b35f8b6-9628-4978-83d9-924a8ce12425 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:59.385992 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 964/1899] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:31:58 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 325 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:31:59.392608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b35f8b6-9628-4978-83d9-924a8ce12425 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:59.392989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b35f8b6-9628-4978-83d9-924a8ce12425 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:59.434780 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b35f8b6-9628-4978-83d9-924a8ce12425 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.079981 Aug 30 03:31:59.439381 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 936/1900] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 03:31:59 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:31:59.454486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:31:59.455186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:31:59.468752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:59.469268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:59.469741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:59.470468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:31:59.470928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:31:59.481806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:31:59.653330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523186857", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:31:59.764329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:32:00.033156 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-53a3f8dd-d03f-4b2d-9a8e-54b9e1d50eb1 tempest-LiveMigrationTest-293621834 tempest-LiveMigrationTest-293621834-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1532 microversion: 2.1 time: 0.583586 Aug 30 03:32:00.037457 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 965/1901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:31:59 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1532 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:00.050730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3f1d5dd7-22ea-4acf-84ef-1a2f05440294 req-b5690045-98e1-4d69-a189-06634702517d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "name": "network-vif-plugged", "status": "completed", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:00.066564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3f1d5dd7-22ea-4acf-84ef-1a2f05440294 req-b5690045-98e1-4d69-a189-06634702517d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:00.067259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3f1d5dd7-22ea-4acf-84ef-1a2f05440294 req-b5690045-98e1-4d69-a189-06634702517d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:00.067854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3f1d5dd7-22ea-4acf-84ef-1a2f05440294 req-b5690045-98e1-4d69-a189-06634702517d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:00.106543 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3f1d5dd7-22ea-4acf-84ef-1a2f05440294 req-b5690045-98e1-4d69-a189-06634702517d service nova] Creating event network-vif-plugged:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:32:00.120011 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3f1d5dd7-22ea-4acf-84ef-1a2f05440294 req-b5690045-98e1-4d69-a189-06634702517d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080935 Aug 30 03:32:00.124729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 966/1902] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:00.140536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:00.141589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:00.150931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:00.152714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:00.153657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:00.155402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:00.155864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:00.156282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:00.946920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:32:00.947567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:32:00.947804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:32:00.948201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:32:00.948974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:32:00.969690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:00.970398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:00.978095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:00.979229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:00.979865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:00.980456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.021283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Getting quotas for project 47c75c5f2a8c480ab3ddeb0f31b0cc1c. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:32:01.039131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Getting quotas for user 10c8d5cfa9f64d79867aadd8f34d254d and project 47c75c5f2a8c480ab3ddeb0f31b0cc1c. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:32:01.056743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.utils [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] ram quota exceeded for 47c75c5f2a8c480ab3ddeb0f31b0cc1c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122168) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 03:32:01.057660 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Request method failure captured: Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 145 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSdTgpFBLbAozwoErfnBGcrqhRN9JpOR5HfdL5v0jiNHjE43Bit96AAOn4dE5iEKQ13l-RN0-i6iE7QNnsRJ4IbQiPPnA-Y5GDUmBrh2hbZx2uT8Yia0X8-Ep3bZI1jmKgpd7Ngwl8xfguKBwfEbf0eXJ7QCfMoqC0NZfOJ9dB6pIU Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47c75c5f2a8c480ab3ddeb0f31b0cc1c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}] Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 10c8d5cfa9f64d79867aadd8f34d254d Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1523186857", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1523186857', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452'}}} Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:32:01.060202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:01.065836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:01.068954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4631b68-ba8d-42ad-abf0-6ace1a6ccdb1 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.419061 Aug 30 03:32:01.069841 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 937/1903] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:31:59 2022] POST /compute/v2.1/servers => generated 110 bytes in 1422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:01.076848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:01.077606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:01.089442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.089989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.090772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.092161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.092885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.096595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.177221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:01.191198 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bfcaa30-8d1c-42a5-a348-76be82936f69 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1317 microversion: 2.1 time: 1.064074 Aug 30 03:32:01.192495 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 967/1904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:00 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1317 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:01.198197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:01.198710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:01.205695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.206197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.206800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.207530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.208165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.208634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.254899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:32:01.298358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:01.316685 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9a939798-cc4b-4fb4-ad22-3ee0a652a3df tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1308 microversion: 2.1 time: 0.245447 Aug 30 03:32:01.318338 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 938/1905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:01 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:01.326486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:01.328713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:01.330147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:01.339449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.340772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.342441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.343503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.344245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.344958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.408500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57a6a0a8-2280-4cf7-a9cf-cb1e3d5ba233 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 204 len: 0 microversion: 2.1 time: 0.214271 Aug 30 03:32:01.410635 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 968/1906] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:32:01 2022] DELETE /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:32:01.420886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Action: 'update', calling method: .version_select at 0x7f897b023280>, body: {"quota_set": {"ram": 51200}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:01.890415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:01.902603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e80ecaa7-09e7-4d0f-9026-1050252d0fbd tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1811 microversion: 2.1 time: 0.582837 Aug 30 03:32:01.905618 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 939/1907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:01 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1811 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:01.916055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:01.917257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:01.940088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.940901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.941861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:01.945057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:01.945833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:01.947060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:02.010470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:02.015713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:02.016713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:02.018261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:02.020024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:02.022324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:02.171666 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b93b2b1-924c-4ea0-b069-99d081e20a0a tempest-QuotasAdminNegativeTest-130471528 tempest-QuotasAdminNegativeTest-130471528-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 200 len: 329 microversion: 2.1 time: 0.756959 Aug 30 03:32:02.173634 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 969/1908] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:32:01 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 329 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:02.195798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-60870d4f-b4db-4fda-84be-baec7cba0111 req-511ac3da-e01f-4dac-87a4-5c12542f56f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc569f42-9c15-4496-b658-3d65b1c112cf", "tag": "412dd46c-5445-4790-a0c1-f64b221547a6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:02.228175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-60870d4f-b4db-4fda-84be-baec7cba0111 req-511ac3da-e01f-4dac-87a4-5c12542f56f2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:02.233424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-60870d4f-b4db-4fda-84be-baec7cba0111 req-511ac3da-e01f-4dac-87a4-5c12542f56f2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:02.234721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-60870d4f-b4db-4fda-84be-baec7cba0111 req-511ac3da-e01f-4dac-87a4-5c12542f56f2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:02.265237 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-60870d4f-b4db-4fda-84be-baec7cba0111 req-511ac3da-e01f-4dac-87a4-5c12542f56f2 service nova] Creating event network-changed:412dd46c-5445-4790-a0c1-f64b221547a6 for instance dc569f42-9c15-4496-b658-3d65b1c112cf on n-h2-854924-5 Aug 30 03:32:02.285360 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-60870d4f-b4db-4fda-84be-baec7cba0111 req-511ac3da-e01f-4dac-87a4-5c12542f56f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109361 Aug 30 03:32:02.290829 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 970/1909] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:02.305628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86020dce-4921-4e5e-9a53-ab028d0a3087 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Action: 'update', calling method: .version_select at 0x7f8983d320d0>, body: {"quota_set": {"ram": 0}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:02.321224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-86020dce-4921-4e5e-9a53-ab028d0a3087 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '10c8d5cfa9f64d79867aadd8f34d254d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c75c5f2a8c480ab3ddeb0f31b0cc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86020dce-4921-4e5e-9a53-ab028d0a3087 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Request method failure captured: Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c HTTP/1.1 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 25 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSdTgpFBLbAozwoErfnBGcrqhRN9JpOR5HfdL5v0jiNHjE43Bit96AAOn4dE5iEKQ13l-RN0-i6iE7QNnsRJ4IbQiPPnA-Y5GDUmBrh2hbZx2uT8Yia0X8-Ep3bZI1jmKgpd7Ngwl8xfguKBwfEbf0eXJ7QCfMoqC0NZfOJ9dB6pIU Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_47c75c5f2a8c480ab3ddeb0f31b0cc1c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/47c75c5f2a8c480ab3ddeb0f31b0cc1c"}]}] Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 47c75c5f2a8c480ab3ddeb0f31b0cc1c Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-820504195 Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 10c8d5cfa9f64d79867aadd8f34d254d Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-QuotasAdminNegativeTest-820504195-project Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: {"quota_set": {"ram": 0}} Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '47c75c5f2a8c480ab3ddeb0f31b0cc1c', 'body': {'quota_set': {'ram': 0}}} Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:32:02.324163 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 03:32:02.329713 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:02.335474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86020dce-4921-4e5e-9a53-ab028d0a3087 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:02.338716 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-86020dce-4921-4e5e-9a53-ab028d0a3087 tempest-QuotasAdminNegativeTest-820504195 tempest-QuotasAdminNegativeTest-820504195-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c" status: 403 len: 116 microversion: 2.1 time: 0.046203 Aug 30 03:32:02.340794 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 971/1910] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:32:02 2022] PUT /compute/v2.1/os-quota-sets/47c75c5f2a8c480ab3ddeb0f31b0cc1c => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:02.355345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:02.359413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:02.374880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:02.377615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:02.379043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:02.382496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:02.384936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:02.388028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:03.001185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:03.014691 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b4eb053c-485d-4297-a2d1-de0c396224a6 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1387 microversion: 2.1 time: 1.105396 Aug 30 03:32:03.016021 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 940/1911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:01 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1387 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:03.039368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:03.040291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:03.061029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:03.065826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:03.067096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:03.068781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:03.072225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:03.074175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:03.868582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:03.882669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8f04f5d-1d22-4dfb-acd3-d78cba80eeb6 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1467 microversion: 2.1 time: 1.539342 Aug 30 03:32:03.888009 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 972/1912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:02 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1467 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:03.902073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:03.904798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:03.922483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:03.924564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:03.927620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:03.944947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:03.946145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:03.947919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:03.948521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:04.485964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:04.509234 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a4c49c1a-7ffd-4796-8be3-d17eea856435 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 1.481844 Aug 30 03:32:04.509791 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 941/1913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:03 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:04.533260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e5054d3e-b95a-44de-a12c-644d918acb0f req-29cbacd1-caea-4382-a657-a5b8f22df2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-unplugged", "status": "completed", "tag": "0de928a5-1183-4b56-bf15-e6239501fdba"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:04.574118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e5054d3e-b95a-44de-a12c-644d918acb0f req-29cbacd1-caea-4382-a657-a5b8f22df2bb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:04.576410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e5054d3e-b95a-44de-a12c-644d918acb0f req-29cbacd1-caea-4382-a657-a5b8f22df2bb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:04.576879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e5054d3e-b95a-44de-a12c-644d918acb0f req-29cbacd1-caea-4382-a657-a5b8f22df2bb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:04.600169 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e5054d3e-b95a-44de-a12c-644d918acb0f req-29cbacd1-caea-4382-a657-a5b8f22df2bb service nova] Creating event network-vif-unplugged:0de928a5-1183-4b56-bf15-e6239501fdba for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:32:04.617335 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e5054d3e-b95a-44de-a12c-644d918acb0f req-29cbacd1-caea-4382-a657-a5b8f22df2bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105514 Aug 30 03:32:04.620432 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 942/1914] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:04.635555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2f6585d5-bc1e-4289-a91f-db14d17413e2 req-b0349e03-6816-4a4f-b11f-8bfedd4560c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd1f1d3-d61a-49d0-873a-e46452077453", "name": "network-vif-deleted", "tag": "481ec842-15ee-4bd6-a3db-f69ed6a05458"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:04.652399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f6585d5-bc1e-4289-a91f-db14d17413e2 req-b0349e03-6816-4a4f-b11f-8bfedd4560c5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:04.653191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f6585d5-bc1e-4289-a91f-db14d17413e2 req-b0349e03-6816-4a4f-b11f-8bfedd4560c5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:04.654306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f6585d5-bc1e-4289-a91f-db14d17413e2 req-b0349e03-6816-4a4f-b11f-8bfedd4560c5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:04.673326 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2f6585d5-bc1e-4289-a91f-db14d17413e2 req-b0349e03-6816-4a4f-b11f-8bfedd4560c5 service nova] Creating event network-vif-deleted:481ec842-15ee-4bd6-a3db-f69ed6a05458 for instance 1bd1f1d3-d61a-49d0-873a-e46452077453 on n-h2-854924-5 Aug 30 03:32:04.682970 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2f6585d5-bc1e-4289-a91f-db14d17413e2 req-b0349e03-6816-4a4f-b11f-8bfedd4560c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055645 Aug 30 03:32:04.686286 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 943/1915] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:04.693886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-976781477", "metadata": {"image_type": "test"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:04.697421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:04.705029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:04.706162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:04.707259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:04.709129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:04.709870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:04.712921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:04.808707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Getting quotas for project 11a7139623854f1d85930bc0e9e4f1d2. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:32:04.818587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Getting quotas for user f6a16685a31c4a9db9bb468c0b8552ca and project 11a7139623854f1d85930bc0e9e4f1d2. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:32:05.353061 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1227103e-37e0-4a10-88e2-585ad82ff4a8 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "POST /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a/action" status: 202 len: 0 microversion: 2.1 time: 0.662633 Aug 30 03:32:05.360771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 944/1916] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:32:04 2022] POST /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:32:05.379430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:05.381581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:05.429061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:05.431173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:05.432927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:05.436433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:05.444122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:05.445040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:05.984862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:05.996288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb29ab70-a578-4c55-8201-8de308dafb7e tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1183 microversion: 2.1 time: 0.630419 Aug 30 03:32:05.996930 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 945/1917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:05 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1183 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:06.014498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8286a2bb-9253-4c43-935c-ecacb264c37f req-22a6cb18-3c6d-47c8-830e-1f7f3f7b289d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-deleted", "tag": "2ec60260-9d16-43dd-a064-a573c75aa05c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:06.043222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8286a2bb-9253-4c43-935c-ecacb264c37f req-22a6cb18-3c6d-47c8-830e-1f7f3f7b289d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:06.043492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8286a2bb-9253-4c43-935c-ecacb264c37f req-22a6cb18-3c6d-47c8-830e-1f7f3f7b289d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:06.043785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8286a2bb-9253-4c43-935c-ecacb264c37f req-22a6cb18-3c6d-47c8-830e-1f7f3f7b289d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:06.063113 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8286a2bb-9253-4c43-935c-ecacb264c37f req-22a6cb18-3c6d-47c8-830e-1f7f3f7b289d service nova] Creating event network-vif-deleted:2ec60260-9d16-43dd-a064-a573c75aa05c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:32:06.069786 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8286a2bb-9253-4c43-935c-ecacb264c37f req-22a6cb18-3c6d-47c8-830e-1f7f3f7b289d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070022 Aug 30 03:32:06.070790 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 946/1918] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:06.078252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad7c1b4b-745d-4572-bb28-49525d81a4bf tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b163dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:06.189432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ad7c1b4b-745d-4572-bb28-49525d81a4bf tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.114412 Aug 30 03:32:06.190738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 947/1919] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:06 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:06.198304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:06.199707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:06.210890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:06.211832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:06.212517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:06.213726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:06.214426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:06.215038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:06.373884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:06.392917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a566a0fd-82fa-4035-ac23-123429d5817d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1790 microversion: 2.1 time: 2.502257 Aug 30 03:32:06.394763 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 973/1920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:03 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1790 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:06.672069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4c95cdf1-f05e-477b-9532-e3561bf1ecc2 req-9cd47abc-b207-43e8-bc37-b538c07e8233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-unplugged", "status": "completed", "tag": "71b202ff-2ae5-4110-a1ab-3829ddd4de1c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:06.702232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4c95cdf1-f05e-477b-9532-e3561bf1ecc2 req-9cd47abc-b207-43e8-bc37-b538c07e8233 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:06.703442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4c95cdf1-f05e-477b-9532-e3561bf1ecc2 req-9cd47abc-b207-43e8-bc37-b538c07e8233 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:06.703902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4c95cdf1-f05e-477b-9532-e3561bf1ecc2 req-9cd47abc-b207-43e8-bc37-b538c07e8233 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:06.751035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4c95cdf1-f05e-477b-9532-e3561bf1ecc2 req-9cd47abc-b207-43e8-bc37-b538c07e8233 service nova] Creating event network-vif-unplugged:71b202ff-2ae5-4110-a1ab-3829ddd4de1c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:32:06.763147 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4c95cdf1-f05e-477b-9532-e3561bf1ecc2 req-9cd47abc-b207-43e8-bc37-b538c07e8233 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093779 Aug 30 03:32:06.766152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 974/1921] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:07.023678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:07.024597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:07.039078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:07.042964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:07.043737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:07.050019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:07.050735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:07.053596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:07.544578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:07.556781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9b92865-0480-4904-b25a-196a0da92333 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 1.364571 Aug 30 03:32:07.562999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:07.567963 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 948/1922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:06 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:07.594568 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23cc8099-7d38-4d30-b306-3e42cadcd8e3 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1183 microversion: 2.1 time: 0.573698 Aug 30 03:32:07.595880 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 975/1923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:07 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1183 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:07.597816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74ea5ddf-5bce-4d3c-9adf-aa317516150f tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b12fa60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:07.618938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:07.620441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:07.637701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:07.642259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:07.643027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:07.644143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:07.645377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:07.648609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:07.676082 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74ea5ddf-5bce-4d3c-9adf-aa317516150f tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.088592 Aug 30 03:32:07.678774 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 949/1924] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:07 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:08.211008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1eeea1ea-491e-471f-9ea6-2855532c6a63 req-281b80c1-c335-4a6b-8bc4-149eec0a679e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-deleted", "tag": "0de928a5-1183-4b56-bf15-e6239501fdba"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:08.248306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1eeea1ea-491e-471f-9ea6-2855532c6a63 req-281b80c1-c335-4a6b-8bc4-149eec0a679e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:08.248982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1eeea1ea-491e-471f-9ea6-2855532c6a63 req-281b80c1-c335-4a6b-8bc4-149eec0a679e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:08.249452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1eeea1ea-491e-471f-9ea6-2855532c6a63 req-281b80c1-c335-4a6b-8bc4-149eec0a679e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:08.279673 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1eeea1ea-491e-471f-9ea6-2855532c6a63 req-281b80c1-c335-4a6b-8bc4-149eec0a679e service nova] Creating event network-vif-deleted:0de928a5-1183-4b56-bf15-e6239501fdba for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:32:08.290752 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1eeea1ea-491e-471f-9ea6-2855532c6a63 req-281b80c1-c335-4a6b-8bc4-149eec0a679e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086300 Aug 30 03:32:08.293773 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 950/1925] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:32:08.420587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:08.439466 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e147c858-3b90-4c62-a1ab-61fe1df87c2d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1655 microversion: 2.1 time: 0.833765 Aug 30 03:32:08.440609 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 976/1926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:07 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1655 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:08.595042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:08.595839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:08.614022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:08.625239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:08.628769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:08.634437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:08.635312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:08.642049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:08.643025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:08.643677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:08.647996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:08.648527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:08.649061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:08.650014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:08.650481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:08.651976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:08.860551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:08.879525 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-abddcff2-d088-437e-88e9-0ffbc342f612 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1183 microversion: 2.1 time: 0.261581 Aug 30 03:32:08.883261 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 977/1927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:08 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:08.904367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4b15b36e-19d5-4fe8-b95b-df564e3069fd tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983c9b4c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:09.013851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:09.031086 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4b15b36e-19d5-4fe8-b95b-df564e3069fd tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.132508 Aug 30 03:32:09.040215 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f6d3b37-c455-4dff-a82e-f9623233a62b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 0.451534 Aug 30 03:32:09.041240 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 978/1928] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:08 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:09.041761 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 951/1929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:08 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:09.474996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:09.476470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:09.506052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:09.511746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:09.512592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:09.516687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:09.520382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:09.520981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:09.668533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:09.674219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:09.677071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:09.678425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lazy-loading 'fault' on Instance uuid 353619ab-a701-4d61-86f5-5f1ad59ac2ce {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:09.872582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:09.895948 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5cfdd52d-8ca4-4fbd-87b3-1ada70172142 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 200 len: 1302 microversion: 2.1 time: 0.434183 Aug 30 03:32:09.905927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:09.906755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:09.912352 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 979/1930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:09 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 1302 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:09.920063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:09.922817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:09.924064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:09.926118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:09.927325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:09.929297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:10.045965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ade3b82-d424-4327-80b0-7d66448ef05e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897bb23af0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:10.127182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:10.145399 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2b213f0-53a3-4221-ba5a-3c4fed9ce7f1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1183 microversion: 2.1 time: 0.243428 Aug 30 03:32:10.145970 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 952/1931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:09 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:10.165148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:10.165835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:10.166476 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ade3b82-d424-4327-80b0-7d66448ef05e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.124799 Aug 30 03:32:10.167426 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 980/1932] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:10 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:10.191115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:10.192675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:10.195480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:10.198022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:10.198821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:10.202269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:10.414208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353619ab-a701-4d61-86f5-5f1ad59ac2ce", "name": "network-vif-deleted", "tag": "71b202ff-2ae5-4110-a1ab-3829ddd4de1c"}, {"name": "network-changed", "server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:10.468028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:10.468973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:10.469713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:10.502812 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] Creating event network-vif-deleted:71b202ff-2ae5-4110-a1ab-3829ddd4de1c for instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce on n-h1-854924-5 Aug 30 03:32:10.504811 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] Creating event network-changed:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:32:10.523459 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fde5c08e-44a1-419c-8aff-6249f89bb048 req-fadd50da-0164-4abf-b1c3-b14c6cb50442 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106675 Aug 30 03:32:10.525554 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 981/1933] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:10.976225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:10.988859 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-90cad11b-3cda-4c8b-afed-46fd819be607 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 0.838195 Aug 30 03:32:10.989469 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 953/1934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:10 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:11.011489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:11.012410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:11.016627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:11.036897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:11.040034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:11.040481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:11.047121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:11.047625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:11.048081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:11.064257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=34 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:11.068292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:11.123516 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] HTTP exception thrown: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Request method failure captured: Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce HTTP/1.1 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRnGtaRLOXs8K8wQYIUSqNJqeatVZF4YmIPD53K1F1VmCBrYSOALLpiwK0LX5KQ_R01TtAoqI4E8PoGFwrOcMkkQWYYd-I4gUIhZf8fNmp10kf48R-EsrCwGq1G9pPtKrOJjx-yAv2G3nP7QMVGBbyHpUkYD0tO73dSwb9UIo4a7eY Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b1a03c37eb24082bfd84f9e5da2e86e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}] Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestMultiNic-489872106 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestMultiNic-489872106-project Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15d26d112e044244b16a6e41093a3ebd Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestMultiNic-489872106-project Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '353619ab-a701-4d61-86f5-5f1ad59ac2ce'} Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:11.128939 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Returning 404 to user: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:11.135992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9603926-67d8-452a-8f55-68d81720fd11 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 404 len: 111 microversion: 2.1 time: 0.131724 Aug 30 03:32:11.142709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 954/1935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:10 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:11.168821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:11.170170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:11.192436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:11.192940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:11.193394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:11.194109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:11.194558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:11.202376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:11.221187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-677698175", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:11.361013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:32:11.702553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:11.726978 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8478c42a-9c63-47a5-807b-e89d0dc34208 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1183 microversion: 2.1 time: 0.549615 Aug 30 03:32:11.733800 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 955/1936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:11 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1183 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:11.739514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1cddf264-145b-41de-a82a-85213600ad0e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d4ad30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:11.902649 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1cddf264-145b-41de-a82a-85213600ad0e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.166761 Aug 30 03:32:11.903230 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 956/1937] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:11 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:12.015446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:12.018803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:12.044228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:12.048652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:12.052428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:12.056594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:12.072634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:12.074794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:12.083223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:12.149870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=43 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:13.627721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:32:13.630112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:32:13.631034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:32:13.631734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:32:13.632861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:32:13.685182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:13.691032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:13.695009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fee18573-8e13-4128-b678-319044ddf70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 1.686297 Aug 30 03:32:13.695600 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 957/1938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:12 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:13.699730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:13.723648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:13.725078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-daba8c34-1d2f-40f9-889e-8369a1a44266 req-707bd1df-28ad-48ef-80e2-fdbeefcc0e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "name": "network-vif-plugged", "status": "completed", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:13.725371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:13.735555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:13.736015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:13.770282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:13.798078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-daba8c34-1d2f-40f9-889e-8369a1a44266 req-707bd1df-28ad-48ef-80e2-fdbeefcc0e84 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:13.798861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-daba8c34-1d2f-40f9-889e-8369a1a44266 req-707bd1df-28ad-48ef-80e2-fdbeefcc0e84 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:13.799268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-daba8c34-1d2f-40f9-889e-8369a1a44266 req-707bd1df-28ad-48ef-80e2-fdbeefcc0e84 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:13.843136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-daba8c34-1d2f-40f9-889e-8369a1a44266 req-707bd1df-28ad-48ef-80e2-fdbeefcc0e84 service nova] Creating event network-vif-plugged:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:32:13.859982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:32:13.873663 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-daba8c34-1d2f-40f9-889e-8369a1a44266 req-707bd1df-28ad-48ef-80e2-fdbeefcc0e84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173508 Aug 30 03:32:13.874539 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 958/1939] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:13.892111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:32:13.915084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:13.919843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:13.951685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:32:13.954211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:32:13.955907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:13.956407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:13.956841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:13.957587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:13.958046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:13.958470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:14.103460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:14.112273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:14.112982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:14.117278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lazy-loading 'fault' on Instance uuid 1bd1f1d3-d61a-49d0-873a-e46452077453 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:14.246137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93b6eaec-200e-40b3-bf77-baeb521fe43e tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.718639 Aug 30 03:32:14.246804 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 982/1940] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:32:14.265935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c05a55e-46ed-4819-b4de-a2761da28f18 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897afc3dc0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:14.392380 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c05a55e-46ed-4819-b4de-a2761da28f18 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.131042 Aug 30 03:32:14.394347 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 983/1941] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:14 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:14.412540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d028ff8b-f28c-4b3d-b96e-1f47df7ecde4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:14.413579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d028ff8b-f28c-4b3d-b96e-1f47df7ecde4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:14.610789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:14.628693 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0ac6c25-ea88-4cd3-bc3f-d2dc3494ae28 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 200 len: 1142 microversion: 2.1 time: 0.748212 Aug 30 03:32:14.630494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 959/1942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:13 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 1142 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:14.700004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d028ff8b-f28c-4b3d-b96e-1f47df7ecde4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:14.719365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:14.721318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:14.733683 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d028ff8b-f28c-4b3d-b96e-1f47df7ecde4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1192 microversion: 2.1 time: 0.330914 Aug 30 03:32:14.734713 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 984/1943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:14 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1192 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:14.755123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:14.756257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:14.764478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:14.765540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:14.766234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:14.767396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:15.249491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:15.260356 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-44899594-f304-4dab-81e1-48f0f6703f93 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 0.546097 Aug 30 03:32:15.274926 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 960/1944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:14 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:15.407679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae6702a8-935c-4637-b9df-4f28ae709e48 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b765f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:15.485660 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae6702a8-935c-4637-b9df-4f28ae709e48 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.081806 Aug 30 03:32:15.486694 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 985/1945] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:15 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:15.656329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:15.657129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 1bd1f1d3-d61a-49d0-873a-e46452077453] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:15.668610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:15.670843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:15.674020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:15.675101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:15.677589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:15.678352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:15.722458 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] HTTP exception thrown: Instance 1bd1f1d3-d61a-49d0-873a-e46452077453 could not be found. Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Request method failure captured: Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 HTTP/1.1 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYMUiE67F2kpRUFCFB3lGQ21DEIBr9DC3_QVnYdnqzb_7swA2j-uzmIWSeoCyuh73m3C_y-JjMF9yyVCcNquWTqT0I2gVC-8nRQgpR_hI-kv7cKU0utWuOraTFVJXeZ9_d7Jb-rmuvoCeCtdS2jLIuaCc-dwHwj9AIHgglnudam-dec Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ae15b112fcf0488aa618aedf7b310348", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}] Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15eb8a27991445a491ccce6ff650f32a Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 1bd1f1d3-d61a-49d0-873a-e46452077453 could not be found. Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1bd1f1d3-d61a-49d0-873a-e46452077453'} Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd1f1d3-d61a-49d0-873a-e46452077453 could not be found. Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd1f1d3-d61a-49d0-873a-e46452077453 could not be found. Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:15.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd1f1d3-d61a-49d0-873a-e46452077453 could not be found. Aug 30 03:32:15.730106 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:15.737331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Returning 404 to user: Instance 1bd1f1d3-d61a-49d0-873a-e46452077453 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:15.739869 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-faef9655-f67e-4000-90cf-6e628b2adf25 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453" status: 404 len: 111 microversion: 2.1 time: 0.088625 Aug 30 03:32:15.742874 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 961/1946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:15 2022] GET /compute/v2.1/servers/1bd1f1d3-d61a-49d0-873a-e46452077453 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:15.762043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:15.763787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:15.845060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:15.849668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:15.851525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:15.857411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:15.861878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:15.866693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:16.152765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:16.192595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48687a56-5bd6-42f7-99f5-253cc1f4664b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1196 microversion: 2.1 time: 0.423753 Aug 30 03:32:16.192595 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 986/1947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:15 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1196 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:16.284563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:16.285201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:16.297870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:16.305265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:16.308491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:16.312821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:16.316321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:16.319853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:16.511086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30458a50-f7a9-4bd1-a792-3c73dfcc5e5b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b7659d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:16.619324 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30458a50-f7a9-4bd1-a792-3c73dfcc5e5b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.122427 Aug 30 03:32:16.621541 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 987/1948] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:16 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:17.208470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:17.209550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:17.225557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:17.250432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:17.255952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:17.260638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:17.261149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:17.261802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:18.278322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:18.288314 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5be625c-fffc-4901-8865-238f69272e37 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1244 microversion: 2.1 time: 1.085394 Aug 30 03:32:18.300267 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 988/1949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:17 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1244 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:18.310874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-afe79ae8-b7a3-4b18-a1ca-23ac18e09f63 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d09040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:18.411967 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-afe79ae8-b7a3-4b18-a1ca-23ac18e09f63 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.110509 Aug 30 03:32:18.412711 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 989/1950] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:18 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:18.487914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:18.503925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bde29c9b-ebfa-410d-8aac-769af7f94b4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 2.223767 Aug 30 03:32:18.509901 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 962/1951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:16 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:19.190294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6b512be7-7e91-4291-8178-a03e76d60076 req-bdae2cd0-71a8-4ce7-a1f8-6bd71ba84c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:19.251347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6b512be7-7e91-4291-8178-a03e76d60076 req-bdae2cd0-71a8-4ce7-a1f8-6bd71ba84c7c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:19.261712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6b512be7-7e91-4291-8178-a03e76d60076 req-bdae2cd0-71a8-4ce7-a1f8-6bd71ba84c7c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:19.264436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6b512be7-7e91-4291-8178-a03e76d60076 req-bdae2cd0-71a8-4ce7-a1f8-6bd71ba84c7c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:19.290739 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6b512be7-7e91-4291-8178-a03e76d60076 req-bdae2cd0-71a8-4ce7-a1f8-6bd71ba84c7c service nova] Creating event network-vif-plugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:32:19.314983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:19.316032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:19.332289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6b512be7-7e91-4291-8178-a03e76d60076 req-bdae2cd0-71a8-4ce7-a1f8-6bd71ba84c7c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149288 Aug 30 03:32:19.334822 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 990/1952] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:32:19.337181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:19.337744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:19.341013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:19.344235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:19.352372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:19.352790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:19.441490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-429b6088-2b9e-4ea4-a795-465731ac4dac tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b7f50d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:19.563283 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-429b6088-2b9e-4ea4-a795-465731ac4dac tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.138314 Aug 30 03:32:19.564790 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 991/1953] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:19 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:19.576066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:19.579338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:19.599786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:19.601967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:19.602886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:19.604910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:19.608870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:19.610294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:20.014150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:20.032787 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ccf3017f-3f62-49f3-9117-0696eedfbf8a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1250 microversion: 2.1 time: 0.719568 Aug 30 03:32:20.035595 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 963/1954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:19 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1250 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:20.577797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba0c4ca9-e119-4e74-aeb3-7ade58b586bb tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b146d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:20.703109 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba0c4ca9-e119-4e74-aeb3-7ade58b586bb tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.129149 Aug 30 03:32:20.704631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 964/1955] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:20 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:21.058507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:21.059133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:21.078381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:21.078920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:21.079318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:21.084627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:21.085132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:21.087598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:21.569440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:21.579040 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58b7827c-0cef-4013-964a-5a5d56a8da1d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 0.524874 Aug 30 03:32:21.583153 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 965/1956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:21 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:21.599807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:21.615481 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-76de258f-ccf4-474c-9240-28921338dc91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 2.044141 Aug 30 03:32:21.632297 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 992/1957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:19 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:21.720886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1036046d-df91-40f7-88af-decdcc4e0709 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983c9b4c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:21.862368 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1036046d-df91-40f7-88af-decdcc4e0709 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.143931 Aug 30 03:32:21.862968 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 993/1958] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:21 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:22.258421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78a19140-1fa3-4c4d-9e18-a252d0fd73c6 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.271321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78a19140-1fa3-4c4d-9e18-a252d0fd73c6 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.616600 Aug 30 03:32:22.283246 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 966/1959] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:22.287500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c14a83c-623a-49e5-a509-d8b2d21dc56e tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.355181 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c14a83c-623a-49e5-a509-d8b2d21dc56e tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.073265 Aug 30 03:32:22.359706 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 994/1960] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:32:22 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:22.395262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-337ac0d6-1e35-45bb-bfe6-df0dcdbc0d5d tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.436116 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-337ac0d6-1e35-45bb-bfe6-df0dcdbc0d5d tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060205 Aug 30 03:32:22.444564 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 967/1961] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:22.472801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca8be8de-f217-4b96-86cc-16838a8a5e03 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.495297 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca8be8de-f217-4b96-86cc-16838a8a5e03 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029513 Aug 30 03:32:22.496352 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 995/1962] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:22.510269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-161c6c3b-4817-4f25-921f-fd724521e60b tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.606778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.607503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:22.630837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:22.642348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:22.644081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:22.647271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:22.655119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:22.656997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:22.673767 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-161c6c3b-4817-4f25-921f-fd724521e60b tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.167390 Aug 30 03:32:22.675031 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 968/1963] 10.222.0.30 () {58 vars in 1165 bytes} [Tue Aug 30 03:32:22 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:22.680027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:22.680864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:22.689383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:22.690247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:22.690881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:22.691784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:22.692647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:22.693249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:23.610605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:23.614118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:23.635011 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b13c1e4-1802-49f6-93a1-1abf5749c42e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1363 microversion: 2.1 time: 0.958583 Aug 30 03:32:23.645555 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 969/1964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:22 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1363 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:23.648468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-17aaf615-b46c-4ef4-ae13-273c9a037ec5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.045752 Aug 30 03:32:23.654719 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 996/1965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:22 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:23.675049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ad0dbe2-07fd-4882-98ee-182c37a04d9c tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:23.680501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d41c0a55-7ce6-4c11-97c9-7fbf3544aa01 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b7f53a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:23.722526 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9ad0dbe2-07fd-4882-98ee-182c37a04d9c tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.071973 Aug 30 03:32:23.726717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 970/1966] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:23.750072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9aea5bd9-5ecb-4322-bfaa-9f6b23cfa58c tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:23.816592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:23.836103 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9aea5bd9-5ecb-4322-bfaa-9f6b23cfa58c tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.099083 Aug 30 03:32:23.900123 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d41c0a55-7ce6-4c11-97c9-7fbf3544aa01 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.188144 Aug 30 03:32:23.900482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 971/1967] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Aug 30 03:32:23 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:23.900786 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 997/1968] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:23 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:23.900891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e92a7e86-317b-42e7-8d01-5559d7ed91dd tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:23.905234 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e92a7e86-317b-42e7-8d01-5559d7ed91dd tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.045275 Aug 30 03:32:23.905850 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 972/1969] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:32:23 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:32:23.923819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0659dbb-8a79-4c3c-9cf2-c0d387f4a9a7 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:23.949926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0659dbb-8a79-4c3c-9cf2-c0d387f4a9a7 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029002 Aug 30 03:32:23.951273 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 998/1970] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:23.962948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b2b6506d-379b-4cf0-a61a-80ce2e1cb88e tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.015815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b2b6506d-379b-4cf0-a61a-80ce2e1cb88e tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.056610 Aug 30 03:32:24.016971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 973/1971] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:32:23 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:24.038979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03ceccfd-1d3b-448b-9162-f4c16b31f2be tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.060351 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03ceccfd-1d3b-448b-9162-f4c16b31f2be tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025322 Aug 30 03:32:24.063959 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 999/1972] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:24.075128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee5d5c21-b588-4b4c-8861-2a0de9816cc0 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.118100 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee5d5c21-b588-4b4c-8861-2a0de9816cc0 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043134 Aug 30 03:32:24.131434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 974/1973] 10.222.0.30 () {58 vars in 1144 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:24.135944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c08a80b9-309e-46ad-986f-bae41639bc48 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.154873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c08a80b9-309e-46ad-986f-bae41639bc48 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019307 Aug 30 03:32:24.158154 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1000/1974] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:24.170963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6468a868-de51-42ad-ac33-0565f84466e1 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.193566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.199074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:24.221233 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6468a868-de51-42ad-ac33-0565f84466e1 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.055641 Aug 30 03:32:24.228909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.229903 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 975/1975] 10.222.0.30 () {58 vars in 1148 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:24.239495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.249906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:24.252324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.253089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.253751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:24.262347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36d14364-c753-4358-a31c-6ed3ca90b9b1 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.300482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:32:24.322392 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36d14364-c753-4358-a31c-6ed3ca90b9b1 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.063744 Aug 30 03:32:24.322998 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 976/1976] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:24.338429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56563d3e-d8e0-4b52-8399-665f204b57eb tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.379739 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56563d3e-d8e0-4b52-8399-665f204b57eb tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045115 Aug 30 03:32:24.387070 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 977/1977] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:24.398266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78515eb6-300d-44bc-b6e9-4134abb66641 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.493875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78515eb6-300d-44bc-b6e9-4134abb66641 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.099221 Aug 30 03:32:24.502827 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 978/1978] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:24.534295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d33f7ee5-3644-4842-9646-250c72cb4360 req-3d977c00-f9a6-45ed-8d58-7102728479c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8779a51b-60a6-4613-9000-8457ee7d8860", "tag": "bd79ad2e-ddf2-4e69-9cd0-0bebd4416ccb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:24.542282 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9609806e-bcae-4b48-9336-c1ba6fb5fd47 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 204 len: 0 microversion: 2.1 time: 0.366007 Aug 30 03:32:24.543716 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1001/1979] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:32:24 2022] DELETE /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:32:24.559220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6067a72b-7413-4cda-a2c8-2562ad13bff1 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.575047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d33f7ee5-3644-4842-9646-250c72cb4360 req-3d977c00-f9a6-45ed-8d58-7102728479c6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.575295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d33f7ee5-3644-4842-9646-250c72cb4360 req-3d977c00-f9a6-45ed-8d58-7102728479c6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.576271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d33f7ee5-3644-4842-9646-250c72cb4360 req-3d977c00-f9a6-45ed-8d58-7102728479c6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:24.624534 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6067a72b-7413-4cda-a2c8-2562ad13bff1 tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074781 Aug 30 03:32:24.628843 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d33f7ee5-3644-4842-9646-250c72cb4360 req-3d977c00-f9a6-45ed-8d58-7102728479c6 service nova] Creating event network-changed:bd79ad2e-ddf2-4e69-9cd0-0bebd4416ccb for instance 8779a51b-60a6-4613-9000-8457ee7d8860 on n-h1-854924-5 Aug 30 03:32:24.644635 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1002/1980] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:24.651671 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d33f7ee5-3644-4842-9646-250c72cb4360 req-3d977c00-f9a6-45ed-8d58-7102728479c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147319 Aug 30 03:32:24.652287 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 979/1981] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:32:24.669976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.671308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:24.681810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-38a2b756-02ef-40bf-ab89-fbbdad3b396f tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.696122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.699161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.703096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:24.706253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.706940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.708458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:24.716077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:24.718863 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-38a2b756-02ef-40bf-ab89-fbbdad3b396f tempest-FlavorsV2TestJSON-381874709 tempest-FlavorsV2TestJSON-381874709-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065317 Aug 30 03:32:24.722023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 980/1982] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:24.727010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:24.746844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:24.779162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.779658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.780089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:24.780796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:24.796919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:24.801887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:25.606058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:25.628325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8fe2e80a-f96d-45fe-bd77-fcfc95ea66ba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1551 microversion: 2.1 time: 0.902908 Aug 30 03:32:25.631603 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 981/1983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1551 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:25.645928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:25.646814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:25.667217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:25.669634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:25.670871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:25.672658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:25.675828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:25.676469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:25.813735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:25.823485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:25.833154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e77be5c8-ad91-4e1f-a8a2-0d2d03c15638 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1669 microversion: 2.1 time: 1.183048 Aug 30 03:32:25.835924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1003/1984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:24 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1669 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:25.850042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cf40fa84-dd49-4b29-bded-4cafd85fa1db tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983c2a040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:25.977084 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cf40fa84-dd49-4b29-bded-4cafd85fa1db tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.137340 Aug 30 03:32:25.979458 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1004/1985] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:25 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:25.996829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-350402429", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "dab5c732-b11c-4d0e-81fd-22a8edd91714"}, {"uuid": "13190d97-bf92-4d84-b581-1d3cad7c7cbe"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:26.178303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] validate_networks() for [('dab5c732-b11c-4d0e-81fd-22a8edd91714', None, None, None, None, None), ('13190d97-bf92-4d84-b581-1d3cad7c7cbe', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:32:27.098494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:27.113060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d0e9244-1c0f-4b46-8de8-60c5833c90c4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.478304 Aug 30 03:32:27.113710 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 982/1986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:25 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:27.135624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:27.136126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:27.168736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:27.171793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:27.171793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:27.171793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:27.171793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:27.171793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:27.807201 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69b23590-5da9-485f-87ca-fc24a2195a05 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.692314 Aug 30 03:32:27.810136 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 983/1987] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:32:27 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/os-interface => generated 285 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:27.817858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:27.819883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:27.830788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:27.835479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:27.838831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:27.842818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:27.844305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:27.844970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:29.396129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:29.411108 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0378f70f-9324-4641-b63c-470c302645bc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1669 microversion: 2.1 time: 1.598888 Aug 30 03:32:29.413617 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 984/1988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:27 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1669 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:29.423791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d25c661-38ce-4c6c-8059-2f998945d2a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b21e700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:29.557023 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d25c661-38ce-4c6c-8059-2f998945d2a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.140113 Aug 30 03:32:29.558578 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 985/1989] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:29 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:29.571551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:29.577433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:29.595145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:29.598848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:29.599628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:29.601158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:29.607087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:29.607810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:30.993548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:31.012468 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e528ee5c-d195-4a04-87dd-79b882481cb5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.452167 Aug 30 03:32:31.013926 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 986/1990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:29 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:31.022382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:31.023367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:31.037044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:31.037936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:31.039075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:31.042263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:31.042833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:31.043445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:31.317464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:31.372124 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce230637-5553-4702-80ca-f7d0db7434e1 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1602 microversion: 2.1 time: 0.356750 Aug 30 03:32:31.454385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:32:31.455427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:32:31.456073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:32:31.456617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:32:31.457168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:32:31.467022 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 987/1991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:31 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1602 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:31.490302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:31.490782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c81bf720-8620-497c-bc4d-e40f51a500df tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b163ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:31.508612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:31.511968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:31.520775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:31.522252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:31.523183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:31.552214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Getting quotas for project 4b1a03c37eb24082bfd84f9e5da2e86e. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:32:31.568182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Getting quotas for user 15d26d112e044244b16a6e41093a3ebd and project 4b1a03c37eb24082bfd84f9e5da2e86e. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:32:31.579402 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c81bf720-8620-497c-bc4d-e40f51a500df tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.111028 Aug 30 03:32:31.580196 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 988/1992] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:31 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:31.589258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5d2a0712-8cb2-4ead-bb09-e6101917a569 req-120b6b9e-1138-4d0f-a2cd-472a225df9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:31.613690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:32:31.617986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d2a0712-8cb2-4ead-bb09-e6101917a569 req-120b6b9e-1138-4d0f-a2cd-472a225df9d5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:31.618652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d2a0712-8cb2-4ead-bb09-e6101917a569 req-120b6b9e-1138-4d0f-a2cd-472a225df9d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:31.619913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d2a0712-8cb2-4ead-bb09-e6101917a569 req-120b6b9e-1138-4d0f-a2cd-472a225df9d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:31.624230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:32:31.646570 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5d2a0712-8cb2-4ead-bb09-e6101917a569 req-120b6b9e-1138-4d0f-a2cd-472a225df9d5 service nova] Creating event network-changed:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:32:31.665958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5d2a0712-8cb2-4ead-bb09-e6101917a569 req-120b6b9e-1138-4d0f-a2cd-472a225df9d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084349 Aug 30 03:32:31.667252 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 989/1993] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:31.676843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-57eb0c62-e6db-4a4d-94c4-ed9cc3cec7e7 req-e073c60d-1df8-4eea-a0e3-4618937fbb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ab56e1-fa28-4a76-8f7c-f21ad1acd129", "name": "network-vif-deleted", "tag": "e30cbadc-95e2-4ab6-9a62-fbf45745804c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:31.736984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-57eb0c62-e6db-4a4d-94c4-ed9cc3cec7e7 req-e073c60d-1df8-4eea-a0e3-4618937fbb66 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:31.740079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-57eb0c62-e6db-4a4d-94c4-ed9cc3cec7e7 req-e073c60d-1df8-4eea-a0e3-4618937fbb66 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:31.743714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-57eb0c62-e6db-4a4d-94c4-ed9cc3cec7e7 req-e073c60d-1df8-4eea-a0e3-4618937fbb66 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:31.796723 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-57eb0c62-e6db-4a4d-94c4-ed9cc3cec7e7 req-e073c60d-1df8-4eea-a0e3-4618937fbb66 service nova] Creating event network-vif-deleted:e30cbadc-95e2-4ab6-9a62-fbf45745804c for instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 on n-h1-854924-5 Aug 30 03:32:31.826112 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-57eb0c62-e6db-4a4d-94c4-ed9cc3cec7e7 req-e073c60d-1df8-4eea-a0e3-4618937fbb66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153451 Aug 30 03:32:31.827389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 990/1994] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:31.846893 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e17a98b1-eac4-4e4b-9ecb-0f0755a5437d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.863695 Aug 30 03:32:31.850282 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1005/1995] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:32:31.865959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16d94c5a-a51b-418d-b717-e4c3e8dc36ae tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:31.867489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16d94c5a-a51b-418d-b717-e4c3e8dc36ae tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:32.045395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:32.046192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:32.069169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:32.074103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:32.074837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:32.081487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:32.083159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:32.108384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:32.211963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-16d94c5a-a51b-418d-b717-e4c3e8dc36ae tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:32.220245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16d94c5a-a51b-418d-b717-e4c3e8dc36ae tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1212 microversion: 2.1 time: 0.360509 Aug 30 03:32:32.233385 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 991/1996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:31 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1212 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:32.484564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:32.485272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:32.509706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:32.510242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:32.514756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:32.515937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:32.524533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:32.525401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:32.699441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:32.701146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:32.703669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:32.705396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lazy-loading 'fault' on Instance uuid 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:32.720959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:33.064627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:33.084770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:33.094930 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b79e703a-d844-468b-8580-21f312908610 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.035604 Aug 30 03:32:33.101408 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1006/1997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:32 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:33.105653 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0420d897-f61d-4353-92da-a3ca838327cc tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 200 len: 1325 microversion: 2.1 time: 0.626009 Aug 30 03:32:33.132206 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 992/1998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:32 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:33.138327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15db9b17-0ad4-4ad5-b5ce-dacf8eb20eca tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b7f58b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:33.234667 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-15db9b17-0ad4-4ad5-b5ce-dacf8eb20eca tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.123593 Aug 30 03:32:33.235272 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1007/1999] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:33 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:33.247848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:33.249037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:33.269765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:33.271255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:33.272520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:33.276672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:33.278757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:33.280293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:33.492793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:33.526829 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7672e9fe-99b9-44fb-9006-4e6a3ce26a1d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1216 microversion: 2.1 time: 0.285999 Aug 30 03:32:33.533772 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 993/2000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:33 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1216 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:34.123784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:34.127050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:34.135487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:34.135771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: 21ab56e1-fa28-4a76-8f7c-f21ad1acd129] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:34.142134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:34.156958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:34.164183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:34.164713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:34.165743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:34.166226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:34.166652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:34.182714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:34.183230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:34.183949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:34.186053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:34.186525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:34.186949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:34.238588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] HTTP exception thrown: Instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 could not be found. Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Request method failure captured: Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 HTTP/1.1 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYMUiE67F2kpRUFCFB3lGQ21DEIBr9DC3_QVnYdnqzb_7swA2j-uzmIWSeoCyuh73m3C_y-JjMF9yyVCcNquWTqT0I2gVC-8nRQgpR_hI-kv7cKU0utWuOraTFVJXeZ9_d7Jb-rmuvoCeCtdS2jLIuaCc-dwHwj9AIHgglnudam-dec Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ae15b112fcf0488aa618aedf7b310348", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}] Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15eb8a27991445a491ccce6ff650f32a Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 could not be found. Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '21ab56e1-fa28-4a76-8f7c-f21ad1acd129'} Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 could not be found. Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 could not be found. Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:34.246292 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 could not be found. Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Returning 404 to user: Instance 21ab56e1-fa28-4a76-8f7c-f21ad1acd129 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:34.250579 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-15328293-4c3e-4316-99c2-625308a0aa56 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129" status: 404 len: 111 microversion: 2.1 time: 0.118204 Aug 30 03:32:34.264147 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 994/2001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:34 2022] GET /compute/v2.1/servers/21ab56e1-fa28-4a76-8f7c-f21ad1acd129 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:34.270021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc325c10-8672-45b8-b482-d3e532ed0422 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983c5b0d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:34.437969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc325c10-8672-45b8-b482-d3e532ed0422 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.172631 Aug 30 03:32:34.438793 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 995/2002] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:34 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:34.470636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb75c5f3-ba61-4590-b0c6-b3758e15f516 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '.version_select at 0x7f8983c5bee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:34.534790 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb75c5f3-ba61-4590-b0c6-b3758e15f516 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055053357" status: 202 len: 0 microversion: 2.1 time: 0.077126 Aug 30 03:32:34.535653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 996/2003] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055053357 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:32:34.557319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:34.558193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:34.572642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:34.573703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:34.577302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:34.578435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:34.581151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:34.581795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:34.980451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:34.991474 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0121519d-74b4-4b4e-b974-e909c051de8d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1272 microversion: 2.1 time: 0.438539 Aug 30 03:32:34.994063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 997/2004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:34 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:35.010068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:35.014338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:35.037497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:35.038316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:35.044392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:35.045395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:35.045999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:35.048126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:35.213543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:35.224033 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-edf780cb-66ac-4ff9-bd99-a95a13e22b35 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.105981 Aug 30 03:32:35.230853 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1008/2005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:34 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:35.454399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f7057be-5d6a-4624-a0fc-71d1152246ee tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983cf8820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:35.594835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f7057be-5d6a-4624-a0fc-71d1152246ee tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.145131 Aug 30 03:32:35.596222 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1009/2006] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:35 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:35.653979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:35.697033 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51256e98-e582-40ec-ac0e-6a208b09f449 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 2339 microversion: 2.25 time: 0.698543 Aug 30 03:32:35.701693 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 998/2007] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:32:34 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 2339 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:32:35.727062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:35.732479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:35.734095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:35.735183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:35.736405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:35.737089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:35.737860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:35.812206 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb6474bb-03f7-467e-aaa8-100f6f8d3ce7 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.089372 Aug 30 03:32:35.813405 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1010/2008] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Aug 30 03:32:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:32:36.015455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:36.016076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:36.030577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:36.031093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:36.031539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:36.032250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:36.032706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:36.033130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:36.263294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:36.274445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:36.319559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:36.326937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:36.327649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:36.327850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:36.330234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:36.335057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:36.336668 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2cb637b4-f421-4372-93c3-d9cae135a920 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1270 microversion: 2.1 time: 0.325578 Aug 30 03:32:36.337318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:36.338024 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 999/2009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:36 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1270 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:36.610475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-84d18dfb-c29a-49c2-9403-2132f94ea2fe tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b11a160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:36.746020 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-84d18dfb-c29a-49c2-9403-2132f94ea2fe tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.139394 Aug 30 03:32:36.755231 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1000/2010] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:36 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:37.286970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:37.288568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:37.325935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:37.326557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:37.327006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:37.327751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:37.328203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:37.328626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:37.482145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:32:37.688369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:37.690969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce55caea-6333-47b1-883c-ce1dcf699ac8 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 204 len: 0 microversion: 2.1 time: 0.406206 Aug 30 03:32:37.692662 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1001/2011] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:32:37 2022] DELETE /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:32:37.710395 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7af5a276-d9e3-4b2d-b0f1-0f7448a35bee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.452313 Aug 30 03:32:37.711606 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1011/2012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:36 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:37.720847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:37.725234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:37.729457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:37.733039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:37.741557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:37.743990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:37.744904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:37.755544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:37.757095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:37.759086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:37.760920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:37.764953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:37.765433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:37.766190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:37.766648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:37.767073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:38.870554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:38.907034 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84de4c73-015b-40ad-8244-08a5e9fe5834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1485 microversion: 2.1 time: 1.194183 Aug 30 03:32:38.913449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1012/2013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:37 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1485 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:38.929256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-119c55e1-370d-4538-8e8b-34c8c06f0022 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897bd28ca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:39.086047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-119c55e1-370d-4538-8e8b-34c8c06f0022 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.170885 Aug 30 03:32:39.086955 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1013/2014] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:38 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:39.110764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:39.111391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:39.135032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:39.138244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:39.138744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:39.139491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:39.146073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:39.146571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:40.028394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:40.046693 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb860e9f-e6d0-42a2-bae1-3049080c4a03 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1312 microversion: 2.1 time: 2.352337 Aug 30 03:32:40.051540 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1002/2015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:37 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1312 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:40.058460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:40.065868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:40.082199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:40.100301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:40.101130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:40.104984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:40.107963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:40.108462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:40.492315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:40.512552 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec5c867b-0033-4850-ab4e-56b71c3ca826 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1443 microversion: 2.1 time: 0.457613 Aug 30 03:32:40.522925 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1003/2016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:40 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1443 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:40.551899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e2792d4-b661-4060-86d6-b3ff193dc959 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983c5b670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:40.581403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:40.598445 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0f5544f-5037-487a-84a8-22527796af8d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.507267 Aug 30 03:32:40.625735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1014/2017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:39 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:40.636721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f084ae85-15b1-4699-87ba-e75dc422850b", "device": "/dev/xvdb"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:40.655470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:40.686901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:40.688738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:40.690023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:40.694491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:40.698392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:40.699137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:40.750436 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e2792d4-b661-4060-86d6-b3ff193dc959 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.224892 Aug 30 03:32:40.754980 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1004/2018] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:40 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:40.817617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-953bd242-130f-4397-a388-af0da1061215 req-cc2aca03-4543-46db-849a-24140830454f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55ec963-f681-4634-a76a-136dbefc4d4a", "name": "network-vif-deleted", "tag": "437d327d-babd-4d6f-afbf-fd52a78b63e4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:40.922187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-953bd242-130f-4397-a388-af0da1061215 req-cc2aca03-4543-46db-849a-24140830454f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:40.922791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-953bd242-130f-4397-a388-af0da1061215 req-cc2aca03-4543-46db-849a-24140830454f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:40.923236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-953bd242-130f-4397-a388-af0da1061215 req-cc2aca03-4543-46db-849a-24140830454f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:40.985740 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-953bd242-130f-4397-a388-af0da1061215 req-cc2aca03-4543-46db-849a-24140830454f service nova] Creating event network-vif-deleted:437d327d-babd-4d6f-afbf-fd52a78b63e4 for instance f55ec963-f681-4634-a76a-136dbefc4d4a on n-h1-854924-5 Aug 30 03:32:41.013212 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-953bd242-130f-4397-a388-af0da1061215 req-cc2aca03-4543-46db-849a-24140830454f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251273 Aug 30 03:32:41.018145 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1005/2019] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:41.073537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:41.074803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:41.096131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:41.116532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:41.119762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:41.120401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:41.125362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:41.129153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:41.129757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:41.528063 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eecec1e1-423b-47a5-9643-3ef01a27fbf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "POST /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.895922 Aug 30 03:32:41.544229 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1015/2020] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Aug 30 03:32:40 2022] POST /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:32:41.559467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:41.563245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:41.585029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:41.595014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:41.600089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:41.600854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:41.603108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:41.606732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:41.607738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:41.725863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:41.743467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:41.744829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:41.748100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lazy-loading 'fault' on Instance uuid f55ec963-f681-4634-a76a-136dbefc4d4a {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:42.226070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:42.247966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:42.256621 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dfef850a-7ec2-489c-a45d-8d0114f65973 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 200 len: 1300 microversion: 2.1 time: 0.710822 Aug 30 03:32:42.257224 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1016/2021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:41 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 1300 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:42.272028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:42.311122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:42.352276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:42.352781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:42.353231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:42.353993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:42.354460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:42.354893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:43.183723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:43.197671 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f915164-3664-4e6c-83bb-782c71e8741c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 2.129852 Aug 30 03:32:43.199063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1006/2022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:41 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:43.234681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89a29080-b5ea-4a71-a0d2-31105016178d tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d45310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:43.378254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:43.395006 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0322adf-db24-46ac-bbda-b106c8b72257 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 1.125907 Aug 30 03:32:43.395280 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89a29080-b5ea-4a71-a0d2-31105016178d tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1421 microversion: 2.1 time: 0.192250 Aug 30 03:32:43.397402 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1007/2023] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:43 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1421 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:43.407147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1017/2024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:42 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:43.416345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-21ef3526-bf63-4ab9-907f-6567ad8718b3 req-2de4f8a5-2130-4320-8c5a-d4607ecef567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8779a51b-60a6-4613-9000-8457ee7d8860", "name": "network-vif-plugged", "status": "completed", "tag": "bd79ad2e-ddf2-4e69-9cd0-0bebd4416ccb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:43.424941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:43.443301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: f55ec963-f681-4634-a76a-136dbefc4d4a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:43.448920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-21ef3526-bf63-4ab9-907f-6567ad8718b3 req-2de4f8a5-2130-4320-8c5a-d4607ecef567 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:43.449450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-21ef3526-bf63-4ab9-907f-6567ad8718b3 req-2de4f8a5-2130-4320-8c5a-d4607ecef567 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:43.449892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-21ef3526-bf63-4ab9-907f-6567ad8718b3 req-2de4f8a5-2130-4320-8c5a-d4607ecef567 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:43.473021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:43.473938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:43.475578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:43.476479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:43.478081 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-21ef3526-bf63-4ab9-907f-6567ad8718b3 req-2de4f8a5-2130-4320-8c5a-d4607ecef567 service nova] Creating event network-vif-plugged:bd79ad2e-ddf2-4e69-9cd0-0bebd4416ccb for instance 8779a51b-60a6-4613-9000-8457ee7d8860 on n-h1-854924-5 Aug 30 03:32:43.481249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:43.482247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:43.500630 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-21ef3526-bf63-4ab9-907f-6567ad8718b3 req-2de4f8a5-2130-4320-8c5a-d4607ecef567 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101909 Aug 30 03:32:43.510284 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1008/2025] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:43.549654 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] HTTP exception thrown: Instance f55ec963-f681-4634-a76a-136dbefc4d4a could not be found. Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Request method failure captured: Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a HTTP/1.1 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYMUiE67F2kpRUFCFB3lGQ21DEIBr9DC3_QVnYdnqzb_7swA2j-uzmIWSeoCyuh73m3C_y-JjMF9yyVCcNquWTqT0I2gVC-8nRQgpR_hI-kv7cKU0utWuOraTFVJXeZ9_d7Jb-rmuvoCeCtdS2jLIuaCc-dwHwj9AIHgglnudam-dec Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ae15b112fcf0488aa618aedf7b310348", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}] Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 15eb8a27991445a491ccce6ff650f32a Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance f55ec963-f681-4634-a76a-136dbefc4d4a could not be found. Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f55ec963-f681-4634-a76a-136dbefc4d4a'} Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55ec963-f681-4634-a76a-136dbefc4d4a could not be found. Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55ec963-f681-4634-a76a-136dbefc4d4a could not be found. Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:43.554236 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55ec963-f681-4634-a76a-136dbefc4d4a could not be found. Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Returning 404 to user: Instance f55ec963-f681-4634-a76a-136dbefc4d4a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af8e4558-e8eb-40c6-9a20-aa71df2ac082 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a" status: 404 len: 111 microversion: 2.1 time: 0.140202 Aug 30 03:32:43.557900 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1018/2026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:43 2022] GET /compute/v2.1/servers/f55ec963-f681-4634-a76a-136dbefc4d4a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:43.568124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:43.568754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:43.586331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:43.586837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:43.587282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:43.597481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:43.598211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:43.601206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:43.694698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:32:44.041254 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-22932b9a-403e-4a03-9a16-39e472fd4ed9 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 204 len: 0 microversion: 2.1 time: 0.462360 Aug 30 03:32:44.042704 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1009/2027] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:32:43 2022] DELETE /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:32:44.050855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:44.051479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:44.071059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:44.071573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:44.072026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:44.076544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:44.077361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:44.077878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:44.380478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f74fee9-607e-4a24-81b9-ea1305b29d03 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Action: 'create', calling method: .version_select at 0x7f8983d4a8b0>, body: {"pool": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:44.668536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:44.691852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0361c815-d750-420d-bc1b-2c032cddee92 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1500 microversion: 2.1 time: 0.642090 Aug 30 03:32:44.692763 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1019/2028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:44 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1500 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:44.716047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:44.718025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:44.726444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:44.727739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:44.728391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:44.729431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:44.730659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:44.731524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:45.299128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:45.312877 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3fc20ea6-1c5c-495e-beee-4b29a9cb6b45 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.617389 Aug 30 03:32:45.314485 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1020/2029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:44 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:45.319748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8475194-2f8e-4bcd-8726-f45f480510de tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f89805b1f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:45.382826 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8475194-2f8e-4bcd-8726-f45f480510de tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1430 microversion: 2.1 time: 0.066867 Aug 30 03:32:45.388564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1021/2030] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:45 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1430 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:45.401010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:45.404195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:45.413540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:45.414277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:45.415186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:45.417005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:45.419319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:45.420179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:45.758496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:45.916010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:45.935556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e0198b5-32e7-4a5e-bb48-d8e5dd5de9e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1292 microversion: 2.1 time: 0.545231 Aug 30 03:32:45.949822 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1022/2031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:45 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1292 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:45.949822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4b206a62-7bdd-4a43-b881-b28a5fae792a req-8c9c9cde-449f-4c1d-9baa-092057b91707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "tag": "9cc78094-42b9-412b-b417-29d0e6781af7"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:45.978096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4b206a62-7bdd-4a43-b881-b28a5fae792a req-8c9c9cde-449f-4c1d-9baa-092057b91707 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:45.978583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4b206a62-7bdd-4a43-b881-b28a5fae792a req-8c9c9cde-449f-4c1d-9baa-092057b91707 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:45.979020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4b206a62-7bdd-4a43-b881-b28a5fae792a req-8c9c9cde-449f-4c1d-9baa-092057b91707 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:45.999453 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4b206a62-7bdd-4a43-b881-b28a5fae792a req-8c9c9cde-449f-4c1d-9baa-092057b91707 service nova] Creating event network-changed:9cc78094-42b9-412b-b417-29d0e6781af7 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:32:46.007373 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4b206a62-7bdd-4a43-b881-b28a5fae792a req-8c9c9cde-449f-4c1d-9baa-092057b91707 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069836 Aug 30 03:32:46.013549 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1023/2032] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:46.020329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ca76936-3f47-4b79-a95b-85a4736347f0 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983cc4c10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:46.147018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ca76936-3f47-4b79-a95b-85a4736347f0 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 200 len: 1430 microversion: 2.1 time: 0.128422 Aug 30 03:32:46.149550 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1024/2033] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:46 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 1430 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:46.164121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:46.169880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:46.202030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:46.205957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:46.206483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:46.207236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:46.207699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:46.208125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:46.787200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:46.803702 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7eab0f4-10d5-4c55-9a4c-3c48ace9a066 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1500 microversion: 2.1 time: 0.648843 Aug 30 03:32:46.819901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1025/2034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:46 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1500 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:46.826209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:46.826887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:46.834554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:46.835277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:46.835854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:46.836797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:46.837460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:46.838026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:47.506180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:47.520468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-544d0cec-38c1-4d4f-abe7-39569ed90670 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1467 microversion: 2.1 time: 0.698543 Aug 30 03:32:47.524168 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1026/2035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:46 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1467 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:47.531499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:47.532274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:47.564086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:47.564742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:47.566142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:47.568202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:47.571949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:47.579567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:47.658278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:48.338857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:48.351391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e80f9bc1-0e00-4a6a-9845-58fbe83df56b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.824650 Aug 30 03:32:48.353251 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1027/2036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:47 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:48.365583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:48.366483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:48.380861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:48.384313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:48.386091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:48.389672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:48.390164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:48.390646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:48.829383 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f74fee9-607e-4a24-81b9-ea1305b29d03 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.675276 Aug 30 03:32:48.832094 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1010/2037] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:32:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:32:48.844128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-defe43d4-ab59-4c53-9de5-52ae6cb420c4 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b11f700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:48.894588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:48.903446 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78e617c6-e129-4731-83a3-94bbf5815164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1473 microversion: 2.1 time: 0.548836 Aug 30 03:32:48.912282 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1028/2038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:48 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1473 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:48.922798 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-defe43d4-ab59-4c53-9de5-52ae6cb420c4 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/b40a5c3f-7379-4565-a6da-58a9aabde37c" status: 200 len: 784 microversion: 2.1 time: 0.085724 Aug 30 03:32:48.923970 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1011/2039] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:48 2022] GET /compute/v2.1/images/b40a5c3f-7379-4565-a6da-58a9aabde37c => generated 784 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:48.927322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:48.928064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:48.932884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c01f850e-c193-4e9a-a52e-fd4cf67d2fee req-d0e9033b-70d6-40f2-b84e-8ed2236e20ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "name": "network-vif-unplugged", "status": "completed", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:48.949874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c01f850e-c193-4e9a-a52e-fd4cf67d2fee req-d0e9033b-70d6-40f2-b84e-8ed2236e20ce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:48.950615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c01f850e-c193-4e9a-a52e-fd4cf67d2fee req-d0e9033b-70d6-40f2-b84e-8ed2236e20ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:48.951510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c01f850e-c193-4e9a-a52e-fd4cf67d2fee req-d0e9033b-70d6-40f2-b84e-8ed2236e20ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:48.952316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:48.952824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:48.953268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:48.958618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:48.960336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:48.960787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:48.975003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c01f850e-c193-4e9a-a52e-fd4cf67d2fee req-d0e9033b-70d6-40f2-b84e-8ed2236e20ce service nova] Creating event network-vif-unplugged:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:32:48.985706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c01f850e-c193-4e9a-a52e-fd4cf67d2fee req-d0e9033b-70d6-40f2-b84e-8ed2236e20ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059632 Aug 30 03:32:48.986535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1012/2040] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:48.998620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-94b19587-9c59-4f25-ac04-4dce60597374 req-2b586c3d-d2ad-4e8c-9592-4556e07810b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa8099c-f76b-4bb1-880f-b6422d1ac7c6", "name": "network-vif-deleted", "tag": "57b82505-7683-441b-871d-3f24751cddff"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:49.014820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-94b19587-9c59-4f25-ac04-4dce60597374 req-2b586c3d-d2ad-4e8c-9592-4556e07810b7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:49.016127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-94b19587-9c59-4f25-ac04-4dce60597374 req-2b586c3d-d2ad-4e8c-9592-4556e07810b7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:49.016831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-94b19587-9c59-4f25-ac04-4dce60597374 req-2b586c3d-d2ad-4e8c-9592-4556e07810b7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:49.033148 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-94b19587-9c59-4f25-ac04-4dce60597374 req-2b586c3d-d2ad-4e8c-9592-4556e07810b7 service nova] Creating event network-vif-deleted:57b82505-7683-441b-871d-3f24751cddff for instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 on n-h1-854924-5 Aug 30 03:32:49.047392 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-94b19587-9c59-4f25-ac04-4dce60597374 req-2b586c3d-d2ad-4e8c-9592-4556e07810b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057085 Aug 30 03:32:49.048403 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1013/2041] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:49.058363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1233d5f4-22a2-4ca4-ab6a-935fe23a1f22 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Calling method '.version_select at 0x7f897be06040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:49.101421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:49.101792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:49.102245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:49.109163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lazy-loading 'fault' on Instance uuid cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:49.649906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eb8a27991445a491ccce6ff650f32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae15b112fcf0488aa618aedf7b310348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:49.662622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4369429d-6c31-4914-a0da-c8d1ffae991b tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 200 len: 1300 microversion: 2.1 time: 0.745322 Aug 30 03:32:49.663382 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1029/2042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:48 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 1300 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:49.668270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6752a38-7fb4-4ce6-a7f1-d4e4d5371fc3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:49.686124 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6752a38-7fb4-4ce6-a7f1-d4e4d5371fc3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021417 Aug 30 03:32:49.687073 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1030/2043] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:32:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:49.709848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1345831415", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:49.794869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:32:49.892879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1233d5f4-22a2-4ca4-ab6a-935fe23a1f22 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/66259924-d665-4616-be12-1a1f8aa231b4" status: 200 len: 142 microversion: 2.1 time: 0.842464 Aug 30 03:32:49.894356 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1014/2044] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:32:49 2022] GET /compute/v2.1/os-floating-ips/66259924-d665-4616-be12-1a1f8aa231b4 => generated 142 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:49.899713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:49.900491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:49.912646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:49.913540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:49.914180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:49.915227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:49.915944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:49.916378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:50.298677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:50.306694 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-515e12e9-398b-43be-8458-5012cfc182db tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.411243 Aug 30 03:32:50.307869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1015/2045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:49 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:50.313867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9220d493-fb38-4c01-b38c-fb39afd56486 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b11f790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:50.856494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:32:50.857009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:32:50.857637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:32:50.858073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:32:50.858804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:32:50.874793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:50.875288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:50.875795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:50.876837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:50.877465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:50.881499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:50.939214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:32:50.948261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:32:50.975290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:32:50.978718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:32:51.076129 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb6ba7d6-5cdb-491b-9cee-bf661d9dd03b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386799 Aug 30 03:32:51.078969 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1031/2046] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:32:51.086263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07484ff3-5a3f-439b-8da0-bc264fe2ce8a tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Calling method '.version_select at 0x7f8983c2e280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.386469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9220d493-fb38-4c01-b38c-fb39afd56486 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "DELETE /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 204 len: 0 microversion: 2.1 time: 1.077282 Aug 30 03:32:51.387046 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1016/2047] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:50 2022] DELETE /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:32:51.387171 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-07484ff3-5a3f-439b-8da0-bc264fe2ce8a tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.306619 Aug 30 03:32:51.391166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1032/2048] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:32:51 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:51.394150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.395002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] [instance: cfa8099c-f76b-4bb1-880f-b6422d1ac7c6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:51.396158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5166d392-8861-449e-a003-f92fc7612670 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.396662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5166d392-8861-449e-a003-f92fc7612670 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:51.409263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.409838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.410286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:51.411017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.411467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.411887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:51.415521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5166d392-8861-449e-a003-f92fc7612670 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:32:51.435045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] HTTP exception thrown: Instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 could not be found. Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Request method failure captured: Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 HTTP/1.1 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYMUiE67F2kpRUFCFB3lGQ21DEIBr9DC3_QVnYdnqzb_7swA2j-uzmIWSeoCyuh73m3C_y-JjMF9yyVCcNquWTqT0I2gVC-8nRQgpR_hI-kv7cKU0utWuOraTFVJXeZ9_d7Jb-rmuvoCeCtdS2jLIuaCc-dwHwj9AIHgglnudam-dec Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ae15b112fcf0488aa618aedf7b310348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ae15b112fcf0488aa618aedf7b310348", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae15b112fcf0488aa618aedf7b310348"}]}] Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ae15b112fcf0488aa618aedf7b310348 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-LiveMigrationTest-1189564515 Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15eb8a27991445a491ccce6ff650f32a Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-LiveMigrationTest-1189564515-project Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 could not be found. Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'cfa8099c-f76b-4bb1-880f-b6422d1ac7c6'} Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 could not be found. Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 could not be found. Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.437264 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 could not be found. Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] Returning 404 to user: Instance cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:51.440993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8201d21e-6dd7-4b95-959f-de8950347834 tempest-LiveMigrationTest-1189564515 tempest-LiveMigrationTest-1189564515-project] 10.222.0.30 "GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6" status: 404 len: 111 microversion: 2.1 time: 0.049626 Aug 30 03:32:51.443417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1017/2049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:51 2022] GET /compute/v2.1/servers/cfa8099c-f76b-4bb1-880f-b6422d1ac7c6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:51.450733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5d2c67b1-545c-4a1b-8a91-903a7a5e7c4e req-1e1b37a4-ec9d-48b0-bf36-a7ce3f1469b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "tag": "81daf264-bb37-4854-82fd-8e248d00e2d6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:51.462738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d2c67b1-545c-4a1b-8a91-903a7a5e7c4e req-1e1b37a4-ec9d-48b0-bf36-a7ce3f1469b7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.463269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d2c67b1-545c-4a1b-8a91-903a7a5e7c4e req-1e1b37a4-ec9d-48b0-bf36-a7ce3f1469b7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.463692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d2c67b1-545c-4a1b-8a91-903a7a5e7c4e req-1e1b37a4-ec9d-48b0-bf36-a7ce3f1469b7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:51.479310 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5d2c67b1-545c-4a1b-8a91-903a7a5e7c4e req-1e1b37a4-ec9d-48b0-bf36-a7ce3f1469b7 service nova] Creating event network-changed:81daf264-bb37-4854-82fd-8e248d00e2d6 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:32:51.485205 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5d2c67b1-545c-4a1b-8a91-903a7a5e7c4e req-1e1b37a4-ec9d-48b0-bf36-a7ce3f1469b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040023 Aug 30 03:32:51.485839 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1018/2050] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:51.492942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.494078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:51.502095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.502897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.503563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:51.504476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.505155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.505832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:51.509247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:32:51.578480 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.scheduler.client.report [None req-5166d392-8861-449e-a003-f92fc7612670 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Deleted allocations for instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f Aug 30 03:32:51.592489 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-5166d392-8861-449e-a003-f92fc7612670 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] Instance Mapping does not exist while attempting local delete cleanup. Aug 30 03:32:51.593366 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5166d392-8861-449e-a003-f92fc7612670 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f" status: 204 len: 0 microversion: 2.1 time: 0.201236 Aug 30 03:32:51.599450 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1033/2051] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:32:51 2022] DELETE /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:32:51.604357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b95cad5-22aa-4e29-ad42-9a321a3f29ce tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983b93e50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.656054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-8b95cad5-22aa-4e29-ad42-9a321a3f29ce tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] HTTP exception thrown: Image not found. Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b95cad5-22aa-4e29-ad42-9a321a3f29ce tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Request method failure captured: Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb HTTP/1.1 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSg1QyeRECtc23JAGSq9c_sOkyF4N5cqYjPzkVPF4VdgjA248cJPHbAyav5kkA7jzcSEgSvaH3-e-Dw79wVDvGPk18TzF8Q7nl0bOOfDp6ctQ8oPkqhTX00qQ5A9PctqGl2JZmChcPF2Wj8j0ilfIjzxDotVHBvqr9FmmBjNqKZmB4 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 11a7139623854f1d85930bc0e9e4f1d2 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11a7139623854f1d85930bc0e9e4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11a7139623854f1d85930bc0e9e4f1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11a7139623854f1d85930bc0e9e4f1d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11a7139623854f1d85930bc0e9e4f1d2"}]}] Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 11a7139623854f1d85930bc0e9e4f1d2 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerTestJSON-565061621-project Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: f6a16685a31c4a9db9bb468c0b8552ca Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerTestJSON-565061621-project Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c595277f-a472-4d5e-8e95-86a28363b0bb'} Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c595277f-a472-4d5e-8e95-86a28363b0bb Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:32:51.658262 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c595277f-a472-4d5e-8e95-86a28363b0bb could not be found. Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b95cad5-22aa-4e29-ad42-9a321a3f29ce tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b95cad5-22aa-4e29-ad42-9a321a3f29ce tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 404 len: 62 microversion: 2.1 time: 0.059277 Aug 30 03:32:51.661636 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1034/2052] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:51 2022] GET /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:32:51.664795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bf3a2a3-41b0-4f99-9ce0-dae27cb6000b tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Calling method '.version_select at 0x7f8983d94820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.757467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:51.766490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0bca4161-03ae-48eb-8ff6-02968df2d1e9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.279199 Aug 30 03:32:51.767434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1019/2053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:51 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:51.782686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fdf6df9-4417-4642-916d-46d67b91cfc7 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:51.783393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1fdf6df9-4417-4642-916d-46d67b91cfc7 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:51.791058 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-1fdf6df9-4417-4642-916d-46d67b91cfc7 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fdf6df9-4417-4642-916d-46d67b91cfc7 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f HTTP/1.1 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f'} Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:32:51.792243 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fdf6df9-4417-4642-916d-46d67b91cfc7 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1fdf6df9-4417-4642-916d-46d67b91cfc7 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f" status: 404 len: 111 microversion: 2.1 time: 0.024953 Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1020/2054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:51 2022] GET /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:32:51.807602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1378432060"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:51.812082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:51.820381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.820888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.821331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:51.822114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:51.822560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:51.823102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:52.063750 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a8fcbcc-bbde-47a9-8986-d86f6343c189 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "POST /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a/action" status: 202 len: 0 microversion: 2.1 time: 0.267683 Aug 30 03:32:52.064430 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1021/2055] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:32:51 2022] POST /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:32:52.069945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1588282322", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:52.146034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:32:53.847547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:32:53.847547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:32:53.849221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:32:53.850221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:32:53.850725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:32:53.868610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:53.874443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:53.875198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:53.876074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:53.876887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:53.877374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:53.900074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:32:53.906310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:32:53.922343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:32:53.925518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:32:54.014246 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1ba426b-de26-4e4a-8187-d4dd7ef57267 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948431 Aug 30 03:32:54.017024 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1022/2056] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:32:54.028557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b4c0f81c-333b-4a22-8b75-081fa340b1bb tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983c673a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:54.095524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b4c0f81c-333b-4a22-8b75-081fa340b1bb tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.076793 Aug 30 03:32:54.096531 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1023/2057] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:54 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:54.103147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:54.104681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:54.113367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:54.114159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:54.114814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:54.115772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:54.116669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:54.117627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:54.327155 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2bf3a2a3-41b0-4f99-9ce0-dae27cb6000b tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/66259924-d665-4616-be12-1a1f8aa231b4" status: 202 len: 0 microversion: 2.1 time: 2.665766 Aug 30 03:32:54.327821 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1035/2058] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:32:51 2022] DELETE /compute/v2.1/os-floating-ips/66259924-d665-4616-be12-1a1f8aa231b4 => generated 0 bytes in 2667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:32:54.334675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bcd87aca-d9fb-4d79-b3cc-e5317f3f6ebc tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:54.335815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcd87aca-d9fb-4d79-b3cc-e5317f3f6ebc tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:54.455032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bcd87aca-d9fb-4d79-b3cc-e5317f3f6ebc tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:54.468072 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bcd87aca-d9fb-4d79-b3cc-e5317f3f6ebc tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1221 microversion: 2.1 time: 0.139197 Aug 30 03:32:54.468897 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1036/2059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:54 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:54.483695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bdbd7a29-4b07-472f-bd2e-92537ae82df6 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Action: 'create', calling method: .version_select at 0x7f897b983c10>, body: {"pool": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:54.554706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:54.564948 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf54cfbb-9696-491e-b72f-b204f44eece9 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.466721 Aug 30 03:32:54.565663 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1024/2060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:54 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:55.111771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b509d5c-c940-4901-b388-78f93e20ee7b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d4adc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:55.174703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b509d5c-c940-4901-b388-78f93e20ee7b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.066978 Aug 30 03:32:55.175971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1025/2061] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:55 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:55.489820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:55.490518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:55.505812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:55.506768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:55.516152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:55.517042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:55.517615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:55.518114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:55.644928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:55.656843 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f546cf61-d590-449b-a2c2-d8a3a5b087ca tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1273 microversion: 2.1 time: 0.171639 Aug 30 03:32:55.658163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1026/2062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:55 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:55.665973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:55.666961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:55.681813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:55.683587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:55.684357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:55.688638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:55.691720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:55.692916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:56.655546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:56.664363 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6dcc6395-d3c0-4fd1-ad4a-ffa6a29bb102 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 1.003902 Aug 30 03:32:56.679164 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1027/2063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:55 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:56.688228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e389d95-575e-4989-baf2-53fbf42b3baf tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d4a5e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:56.789577 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e389d95-575e-4989-baf2-53fbf42b3baf tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.105998 Aug 30 03:32:56.795034 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1028/2064] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:56 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:56.830589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:56.831467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:56.849299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:56.851708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:56.854777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:56.858319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:56.863050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:56.863781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:57.132641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:57.159906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3de2182c-675b-4fce-8bfa-99d357bf3209 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1279 microversion: 2.1 time: 0.356622 Aug 30 03:32:57.160821 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1029/2065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:56 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1279 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:57.204565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-82aff603-eaa5-4344-9977-cb536d12aba4 req-b9af7152-30aa-48fb-8e26-f79427fa53a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "name": "network-vif-plugged", "status": "completed", "tag": "9cc78094-42b9-412b-b417-29d0e6781af7"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:57.242590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-82aff603-eaa5-4344-9977-cb536d12aba4 req-b9af7152-30aa-48fb-8e26-f79427fa53a0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:57.244275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-82aff603-eaa5-4344-9977-cb536d12aba4 req-b9af7152-30aa-48fb-8e26-f79427fa53a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:57.244741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-82aff603-eaa5-4344-9977-cb536d12aba4 req-b9af7152-30aa-48fb-8e26-f79427fa53a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:57.277161 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-82aff603-eaa5-4344-9977-cb536d12aba4 req-b9af7152-30aa-48fb-8e26-f79427fa53a0 service nova] Creating event network-vif-plugged:9cc78094-42b9-412b-b417-29d0e6781af7 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:32:57.288752 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-82aff603-eaa5-4344-9977-cb536d12aba4 req-b9af7152-30aa-48fb-8e26-f79427fa53a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110002 Aug 30 03:32:57.291882 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1030/2066] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:57.694373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:57.705136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:57.745212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:57.750358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:57.752981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:57.759285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:57.762775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:57.764998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:58.243511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:58.285276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-93521d07-cc60-467f-91ee-dfda9e697edb tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.602070 Aug 30 03:32:58.287751 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1031/2067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:57 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:32:58.305716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8ce19df-ffe1-43fc-8e12-846bfc9fdd2a tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d2b1f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:58.389663 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8ce19df-ffe1-43fc-8e12-846bfc9fdd2a tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.098141 Aug 30 03:32:58.392870 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1032/2068] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:32:58 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:58.414433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:58.417888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:58.441782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:58.442564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:58.443645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:58.450434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:58.452889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:58.455640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:59.061051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:59.101574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-924479a7-13b9-417d-87d3-79b53ceb1c1a tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 2417 microversion: 2.25 time: 0.706053 Aug 30 03:32:59.124960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1033/2069] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:32:58 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 2417 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:32:59.131229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:32:59.132211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:59.140896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:59.144177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:59.144820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:59.150767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:59.151437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:59.152025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:59.258210 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bdbd7a29-4b07-472f-bd2e-92537ae82df6 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.778898 Aug 30 03:32:59.258820 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1037/2070] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:32:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:32:59.274618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": "auto"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:32:59.281104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:32:59.298251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:59.298751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:59.301764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:59.304630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:32:59.305506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:32:59.306254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:32:59.364879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'flavor' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:32:59.399111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Going to try to live migrate instance to n-h1-854924-5 {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:32:59.830683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:32:59.842611 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-366bac99-aee9-45ea-938e-783cc1bcecf4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.716206 Aug 30 03:32:59.845510 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1034/2071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:32:59 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:32:59.853049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e587aec-5a67-4956-826a-2b3e8bf5b660 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Calling method '.version_select at 0x7f8983d54ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:00.906599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:01.769820 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21e6a1fe-576c-4032-8a57-468a307217c1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/action" status: 202 len: 0 microversion: 2.25 time: 2.502080 Aug 30 03:33:01.774809 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1038/2072] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:32:59 2022] POST /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/action => generated 0 bytes in 2515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:01.787299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:01.788395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:01.801051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:01.801645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:01.816740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:01.817959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:01.818807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:01.820133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:02.572157 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e587aec-5a67-4956-826a-2b3e8bf5b660 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815" status: 202 len: 0 microversion: 2.1 time: 2.725084 Aug 30 03:33:02.573859 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1035/2073] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:32:59 2022] DELETE /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815 => generated 0 bytes in 2728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:33:02.580604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fca1789e-0e0c-41e3-8175-491227f615c9 req-2253b8cc-2f25-461a-ad82-78b69162e0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "name": "network-vif-plugged", "status": "completed", "tag": "81daf264-bb37-4854-82fd-8e248d00e2d6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:02.594315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:02.606992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fca1789e-0e0c-41e3-8175-491227f615c9 req-2253b8cc-2f25-461a-ad82-78b69162e0a2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:02.607814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fca1789e-0e0c-41e3-8175-491227f615c9 req-2253b8cc-2f25-461a-ad82-78b69162e0a2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:02.608467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fca1789e-0e0c-41e3-8175-491227f615c9 req-2253b8cc-2f25-461a-ad82-78b69162e0a2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:02.611028 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10b8ba4c-4cab-49b7-ae22-7e90fe7e0f0d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.832624 Aug 30 03:33:02.627120 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1039/2074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:01 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:02.634266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a50f736e-709e-4884-af88-658a1fd2dc2a tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b982160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:02.647966 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fca1789e-0e0c-41e3-8175-491227f615c9 req-2253b8cc-2f25-461a-ad82-78b69162e0a2 service nova] Creating event network-vif-plugged:81daf264-bb37-4854-82fd-8e248d00e2d6 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:33:02.664245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fca1789e-0e0c-41e3-8175-491227f615c9 req-2253b8cc-2f25-461a-ad82-78b69162e0a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085240 Aug 30 03:33:02.665026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1036/2075] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:02.685053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:02.686231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:02.694474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:02.695356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:02.696016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:02.696978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:02.697811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:02.698691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:02.710652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a50f736e-709e-4884-af88-658a1fd2dc2a tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.081674 Aug 30 03:33:02.711785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1040/2076] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:02 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:02.722317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:02.726147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:02.744977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:02.745800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:02.746240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:02.747062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:02.747513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:02.747932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:03.633152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:03.642929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49d48660-d75e-4703-bdaa-9aafec8b42e1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.976443 Aug 30 03:33:03.649216 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1037/2077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:02 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:03.665133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fdc6958a-c255-4c47-b8e5-e264f2aeb1a3 req-52c2f5cc-4bc1-48ab-8e95-490215a72036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3128b88b-1c97-43a5-91d6-c14a3a5a721b", "tag": "db20af0d-1da9-49f1-b358-5470eecbe884"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:03.683763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fdc6958a-c255-4c47-b8e5-e264f2aeb1a3 req-52c2f5cc-4bc1-48ab-8e95-490215a72036 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:03.684278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fdc6958a-c255-4c47-b8e5-e264f2aeb1a3 req-52c2f5cc-4bc1-48ab-8e95-490215a72036 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:03.684704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fdc6958a-c255-4c47-b8e5-e264f2aeb1a3 req-52c2f5cc-4bc1-48ab-8e95-490215a72036 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:03.709919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fdc6958a-c255-4c47-b8e5-e264f2aeb1a3 req-52c2f5cc-4bc1-48ab-8e95-490215a72036 service nova] Creating event network-changed:db20af0d-1da9-49f1-b358-5470eecbe884 for instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b on n-h2-854924-5 Aug 30 03:33:03.717574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fdc6958a-c255-4c47-b8e5-e264f2aeb1a3 req-52c2f5cc-4bc1-48ab-8e95-490215a72036 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066695 Aug 30 03:33:03.718172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1038/2078] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:03.724718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:03.725260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a92fceb-a473-4e11-b948-d2482bddce47 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Calling method '.version_select at 0x7f897be06040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:03.741374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:03.743164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:03.746278 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-864f41c6-665f-498e-a2de-43ae0af88d7b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 1.033379 Aug 30 03:33:03.747502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1041/2079] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:02 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:03.757792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:03.763458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:03.780528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:03.781833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:03.783086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:03.783974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:03.784602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:03.785699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:03.888593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:03.890714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-1a92fceb-a473-4e11-b948-d2482bddce47 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP db586894-1f38-4bee-8757-382baf7f4815 could not be found", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:33:03.891373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-1a92fceb-a473-4e11-b948-d2482bddce47 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] HTTP exception thrown: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a92fceb-a473-4e11-b948-d2482bddce47 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Request method failure captured: Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815 HTTP/1.1 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYTbR3yo_Dh_LogTt9F2tv8cgZERlxsZ42ofB3-o92g7g6F2RZxFcAqlLckAQiAvN47gDbdgznvr-jRhc3yYZeVIwnGLzZkHHqPmQlbJXL36HmnAXhqFiiC0h3M2mlut7X4NP5Z4I4BpSKvIIcC0JoqctMS4keaDhZM0bzmpJVH3Ea4 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f35216114ce841459fdde6afb4ff15cf Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsTestJSON-294057097 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f35216114ce841459fdde6afb4ff15cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f35216114ce841459fdde6afb4ff15cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f35216114ce841459fdde6afb4ff15cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f35216114ce841459fdde6afb4ff15cf"}]}] Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsTestJSON-294057097 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f35216114ce841459fdde6afb4ff15cf Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsTestJSON-294057097 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsTestJSON-294057097-project Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ede809d81e29421bb40b474d1c894bf4 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsTestJSON-294057097-project Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: exception: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'db586894-1f38-4bee-8757-382baf7f4815'} Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP db586894-1f38-4bee-8757-382baf7f4815 could not be found Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ba75afc-4991-4736-b711-17585744f331'] Aug 30 03:33:03.894207 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815. Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a92fceb-a473-4e11-b948-d2482bddce47 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Returning 404 to user: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a92fceb-a473-4e11-b948-d2482bddce47 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815" status: 404 len: 111 microversion: 2.1 time: 0.174924 Aug 30 03:33:03.899343 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1039/2080] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:33:03 2022] GET /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:03.901557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5a4d1ca-06f2-4c67-9b3f-7d5e59a16e43 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b11aaf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:03.914844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:03.993876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d5a4d1ca-06f2-4c67-9b3f-7d5e59a16e43 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.094921 Aug 30 03:33:04.003679 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1040/2081] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:03 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:04.010837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63df8cc8-534b-43a8-9fcf-f6e674617523 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Calling method '.version_select at 0x7f897b16b4c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:04.150201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-63df8cc8-534b-43a8-9fcf-f6e674617523 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP db586894-1f38-4bee-8757-382baf7f4815 could not be found", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:33:04.150896 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-63df8cc8-534b-43a8-9fcf-f6e674617523 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] HTTP exception thrown: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63df8cc8-534b-43a8-9fcf-f6e674617523 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Request method failure captured: Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815 HTTP/1.1 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYTbR3yo_Dh_LogTt9F2tv8cgZERlxsZ42ofB3-o92g7g6F2RZxFcAqlLckAQiAvN47gDbdgznvr-jRhc3yYZeVIwnGLzZkHHqPmQlbJXL36HmnAXhqFiiC0h3M2mlut7X4NP5Z4I4BpSKvIIcC0JoqctMS4keaDhZM0bzmpJVH3Ea4 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f35216114ce841459fdde6afb4ff15cf Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsTestJSON-294057097 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f35216114ce841459fdde6afb4ff15cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f35216114ce841459fdde6afb4ff15cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f35216114ce841459fdde6afb4ff15cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f35216114ce841459fdde6afb4ff15cf"}]}] Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsTestJSON-294057097 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f35216114ce841459fdde6afb4ff15cf Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsTestJSON-294057097 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsTestJSON-294057097-project Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ede809d81e29421bb40b474d1c894bf4 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsTestJSON-294057097-project Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: exception: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'db586894-1f38-4bee-8757-382baf7f4815'} Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP db586894-1f38-4bee-8757-382baf7f4815 could not be found Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e236fb08-1a17-4a12-a090-78c18656e13f'] Aug 30 03:33:04.152758 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815. Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63df8cc8-534b-43a8-9fcf-f6e674617523 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] Returning 404 to user: Floating IP not found for ID db586894-1f38-4bee-8757-382baf7f4815 {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63df8cc8-534b-43a8-9fcf-f6e674617523 tempest-FloatingIPsTestJSON-294057097 tempest-FloatingIPsTestJSON-294057097-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815" status: 404 len: 111 microversion: 2.1 time: 0.148615 Aug 30 03:33:04.156022 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1041/2082] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:33:04 2022] DELETE /compute/v2.1/os-floating-ips/db586894-1f38-4bee-8757-382baf7f4815 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:04.211622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:04.220251 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f58ed80-7959-4b56-b1e1-ee5775cc6d0b tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1333 microversion: 2.1 time: 0.471259 Aug 30 03:33:04.227309 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1042/2083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:03 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1333 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:04.672688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:04.673412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:04.682175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8aa5e353-24f2-4de9-825a-236542d39c9b req-f498f61b-1194-45d6-beb1-98e90e9cb399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "name": "network-vif-plugged", "status": "completed", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:04.695390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:04.696586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:04.703856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:04.704370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:04.704816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:04.705578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:04.706032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:04.706457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:04.709361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8aa5e353-24f2-4de9-825a-236542d39c9b req-f498f61b-1194-45d6-beb1-98e90e9cb399 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:04.709839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8aa5e353-24f2-4de9-825a-236542d39c9b req-f498f61b-1194-45d6-beb1-98e90e9cb399 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:04.710264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8aa5e353-24f2-4de9-825a-236542d39c9b req-f498f61b-1194-45d6-beb1-98e90e9cb399 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:04.745452 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8aa5e353-24f2-4de9-825a-236542d39c9b req-f498f61b-1194-45d6-beb1-98e90e9cb399 service nova] Creating event network-vif-plugged:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:33:04.755921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8aa5e353-24f2-4de9-825a-236542d39c9b req-f498f61b-1194-45d6-beb1-98e90e9cb399 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077447 Aug 30 03:33:04.756564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1043/2084] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:04.771011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:04.772513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:04.785188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:04.786167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:04.786914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:04.788484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:04.789171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:04.789926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:05.298379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:05.316960 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a440ad69-93e5-4d17-9b01-1952ca188f3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.648581 Aug 30 03:33:05.317769 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1042/2085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:04 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:05.333453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dfb6d5d3-fa5d-48cf-82df-0234430a7319 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b16b700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:05.397378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:05.404596 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dfb6d5d3-fa5d-48cf-82df-0234430a7319 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.085602 Aug 30 03:33:05.405176 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1043/2086] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:05 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:05.411457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:05.412071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:05.413116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:05.414761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:05.422620 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23d8d9c5-106f-4020-8eb7-a7e6c9f80af9 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.656013 Aug 30 03:33:05.423733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1044/2087] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:04 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:05.437041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:05.440144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:05.440635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:05.441477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:05.441950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:05.442379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.323279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:06.342302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:06.342963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:06.350298 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-91c3e95c-4717-44de-af38-69ab614e4261 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1669 microversion: 2.1 time: 0.925660 Aug 30 03:33:06.352114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:06.352605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:06.353033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.353768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:06.354222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:06.354642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.373761 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1044/2088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:05 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1669 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:06.386663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:06.387451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:06.396297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:06.405689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:06.406370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.407295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:06.407900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:06.408468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.484125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bdf3fe80-24d0-4a1f-858f-e314973ac5ad tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89/ips" status: 200 len: 180 microversion: 2.1 time: 0.103339 Aug 30 03:33:06.484717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1045/2089] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:33:06 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89/ips => generated 180 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:06.516062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2d0fa53-b57e-454e-8fdc-41ce844c8ac3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897be06040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:06.621825 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2d0fa53-b57e-454e-8fdc-41ce844c8ac3 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.112073 Aug 30 03:33:06.622455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1046/2090] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:06 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:06.627626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:06.641496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:06.648547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:06.649266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:06.651176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.652147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:06.661638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:06.662337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:06.996397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:07.046809 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-196e72bc-a8fb-4e53-892b-c365f4da2846 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.708357 Aug 30 03:33:07.047931 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1045/2091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:06 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:07.067751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:07.069125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:07.089143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:07.095953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:07.096871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:07.097852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:07.098524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:07.100209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:07.145601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:33:07.247924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:07.260454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:07.273294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:07.274733 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29051c19-059b-481f-b539-5d5f71aafa2d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.651071 Aug 30 03:33:07.275549 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1047/2092] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:06 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:07.344095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-39e19945-193f-416b-a9b9-ca020abc1931 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 204 len: 0 microversion: 2.1 time: 0.294734 Aug 30 03:33:07.358601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1046/2093] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:33:07 2022] DELETE /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:07.370868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:07.371331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:07.386117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:07.386616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:07.388305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:07.389048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:07.389537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:07.389962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:07.396263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:07.638489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee101a1d-22a7-458e-a648-b6f2411dc231 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b982430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:07.721569 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee101a1d-22a7-458e-a648-b6f2411dc231 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.086471 Aug 30 03:33:07.722639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1047/2094] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:07 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:07.886716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:07.918024 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-914ba571-9ef4-49de-b047-e5635d6e1fa6 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1675 microversion: 2.1 time: 0.551547 Aug 30 03:33:07.919459 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1048/2095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:07 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1675 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:08.089006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:08.093098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:08.116919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:08.118636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:08.120013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:08.121442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:08.122082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:08.123261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:08.304389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:08.305240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:08.315006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:08.319852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:08.320669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:08.321609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:08.322224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:08.322831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:09.041008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:09.050938 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35999985-44a1-47f6-a944-c47a05c6f7ee tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.985030 Aug 30 03:33:09.056068 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1048/2096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:08 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:09.069922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e7c9969-66d9-4c4c-b1ec-4dd855bd516c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897bab1f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:09.076042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:09.099196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:09.100973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:09.102811 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d9bef2f-3790-48d5-a69b-4323b58b3118 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.802509 Aug 30 03:33:09.116918 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1049/2097] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:08 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:09.130620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:09.131743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:09.149096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:09.151892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:09.152399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:09.153221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:09.156871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:09.157586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:09.216976 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e7c9969-66d9-4c4c-b1ec-4dd855bd516c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.159644 Aug 30 03:33:09.218050 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1049/2098] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:09 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:10.081204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:10.081973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:10.094422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:10.094928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:10.095370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:10.096098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:10.096558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:10.096985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:10.152513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:10.189326 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-00ead6c4-646a-4c7b-8f83-64515b00203c tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1675 microversion: 2.1 time: 1.062842 Aug 30 03:33:10.211867 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1050/2099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:09 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1675 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:10.222698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:10.223564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:10.232551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:10.233963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:10.234675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:10.235624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:10.236486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:10.237585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:10.860609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:10.880055 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f731c428-7a17-4d3f-8435-145a8dde3f41 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.803210 Aug 30 03:33:10.905092 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1050/2100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:10 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:10.914703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b417492b-a82b-4be7-99e7-e219064d1e6e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f898029e160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:10.937308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:10.958393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:10.960404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:10.966325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cdc51e7a-414c-487d-92b6-195ee724c16e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.751787 Aug 30 03:33:10.967241 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1051/2101] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:10 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:11.056300 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b417492b-a82b-4be7-99e7-e219064d1e6e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.160814 Aug 30 03:33:11.057376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1051/2102] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:10 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:11.106315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c13a023d-9486-473a-b469-b063e2e37dcc req-27dc48e2-a358-4721-8961-d6e346f6db17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "name": "network-vif-deleted", "tag": "9cc78094-42b9-412b-b417-29d0e6781af7"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:11.128763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c13a023d-9486-473a-b469-b063e2e37dcc req-27dc48e2-a358-4721-8961-d6e346f6db17 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:11.133909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c13a023d-9486-473a-b469-b063e2e37dcc req-27dc48e2-a358-4721-8961-d6e346f6db17 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:11.140128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c13a023d-9486-473a-b469-b063e2e37dcc req-27dc48e2-a358-4721-8961-d6e346f6db17 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:11.170689 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c13a023d-9486-473a-b469-b063e2e37dcc req-27dc48e2-a358-4721-8961-d6e346f6db17 service nova] Creating event network-vif-deleted:9cc78094-42b9-412b-b417-29d0e6781af7 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:33:11.181949 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c13a023d-9486-473a-b469-b063e2e37dcc req-27dc48e2-a358-4721-8961-d6e346f6db17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080733 Aug 30 03:33:11.189249 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1052/2103] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:11.221637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:11.222426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:11.232748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:11.236611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:11.237672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:11.238549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:11.242055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:11.242843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:11.305170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:11.321277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5a2fa098-cfb5-47ff-bc90-04ff659b0a5e req-9de6a619-dd05-4753-9a99-861f2615c234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3128b88b-1c97-43a5-91d6-c14a3a5a721b", "name": "network-vif-plugged", "status": "completed", "tag": "db20af0d-1da9-49f1-b358-5470eecbe884"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:11.359631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a2fa098-cfb5-47ff-bc90-04ff659b0a5e req-9de6a619-dd05-4753-9a99-861f2615c234 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:11.360510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a2fa098-cfb5-47ff-bc90-04ff659b0a5e req-9de6a619-dd05-4753-9a99-861f2615c234 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:11.361058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a2fa098-cfb5-47ff-bc90-04ff659b0a5e req-9de6a619-dd05-4753-9a99-861f2615c234 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:11.400136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5a2fa098-cfb5-47ff-bc90-04ff659b0a5e req-9de6a619-dd05-4753-9a99-861f2615c234 service nova] Creating event network-vif-plugged:db20af0d-1da9-49f1-b358-5470eecbe884 for instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b on n-h2-854924-5 Aug 30 03:33:11.426556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5a2fa098-cfb5-47ff-bc90-04ff659b0a5e req-9de6a619-dd05-4753-9a99-861f2615c234 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113660 Aug 30 03:33:11.427834 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1053/2104] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:11.918696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:11.919686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:11.931519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:11.940168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:11.940978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:11.942012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:11.942683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:11.943330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:12.702236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:12.722483 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46649788-8107-427c-8eef-ec0433dbd2fc tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1496 microversion: 2.1 time: 1.502805 Aug 30 03:33:12.723932 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1052/2105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:11 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1496 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:12.741749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:12.743260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:12.755769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:12.762702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:12.763383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:12.764638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:12.765265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:12.765837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:12.819942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:12.838286 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9dcfd055-a664-4991-bd2b-010723b63b76 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1321 microversion: 2.1 time: 0.923933 Aug 30 03:33:12.848569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1054/2106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:11 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1321 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:12.862431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2d1c031a-0b27-4ab2-9426-c97d7dc86463 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b1b3a60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:12.949858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2d1c031a-0b27-4ab2-9426-c97d7dc86463 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.098956 Aug 30 03:33:12.950784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1055/2107] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:12 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:13.235150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:13.238776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6a244d5c-90b2-4b85-8fbb-012702141d75 req-ec3229f6-d940-42e5-b57d-0a1336c6edba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "name": "network-vif-deleted", "tag": "81daf264-bb37-4854-82fd-8e248d00e2d6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:13.258116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:13.272791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:13.281752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:13.281954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-299bc2cb-8d76-4520-aead-295d79951efa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.554185 Aug 30 03:33:13.283310 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1053/2108] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:12 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:13.306960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6a244d5c-90b2-4b85-8fbb-012702141d75 req-ec3229f6-d940-42e5-b57d-0a1336c6edba service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.307466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6a244d5c-90b2-4b85-8fbb-012702141d75 req-ec3229f6-d940-42e5-b57d-0a1336c6edba service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.314961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6a244d5c-90b2-4b85-8fbb-012702141d75 req-ec3229f6-d940-42e5-b57d-0a1336c6edba service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.356139 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6a244d5c-90b2-4b85-8fbb-012702141d75 req-ec3229f6-d940-42e5-b57d-0a1336c6edba service nova] Creating event network-vif-deleted:81daf264-bb37-4854-82fd-8e248d00e2d6 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:33:13.385495 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6a244d5c-90b2-4b85-8fbb-012702141d75 req-ec3229f6-d940-42e5-b57d-0a1336c6edba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151020 Aug 30 03:33:13.386113 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1056/2109] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:13.547539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-098ae475-263c-4049-929d-73b7a20f9ccb req-0fede89a-a5b8-410b-afe4-01fb4a655db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2963f8-03bc-4345-a969-fede4cdb3b89", "name": "network-vif-unplugged", "status": "completed", "tag": "81daf264-bb37-4854-82fd-8e248d00e2d6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:13.574000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-098ae475-263c-4049-929d-73b7a20f9ccb req-0fede89a-a5b8-410b-afe4-01fb4a655db4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.580554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-098ae475-263c-4049-929d-73b7a20f9ccb req-0fede89a-a5b8-410b-afe4-01fb4a655db4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.581274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-098ae475-263c-4049-929d-73b7a20f9ccb req-0fede89a-a5b8-410b-afe4-01fb4a655db4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.633072 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-098ae475-263c-4049-929d-73b7a20f9ccb req-0fede89a-a5b8-410b-afe4-01fb4a655db4 service nova] Creating event network-vif-unplugged:81daf264-bb37-4854-82fd-8e248d00e2d6 for instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 on n-h2-854924-5 Aug 30 03:33:13.647560 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-098ae475-263c-4049-929d-73b7a20f9ccb req-0fede89a-a5b8-410b-afe4-01fb4a655db4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104042 Aug 30 03:33:13.657655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1054/2110] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:13.750263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:13.751221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:13.790934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.791840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.792433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.794536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.802286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.803001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.874141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:13.875667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:13.891068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.894073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.894853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.904655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.905568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.906523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.951089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:13.954946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:13.955484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:13.955959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lazy-loading 'fault' on Instance uuid 8b2963f8-03bc-4345-a969-fede4cdb3b89 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:14.308377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d26d112e044244b16a6e41093a3ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b1a03c37eb24082bfd84f9e5da2e86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:14.318728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca904a46-d70e-4133-947e-b5396214e861 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 200 len: 1302 microversion: 2.1 time: 0.573519 Aug 30 03:33:14.319314 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1057/2111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:13 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 1302 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:14.337391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc342058-85ab-45f3-8c5d-9274f17b61b7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b1feca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:14.370738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:14.380858 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-070b7e8a-3f15-4bb5-9872-d853059e9628 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1502 microversion: 2.1 time: 0.512199 Aug 30 03:33:14.405520 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1055/2112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:13 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1502 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:14.417431 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc342058-85ab-45f3-8c5d-9274f17b61b7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.096242 Aug 30 03:33:14.419489 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1058/2113] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:14 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:14.419622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:14.420178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:14.432245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:14.433065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:14.441721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:14.442610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:14.443374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:14.444419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:14.445114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:14.445842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:14.451124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:14.451629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:14.452080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:14.452800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:14.453458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:14.454029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:14.727104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:14.748358 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b51ebf60-232e-4bbf-8b91-df11af28f5c0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1502 microversion: 2.1 time: 0.325999 Aug 30 03:33:14.750506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1059/2114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:14 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:14.774129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:14.775551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:14.790335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:14.794088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:14.794765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:14.797301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:14.797812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:14.802561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:14.848393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:14.861791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:14.864864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:14.866514 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6465021e-c092-4d1c-87f1-bb34bcf22b2e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.459868 Aug 30 03:33:14.867268 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1056/2115] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:14 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:14.893742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:33:15.054728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-804248f1-de2c-4aa0-a735-58a2da87a0b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 204 len: 0 microversion: 2.1 time: 0.283278 Aug 30 03:33:15.056333 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1060/2116] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:33:14 2022] DELETE /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:15.068449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:15.069894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:15.079117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:15.079968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:15.081003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:15.082195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:15.083932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:15.085866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:15.343542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:15.344505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:15.355522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:15.356945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:15.358694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:15.360801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:15.361846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:15.363143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:15.394543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] HTTP exception thrown: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:15.401321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Request method failure captured: Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 HTTP/1.1 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRnGtaRLOXs8K8wQYIUSqNJqeatVZF4YmIPD53K1F1VmCBrYSOALLpiwK0LX5KQ_R01TtAoqI4E8PoGFwrOcMkkQWYYd-I4gUIhZf8fNmp10kf48R-EsrCwGq1G9pPtKrOJjx-yAv2G3nP7QMVGBbyHpUkYD0tO73dSwb9UIo4a7eY Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b1a03c37eb24082bfd84f9e5da2e86e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}] Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15d26d112e044244b16a6e41093a3ebd Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '8b2963f8-03bc-4345-a969-fede4cdb3b89'} Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:15.408660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:15.413037 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:15.414349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Returning 404 to user: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:15.417054 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48b13a3c-6ec1-4cfb-84e9-52b262db8b9d tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 404 len: 111 microversion: 2.1 time: 0.079771 Aug 30 03:33:15.421210 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1061/2117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:15 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:15.424364 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-516e7ca8-c9d2-4d4a-9eda-f200f3020eea tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1508 microversion: 2.1 time: 0.360452 Aug 30 03:33:15.429452 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1057/2118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:15 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1508 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:15.435798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca1b579b-3265-44fb-906c-e7fbe5048abf tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b1f7ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:15.510119 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca1b579b-3265-44fb-906c-e7fbe5048abf tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.080745 Aug 30 03:33:15.514824 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1062/2119] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:15 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:15.897454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:15.898082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:15.916647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:15.922462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:15.924735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:15.933271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:15.935030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:15.945131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:16.452295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:16.454183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:16.473328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:16.474166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:16.474838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:16.475736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:16.476545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:16.477172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:16.501871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:16.520782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:16.531491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:16.532359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4ef5666-7f49-4008-a8d2-0b023b24b4f8 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.640566 Aug 30 03:33:16.550375 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1058/2120] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:15 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:16.575154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1f46d6c-58d9-412e-ac0a-83b7e2c16577 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897bcca430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:16.672684 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1f46d6c-58d9-412e-ac0a-83b7e2c16577 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.120945 Aug 30 03:33:16.677968 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1059/2121] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:16 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:17.561923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:17.563287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:17.590933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:17.591994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:17.592449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:17.593189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:17.593677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:17.594109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:17.770577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:17.781958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77310beb-bb02-4ea9-81a3-be0a270269c1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1508 microversion: 2.1 time: 1.335000 Aug 30 03:33:17.794063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1063/2122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:16 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1508 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:17.806294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2579a2d6-6867-47c9-be15-864d7c5b5f75 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b237ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:17.872751 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2579a2d6-6867-47c9-be15-864d7c5b5f75 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1427 microversion: 2.1 time: 0.077417 Aug 30 03:33:17.881085 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1064/2123] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:17 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:17.922058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:17.942412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:17.945283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:17.951298 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c1be710b-c120-4b30-9f0b-61660ac384e2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.394751 Aug 30 03:33:17.952910 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1060/2124] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:17 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:33:18.462801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d51c8306-315a-4775-a5b2-10e41344b6c1 req-dba96a2b-29d5-4f4f-b74a-9f22be5844c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3128b88b-1c97-43a5-91d6-c14a3a5a721b", "name": "network-vif-deleted", "tag": "db20af0d-1da9-49f1-b358-5470eecbe884"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:18.482286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d51c8306-315a-4775-a5b2-10e41344b6c1 req-dba96a2b-29d5-4f4f-b74a-9f22be5844c0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:18.483218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d51c8306-315a-4775-a5b2-10e41344b6c1 req-dba96a2b-29d5-4f4f-b74a-9f22be5844c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:18.483685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d51c8306-315a-4775-a5b2-10e41344b6c1 req-dba96a2b-29d5-4f4f-b74a-9f22be5844c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:18.506648 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d51c8306-315a-4775-a5b2-10e41344b6c1 req-dba96a2b-29d5-4f4f-b74a-9f22be5844c0 service nova] Creating event network-vif-deleted:db20af0d-1da9-49f1-b358-5470eecbe884 for instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b on n-h2-854924-5 Aug 30 03:33:18.516745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d51c8306-315a-4775-a5b2-10e41344b6c1 req-dba96a2b-29d5-4f4f-b74a-9f22be5844c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058960 Aug 30 03:33:18.521626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1065/2125] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:18.811091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:18.812472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:18.823706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:18.825697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:18.826314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:18.827334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:18.827937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:18.828543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:18.873237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:18.873792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:18.874231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:18.874807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lazy-loading 'fault' on Instance uuid 3128b88b-1c97-43a5-91d6-c14a3a5a721b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:18.890332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f8dda95-f10b-493c-ac55-2c77ddcda472 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f897b11f0d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:18.966288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:18.968998 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f8dda95-f10b-493c-ac55-2c77ddcda472 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1436 microversion: 2.1 time: 0.084098 Aug 30 03:33:18.969832 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1066/2126] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:18 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1436 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:18.978965 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8bfda73-e64a-4d69-8cad-5da8b7770159 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 200 len: 1311 microversion: 2.1 time: 0.174045 Aug 30 03:33:18.979579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1061/2127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:18 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:18.992516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:18.993386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:19.006186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4bbb41d1-68a8-4bad-8d96-2eb60ea9534a tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d45d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.007741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.011026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.011669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.014716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.016247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.017130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.089267 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4bbb41d1-68a8-4bad-8d96-2eb60ea9534a tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 200 len: 1436 microversion: 2.1 time: 0.097114 Aug 30 03:33:19.099357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1067/2128] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:18 2022] GET /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 1436 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:19.106974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.108022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:19.115235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.116196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.116816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.118623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.119286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.120004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.350878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:19.382454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:19.393304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:19.394677 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16c72fe8-451b-424d-b717-5c52751f2b97 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.414013 Aug 30 03:33:19.398017 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1062/2129] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:18 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:19.431135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:19.444329 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56eee705-b041-4c9a-b138-b87cc400189b tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1467 microversion: 2.1 time: 0.342782 Aug 30 03:33:19.444329 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1068/2130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:19 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1467 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:19.471248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-187a9a64-bfa4-4026-a592-f0d4bfea1882 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983d32820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.509875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.510505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:19.525628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.526309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.526924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.530116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.531004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.531510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.563012 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] HTTP exception thrown: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Request method failure captured: Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 HTTP/1.1 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRnGtaRLOXs8K8wQYIUSqNJqeatVZF4YmIPD53K1F1VmCBrYSOALLpiwK0LX5KQ_R01TtAoqI4E8PoGFwrOcMkkQWYYd-I4gUIhZf8fNmp10kf48R-EsrCwGq1G9pPtKrOJjx-yAv2G3nP7QMVGBbyHpUkYD0tO73dSwb9UIo4a7eY Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b1a03c37eb24082bfd84f9e5da2e86e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}] Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15d26d112e044244b16a6e41093a3ebd Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '8b2963f8-03bc-4345-a969-fede4cdb3b89'} Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:19.571189 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.576023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.578836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Returning 404 to user: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:19.579831 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8fe204df-58d7-4beb-b04c-5518272fb265 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 404 len: 111 microversion: 2.1 time: 0.074486 Aug 30 03:33:19.582371 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1069/2131] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:33:19 2022] DELETE /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:19.607037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.607816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 8b2963f8-03bc-4345-a969-fede4cdb3b89] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:19.615791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.618511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.619489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.620251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.620722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.621192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.644264 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] HTTP exception thrown: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Request method failure captured: Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 HTTP/1.1 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRnGtaRLOXs8K8wQYIUSqNJqeatVZF4YmIPD53K1F1VmCBrYSOALLpiwK0LX5KQ_R01TtAoqI4E8PoGFwrOcMkkQWYYd-I4gUIhZf8fNmp10kf48R-EsrCwGq1G9pPtKrOJjx-yAv2G3nP7QMVGBbyHpUkYD0tO73dSwb9UIo4a7eY Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b1a03c37eb24082bfd84f9e5da2e86e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}] Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15d26d112e044244b16a6e41093a3ebd Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '8b2963f8-03bc-4345-a969-fede4cdb3b89'} Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.646869 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.651205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Returning 404 to user: Instance 8b2963f8-03bc-4345-a969-fede4cdb3b89 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:19.652349 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b56cb7a-3a11-4dee-83bf-49bf8cb499e4 tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89" status: 404 len: 111 microversion: 2.1 time: 0.053097 Aug 30 03:33:19.656813 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1070/2132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:19 2022] GET /compute/v2.1/servers/8b2963f8-03bc-4345-a969-fede4cdb3b89 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:33:19.662899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.663468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:19.673989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.677625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.678285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.679094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.679619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.680111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.695789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] HTTP exception thrown: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Request method failure captured: Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce HTTP/1.1 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRnGtaRLOXs8K8wQYIUSqNJqeatVZF4YmIPD53K1F1VmCBrYSOALLpiwK0LX5KQ_R01TtAoqI4E8PoGFwrOcMkkQWYYd-I4gUIhZf8fNmp10kf48R-EsrCwGq1G9pPtKrOJjx-yAv2G3nP7QMVGBbyHpUkYD0tO73dSwb9UIo4a7eY Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b1a03c37eb24082bfd84f9e5da2e86e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}] Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15d26d112e044244b16a6e41093a3ebd Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '353619ab-a701-4d61-86f5-5f1ad59ac2ce'} Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:19.697431 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Returning 404 to user: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6326a2f6-8221-49cf-851d-cbd9197a416f tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "DELETE /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 404 len: 111 microversion: 2.1 time: 0.040673 Aug 30 03:33:19.702172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1071/2133] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:33:19 2022] DELETE /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:19.707835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:19.708443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] [instance: 353619ab-a701-4d61-86f5-5f1ad59ac2ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:19.714610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.715758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.716187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.716897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:19.717382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:19.717793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:19.734137 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] HTTP exception thrown: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Request method failure captured: Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce HTTP/1.1 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYRnGtaRLOXs8K8wQYIUSqNJqeatVZF4YmIPD53K1F1VmCBrYSOALLpiwK0LX5KQ_R01TtAoqI4E8PoGFwrOcMkkQWYYd-I4gUIhZf8fNmp10kf48R-EsrCwGq1G9pPtKrOJjx-yAv2G3nP7QMVGBbyHpUkYD0tO73dSwb9UIo4a7eY Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b1a03c37eb24082bfd84f9e5da2e86e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b1a03c37eb24082bfd84f9e5da2e86e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b1a03c37eb24082bfd84f9e5da2e86e"}]}] Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4b1a03c37eb24082bfd84f9e5da2e86e Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestMultiNic-489872106 Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 15d26d112e044244b16a6e41093a3ebd Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestMultiNic-489872106-project Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '353619ab-a701-4d61-86f5-5f1ad59ac2ce'} Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:19.735683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] Returning 404 to user: Instance 353619ab-a701-4d61-86f5-5f1ad59ac2ce could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed021577-e887-4e2c-8b52-d2e1077a833e tempest-ServersTestMultiNic-489872106 tempest-ServersTestMultiNic-489872106-project] 10.222.0.30 "GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce" status: 404 len: 111 microversion: 2.1 time: 0.032951 Aug 30 03:33:19.742306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1072/2134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:19 2022] GET /compute/v2.1/servers/353619ab-a701-4d61-86f5-5f1ad59ac2ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:33:20.071165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0406d299-3e81-427a-826b-2ad9e7b0dbec tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Calling method '.version_select at 0x7f8983d2bf70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.106081 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-0406d299-3e81-427a-826b-2ad9e7b0dbec tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0406d299-3e81-427a-826b-2ad9e7b0dbec tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Request method failure captured: Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/images/f0817249-cb4c-4b91-9f6e-1456dac7c47b/metadata/os_distro HTTP/1.1 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYT_NqkK4bxOXVPZlJW1p_RDXf38uyCVl1-WU5mn_yxVxFDJ9RlDhVYqeIfKYxicHqIFb_6QiVuyHFqgNgPdD9W_ZpMJjKfNKaEmBY0elT5-1LbLC04X-6qhlONtxhwss6KSvzcwB7NpqCc2apVSegk52VEyUbKFgKvMw1klDdPtk54 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3fcb34cc41411a95ecb3c475b81c63", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}] Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b294aababf0247f7b77c5de4e2cf8d60 Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'image_id': 'f0817249-cb4c-4b91-9f6e-1456dac7c47b', 'id': 'os_distro'} Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0817249-cb4c-4b91-9f6e-1456dac7c47b Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:20.108850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0817249-cb4c-4b91-9f6e-1456dac7c47b could not be found. Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0406d299-3e81-427a-826b-2ad9e7b0dbec tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0406d299-3e81-427a-826b-2ad9e7b0dbec tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] 10.222.0.30 "DELETE /compute/v2.1/images/f0817249-cb4c-4b91-9f6e-1456dac7c47b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.294782 Aug 30 03:33:20.112552 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1073/2135] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Aug 30 03:33:19 2022] DELETE /compute/v2.1/images/f0817249-cb4c-4b91-9f6e-1456dac7c47b/metadata/os_distro => generated 62 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:20.119384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.119550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:20.129053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:20.129580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:20.130205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:20.131071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:20.131533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:20.132120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:20.149236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b HTTP/1.1 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3128b88b-1c97-43a5-91d6-c14a3a5a721b'} Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.150988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:33:20.155351 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.157467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.158613 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f92c9b95-09ff-4419-8208-d777490b049f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 404 len: 111 microversion: 2.1 time: 0.046022 Aug 30 03:33:20.159827 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1074/2136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:20 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:20.170022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a44b8a31-f5e5-4801-8200-58d8008068a1 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Calling method '.version_select at 0x7f8983d2b9d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.194788 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a44b8a31-f5e5-4801-8200-58d8008068a1 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a44b8a31-f5e5-4801-8200-58d8008068a1 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Request method failure captured: Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/images/c5b8818d-b249-4396-aa52-525892379b0f/metadata/os_version HTTP/1.1 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYT_NqkK4bxOXVPZlJW1p_RDXf38uyCVl1-WU5mn_yxVxFDJ9RlDhVYqeIfKYxicHqIFb_6QiVuyHFqgNgPdD9W_ZpMJjKfNKaEmBY0elT5-1LbLC04X-6qhlONtxhwss6KSvzcwB7NpqCc2apVSegk52VEyUbKFgKvMw1klDdPtk54 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3fcb34cc41411a95ecb3c475b81c63", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}] Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b294aababf0247f7b77c5de4e2cf8d60 Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'image_id': 'c5b8818d-b249-4396-aa52-525892379b0f', 'id': 'os_version'} Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c5b8818d-b249-4396-aa52-525892379b0f Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:20.196937 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5b8818d-b249-4396-aa52-525892379b0f could not be found. Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a44b8a31-f5e5-4801-8200-58d8008068a1 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a44b8a31-f5e5-4801-8200-58d8008068a1 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] 10.222.0.30 "GET /compute/v2.1/images/c5b8818d-b249-4396-aa52-525892379b0f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.037856 Aug 30 03:33:20.201529 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1075/2137] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Aug 30 03:33:20 2022] GET /compute/v2.1/images/c5b8818d-b249-4396-aa52-525892379b0f/metadata/os_version => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:20.207888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b181ef71-c714-4e93-b075-3ee386b86168 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: .version_select at 0x7f897b22f670>, body: {"keypair": {"name": "tempest-key-776622061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYJWimYEPzyu3gWxfUtuP55WcrRBp1jmJnOMiNxbxycn11FrPKPv0FLo46+OgPlyYm/Fk3UIHHZ7ojarbwOK/IkS/c9jXyyBm3CwJWtYJzm5PF7Oqwn960VTJxNMca6WQ=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:20.230931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b181ef71-c714-4e93-b075-3ee386b86168 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:20.236924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b181ef71-c714-4e93-b075-3ee386b86168 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:20.267699 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b181ef71-c714-4e93-b075-3ee386b86168 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.065383 Aug 30 03:33:20.268959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1076/2138] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:33:20 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:20.275529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffa963c7-085f-42e7-b8c2-8efbae0b49b5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Calling method '.version_select at 0x7f8983d2b430>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.304671 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ffa963c7-085f-42e7-b8c2-8efbae0b49b5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffa963c7-085f-42e7-b8c2-8efbae0b49b5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Request method failure captured: Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/images/5894c9a6-bfc1-4a96-9603-b9061a839bbe/metadata HTTP/1.1 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYT_NqkK4bxOXVPZlJW1p_RDXf38uyCVl1-WU5mn_yxVxFDJ9RlDhVYqeIfKYxicHqIFb_6QiVuyHFqgNgPdD9W_ZpMJjKfNKaEmBY0elT5-1LbLC04X-6qhlONtxhwss6KSvzcwB7NpqCc2apVSegk52VEyUbKFgKvMw1klDdPtk54 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3fcb34cc41411a95ecb3c475b81c63", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}] Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b294aababf0247f7b77c5de4e2cf8d60 Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'image_id': '5894c9a6-bfc1-4a96-9603-b9061a839bbe'} Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5894c9a6-bfc1-4a96-9603-b9061a839bbe Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:20.311663 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5894c9a6-bfc1-4a96-9603-b9061a839bbe could not be found. Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffa963c7-085f-42e7-b8c2-8efbae0b49b5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.315144 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffa963c7-085f-42e7-b8c2-8efbae0b49b5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] 10.222.0.30 "GET /compute/v2.1/images/5894c9a6-bfc1-4a96-9603-b9061a839bbe/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043272 Aug 30 03:33:20.325461 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1077/2139] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:33:20 2022] GET /compute/v2.1/images/5894c9a6-bfc1-4a96-9603-b9061a839bbe/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:20.325461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d0b329b-0dd5-452e-9663-8acc88aa6b7a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '.version_select at 0x7f8983d4a790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.327201 n-d-854924-5 devstack@n-api.service[122168]: WARNING oslo_db.sqlalchemy.utils [None req-1d0b329b-0dd5-452e-9663-8acc88aa6b7a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 03:33:20.334380 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d0b329b-0dd5-452e-9663-8acc88aa6b7a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.016948 Aug 30 03:33:20.335215 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1078/2140] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:33:20 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:20.340116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70b0fa3d-ea59-423a-89e1-8180c552e36f tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Action: 'update_all', calling method: .version_select at 0x7f897b11a670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-70b0fa3d-ea59-423a-89e1-8180c552e36f tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70b0fa3d-ea59-423a-89e1-8180c552e36f tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Request method failure captured: Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/images/cffa90e9-b1b2-44a1-b6b9-070c62daabc5/metadata HTTP/1.1 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 57 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYT_NqkK4bxOXVPZlJW1p_RDXf38uyCVl1-WU5mn_yxVxFDJ9RlDhVYqeIfKYxicHqIFb_6QiVuyHFqgNgPdD9W_ZpMJjKfNKaEmBY0elT5-1LbLC04X-6qhlONtxhwss6KSvzcwB7NpqCc2apVSegk52VEyUbKFgKvMw1klDdPtk54 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3fcb34cc41411a95ecb3c475b81c63", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}] Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b294aababf0247f7b77c5de4e2cf8d60 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'image_id': 'cffa90e9-b1b2-44a1-b6b9-070c62daabc5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cffa90e9-b1b2-44a1-b6b9-070c62daabc5 Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 03:33:20.386765 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cffa90e9-b1b2-44a1-b6b9-070c62daabc5 could not be found. Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70b0fa3d-ea59-423a-89e1-8180c552e36f tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.393654 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70b0fa3d-ea59-423a-89e1-8180c552e36f tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] 10.222.0.30 "PUT /compute/v2.1/images/cffa90e9-b1b2-44a1-b6b9-070c62daabc5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052924 Aug 30 03:33:20.402502 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1079/2141] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:33:20 2022] PUT /compute/v2.1/images/cffa90e9-b1b2-44a1-b6b9-070c62daabc5/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:20.402502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a33a47b9-110a-4954-af7c-8343d57d291d tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Action: 'update', calling method: .version_select at 0x7f8983d4ab80>, body: {"meta": {"os_distro": "alt"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:20.455006 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a33a47b9-110a-4954-af7c-8343d57d291d tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a33a47b9-110a-4954-af7c-8343d57d291d tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Request method failure captured: Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/images/3cc706d4-bf99-49b7-8cc3-3ddd20af36b3/metadata/os_distro HTTP/1.1 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 30 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYT_NqkK4bxOXVPZlJW1p_RDXf38uyCVl1-WU5mn_yxVxFDJ9RlDhVYqeIfKYxicHqIFb_6QiVuyHFqgNgPdD9W_ZpMJjKfNKaEmBY0elT5-1LbLC04X-6qhlONtxhwss6KSvzcwB7NpqCc2apVSegk52VEyUbKFgKvMw1klDdPtk54 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3fcb34cc41411a95ecb3c475b81c63", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}] Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b294aababf0247f7b77c5de4e2cf8d60 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: {"meta": {"os_distro": "alt"}} Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'image_id': '3cc706d4-bf99-49b7-8cc3-3ddd20af36b3', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3cc706d4-bf99-49b7-8cc3-3ddd20af36b3 Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:20.457104 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3cc706d4-bf99-49b7-8cc3-3ddd20af36b3 could not be found. Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a33a47b9-110a-4954-af7c-8343d57d291d tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a33a47b9-110a-4954-af7c-8343d57d291d tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] 10.222.0.30 "PUT /compute/v2.1/images/3cc706d4-bf99-49b7-8cc3-3ddd20af36b3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.063455 Aug 30 03:33:20.468385 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1080/2142] 10.222.0.30 () {60 vars in 1310 bytes} [Tue Aug 30 03:33:20 2022] PUT /compute/v2.1/images/3cc706d4-bf99-49b7-8cc3-3ddd20af36b3/metadata/os_distro => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:33:20.475886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.475886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:20.483600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:20.484344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:20.484512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:20.485209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:20.485689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:20.486108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:20.719222 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-187a9a64-bfa4-4026-a592-f0d4bfea1882 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "DELETE /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454" status: 204 len: 0 microversion: 2.1 time: 1.251881 Aug 30 03:33:20.719898 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1063/2143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:19 2022] DELETE /compute/v2.1/images/f10ec519-2ac8-403b-8248-0d267b613454 => generated 0 bytes in 1253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:20.724882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3896e4ba-7639-4a8c-8383-f6ffadfcdae5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Action: 'create', calling method: .version_select at 0x7f897b7f58b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:20.750784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:20.765913 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-3896e4ba-7639-4a8c-8383-f6ffadfcdae5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3896e4ba-7639-4a8c-8383-f6ffadfcdae5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Request method failure captured: Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/images/41004ac7-6cab-446a-bcac-efa7e6537fbe/metadata HTTP/1.1 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 57 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYT_NqkK4bxOXVPZlJW1p_RDXf38uyCVl1-WU5mn_yxVxFDJ9RlDhVYqeIfKYxicHqIFb_6QiVuyHFqgNgPdD9W_ZpMJjKfNKaEmBY0elT5-1LbLC04X-6qhlONtxhwss6KSvzcwB7NpqCc2apVSegk52VEyUbKFgKvMw1klDdPtk54 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef3fcb34cc41411a95ecb3c475b81c63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef3fcb34cc41411a95ecb3c475b81c63", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef3fcb34cc41411a95ecb3c475b81c63"}]}] Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ef3fcb34cc41411a95ecb3c475b81c63 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: b294aababf0247f7b77c5de4e2cf8d60 Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1179361050-project Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'image_id': '41004ac7-6cab-446a-bcac-efa7e6537fbe', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 41004ac7-6cab-446a-bcac-efa7e6537fbe Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:20.768729 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41004ac7-6cab-446a-bcac-efa7e6537fbe could not be found. Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.772974 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.776361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:20.776361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:20.776361 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1c64acc-5ef0-4612-95fa-474adf7f7cf1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.311970 Aug 30 03:33:20.776361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1081/2144] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:20 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:20.778174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3896e4ba-7639-4a8c-8383-f6ffadfcdae5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.779195 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3896e4ba-7639-4a8c-8383-f6ffadfcdae5 tempest-ImagesMetadataNegativeTestJSON-1179361050 tempest-ImagesMetadataNegativeTestJSON-1179361050-project] 10.222.0.30 "POST /compute/v2.1/images/41004ac7-6cab-446a-bcac-efa7e6537fbe/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058208 Aug 30 03:33:20.779924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1064/2145] 10.222.0.30 () {60 vars in 1281 bytes} [Tue Aug 30 03:33:20 2022] POST /compute/v2.1/images/41004ac7-6cab-446a-bcac-efa7e6537fbe/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:20.790756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfa4ebd3-4748-4eee-9142-d0fc2512743e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '.version_select at 0x7f8983cf4c10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.790939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1167713961", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-key-776622061", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:20.827590 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-cfa4ebd3-4748-4eee-9142-d0fc2512743e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] HTTP exception thrown: Image not found. Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfa4ebd3-4748-4eee-9142-d0fc2512743e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Request method failure captured: Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb HTTP/1.1 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSg1QyeRECtc23JAGSq9c_sOkyF4N5cqYjPzkVPF4VdgjA248cJPHbAyav5kkA7jzcSEgSvaH3-e-Dw79wVDvGPk18TzF8Q7nl0bOOfDp6ctQ8oPkqhTX00qQ5A9PctqGl2JZmChcPF2Wj8j0ilfIjzxDotVHBvqr9FmmBjNqKZmB4 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 11a7139623854f1d85930bc0e9e4f1d2 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11a7139623854f1d85930bc0e9e4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11a7139623854f1d85930bc0e9e4f1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11a7139623854f1d85930bc0e9e4f1d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11a7139623854f1d85930bc0e9e4f1d2"}]}] Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 11a7139623854f1d85930bc0e9e4f1d2 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerTestJSON-565061621-project Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: f6a16685a31c4a9db9bb468c0b8552ca Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerTestJSON-565061621-project Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c595277f-a472-4d5e-8e95-86a28363b0bb'} Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c595277f-a472-4d5e-8e95-86a28363b0bb to delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c595277f-a472-4d5e-8e95-86a28363b0bb could not be found. Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.829612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfa4ebd3-4748-4eee-9142-d0fc2512743e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfa4ebd3-4748-4eee-9142-d0fc2512743e tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "DELETE /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb" status: 404 len: 62 microversion: 2.1 time: 0.049948 Aug 30 03:33:20.836742 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1065/2146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:20 2022] DELETE /compute/v2.1/images/c595277f-a472-4d5e-8e95-86a28363b0bb => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:20.841739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:20.841739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:20.865594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:20.866100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:20.866544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:20.867267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:20.867727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:20.868155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:20.905022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:33:20.924267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:33:21.081814 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c7e5a21b-6586-455f-8ebf-5da2b9d55996 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 204 len: 0 microversion: 2.1 time: 0.242797 Aug 30 03:33:21.082575 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1066/2147] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:33:20 2022] DELETE /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:21.097956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-49a09529-f787-4eef-a5e3-2e2cc749001d req-b0167e67-6f7e-4835-a378-56784581b52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "name": "network-vif-unplugged", "status": "completed", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:21.129627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-49a09529-f787-4eef-a5e3-2e2cc749001d req-b0167e67-6f7e-4835-a378-56784581b52b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.130379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-49a09529-f787-4eef-a5e3-2e2cc749001d req-b0167e67-6f7e-4835-a378-56784581b52b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.130972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-49a09529-f787-4eef-a5e3-2e2cc749001d req-b0167e67-6f7e-4835-a378-56784581b52b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.153208 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-49a09529-f787-4eef-a5e3-2e2cc749001d req-b0167e67-6f7e-4835-a378-56784581b52b service nova] Creating event network-vif-unplugged:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:33:21.167628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-49a09529-f787-4eef-a5e3-2e2cc749001d req-b0167e67-6f7e-4835-a378-56784581b52b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083713 Aug 30 03:33:21.177146 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1067/2148] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:21.182338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:21.183046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:21.190750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.191450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.192039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.192895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.193531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.194145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.525882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:21.535750 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d01b2474-2a8f-470d-b63f-a36f2a9880a7 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1473 microversion: 2.1 time: 0.357612 Aug 30 03:33:21.540709 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1068/2149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:21 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:21.789684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:33:21.790279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:33:21.790568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:33:21.790973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:33:21.791388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:33:21.801777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:21.802568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:21.807997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.808987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.809579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.810322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.810778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.811195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.812642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.813148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.816466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.817278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:21.818245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:21.818689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:21.846826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:21.854432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:21.877844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:33:21.881429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:33:21.961367 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e44335b-54b2-4c50-9b89-fc7ce4f1fb78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187272 Aug 30 03:33:21.962042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1082/2150] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:33:21.974196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4cf293b-8525-4177-aad8-b0f0641ca36f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:21.976866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4cf293b-8525-4177-aad8-b0f0641ca36f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:22.091619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f4cf293b-8525-4177-aad8-b0f0641ca36f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:22.103752 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4cf293b-8525-4177-aad8-b0f0641ca36f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1228 microversion: 2.1 time: 0.134318 Aug 30 03:33:22.105258 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1083/2151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:21 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1228 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:22.219999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:22.235971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:22.237803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:22.239657 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a4a045f-61c4-4b1b-8a7c-5fa2a7753f58 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.443506 Aug 30 03:33:22.254189 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1069/2152] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:21 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:33:22.503779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-519366904", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:22.565505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:22.567597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:22.576624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:22.583257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:22.584023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:22.584966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:22.586026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:22.590725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:22.627424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:33:23.358995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:23.369153 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8ef106f-556f-4cdd-8872-af97360aef82 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1473 microversion: 2.1 time: 0.807567 Aug 30 03:33:23.385721 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1070/2153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:22 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1473 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:23.418923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-315fb9c1-7e6b-41ae-b899-be60295de2a2 req-b733c019-c41b-4692-b46c-7653a1167b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc569f42-9c15-4496-b658-3d65b1c112cf", "name": "network-vif-unplugged", "status": "completed", "tag": "412dd46c-5445-4790-a0c1-f64b221547a6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:23.456631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-315fb9c1-7e6b-41ae-b899-be60295de2a2 req-b733c019-c41b-4692-b46c-7653a1167b0e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.458722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-315fb9c1-7e6b-41ae-b899-be60295de2a2 req-b733c019-c41b-4692-b46c-7653a1167b0e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.460872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-315fb9c1-7e6b-41ae-b899-be60295de2a2 req-b733c019-c41b-4692-b46c-7653a1167b0e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.508026 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-315fb9c1-7e6b-41ae-b899-be60295de2a2 req-b733c019-c41b-4692-b46c-7653a1167b0e service nova] Creating event network-vif-unplugged:412dd46c-5445-4790-a0c1-f64b221547a6 for instance dc569f42-9c15-4496-b658-3d65b1c112cf on n-h2-854924-5 Aug 30 03:33:23.527934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-315fb9c1-7e6b-41ae-b899-be60295de2a2 req-b733c019-c41b-4692-b46c-7653a1167b0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139948 Aug 30 03:33:23.529213 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1071/2154] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:23.534836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:23.535882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:23.542965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.543778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.544475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.545523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.546365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.547499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.549219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:33:23.549717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:33:23.550148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:33:23.550563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:33:23.550979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:33:23.572234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.572719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.573958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.575416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.576054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.576701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.600038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:23.638119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Getting quotas for project 166951db958c4bbb86c5808b3e6bbd00. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:23.645450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Getting quotas for user f5d032f3a8994127b3ffc36dc35133ba and project 166951db958c4bbb86c5808b3e6bbd00. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:23.685989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:33:23.688625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:33:23.767106 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34ea4070-e9bc-4ad5-b8ac-953d568e10bb tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531507 Aug 30 03:33:23.769097 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1084/2155] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:33:23.781374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:23.783459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:23.799733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.800926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.801605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.802721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:23.803326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:23.806466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:23.989887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:24.006228 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e7b16ee-860d-41f4-b3b5-f9ce1ed92d42 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1280 microversion: 2.1 time: 0.475445 Aug 30 03:33:24.006894 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1072/2156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:23 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1280 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:24.025229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc380b22-04eb-4a6a-bfec-7f77420740fd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:24.026058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dc380b22-04eb-4a6a-bfec-7f77420740fd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:24.402714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dc380b22-04eb-4a6a-bfec-7f77420740fd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:24.414199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc380b22-04eb-4a6a-bfec-7f77420740fd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1218 microversion: 2.1 time: 0.405828 Aug 30 03:33:24.419622 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1073/2157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:24 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1218 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:24.443656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:24.446377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:24.454468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:24.455465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:24.456007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:24.457118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:24.457800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:24.458247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:24.486161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:24.801981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:24.813675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:24.815308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:24.816535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1bb750c7-6130-494c-b1f1-477cf98ae451 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 1.045894 Aug 30 03:33:24.853141 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1085/2158] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:23 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:25.029584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:25.030559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:25.040994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.050719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.051593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:25.052568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.053245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.053909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:25.216308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:25.227851 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af56f187-f2a4-4a19-b0a0-fd3ca8007299 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1473 microversion: 2.1 time: 0.792283 Aug 30 03:33:25.228368 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1074/2159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:24 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1473 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:25.265123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:25.277021 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d136d3c-2d19-48e6-875b-758f3849ee13 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1286 microversion: 2.1 time: 0.252444 Aug 30 03:33:25.278411 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1086/2160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:25 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1286 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:25.446981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:25.447697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:25.467946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.468528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.468990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:25.469729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.470185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.470613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:25.592629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc569f42-9c15-4496-b658-3d65b1c112cf", "tag": "412dd46c-5445-4790-a0c1-f64b221547a6"}, {"server_uuid": "63a89c91-9932-4b19-ad93-c8ff7f84e87a", "name": "network-vif-deleted", "tag": "2d66ab69-d4af-446e-be79-88678d99b65c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:25.630377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.632128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.646770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:25.703848 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] Creating event network-changed:412dd46c-5445-4790-a0c1-f64b221547a6 for instance dc569f42-9c15-4496-b658-3d65b1c112cf on n-h2-854924-5 Aug 30 03:33:25.707040 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] Creating event network-vif-deleted:2d66ab69-d4af-446e-be79-88678d99b65c for instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a on n-h2-854924-5 Aug 30 03:33:25.731425 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e35ba40f-8dff-441d-865b-f56a8c04cccb req-3791da3f-6848-40e0-ba9f-8c1ffbbe71a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.145856 Aug 30 03:33:25.734709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1087/2161] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:25.736683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:25.748130 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ac2a64e-a6f4-4a35-b819-2c072f99fb5c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1270 microversion: 2.1 time: 0.306278 Aug 30 03:33:25.748725 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1075/2162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:25 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1270 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:25.846260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:25.847124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:25.854858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.857085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.857879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:25.863039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:25.863888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:25.864564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.254934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:26.257501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:26.284494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.290430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.291310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.294682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.297777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.301821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.382947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:26.389833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.390623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.391479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.392120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lazy-loading 'fault' on Instance uuid 63a89c91-9932-4b19-ad93-c8ff7f84e87a {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:26.398140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:26.399991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:26.401643 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b28e233-c944-4f78-bc20-0b4f41add1f6 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.561711 Aug 30 03:33:26.402703 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1088/2163] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:25 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:26.408360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:26.408975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:26.417410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.418487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.418930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.419809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.420712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.421149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.534758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a16685a31c4a9db9bb468c0b8552ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a7139623854f1d85930bc0e9e4f1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:26.555176 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f29847ed-e104-468e-844d-af8a4de0547c tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 200 len: 1307 microversion: 2.1 time: 0.308304 Aug 30 03:33:26.556260 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1076/2164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:26 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:26.671885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:26.690934 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cdaa317a-2de5-47c6-bb84-5cdd5c854b9a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1286 microversion: 2.1 time: 0.286866 Aug 30 03:33:26.691565 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1089/2165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:26 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1286 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:26.772291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:26.773125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:26.780686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.781512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.782185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:26.783012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:26.783485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:26.783940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:27.228086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:27.242748 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3e30e55-b9a5-4a75-b914-519d163da67c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1276 microversion: 2.1 time: 0.474157 Aug 30 03:33:27.243563 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1077/2166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:26 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1276 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:27.424742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:27.425447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:27.437308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:27.437952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:27.438395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:27.439116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:27.439572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:27.439999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:27.585967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:27.588237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] [instance: 63a89c91-9932-4b19-ad93-c8ff7f84e87a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:27.613481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:27.616462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:27.617178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:27.618461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:27.619138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:27.622805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:27.670658 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] HTTP exception thrown: Instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a could not be found. Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Request method failure captured: Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a HTTP/1.1 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSg1QyeRECtc23JAGSq9c_sOkyF4N5cqYjPzkVPF4VdgjA248cJPHbAyav5kkA7jzcSEgSvaH3-e-Dw79wVDvGPk18TzF8Q7nl0bOOfDp6ctQ8oPkqhTX00qQ5A9PctqGl2JZmChcPF2Wj8j0ilfIjzxDotVHBvqr9FmmBjNqKZmB4 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 11a7139623854f1d85930bc0e9e4f1d2 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11a7139623854f1d85930bc0e9e4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11a7139623854f1d85930bc0e9e4f1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11a7139623854f1d85930bc0e9e4f1d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11a7139623854f1d85930bc0e9e4f1d2"}]}] Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 11a7139623854f1d85930bc0e9e4f1d2 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-565061621 Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesOneServerTestJSON-565061621-project Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: f6a16685a31c4a9db9bb468c0b8552ca Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesOneServerTestJSON-565061621-project Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a could not be found. Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '63a89c91-9932-4b19-ad93-c8ff7f84e87a'} Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a could not be found. Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a could not be found. Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:27.673872 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a could not be found. Aug 30 03:33:27.677492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:27.680159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] Returning 404 to user: Instance 63a89c91-9932-4b19-ad93-c8ff7f84e87a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:27.681544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d69a260d-2b18-4b85-addb-4a6ef8f03760 tempest-ImagesOneServerTestJSON-565061621 tempest-ImagesOneServerTestJSON-565061621-project] 10.222.0.30 "GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a" status: 404 len: 111 microversion: 2.1 time: 0.104782 Aug 30 03:33:27.684278 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1078/2167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:27 2022] GET /compute/v2.1/servers/63a89c91-9932-4b19-ad93-c8ff7f84e87a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:27.713613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:27.714846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:27.724675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:27.725643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:27.727181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:27.728132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:27.729380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:27.730124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:28.282312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:28.338904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:28.341730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:28.344504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c81d2d67-3542-44ef-beee-34acf829d16b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.924249 Aug 30 03:33:28.345730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1090/2168] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:27 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:28.353394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:28.354772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:28.358452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:28.361632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:28.375619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:28.377756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:28.379594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:28.381118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:28.382289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:28.383274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:28.384439 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d3778b6-ee3b-4095-8f11-fde9a5cca8b2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.676110 Aug 30 03:33:28.389143 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1079/2169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:27 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:29.141509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:29.155657 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f933708-dfa6-4e05-ab23-744492b7dff8 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.808578 Aug 30 03:33:29.170281 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1091/2170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:28 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:29.381179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:29.382106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:29.396088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:29.397914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:29.399339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:29.401284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:29.402022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:29.403666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:29.408592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:29.409606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:29.419824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:29.420768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:29.423377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:29.425308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:29.429312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:29.430007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:30.306837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:30.318999 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2ca4c93-f99d-4dfe-816a-47feb30f62ef tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.916579 Aug 30 03:33:30.320404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1092/2171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:29 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:30.326247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:30.327231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:30.352638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:30.365950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:30.367592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:30.372117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:30.373628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:30.374410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:30.374999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:30.376448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:30.378691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:30.384434 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9228d42-e94a-43c8-a5ac-77b4eb056868 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 1.015262 Aug 30 03:33:30.398444 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1080/2172] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:29 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:30.709920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3b3ed679-3668-47d9-990e-65f5c9d52d6e req-4250b1df-fe81-4486-b02c-63083e20cc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b", "tag": "0cb0b50e-d394-4a82-ae71-4c77a8c85b43"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:30.867354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3b3ed679-3668-47d9-990e-65f5c9d52d6e req-4250b1df-fe81-4486-b02c-63083e20cc2d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:30.867354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3b3ed679-3668-47d9-990e-65f5c9d52d6e req-4250b1df-fe81-4486-b02c-63083e20cc2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:30.868266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:30.869092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3b3ed679-3668-47d9-990e-65f5c9d52d6e req-4250b1df-fe81-4486-b02c-63083e20cc2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:30.869813 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6044f4bb-bc5e-487b-afad-d8937ae7f4af tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.437463 Aug 30 03:33:30.869813 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1093/2173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:30 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:30.871468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3b3ed679-3668-47d9-990e-65f5c9d52d6e req-4250b1df-fe81-4486-b02c-63083e20cc2d service nova] Creating event network-changed:0cb0b50e-d394-4a82-ae71-4c77a8c85b43 for instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b on n-h2-854924-5 Aug 30 03:33:30.871468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3b3ed679-3668-47d9-990e-65f5c9d52d6e req-4250b1df-fe81-4486-b02c-63083e20cc2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090749 Aug 30 03:33:30.871468 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1081/2174] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:30.952625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-31b63605-c146-4ee6-abc7-c18d2519240b req-57029cdc-cd3c-4fd0-8d7b-fba427fa1a01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92612d47-429e-44ad-8524-75d16dbdfcbc", "tag": "697ca39f-b1e9-4ac1-815b-0c89db8aac6c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:30.982309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31b63605-c146-4ee6-abc7-c18d2519240b req-57029cdc-cd3c-4fd0-8d7b-fba427fa1a01 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:30.982750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31b63605-c146-4ee6-abc7-c18d2519240b req-57029cdc-cd3c-4fd0-8d7b-fba427fa1a01 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:30.986054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31b63605-c146-4ee6-abc7-c18d2519240b req-57029cdc-cd3c-4fd0-8d7b-fba427fa1a01 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:31.029880 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-31b63605-c146-4ee6-abc7-c18d2519240b req-57029cdc-cd3c-4fd0-8d7b-fba427fa1a01 service nova] Creating event network-changed:697ca39f-b1e9-4ac1-815b-0c89db8aac6c for instance 92612d47-429e-44ad-8524-75d16dbdfcbc on n-h1-854924-5 Aug 30 03:33:31.050758 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-31b63605-c146-4ee6-abc7-c18d2519240b req-57029cdc-cd3c-4fd0-8d7b-fba427fa1a01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101409 Aug 30 03:33:31.054937 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1094/2175] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:31.352896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:31.363639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:31.391271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:31.394200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:31.395212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:31.396824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:31.399129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:31.401953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:31.571948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9374f0ee-9cfa-47f5-8c21-003c71a362a0 tempest-ListImageFiltersNegativeTestJSON-74208232 tempest-ListImageFiltersNegativeTestJSON-74208232-project] Calling method '.version_select at 0x7f897b9abc10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:31.599774 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9374f0ee-9cfa-47f5-8c21-003c71a362a0 tempest-ListImageFiltersNegativeTestJSON-74208232 tempest-ListImageFiltersNegativeTestJSON-74208232-project] HTTP exception thrown: Image not found. Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9374f0ee-9cfa-47f5-8c21-003c71a362a0 tempest-ListImageFiltersNegativeTestJSON-74208232 tempest-ListImageFiltersNegativeTestJSON-74208232-project] Request method failure captured: Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/images/ad809111-300c-4949-abc8-ec182bf5019b HTTP/1.1 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYULqcPq0j0Hhg6B9AA0UlQYZmhHSfOuT7DPfyb-tB102BtwIqjmV7poXfxb2EMXnVEChF_4alkeCIDpZQb1ewoQJLAojUNbwXEGK5X62x5QDvUJOzs7gjyAsjBdesmoo3UnzO_EYxpbqR2a0YvzpLuhj9j1T0jwL_ZaDnKf6jzASzE Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 46ce74b7a1de48a2b8e928dd87b7fb7f Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-74208232 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46ce74b7a1de48a2b8e928dd87b7fb7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/46ce74b7a1de48a2b8e928dd87b7fb7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_46ce74b7a1de48a2b8e928dd87b7fb7f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/46ce74b7a1de48a2b8e928dd87b7fb7f"}]}] Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-74208232 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 46ce74b7a1de48a2b8e928dd87b7fb7f Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-74208232 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListImageFiltersNegativeTestJSON-74208232-project Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: df8958a6bb9840ed96cbd92ca1f14d21 Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-74208232-project Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'ad809111-300c-4949-abc8-ec182bf5019b'} Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ad809111-300c-4949-abc8-ec182bf5019b Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:33:31.602528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ad809111-300c-4949-abc8-ec182bf5019b could not be found. Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:31.606588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9374f0ee-9cfa-47f5-8c21-003c71a362a0 tempest-ListImageFiltersNegativeTestJSON-74208232 tempest-ListImageFiltersNegativeTestJSON-74208232-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:31.612084 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9374f0ee-9cfa-47f5-8c21-003c71a362a0 tempest-ListImageFiltersNegativeTestJSON-74208232 tempest-ListImageFiltersNegativeTestJSON-74208232-project] 10.222.0.30 "GET /compute/v2.1/images/ad809111-300c-4949-abc8-ec182bf5019b" status: 404 len: 62 microversion: 2.1 time: 0.275486 Aug 30 03:33:31.612678 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1082/2176] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:33:31 2022] GET /compute/v2.1/images/ad809111-300c-4949-abc8-ec182bf5019b => generated 62 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:33:31.617284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:31.620222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:31.647587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:31.648512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:31.649104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:31.649884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:31.650381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:31.650998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:31.984891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:32.015619 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69c9c619-e3ef-47c9-aa5b-31438e09f13d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.672210 Aug 30 03:33:32.016748 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1095/2177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:31 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:32.033192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:32.036148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:32.064117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:32.065017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:32.068615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:32.069588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:32.070204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:32.090995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:32.205654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:32.237816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:32.239499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:32.240785 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5fa780f4-57c6-47ce-b0c0-12e66e92cb04 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.627142 Aug 30 03:33:32.241415 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1083/2178] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:31 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:32.503070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:32.517668 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-14ea21b3-468d-425b-a083-9a740b416670 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.497577 Aug 30 03:33:32.518964 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1096/2179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:32 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:33.042931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:33.044363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:33.052547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:33.053453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:33.054187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:33.055365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:33.056056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:33.056913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:33.266096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:33.267180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:33.294205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:33.295059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:33.295689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:33.296590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:33.297222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:33.297906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:33.558169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:33.568917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ac0a7a0-b58f-43a3-b78b-4f670f84d375 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.530324 Aug 30 03:33:33.575754 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1084/2180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:33 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:33.584709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:33.589522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:33.600769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:33.611216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:33.611715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:33.612176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:33.612876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:33.613328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:33.613779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:33.616855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:33.634134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:33.641704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:33.644568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d338f6f-edc9-4f2f-9ad7-9614872917f2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.380994 Aug 30 03:33:33.647054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1097/2181] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:33 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:33.974077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:33.983050 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6902868-6831-4585-adbb-745f7bc87854 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.405642 Aug 30 03:33:33.987035 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1085/2182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:33 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:34.593565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:34.594799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:34.600643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=18 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:34.619338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:34.623632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:34.625684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:34.627163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:34.628061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:34.629286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:34.673688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:34.675632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:34.704349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:34.710784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:34.714037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:34.715239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:34.721766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:34.724726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:34.726218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:35.891879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:35.919808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:35.923740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:35.930273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2719ff98-b822-42e4-80a2-04736bbc9deb tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 1.257465 Aug 30 03:33:35.931039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1086/2183] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:34 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:35.945634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:35.947920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:35.961789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:35.979461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:35.981204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2793caa-7781-4430-bdd8-56ecc3b8d229 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 1.391092 Aug 30 03:33:35.983947 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1098/2184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:34 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:35.985840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:35.989163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:35.990961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:35.994760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:35.999276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:36.000276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:36.397948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-477de3a8-1d6c-4dd6-b685-1e6743cb5a95 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f8983cb79d0>, body: {"keypair": {"name": "tempest-keypair-1198885211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPb9qcjgByd94R4th+2sOKnGS4D4zt6Cs0MG8LgX/0raCzh0YGmQ6FDU9CBz5Yn4dG9R7VawEzPVug/kqRg82grp6P/Ex9w4VBetSPDZF3UamS/48ff2IVoOxPuH87+wZw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:36.413644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:36.424968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-477de3a8-1d6c-4dd6-b685-1e6743cb5a95 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:36.425600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0564b1e-1c45-456a-b29a-3c351eeb5759 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.492709 Aug 30 03:33:36.426204 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1087/2185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:35 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:36.432433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-477de3a8-1d6c-4dd6-b685-1e6743cb5a95 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:36.479700 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-477de3a8-1d6c-4dd6-b685-1e6743cb5a95 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.491927 Aug 30 03:33:36.482462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1099/2186] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 498 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:33:36.493505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-82c8d627-1919-4a55-a97e-6109d208d28d tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897ba58670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:36.504536 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-82c8d627-1919-4a55-a97e-6109d208d28d tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1198885211" status: 200 len: 513 microversion: 2.2 time: 0.015167 Aug 30 03:33:36.505760 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1088/2187] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Aug 30 03:33:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1198885211 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:36.520545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-047d0712-7614-420a-b7f1-53f4b8c49a00 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b240f70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:36.549641 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-047d0712-7614-420a-b7f1-53f4b8c49a00 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198885211" status: 204 len: 0 microversion: 2.2 time: 0.033808 Aug 30 03:33:36.551669 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1100/2188] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Aug 30 03:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198885211 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:36.564698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6f727738-d43f-4684-b631-0537e1e230b6 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897bab1f70>, body: {"keypair": {"name": "tempest-keypair-555755711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPUVwWaDLu/+Z/zM+OR9l2OUvAm6LawvwkiHQ3/4mjKMwnvroU1syYqAS47DC0FXKQMn13qkuCN4lKZBk3SJVIAmCLS/Ybtc8yGpgcvJ+h0N1Y6Kk5ZCWMnGmP43X57Ew=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:36.606010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-6f727738-d43f-4684-b631-0537e1e230b6 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:36.618295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-6f727738-d43f-4684-b631-0537e1e230b6 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:36.691309 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6f727738-d43f-4684-b631-0537e1e230b6 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.131271 Aug 30 03:33:36.693155 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1089/2189] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:33:36.705905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8cdb3610-c1d7-45c0-a47c-bcd96bd4b119 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897bb53dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:36.749100 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8cdb3610-c1d7-45c0-a47c-bcd96bd4b119 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-555755711" status: 204 len: 0 microversion: 2.2 time: 0.049836 Aug 30 03:33:36.752562 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1101/2190] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Aug 30 03:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-555755711 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:36.762958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7273395f-9ebd-4aee-ab59-3ccd31f89a4f tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897b8b8c10>, body: {"keypair": {"name": "tempest-keypair-89356721", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:36.814439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7273395f-9ebd-4aee-ab59-3ccd31f89a4f tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:36.825259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7273395f-9ebd-4aee-ab59-3ccd31f89a4f tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:36.892647 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7273395f-9ebd-4aee-ab59-3ccd31f89a4f tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.134927 Aug 30 03:33:36.893403 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1090/2191] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:36 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 30 03:33:36.911075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9225ec92-d6ec-494e-9e02-d26c0b835aed tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b279790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:36.962662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:36.967448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:36.975712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9225ec92-d6ec-494e-9e02-d26c0b835aed tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89356721" status: 204 len: 0 microversion: 2.2 time: 0.075414 Aug 30 03:33:36.980490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:36.981044 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1102/2192] 10.222.0.30 () {60 vars in 1255 bytes} [Tue Aug 30 03:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89356721 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:36.981740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:36.982452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:36.983429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:36.986063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:36.986876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:36.996654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06b5feaa-46eb-4977-8680-f90c393e6be2 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897be119d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-912178973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNczgLMMizB8mji39cxFqXL6LDJL9BTKMHycramjrD64CAUaXHTaMnX03jvurEkOoQrkIt63Ae1x9ypCF6b10lw8xbid05PJ7ji5kBwk8p77em/AYcDD/MH5VzGCcjjrdw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:37.049555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-06b5feaa-46eb-4977-8680-f90c393e6be2 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:37.087609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-06b5feaa-46eb-4977-8680-f90c393e6be2 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:37.174337 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06b5feaa-46eb-4977-8680-f90c393e6be2 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.182266 Aug 30 03:33:37.177654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1103/2193] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:36 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:33:37.189483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:37.190664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:37.201229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:37.202638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:37.203311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:37.204665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:37.205367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:37.209207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:37.520261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:37.531141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:37.532985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:37.534474 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33da8f0d-c47f-4efe-b5de-2acc33127804 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.581104 Aug 30 03:33:37.535867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1091/2194] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:36 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:37.541704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd9f6004-7301-46df-875e-88e2f259a963 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897b8ab9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1426302010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCx+5S8+eKptVdagbaxBTkW4GVkzMyXFaLnpUzUlxCsI7pMNdbDnHUE/kdCR9mSn8t/oOFLK7FL6F8X5ydD40arYWRW5QT9gMuExTIW0lierw/6vii/ZfM8coXDQCBUjg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:37.574549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bd9f6004-7301-46df-875e-88e2f259a963 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:37.582295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bd9f6004-7301-46df-875e-88e2f259a963 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:37.618546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd9f6004-7301-46df-875e-88e2f259a963 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.080871 Aug 30 03:33:37.620036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1092/2195] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:37 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:33:37.644516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:37.645255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:37.653775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:37.654369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:37.654884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:37.655686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:37.656296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:37.657057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:37.672551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:37.691144 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e3b466e-ac07-41d6-b045-764b9a28627a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.512132 Aug 30 03:33:37.704773 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1104/2196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:37 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:37.710264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7fb1d126-4b79-4aba-8a90-a460f6d8f1d1 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897b7b0940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1232467211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt+1UTaVRAwiM3g6F9r9pj+BrsB2kH7H/T+pL1kT5QGjKKOkht9hAmsZPqVvj1U/G14RnnQRy02MD4GvBIp01NdNo7A6g1yEw7A4iPs/WzqAuTD8SOuROYvtmqi22cYHA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:37.732199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7fb1d126-4b79-4aba-8a90-a460f6d8f1d1 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:37.736900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7fb1d126-4b79-4aba-8a90-a460f6d8f1d1 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:37.766179 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7fb1d126-4b79-4aba-8a90-a460f6d8f1d1 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.065715 Aug 30 03:33:37.767453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1105/2197] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:37 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:33:37.783731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f3d6c0c-3db7-49dc-84ba-da906a3bb7de tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897bb53820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:37.793951 n-d-854924-5 devstack@n-api.service[122168]: WARNING oslo_db.sqlalchemy.utils [None req-3f3d6c0c-3db7-49dc-84ba-da906a3bb7de tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 03:33:37.806720 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f3d6c0c-3db7-49dc-84ba-da906a3bb7de tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.031624 Aug 30 03:33:37.807319 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1106/2198] 10.222.0.30 () {60 vars in 1177 bytes} [Tue Aug 30 03:33:37 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:37.823883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c997715f-8022-4d09-8275-b5d74a27d122 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b240670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:37.849331 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c997715f-8022-4d09-8275-b5d74a27d122 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1232467211" status: 204 len: 0 microversion: 2.2 time: 0.029088 Aug 30 03:33:37.853929 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1107/2199] 10.222.0.30 () {60 vars in 1321 bytes} [Tue Aug 30 03:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1232467211 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:37.862545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-83bcee72-b198-4ed5-ad97-8fcc423cee57 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f8983d549d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:37.905989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-83bcee72-b198-4ed5-ad97-8fcc423cee57 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1426302010" status: 204 len: 0 microversion: 2.2 time: 0.046341 Aug 30 03:33:37.907849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1108/2200] 10.222.0.30 () {60 vars in 1321 bytes} [Tue Aug 30 03:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1426302010 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:37.914039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:37.915713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b2286d9-b0c0-494b-a4db-6bc313904985 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b1b5ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:37.944609 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b2035a1-cef1-4e77-bd16-2de8f00c84a6 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.321615 Aug 30 03:33:37.962012 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1093/2201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:37 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:37.966705 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b2286d9-b0c0-494b-a4db-6bc313904985 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-912178973" status: 204 len: 0 microversion: 2.2 time: 0.054764 Aug 30 03:33:37.967591 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1109/2202] 10.222.0.30 () {60 vars in 1318 bytes} [Tue Aug 30 03:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-912178973 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:37.979801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ba95b14-7ce4-4ad6-a6f8-23c8b699f44c tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897ba58040>, body: {"keypair": {"name": "tempest-keypair-1227498738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDE9fH3geZsNHrb46mj/eLd7uaOkHn3HRpYV2aJYaa4lVh9hG0JuzFMPYMc+Z+HKirJKtrua+oqWHtXPS0wGN+4WM3DgAU7Jkc6hZJ7ZPA158512jpJw9u7ozZTgDKNvg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:38.019080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0ba95b14-7ce4-4ad6-a6f8-23c8b699f44c tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:38.027962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0ba95b14-7ce4-4ad6-a6f8-23c8b699f44c tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:38.078659 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ba95b14-7ce4-4ad6-a6f8-23c8b699f44c tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.103011 Aug 30 03:33:38.080173 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1094/2203] 10.222.0.30 () {62 vars in 1199 bytes} [Tue Aug 30 03:33:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 03:33:38.090954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-048b58aa-f40e-4b5a-90d5-9a571dded150 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f8983d54f70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:38.111426 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-048b58aa-f40e-4b5a-90d5-9a571dded150 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1227498738" status: 200 len: 513 microversion: 2.2 time: 0.025191 Aug 30 03:33:38.112841 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1110/2204] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Aug 30 03:33:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1227498738 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:33:38.125231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e2f5a92-57e4-43c3-a46f-a424915e6a92 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b861a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:38.129712 n-d-854924-5 devstack@n-api.service[122167]: WARNING oslo_db.sqlalchemy.utils [None req-9e2f5a92-57e4-43c3-a46f-a424915e6a92 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 03:33:38.140307 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e2f5a92-57e4-43c3-a46f-a424915e6a92 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.020167 Aug 30 03:33:38.146528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1095/2205] 10.222.0.30 () {60 vars in 1177 bytes} [Tue Aug 30 03:33:38 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:38.155001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-97a905ca-96c4-4d89-83bc-280f0534b8d0 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b2794c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:38.181212 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-97a905ca-96c4-4d89-83bc-280f0534b8d0 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227498738" status: 204 len: 0 microversion: 2.2 time: 0.033573 Aug 30 03:33:38.186054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1111/2206] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Aug 30 03:33:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227498738 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:38.209837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Action: 'create', calling method: .version_select at 0x7f897b8741f0>, body: {"keypair": {"name": "tempest-keypair-1181695418", "type": "x509"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:38.264871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:38.282110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:38.309161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.processutils [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmphrsso8pr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphrsso8pr/temp.key -subj /CN=a35f9a377b6f4fb28710e16aa1b0b873 -extensions v3_req_client {{(pid=122167) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 03:33:38.498640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.processutils [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmphrsso8pr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphrsso8pr/temp.key -subj /CN=a35f9a377b6f4fb28710e16aa1b0b873 -extensions v3_req_client" returned: 0 in 0.189s {{(pid=122167) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 03:33:38.500269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.processutils [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmphrsso8pr/temp.key -password pass: {{(pid=122167) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 03:33:38.557099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.processutils [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] CMD "openssl pkcs12 -export -inkey /tmp/tmphrsso8pr/temp.key -password pass:" returned: 0 in 0.056s {{(pid=122167) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 03:33:38.562704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:38.564888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:38.580579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:38.581915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:38.582707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:38.584415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:38.585612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:38.594263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:38.642490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:38.649804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Getting quotas for user a35f9a377b6f4fb28710e16aa1b0b873 and project a3975e2cfbac4c0e9bf647ec51d2b9ae. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:38.727086 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a8e46df-c615-4a85-8f6c-f51a56d4ec56 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.537416 Aug 30 03:33:38.727086 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1096/2207] 10.222.0.30 () {62 vars in 1198 bytes} [Tue Aug 30 03:33:38 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 540 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:38.739654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:38.740390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:38.749238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:38.749832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:38.758894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:38.759938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:38.760449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:38.760901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:39.336729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:39.349306 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3595f39-bba1-4f35-9541-f8c12159c6cd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.620969 Aug 30 03:33:39.349927 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1097/2208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:38 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:39.361610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5f4338b-8396-4be8-9714-fe3419aeae41 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897bd28820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:39.395999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5f4338b-8396-4be8-9714-fe3419aeae41 tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1181695418" status: 200 len: 1534 microversion: 2.2 time: 0.039280 Aug 30 03:33:39.398804 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1098/2209] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Aug 30 03:33:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1181695418 => generated 1534 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:39.404955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:39.418659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:39.428474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:39.438334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:39.453808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:39.457813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:39.459321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d0f9c0e5-f43f-43e8-8fd1-798f158df9e7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.900813 Aug 30 03:33:39.470972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:39.471785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1112/2210] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:38 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:39.474519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:39.475611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:39.478359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:39.479439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:39.490773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-75de04b0-1aef-4078-b50c-e909fc562940 req-89dd4c74-51ec-447d-bdc9-369aafd01b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b", "name": "network-vif-plugged", "status": "completed", "tag": "0cb0b50e-d394-4a82-ae71-4c77a8c85b43"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:39.523784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-75de04b0-1aef-4078-b50c-e909fc562940 req-89dd4c74-51ec-447d-bdc9-369aafd01b5e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:39.524309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-75de04b0-1aef-4078-b50c-e909fc562940 req-89dd4c74-51ec-447d-bdc9-369aafd01b5e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:39.524935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-75de04b0-1aef-4078-b50c-e909fc562940 req-89dd4c74-51ec-447d-bdc9-369aafd01b5e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:39.560396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-75de04b0-1aef-4078-b50c-e909fc562940 req-89dd4c74-51ec-447d-bdc9-369aafd01b5e service nova] Creating event network-vif-plugged:0cb0b50e-d394-4a82-ae71-4c77a8c85b43 for instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b on n-h2-854924-5 Aug 30 03:33:39.565924 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-75de04b0-1aef-4078-b50c-e909fc562940 req-89dd4c74-51ec-447d-bdc9-369aafd01b5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092622 Aug 30 03:33:39.566725 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1113/2211] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:39.576932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af862b64-7293-4c68-bb99-83985cce532b tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f8983d54790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:39.602292 n-d-854924-5 devstack@n-api.service[122168]: WARNING oslo_db.sqlalchemy.utils [None req-af862b64-7293-4c68-bb99-83985cce532b tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 03:33:39.610320 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af862b64-7293-4c68-bb99-83985cce532b tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.042210 Aug 30 03:33:39.618126 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1114/2212] 10.222.0.30 () {60 vars in 1177 bytes} [Tue Aug 30 03:33:39 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:39.624352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94183c15-d279-4cb8-b6b1-0cd1e199d39f tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] Calling method '.version_select at 0x7f897b279820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:39.674441 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94183c15-d279-4cb8-b6b1-0cd1e199d39f tempest-KeyPairsV22TestJSON-1725836600 tempest-KeyPairsV22TestJSON-1725836600-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181695418" status: 204 len: 0 microversion: 2.2 time: 0.054609 Aug 30 03:33:39.679401 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1115/2213] 10.222.0.30 () {60 vars in 1261 bytes} [Tue Aug 30 03:33:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181695418 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:40.197580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:40.216886 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7f71e1d-a2f8-4a3f-bfa4-6ecf8d210a61 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.816276 Aug 30 03:33:40.225943 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1099/2214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:39 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:40.372854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:40.373793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:40.404954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:40.405933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:40.409457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:40.410342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:40.413281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:40.414029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:40.487851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:40.489205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:40.506149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:40.509893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:40.512594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:40.515846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:40.516852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:40.523236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:40.892749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:40.909297 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be8b6075-3d9f-4e2f-9cdf-91317e9ad585 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.539331 Aug 30 03:33:40.910953 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1116/2215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:40 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:41.254590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:41.255236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:41.269200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:41.269733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:41.270175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:41.270888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:41.271524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:41.272109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:41.309172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:41.577609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:41.586449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:41.598315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:41.603012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:41.616429 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-63eced46-ebb2-4110-a8fc-97576d792485 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 1.132896 Aug 30 03:33:41.637647 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1100/2216] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:40 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:33:41.813463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:41.829914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af5468a1-5219-443c-b400-48427085bf20 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1318 microversion: 2.1 time: 0.585659 Aug 30 03:33:41.832185 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1117/2217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:41 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:41.842092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-69bc4a40-5011-406e-9ace-545b84880443 req-4b5b41a8-9124-48d4-9b63-04bdebb63f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92612d47-429e-44ad-8524-75d16dbdfcbc", "name": "network-vif-plugged", "status": "completed", "tag": "697ca39f-b1e9-4ac1-815b-0c89db8aac6c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:41.872579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:41.881996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-69bc4a40-5011-406e-9ace-545b84880443 req-4b5b41a8-9124-48d4-9b63-04bdebb63f94 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:41.883858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-69bc4a40-5011-406e-9ace-545b84880443 req-4b5b41a8-9124-48d4-9b63-04bdebb63f94 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:41.885633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-69bc4a40-5011-406e-9ace-545b84880443 req-4b5b41a8-9124-48d4-9b63-04bdebb63f94 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:41.924592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1817615546", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b426cd56-ffb2-4a75-8914-dc1bc200de06"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:41.953309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-69bc4a40-5011-406e-9ace-545b84880443 req-4b5b41a8-9124-48d4-9b63-04bdebb63f94 service nova] Creating event network-vif-plugged:697ca39f-b1e9-4ac1-815b-0c89db8aac6c for instance 92612d47-429e-44ad-8524-75d16dbdfcbc on n-h1-854924-5 Aug 30 03:33:41.975080 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-69bc4a40-5011-406e-9ace-545b84880443 req-4b5b41a8-9124-48d4-9b63-04bdebb63f94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136886 Aug 30 03:33:41.981099 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1118/2218] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:41.996266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:42.007928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:42.023984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] validate_networks() for [('b426cd56-ffb2-4a75-8914-dc1bc200de06', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:33:42.034192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:42.035390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:42.036565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:42.039022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:42.041644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:42.042217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:42.770572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:42.785624 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42c4f070-92aa-4b1b-9ea9-13f2c61c2c2d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.798897 Aug 30 03:33:42.786568 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1119/2219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:41 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:42.798535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:42.803986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:42.830465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:42.834042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:42.834576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:42.835927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:42.839977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:42.842964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:43.448806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:43.459871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:43.462501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:43.463972 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43021c01-3f33-42a2-9b23-528c0b44c8c3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.674982 Aug 30 03:33:43.464809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1120/2220] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:42 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:43.469654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:43.470557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:43.483370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:43.484250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:43.484914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:43.485906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:43.486588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:43.487229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:43.858877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:43.868355 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-92e5140f-3fc3-422c-a626-e4b9f9cbd136 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1468 microversion: 2.1 time: 0.402248 Aug 30 03:33:43.878438 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1121/2221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:43 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:43.890493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:43.891659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:43.901474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:43.903202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:43.905481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:43.907469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:43.908243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:43.908997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.318188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:33:44.320366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:33:44.321620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:33:44.322395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:33:44.323033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:33:44.340016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:44.341509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:44.343116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.344215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:44.345542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:44.347799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.377876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:44.384089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for user cdbd4bfb488c475dac2862ea5df0fe70 and project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:44.401331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:33:44.403477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:33:44.419784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:44.427645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:44.438687 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29c8d988-59ef-49a6-9f42-b427a1cad6da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.555947 Aug 30 03:33:44.440442 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1122/2222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:43 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:44.454241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:44.455011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:44.467857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:44.469230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:44.470119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.472410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:44.473181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:44.476007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.520813 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec18826a-b113-480b-af7c-37980aa22cf5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.881166 Aug 30 03:33:44.523871 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1101/2223] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:33:44.720103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1069755361", "block_migration": true, "disk_over_commit": false}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:44.723713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:44.737917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:44.738948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:44.741713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.744994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:44.748190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:44.748807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:44.844475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lazy-loading 'flavor' on Instance uuid 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:44.887698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Going to try to live migrate instance to tempest-host-1069755361 {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:33:44.928721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] HTTP exception thrown: Compute host tempest-host-1069755361 could not be found. Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Request method failure captured: Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b/action HTTP/1.1 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 107 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUBacRkBLOVGy-IIuZC-RN3pVmb5A28wyBUXJL8xjhZ-PSl9ZD43et_UuZZ05JGMHTgC8Nvd1RFbGMO_cYSUypezpSlWPpp1ebwpxmVXO0D9jEL49EbJueMq9kLjMDupoJloH1yY8mizIByXhs4qQHQ2YlVi-yfaaFejjcbKzh9Ejw Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e49b36ca8b1d4eaf949e99dfd8ba6eac Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveMigrationNegativeTest-1857448606 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e49b36ca8b1d4eaf949e99dfd8ba6eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e49b36ca8b1d4eaf949e99dfd8ba6eac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e49b36ca8b1d4eaf949e99dfd8ba6eac", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e49b36ca8b1d4eaf949e99dfd8ba6eac"}]}] Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveMigrationNegativeTest-1857448606 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e49b36ca8b1d4eaf949e99dfd8ba6eac Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1857448606 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveMigrationNegativeTest-1857448606-project-admin Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4aee169e95894e8eb957fdcca12e1f79 Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveMigrationNegativeTest-1857448606-project-admin Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: {"os-migrateLive": {"host": "tempest-host-1069755361", "block_migration": true, "disk_over_commit": false}} Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: exception: Compute host tempest-host-1069755361 could not be found. Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b', 'body': {'os-migrateLive': {'host': 'tempest-host-1069755361', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 30 03:33:44.982087 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1069755361 could not be found. Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1069755361 could not be found. Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1069755361 could not be found. Aug 30 03:33:44.985786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:44.988430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Returning 400 to user: Compute host tempest-host-1069755361 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:44.997560 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0dd511c4-0580-44c6-b8c0-d47368e0a884 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b/action" status: 400 len: 100 microversion: 2.1 time: 0.472664 Aug 30 03:33:44.998223 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1102/2224] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Aug 30 03:33:44 2022] POST /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b/action => generated 100 bytes in 476 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:33:45.025561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:45.028166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:45.075748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.076279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.078211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.079916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.083049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.086987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.350412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:45.367411 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67c0bd57-4b0e-470b-825a-15486eb8d68c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1328 microversion: 2.1 time: 0.925346 Aug 30 03:33:45.381376 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1123/2225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:44 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1328 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:45.381376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:45.381376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:45.410576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.415383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.419340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.420203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.420928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.421580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.610789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:45.627901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64e0bd1d-8934-4ebe-b547-4bea9c92b5bf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.619163 Aug 30 03:33:45.652591 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1103/2226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:45 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:45.658514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-244c6e6f-e17c-45a4-abea-9eabf13f1405 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:45.662756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-244c6e6f-e17c-45a4-abea-9eabf13f1405 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:45.745541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:45.764001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:45.766468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:45.770170 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b386536d-5a6f-4d16-b4f2-c705037d86f3 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1809 microversion: 2.25 time: 0.400808 Aug 30 03:33:45.776482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1124/2227] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:45 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:45.788600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-244c6e6f-e17c-45a4-abea-9eabf13f1405 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:45.797749 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-244c6e6f-e17c-45a4-abea-9eabf13f1405 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1208 microversion: 2.1 time: 0.143195 Aug 30 03:33:45.800305 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1104/2228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:45 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:45.803205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:45.803844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:45.806962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:45.807801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:45.815462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.816180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.817010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.818540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.819251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.819867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.824817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.825329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.825754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:45.826456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:45.826908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:45.827326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:46.304183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:46.326368 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-60c56e8a-973a-4a39-83d3-5065af56daba tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.524322 Aug 30 03:33:46.342159 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1105/2229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:45 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:46.347154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:46.355993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c51a6709-8026-4cc7-8197-8c21618a51ef tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1468 microversion: 2.1 time: 0.569363 Aug 30 03:33:46.358302 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1125/2230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:45 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1468 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:46.363204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1519771529"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:46.368520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:46.394812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:46.395726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:46.404153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:46.408384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:46.411394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:46.415568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:46.416465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:46.419142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:46.422196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:46.423348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:46.427679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:46.437539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:46.438162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:46.442009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:46.816364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:46.834155 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d9540f3-b02f-4377-a7f2-16a1d545cb23 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1510 microversion: 2.1 time: 0.436634 Aug 30 03:33:46.837832 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1126/2231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:46 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:46.855534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-812078971", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:47.024585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:33:47.109832 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6cc4807-1bc6-4c27-af71-59f573c8184c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.756467 Aug 30 03:33:47.114708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1106/2232] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:33:46 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 03:33:47.151638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:47.158595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:47.180482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:47.181477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:47.182158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:47.188360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:47.191345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:47.191838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:47.744341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:47.975367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:47.987475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:47.992655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:47.994920 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1eb677ee-09e9-44d9-8c81-2c06ff579056 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1799 microversion: 2.25 time: 0.879803 Aug 30 03:33:48.015207 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1107/2233] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:47 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1799 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:48.022955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:48.023862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:48.031945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:48.032943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:48.033960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:48.034983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:48.036401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:48.037370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:48.197149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:48.206612 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42d1a986-55d8-48a3-ae8f-1a25003f7349 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1266 microversion: 2.1 time: 0.190058 Aug 30 03:33:48.223279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1108/2234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:48 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:48.228155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:48.228777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:48.235680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:48.236436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:48.237092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:48.238063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:48.238737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:48.239376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:48.957891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:33:48.958358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:33:48.958773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:33:48.959176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:33:48.959579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:33:48.990970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:48.991476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:48.995574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:48.998452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.000513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.001865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.059691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Getting quotas for project 166951db958c4bbb86c5808b3e6bbd00. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:49.073020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Getting quotas for user f5d032f3a8994127b3ffc36dc35133ba and project 166951db958c4bbb86c5808b3e6bbd00. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:49.110585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:49.114638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:33:49.117878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:33:49.123134 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a243b274-8e60-4fb4-bbdf-83c7ee122279 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1510 microversion: 2.1 time: 0.897269 Aug 30 03:33:49.123763 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1109/2235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:48 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1510 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:49.147709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83399aff-2b99-4864-aa2c-c0bfc15ec832 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '.version_select at 0x7f897b8bca60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:49.153185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83399aff-2b99-4864-aa2c-c0bfc15ec832 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.153968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83399aff-2b99-4864-aa2c-c0bfc15ec832 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.154845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83399aff-2b99-4864-aa2c-c0bfc15ec832 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.165624 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-83399aff-2b99-4864-aa2c-c0bfc15ec832 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1277 microversion: 2.25 time: 0.024637 Aug 30 03:33:49.167056 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1110/2236] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Aug 30 03:33:49 2022] GET /compute/v2.1/os-migrations => generated 1277 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:49.174121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:49.175073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:49.184559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.185386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.186084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.187544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.188405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.189041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.228081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:33:49.267914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48c6217a-bd61-4a28-be4e-7c08edf32c80 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.428923 Aug 30 03:33:49.277778 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1127/2237] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:33:49.291470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:49.292356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:49.303845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.304501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.305091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.306093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.306686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.307446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.386087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6fdea716-8838-4bff-b22a-42483c8e67aa tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 204 len: 0 microversion: 2.1 time: 0.217312 Aug 30 03:33:49.391093 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1111/2238] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:33:49 2022] DELETE /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:49.399802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:49.402274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:49.419710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.421271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.421947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.423642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.427148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.428785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.860161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:49.871949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:49.879379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8bd04df-5666-4e34-9148-c31c7faa92b4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1266 microversion: 2.1 time: 0.484351 Aug 30 03:33:49.880741 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1112/2239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:49 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1266 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:49.903449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a96dd65-fdd6-49e9-9ea7-a1ed3c800dc1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:49.906878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a96dd65-fdd6-49e9-9ea7-a1ed3c800dc1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:49.928549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68f3642a-48a9-444c-833b-fa28df7d3ee1 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 2417 microversion: 2.25 time: 0.639330 Aug 30 03:33:49.936387 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1128/2240] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:49 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 2417 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:49.944408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:49.953507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:49.970466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.971014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.971292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:49.981495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:49.982271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:49.982733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.069556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9a96dd65-fdd6-49e9-9ea7-a1ed3c800dc1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:50.086221 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a96dd65-fdd6-49e9-9ea7-a1ed3c800dc1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1218 microversion: 2.1 time: 0.202463 Aug 30 03:33:50.086801 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1113/2241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:49 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:50.104011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:50.104629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:50.118660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:50.119213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:50.119601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.122603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:50.129703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:50.131424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.335255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:50.356555 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80a85456-7e8e-417d-99a8-235fd888f966 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1516 microversion: 2.1 time: 0.417784 Aug 30 03:33:50.362344 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1129/2242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:49 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:50.465826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:50.497250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46a96547-4f56-427e-976f-f45b27f89db9 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 2417 microversion: 2.25 time: 0.396769 Aug 30 03:33:50.499062 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1114/2243] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:33:50 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 2417 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:33:50.643803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:50.644637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:50.657017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:50.666274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:50.666862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.667713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:50.668244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:50.668750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.901889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:50.902517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:50.909382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:50.910808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:50.911443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.912352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:50.912997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:50.914081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:50.938418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lazy-loading 'services' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:51.225668 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37a3c2d1-4c18-4e36-8285-1af663d4d44f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments/f084ae85-15b1-4699-87ba-e75dc422850b" status: 202 len: 0 microversion: 2.25 time: 0.585851 Aug 30 03:33:51.228034 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1130/2244] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Aug 30 03:33:50 2022] DELETE /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments/f084ae85-15b1-4699-87ba-e75dc422850b => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:33:51.237851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:51.239057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:51.253782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:51.255848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:51.256452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:51.257320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:51.258187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:51.259261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:51.514209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:51.548954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2316961c-d10c-42bc-8d67-8fd8cb4a9516 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1278 microversion: 2.1 time: 0.309427 Aug 30 03:33:51.552785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1131/2245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:51 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1278 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:51.571591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:51.579185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:51.591273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:51.592214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:51.593843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:51.595016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:51.595733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:51.596482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:51.664589 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85b0ed22-86d7-4bff-8383-645850fbe201 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105224 Aug 30 03:33:51.666561 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1132/2246] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:51 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:33:51.672830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:51.673786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:51.684489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:51.686045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:51.686711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:51.688349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:51.689184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:51.689875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:51.815564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:51.828677 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f14e9bc9-1f03-4526-8d2c-21b0855edaf7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.930738 Aug 30 03:33:51.830090 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1115/2247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:50 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:52.091860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:52.109915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d91fc2d7-0340-44ed-bf16-74d577611a51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1516 microversion: 2.1 time: 0.438692 Aug 30 03:33:52.110545 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1133/2248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:51 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:52.578182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:52.578813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:52.607391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:52.607870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:52.613052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:52.613958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:52.617926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:52.619085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:52.693045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:52.695381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:52.731405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:52.735036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:52.735673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:52.740331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:52.741517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:52.741963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:52.793074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:52.850728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f8af1fc9-7536-430c-82a0-41fdcfb84278 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.175933 Aug 30 03:33:52.865189 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1134/2249] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:52 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:33:52.879628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:52.880442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:52.913508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:52.914048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:52.919527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:52.920293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:52.920763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:52.921190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:53.083687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:53.109511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d251de56-e5eb-457f-9a8b-5fd38d0beb26 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1276 microversion: 2.1 time: 0.536968 Aug 30 03:33:53.125718 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1116/2250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:52 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:53.152407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:53.153270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:53.162320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:53.163813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:53.164410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:53.165285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:53.165933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:53.166617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:53.173051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:53.674072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:53.698286 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42736c97-f4d7-44e0-9c78-bc535644fdce tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1474 microversion: 2.1 time: 0.559018 Aug 30 03:33:53.702697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1117/2251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:53 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1474 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:53.864988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:53.870149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:53.895597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:53.896346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:53.899105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:53.900891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:53.902438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:53.904493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:53.998916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d4ddee5-df32-4dc9-baca-34007b93d150 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138952 Aug 30 03:33:54.004153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1118/2252] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:53 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:33:54.133570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:54.134893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:54.149272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:54.150066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:54.153387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:54.155745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:54.158270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:54.160576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:54.219596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:54.229273 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c98de4db-86eb-4f14-9580-57e7d6687f95 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 1.362277 Aug 30 03:33:54.229948 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1135/2253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:52 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:54.355844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ec76d7f9-bbd1-48b2-bfef-db3366e7db4a req-8b847484-f453-4b8d-8c58-dce0afd3be12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92612d47-429e-44ad-8524-75d16dbdfcbc", "name": "network-vif-deleted", "tag": "697ca39f-b1e9-4ac1-815b-0c89db8aac6c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:54.365223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:33:54.381101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ec76d7f9-bbd1-48b2-bfef-db3366e7db4a req-8b847484-f453-4b8d-8c58-dce0afd3be12 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:54.382061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ec76d7f9-bbd1-48b2-bfef-db3366e7db4a req-8b847484-f453-4b8d-8c58-dce0afd3be12 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:54.384717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ec76d7f9-bbd1-48b2-bfef-db3366e7db4a req-8b847484-f453-4b8d-8c58-dce0afd3be12 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:54.414171 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ec76d7f9-bbd1-48b2-bfef-db3366e7db4a req-8b847484-f453-4b8d-8c58-dce0afd3be12 service nova] Creating event network-vif-deleted:697ca39f-b1e9-4ac1-815b-0c89db8aac6c for instance 92612d47-429e-44ad-8524-75d16dbdfcbc on n-h1-854924-5 Aug 30 03:33:54.427756 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ec76d7f9-bbd1-48b2-bfef-db3366e7db4a req-8b847484-f453-4b8d-8c58-dce0afd3be12 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074347 Aug 30 03:33:54.430483 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1136/2254] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:54.729005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:54.729799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:54.741638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:54.742138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:54.742581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:54.743308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:54.743772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:54.751451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:54.843621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:54.844321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:54.846668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:54.847337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lazy-loading 'fault' on Instance uuid 92612d47-429e-44ad-8524-75d16dbdfcbc {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:33:55.166447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:55.191121 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec567fc3-fa41-4316-b2ac-c25ca4ef4f26 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 200 len: 1318 microversion: 2.1 time: 0.461175 Aug 30 03:33:55.207339 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1137/2255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:54 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:33:55.207339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:55.226375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:55.238274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:55.238935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:55.239486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:55.240346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:55.240917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:55.241493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:55.333687 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d16743b7-9598-4e65-b6fd-cdbd6a0cc59d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137671 Aug 30 03:33:55.335487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1138/2256] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:55 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:33:55.351108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:55.352610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:55.367976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:55.369727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:55.370474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:55.373037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:55.373821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:55.378100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:55.449857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:55.459409 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b2117907-c418-40c1-921a-a8623c67a7fc tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 1.329685 Aug 30 03:33:55.463368 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1119/2257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:54 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:56.216157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:56.217391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:56.234449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:56.234938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:56.239714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:56.240912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:56.246371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:56.247067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:56.279114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc HTTP/1.1 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '92612d47-429e-44ad-8524-75d16dbdfcbc'} Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:33:56.284411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:33:56.288540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:33:56.291450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:33:56.293988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79a3dcc1-4a6e-45da-85d3-98bbcde64c57 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 404 len: 111 microversion: 2.1 time: 0.082706 Aug 30 03:33:56.298084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1120/2258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:56 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:33:56.310968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-59ff5f13-258f-41e7-b685-b88db9ae2099 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '.version_select at 0x7f897b78df70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:56.353049 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-59ff5f13-258f-41e7-b685-b88db9ae2099 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-776622061" status: 202 len: 0 microversion: 2.1 time: 0.051603 Aug 30 03:33:56.355501 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1121/2259] 10.222.0.30 () {58 vars in 1206 bytes} [Tue Aug 30 03:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-776622061 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:33:56.365235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:56.372264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:56.390365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:56.392132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:56.394966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:56.397135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:56.403047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:56.403872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:56.494732 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bff266fc-629c-4cc9-be5a-609734bed32a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135859 Aug 30 03:33:56.505601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1122/2260] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:56 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:33:56.520217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:56.521962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:56.545206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:56.548146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:56.549106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:56.552709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:56.558552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:56.559533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:56.742432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:56.758400 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f53b73fb-d9c3-415a-a6e1-5193e726e404 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 1.419799 Aug 30 03:33:56.759045 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1139/2261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:55 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:56.773435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1635855213", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:56.875285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:33:57.359780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:57.387939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bcbdf63a-1bbc-4a9c-bc40-40d5794ddf8d tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 0.880741 Aug 30 03:33:57.388887 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1123/2262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:56 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:57.394213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2161790b-16d5-4675-a2c6-62279919d9ed req-bd2ad3ef-e028-4c46-bdc4-5a2aa18239db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db50094-5c80-4366-b3d6-2af379db8508", "tag": "7eb03b16-3328-4e92-a75e-2af01c5cfdd3"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:57.417858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2161790b-16d5-4675-a2c6-62279919d9ed req-bd2ad3ef-e028-4c46-bdc4-5a2aa18239db service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:57.418692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2161790b-16d5-4675-a2c6-62279919d9ed req-bd2ad3ef-e028-4c46-bdc4-5a2aa18239db service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:57.419266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2161790b-16d5-4675-a2c6-62279919d9ed req-bd2ad3ef-e028-4c46-bdc4-5a2aa18239db service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:57.435358 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2161790b-16d5-4675-a2c6-62279919d9ed req-bd2ad3ef-e028-4c46-bdc4-5a2aa18239db service nova] Creating event network-changed:7eb03b16-3328-4e92-a75e-2af01c5cfdd3 for instance 3db50094-5c80-4366-b3d6-2af379db8508 on n-h1-854924-5 Aug 30 03:33:57.441544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2161790b-16d5-4675-a2c6-62279919d9ed req-bd2ad3ef-e028-4c46-bdc4-5a2aa18239db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050959 Aug 30 03:33:57.442794 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1124/2263] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:57.449274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f0a3181b-1a79-4f40-aa0e-60c94b07194b req-1ee033c8-a819-4aeb-acd8-1ee0df880bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:57.460692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f0a3181b-1a79-4f40-aa0e-60c94b07194b req-1ee033c8-a819-4aeb-acd8-1ee0df880bed service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:57.462329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f0a3181b-1a79-4f40-aa0e-60c94b07194b req-1ee033c8-a819-4aeb-acd8-1ee0df880bed service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:57.462934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f0a3181b-1a79-4f40-aa0e-60c94b07194b req-1ee033c8-a819-4aeb-acd8-1ee0df880bed service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:57.476498 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f0a3181b-1a79-4f40-aa0e-60c94b07194b req-1ee033c8-a819-4aeb-acd8-1ee0df880bed service nova] Creating event network-vif-plugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:33:57.488926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f0a3181b-1a79-4f40-aa0e-60c94b07194b req-1ee033c8-a819-4aeb-acd8-1ee0df880bed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042663 Aug 30 03:33:57.489832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1125/2264] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:57.512344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:57.515611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:57.523200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:57.523943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:57.524543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:57.525652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:57.526266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:57.529554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:57.623576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1fc99688-fff2-4ffa-9a78-5a226d639bf7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116253 Aug 30 03:33:57.629633 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1126/2265] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:57 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:33:57.780269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:57.781106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:57.788890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:57.789809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:57.790457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:57.791359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:57.791957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:57.792580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:58.391519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:58.401864 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb811464-6ed9-44c1-9d77-c4072372b9e5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.625453 Aug 30 03:33:58.405796 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1127/2266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:57 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:58.416649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b0d1ab9b-765a-4235-b986-a8479dbe6a01 req-f6b1849e-d64a-4519-8103-e115e3143acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acf69eb-abe5-478c-b51a-80fe5d8d16aa", "tag": "aa54580e-7150-490e-994f-7fa8b5a90a94"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:33:58.442822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b0d1ab9b-765a-4235-b986-a8479dbe6a01 req-f6b1849e-d64a-4519-8103-e115e3143acd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:58.444769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b0d1ab9b-765a-4235-b986-a8479dbe6a01 req-f6b1849e-d64a-4519-8103-e115e3143acd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:58.445474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b0d1ab9b-765a-4235-b986-a8479dbe6a01 req-f6b1849e-d64a-4519-8103-e115e3143acd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:58.470226 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b0d1ab9b-765a-4235-b986-a8479dbe6a01 req-f6b1849e-d64a-4519-8103-e115e3143acd service nova] Creating event network-changed:aa54580e-7150-490e-994f-7fa8b5a90a94 for instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa on n-h2-854924-5 Aug 30 03:33:58.476345 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b0d1ab9b-765a-4235-b986-a8479dbe6a01 req-f6b1849e-d64a-4519-8103-e115e3143acd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068933 Aug 30 03:33:58.477757 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1128/2267] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:33:58.483764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:58.484987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:58.493212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:58.494248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:58.495154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:58.496607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:58.497527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:58.498196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:58.765938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:33:58.767511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:33:58.768153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:33:58.768806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:33:58.769555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:33:58.782806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:58.784257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:58.785876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:58.787096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:58.788067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:58.789202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:58.860020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:33:58.870237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:33:58.900044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:33:58.902639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:33:58.992748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:59.001270 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-62376aae-8684-4e9b-8807-6595e2f5b3aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 0.522109 Aug 30 03:33:59.009054 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1129/2268] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:58 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:59.014506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:59.036553 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ee575de-e5d7-4a57-8b71-eadf7d6dc402 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276208 Aug 30 03:33:59.039176 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1140/2269] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:33:59.040676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:59.058749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56ee500c-840f-4470-828c-5c9ea4ab0f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:59.062456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56ee500c-840f-4470-828c-5c9ea4ab0f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:59.074919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:59.076911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:59.078016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:59.085668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:59.086434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:59.087767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:59.198555 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2af0c4f-8534-4c2a-8188-12fb3695e3f0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187848 Aug 30 03:33:59.199826 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1130/2270] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:33:59 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:33:59.238685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-56ee500c-840f-4470-828c-5c9ea4ab0f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:59.249356 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56ee500c-840f-4470-828c-5c9ea4ab0f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1209 microversion: 2.1 time: 0.201348 Aug 30 03:33:59.250409 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1141/2271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:59 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1209 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:33:59.423515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:33:59.424137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:33:59.437857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:59.442586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:59.443184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:59.443952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:33:59.444431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:33:59.444868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:33:59.719684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:33:59.734594 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb008143-5ce2-44ef-8514-f2f6588fcb77 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.310403 Aug 30 03:33:59.736147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1131/2272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:33:59 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:00.033827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:00.034429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:00.043399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.049937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.050453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.055308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.056076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.057584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.114476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=34 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:00.229251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-18dac74f-2242-47de-af9f-e55a2824a911 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f8983cb75e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2086408505", "description": "tempest-description-1225068027"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:00.396382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:00.410837 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dc3cd2f-9f8e-49c6-9321-9a4e57a924f0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 0.380915 Aug 30 03:34:00.422581 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1132/2273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:00 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:00.428978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:00.438279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:00.453688 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-18dac74f-2242-47de-af9f-e55a2824a911 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.480205 Aug 30 03:34:00.457856 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1142/2274] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:33:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:00.467422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:00.468195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:00.478116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.478760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.479322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.480600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.481064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.481533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.486406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.492332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.492957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.494940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.496134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.496736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.563833 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34369021-05ed-4e07-8ac7-688e5d220726 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150339 Aug 30 03:34:00.570199 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1133/2275] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:34:00 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:34:00.575616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6fe73780-774b-45cc-8d05-15ffb42549e9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897bd28ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-216798423", "description": "tempest-description-1308471162"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:00.601465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:00.617249 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a9b2971-20a5-450e-a108-b6c230bd1f72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1213 microversion: 2.1 time: 0.157099 Aug 30 03:34:00.618659 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1143/2276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:00 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:00.760138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:00.762071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:00.779259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.780091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.780827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.781911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:00.787952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:00.801406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:00.849897 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6fe73780-774b-45cc-8d05-15ffb42549e9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.277586 Aug 30 03:34:00.850785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1134/2277] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:00.968154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-799860154", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "dd88f3b5-60f8-4e83-bf63-1610edcfa8b9"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:01.104157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] validate_networks() for [('dd88f3b5-60f8-4e83-bf63-1610edcfa8b9', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:34:01.486271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:01.497549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db9f84e5-4b37-4754-afa0-e6d94018df5a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.743692 Aug 30 03:34:01.501290 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1144/2278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:00 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:34:01.515710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:01.516727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:01.526228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:01.544255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:01.546036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:01.551230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:01.551767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:01.552393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.267149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:02.278593 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3cc24ad3-14aa-4da6-b383-fa69ed2bbb76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 0.774801 Aug 30 03:34:02.279188 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1145/2279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:01 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:02.305047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:02.315272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:02.344234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:02.350133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:02.353317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.355881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:02.360184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:02.360870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.458902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:34:02.459423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:34:02.460121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:34:02.460635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:34:02.461149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:34:02.500665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:02.501303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:02.502942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.503961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:02.504555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:02.505087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.547358 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42d3bd70-3a06-4633-8d30-c196f3bfaa2c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.266974 Aug 30 03:34:02.560854 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1146/2280] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:34:02 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf/os-volume_attachments => generated 25 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:02.595381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:02.600356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:02.653660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:02.661151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Getting quotas for project d40a94656bfd4ebeba785fbf8be1a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:34:02.662082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:02.662630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.676114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:02.676775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:02.679432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:02.688481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Getting quotas for user 9ad10e8a5ee24e44bb60c03014adf1d3 and project d40a94656bfd4ebeba785fbf8be1a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:34:02.781886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:34:02.788989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:34:02.964703 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-86abd2fa-e870-434b-a308-ee5aa9f6c053 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000222 Aug 30 03:34:02.976786 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1135/2281] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:34:03.013929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:03.015431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:03.033284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:03.050980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c722eaee-3c88-4ff1-8006-7888b8b2ced9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1261 microversion: 2.1 time: 0.487147 Aug 30 03:34:03.051390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:03.052425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:03.052752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:03.057049 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1147/2282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:02 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1261 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:03.059683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:03.060214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:03.060679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:03.074910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-04846774-23e7-4ed2-8a07-5a7df6b1ae88 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:03.076721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-04846774-23e7-4ed2-8a07-5a7df6b1ae88 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:03.394598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-04846774-23e7-4ed2-8a07-5a7df6b1ae88 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:03.412034 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-04846774-23e7-4ed2-8a07-5a7df6b1ae88 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1215 microversion: 2.1 time: 0.350379 Aug 30 03:34:03.415373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1148/2283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:03 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1215 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:03.430964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:03.437243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:03.453493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:03.460551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:03.467771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:03.468920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:03.470885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:03.474120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:04.476715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:04.487909 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b64beba3-7810-4bc9-83dd-2a1db47bf478 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 1.498326 Aug 30 03:34:04.490434 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1136/2284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:02 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:04.500185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:04.501224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:04.526815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:04.527318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:04.527756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:04.535778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:04.536291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:04.536741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:04.565301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:04.576919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0b24da2-2fd8-4952-9350-ea44e1009923 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 1.160213 Aug 30 03:34:04.579679 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1149/2285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:03 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:04.596369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29f62b43-50d5-42bd-b7ba-ab3b43b40ced tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:04.597092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29f62b43-50d5-42bd-b7ba-ab3b43b40ced tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:04.809146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29f62b43-50d5-42bd-b7ba-ab3b43b40ced tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:04.818194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29f62b43-50d5-42bd-b7ba-ab3b43b40ced tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1215 microversion: 2.1 time: 0.237267 Aug 30 03:34:04.818778 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1150/2286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:04 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:04.938025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:04.950872 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-795a84a0-09a0-4b17-af9f-01db938008b5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1267 microversion: 2.1 time: 0.458077 Aug 30 03:34:04.954003 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1137/2287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:04 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1267 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:05.514320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:05.514938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:05.529895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:05.534842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:05.540787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:05.541866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:05.547419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:05.548234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:05.548907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:05.606085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:05.607396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:05.639851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:05.640773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:05.641526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:05.642539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:05.644810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:05.645485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:06.817872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:06.833533 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b5f2a2e-91ef-49de-b547-0eff9946eefa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 1.323438 Aug 30 03:34:06.837362 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1151/2288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:05 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:06.859086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:06.859759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:06.880209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:06.882395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:06.883876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:06.886748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:06.886892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:06.888822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:06.890911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:06.896343 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9305cc1f-f4c9-4f5b-929d-d0b26d2d5121 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 1.294755 Aug 30 03:34:06.896939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1138/2289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:05 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:06.916708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:06.924224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:06.934032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:06.960940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:06.964665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:06.968976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:06.972685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:06.973029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:06.973503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:07.011667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:07.159906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:07.171435 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea252d4b-8f6d-4181-8a4c-cb2744802ab1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1273 microversion: 2.1 time: 0.330800 Aug 30 03:34:07.177122 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1152/2290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:06 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:07.749491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:07.759236 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dfb157b0-d379-44aa-bd89-e8b36fcf350d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.861218 Aug 30 03:34:07.765370 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1139/2291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:06 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:07.864179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:07.865694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:07.883370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:07.884212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:07.884825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:07.888886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:07.889740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:07.890372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:07.922933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:07.924215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:07.939507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:07.942707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:07.945750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:07.949247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:07.956522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:07.957269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:08.333366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:08.343134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:08.347074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-72da5ee5-d3a8-4082-bf1d-2dfcf56eeafd tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 0.429641 Aug 30 03:34:08.358815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb0fc7d9-7da9-4281-ac73-5a30c42fcf12 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.495189 Aug 30 03:34:08.364398 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1140/2292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:07 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:08.377159 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1153/2293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:07 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:08.393867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:08.396157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:08.427991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:08.429586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:08.434153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:08.436271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:08.439459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:08.441255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:08.697662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:08.711078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d910a70-8e3d-4978-a4d1-5909e60b7a72 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1273 microversion: 2.1 time: 0.343160 Aug 30 03:34:08.719491 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1141/2294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:08 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:08.787886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:08.788846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:08.821083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:08.825711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:08.826440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:08.827872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:08.831926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:08.832418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:08.838031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:08.904856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-50b250e2-1b5c-4eb4-945a-658a9a7c3e80 req-0729d3f2-476e-4650-8ffc-f9fadad30619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3acf69eb-abe5-478c-b51a-80fe5d8d16aa", "name": "network-vif-plugged", "status": "completed", "tag": "aa54580e-7150-490e-994f-7fa8b5a90a94"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:08.934407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-50b250e2-1b5c-4eb4-945a-658a9a7c3e80 req-0729d3f2-476e-4650-8ffc-f9fadad30619 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:08.935174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-50b250e2-1b5c-4eb4-945a-658a9a7c3e80 req-0729d3f2-476e-4650-8ffc-f9fadad30619 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:08.935778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-50b250e2-1b5c-4eb4-945a-658a9a7c3e80 req-0729d3f2-476e-4650-8ffc-f9fadad30619 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:08.966124 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-50b250e2-1b5c-4eb4-945a-658a9a7c3e80 req-0729d3f2-476e-4650-8ffc-f9fadad30619 service nova] Creating event network-vif-plugged:aa54580e-7150-490e-994f-7fa8b5a90a94 for instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa on n-h2-854924-5 Aug 30 03:34:08.976037 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-50b250e2-1b5c-4eb4-945a-658a9a7c3e80 req-0729d3f2-476e-4650-8ffc-f9fadad30619 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301628 Aug 30 03:34:08.981395 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1154/2295] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:34:09.376522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:09.381496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:09.402996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:09.404325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:09.406970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:09.407612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:09.408538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:09.411042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:09.411802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:09.415564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d71a7841-1351-4bc7-8101-9cf9563ce124 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.630939 Aug 30 03:34:09.421113 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1142/2296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:08 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:09.454260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:09.457068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:09.480760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:09.488991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:09.492299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:09.493551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:09.497057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:09.498948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:10.285069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:10.325680 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6af4086-145f-4b03-bb32-5913465b3dbc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.890383 Aug 30 03:34:10.326294 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1143/2297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:09 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:10.348034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-379f9ff5-24bf-4f53-a572-5863dfb15af7 req-9bb71821-ad7a-4b19-a53b-e01e995215b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d009a60-8954-4751-af6b-79a70c09279b", "tag": "4b8f4bde-8510-4e8b-b73e-9905279f3349"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:10.434075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-379f9ff5-24bf-4f53-a572-5863dfb15af7 req-9bb71821-ad7a-4b19-a53b-e01e995215b6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:10.434677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-379f9ff5-24bf-4f53-a572-5863dfb15af7 req-9bb71821-ad7a-4b19-a53b-e01e995215b6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:10.444345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-379f9ff5-24bf-4f53-a572-5863dfb15af7 req-9bb71821-ad7a-4b19-a53b-e01e995215b6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:10.487972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-379f9ff5-24bf-4f53-a572-5863dfb15af7 req-9bb71821-ad7a-4b19-a53b-e01e995215b6 service nova] Creating event network-changed:4b8f4bde-8510-4e8b-b73e-9905279f3349 for instance 2d009a60-8954-4751-af6b-79a70c09279b on n-h1-854924-5 Aug 30 03:34:10.506244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-379f9ff5-24bf-4f53-a572-5863dfb15af7 req-9bb71821-ad7a-4b19-a53b-e01e995215b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170367 Aug 30 03:34:10.509600 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1144/2298] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:10.515403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:10.527102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:10.552060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:10.553462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:10.554674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:10.556306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:10.557958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:10.558961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:10.575473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:10.584588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a73002b5-7e2c-442d-86d8-f5958c9d6a76 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1318 microversion: 2.1 time: 1.220310 Aug 30 03:34:10.591056 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1155/2299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:09 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1318 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:34:10.602820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:10.603782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:10.631541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:10.632767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:10.634223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:10.639437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:10.640380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:10.647441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:11.463896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:11.466240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:11.482324 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dd92e463-e569-441a-a7a7-c3a4f2f7d175 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.889796 Aug 30 03:34:11.484241 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1156/2300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:10 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:11.500602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4a8c0621-1609-4869-98f0-a1d4f0b9b20c req-6cc74317-87b9-4362-ba0e-3ba1c59fb9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db50094-5c80-4366-b3d6-2af379db8508", "name": "network-vif-plugged", "status": "completed", "tag": "7eb03b16-3328-4e92-a75e-2af01c5cfdd3"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:11.541761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4a8c0621-1609-4869-98f0-a1d4f0b9b20c req-6cc74317-87b9-4362-ba0e-3ba1c59fb9e6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:11.542594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4a8c0621-1609-4869-98f0-a1d4f0b9b20c req-6cc74317-87b9-4362-ba0e-3ba1c59fb9e6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:11.543217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4a8c0621-1609-4869-98f0-a1d4f0b9b20c req-6cc74317-87b9-4362-ba0e-3ba1c59fb9e6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:11.557184 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4a8c0621-1609-4869-98f0-a1d4f0b9b20c req-6cc74317-87b9-4362-ba0e-3ba1c59fb9e6 service nova] Creating event network-vif-plugged:7eb03b16-3328-4e92-a75e-2af01c5cfdd3 for instance 3db50094-5c80-4366-b3d6-2af379db8508 on n-h1-854924-5 Aug 30 03:34:11.569691 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4a8c0621-1609-4869-98f0-a1d4f0b9b20c req-6cc74317-87b9-4362-ba0e-3ba1c59fb9e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082042 Aug 30 03:34:11.574422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1157/2301] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:11.587854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:11.589860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:11.599022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:11.602496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:11.603110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:11.605839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:11.606489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:11.607092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:11.633612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:11.647998 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e5af08d-3943-42cd-b882-7e89106c5388 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1315 microversion: 2.1 time: 1.136731 Aug 30 03:34:11.666561 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1145/2302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:10 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1315 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:11.672353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:11.682059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:11.698926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:11.701753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:11.703899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:11.704875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:11.707739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:11.708503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:12.575054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:12.684138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:12.701145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2727d195-1aaf-494b-b3c3-c2fdd3574d3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 1.118169 Aug 30 03:34:12.710346 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1158/2303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:11 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:12.724434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d32e11b7-0e71-4291-ac29-2cae457a9893 req-b6771461-8e23-4ec6-bb55-f6530a4777d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc46ac6-8e36-41c3-81ee-8268d4bca428", "tag": "918b0f91-cf85-45f5-bac3-5562e487dd8c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:12.748245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d32e11b7-0e71-4291-ac29-2cae457a9893 req-b6771461-8e23-4ec6-bb55-f6530a4777d3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:12.748724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d32e11b7-0e71-4291-ac29-2cae457a9893 req-b6771461-8e23-4ec6-bb55-f6530a4777d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:12.749157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d32e11b7-0e71-4291-ac29-2cae457a9893 req-b6771461-8e23-4ec6-bb55-f6530a4777d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:12.760032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:12.767622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:12.770117 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d28da1a-8616-4b2b-854e-8575497130c1 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1468 microversion: 2.1 time: 1.101911 Aug 30 03:34:12.785397 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1146/2304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:11 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1468 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:12.785641 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d32e11b7-0e71-4291-ac29-2cae457a9893 req-b6771461-8e23-4ec6-bb55-f6530a4777d3 service nova] Creating event network-changed:918b0f91-cf85-45f5-bac3-5562e487dd8c for instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 on n-h2-854924-5 Aug 30 03:34:12.796634 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d32e11b7-0e71-4291-ac29-2cae457a9893 req-b6771461-8e23-4ec6-bb55-f6530a4777d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084723 Aug 30 03:34:12.800408 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1159/2305] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:12.800532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:12.805841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:12.807068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:12.813825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:12.829061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:12.829763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:12.830220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:12.834589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:12.835284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:12.835923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:12.836827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:12.838572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:12.839696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:12.840157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:12.840287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:12.843409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:13.419422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:13.428799 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f3deef3-46dc-4858-8d67-3fab1cc4037c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1315 microversion: 2.1 time: 0.627062 Aug 30 03:34:13.435895 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1160/2306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:12 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:13.445258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:13.445836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:13.464799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:13.465301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:13.465773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:13.466504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:13.466963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:13.473002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:13.477955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:13.487603 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b721e56b-b6b7-4fe0-a151-8980220bc54c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.708447 Aug 30 03:34:13.494475 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1147/2307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:12 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:13.524462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lazy-loading 'flavor' on Instance uuid 3acf69eb-abe5-478c-b51a-80fe5d8d16aa {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:34:13.655654 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51545ba7-0df2-4ba7-8105-60dda2e9e436 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa/action" status: 202 len: 0 microversion: 2.1 time: 0.219163 Aug 30 03:34:13.665592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1161/2308] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:13 2022] POST /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:13.667811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:13.668441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:13.680173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:13.680871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:13.681555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:13.682280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:13.683308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:13.683751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:13.725982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:13.732621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:13.747534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:13.748293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:13.750481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:13.755797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:13.756645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:13.757323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:14.817587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=18 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:15.010556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:15.029035 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2739348-f922-4e6f-9d41-a49328fad154 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 1.305742 Aug 30 03:34:15.029692 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1162/2309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:13 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:34:15.049726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:15.051816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:15.052631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:15.060103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:15.060833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:15.061445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:15.062341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:15.062941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:15.063510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:15.074233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-deac682f-1e28-4f2c-8d4f-5474913ab2c4 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1476 microversion: 2.1 time: 1.402644 Aug 30 03:34:15.075357 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1148/2310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:13 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1476 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:34:15.093645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:15.094675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:15.121287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:15.123807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:15.126678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:15.128960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:15.132246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:15.133102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:15.553764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:15.556520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:15.570987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8918560-394a-4901-8923-2b2e37fbc452 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.491926 Aug 30 03:34:15.574993 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1149/2311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:15 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:15.592271 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06dd9702-9bfe-49fb-9bb4-3d08dcc8ed04 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1315 microversion: 2.1 time: 0.557124 Aug 30 03:34:15.606670 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1163/2312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:15 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:16.051118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:16.051735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:16.067342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.067842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.068547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.069265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.069746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.070422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.105745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:16.106426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:16.126697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.133230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.133927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.134834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.135494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.136083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.726084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:16.735879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e320a118-d2ac-4808-881e-0e941f347faf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1308 microversion: 2.1 time: 0.689267 Aug 30 03:34:16.737666 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1150/2313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:16 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:16.743356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:16.744237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:16.751256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.752395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.753595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.754581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.755240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.755911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.875792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:16.887633 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2fff9d93-72f2-405a-9f2a-bd4feedba808 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1459 microversion: 2.1 time: 0.786381 Aug 30 03:34:16.888801 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1164/2314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:16 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1459 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:16.894420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:16.898433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:16.906402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.907379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.908168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:16.909160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:16.909826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:16.910966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.218812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:17.232450 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6e56064-edc9-44d1-9d55-ac7c3736c95d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.493347 Aug 30 03:34:17.233387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1151/2315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:16 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:17.238162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:17.247657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:17.257576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.270164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.270914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.271832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.272443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.273042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.430951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:17.445409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72050dfe-3e18-425f-bc5f-a3322fa09327 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1315 microversion: 2.1 time: 0.555187 Aug 30 03:34:17.458364 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1165/2316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:16 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:17.763242 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-521f6abb-d5bf-40b0-aaf8-cf189d236bc1 tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1610 microversion: 2.1 time: 0.528569 Aug 30 03:34:17.773377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:17.773377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:17.782293 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1152/2317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:17 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1610 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:17.787823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:17.788608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.792599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.793632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.794381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.799003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.799462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.801400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.804019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.805946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.807958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.812075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.812752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.859615 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5027826-57b6-4f07-9c1c-48f1f29839eb tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.075947 Aug 30 03:34:17.867112 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1153/2318] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 03:34:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:17.879488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:17.885073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:17.897716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.898644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.899434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.900689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:17.901504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:17.902276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:17.958937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Lazy-loading 'flavor' on Instance uuid 3acf69eb-abe5-478c-b51a-80fe5d8d16aa {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:34:17.976861 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa while it is in vm_state suspended Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Request method failure captured: Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa/action HTTP/1.1 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 97 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUBacRkBLOVGy-IIuZC-RN3pVmb5A28wyBUXJL8xjhZ-PSl9ZD43et_UuZZ05JGMHTgC8Nvd1RFbGMO_cYSUypezpSlWPpp1ebwpxmVXO0D9jEL49EbJueMq9kLjMDupoJloH1yY8mizIByXhs4qQHQ2YlVi-yfaaFejjcbKzh9Ejw Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e49b36ca8b1d4eaf949e99dfd8ba6eac Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveMigrationNegativeTest-1857448606 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e49b36ca8b1d4eaf949e99dfd8ba6eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e49b36ca8b1d4eaf949e99dfd8ba6eac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e49b36ca8b1d4eaf949e99dfd8ba6eac", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e49b36ca8b1d4eaf949e99dfd8ba6eac"}]}] Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveMigrationNegativeTest-1857448606 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e49b36ca8b1d4eaf949e99dfd8ba6eac Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1857448606 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveMigrationNegativeTest-1857448606-project-admin Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4aee169e95894e8eb957fdcca12e1f79 Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveMigrationNegativeTest-1857448606-project-admin Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": true, "disk_over_commit": false}} Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'os-migrateLive' instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa while it is in vm_state suspended Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '3acf69eb-abe5-478c-b51a-80fe5d8d16aa', 'body': {'os-migrateLive': {'host': 'n-h1-854924-5', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:17.979452 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa while it is in vm_state suspended Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa while it is in vm_state suspended Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa while it is in vm_state suspended {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:17.983252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0a6e130-8802-4350-bd91-0072f9adb25e tempest-LiveMigrationNegativeTest-1857448606 tempest-LiveMigrationNegativeTest-1857448606-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa/action" status: 409 len: 155 microversion: 2.1 time: 0.109184 Aug 30 03:34:17.986773 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1154/2319] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:17 2022] POST /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa/action => generated 155 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:34:17.994667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:17.996882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:18.004554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.005143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.005751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.007559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.008024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.009837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.048875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:34:18.164226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:18.249178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-224079ec-653f-416f-9525-a0d490de65c0 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 204 len: 0 microversion: 2.1 time: 0.258595 Aug 30 03:34:18.253296 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1155/2320] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:34:17 2022] DELETE /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:34:18.259320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:18.260022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:18.262454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:18.272640 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8840a217-528a-4461-bded-728d393639a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1488 microversion: 2.1 time: 0.514289 Aug 30 03:34:18.277925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.278502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.278951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.279691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.280143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.280570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.287051 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1166/2321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:17 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1488 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:18.310306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:18.311945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:18.331276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.332723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.334081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.340606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.341436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.342690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.684015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:18.699087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-333d7c9b-6b60-4e8d-82c1-5c2dac7b118c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1465 microversion: 2.1 time: 0.444348 Aug 30 03:34:18.700210 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1156/2322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:18 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1465 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:18.709204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:18.713462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:18.727210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.728682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.730508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.733893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.734860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.735515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.786133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:18.797259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a28d311-9a2c-4239-942e-62046c73f491 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.502097 Aug 30 03:34:18.809441 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1167/2323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:18 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:18.809441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:18.809441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:18.815907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.815907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.815907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.815907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.815907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.816420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.851102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f1147ce-4ab4-4d5c-9e46-37e271f9cdbe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508/action" status: 202 len: 0 microversion: 2.1 time: 0.149374 Aug 30 03:34:18.880471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1157/2324] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:18 2022] POST /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:18.894293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:18.895131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:18.903901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.904440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.905187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:18.905977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:18.906482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:18.907122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:19.213329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:19.237994 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8cec118b-d2b9-4952-8697-6f32b7cbab95 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1315 microversion: 2.1 time: 0.437668 Aug 30 03:34:19.238608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1168/2325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:18 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:19.264563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:19.277778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-097d2241-2a19-4a80-b68d-64e70a74ae3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1493 microversion: 2.1 time: 0.395972 Aug 30 03:34:19.294560 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1158/2326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:18 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:19.485469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-70ca52f7-6ea9-4242-a294-fa29576882d4 req-77e5331f-34ae-45d1-b740-8832000128e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc46ac6-8e36-41c3-81ee-8268d4bca428", "name": "network-vif-plugged", "status": "completed", "tag": "918b0f91-cf85-45f5-bac3-5562e487dd8c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:19.540857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-70ca52f7-6ea9-4242-a294-fa29576882d4 req-77e5331f-34ae-45d1-b740-8832000128e4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:19.541478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-70ca52f7-6ea9-4242-a294-fa29576882d4 req-77e5331f-34ae-45d1-b740-8832000128e4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:19.541983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-70ca52f7-6ea9-4242-a294-fa29576882d4 req-77e5331f-34ae-45d1-b740-8832000128e4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:19.567221 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-70ca52f7-6ea9-4242-a294-fa29576882d4 req-77e5331f-34ae-45d1-b740-8832000128e4 service nova] Creating event network-vif-plugged:918b0f91-cf85-45f5-bac3-5562e487dd8c for instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 on n-h2-854924-5 Aug 30 03:34:19.574916 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-70ca52f7-6ea9-4242-a294-fa29576882d4 req-77e5331f-34ae-45d1-b740-8832000128e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097333 Aug 30 03:34:19.577520 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1169/2327] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:19.721879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:19.723622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:19.740419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:19.741274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:19.742825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:19.744185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:19.745434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:19.746085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:19.824004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:19.824703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:19.832165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:19.832923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:19.833363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:19.834071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:19.834770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:19.835201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:20.487031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:20.496445 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f88dfb90-6db6-4e83-abb5-340ee33218ab tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1465 microversion: 2.1 time: 0.780093 Aug 30 03:34:20.503640 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1159/2328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:19 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1465 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:20.512877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:20.522010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:20.528036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:20.529317 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-60728384-e646-4b83-a75e-02211b13609a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.708076 Aug 30 03:34:20.536571 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1170/2329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:19 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:20.547843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:20.548760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:20.549671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:20.550947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:20.551477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:20.552152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:20.554570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:20.555790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:20.560809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:20.561302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:20.566484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:20.566484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:20.566999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:20.567385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:20.924904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:20.940162 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d8a5955-3fd1-4b20-83e5-6524b8ea9f0b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1315 microversion: 2.1 time: 0.435290 Aug 30 03:34:20.941476 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1160/2330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:20 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:20.956059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:20.969425 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-499e7328-6001-4c39-bfdc-8007096cceaf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 200 len: 1473 microversion: 2.1 time: 0.431545 Aug 30 03:34:20.976472 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1171/2331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:20 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 1473 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:21.012214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1889732878"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:21.021401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:21.062534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.074438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.079617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.080417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.080913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.081395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.596038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4bdf010b-4352-4a06-8004-2ab0814dfd0a req-63c70790-06ed-4fe9-a5bf-93d0f3f9c902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3acf69eb-abe5-478c-b51a-80fe5d8d16aa", "name": "network-vif-deleted", "tag": "aa54580e-7150-490e-994f-7fa8b5a90a94"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:21.639384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4bdf010b-4352-4a06-8004-2ab0814dfd0a req-63c70790-06ed-4fe9-a5bf-93d0f3f9c902 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.640223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4bdf010b-4352-4a06-8004-2ab0814dfd0a req-63c70790-06ed-4fe9-a5bf-93d0f3f9c902 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.640997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4bdf010b-4352-4a06-8004-2ab0814dfd0a req-63c70790-06ed-4fe9-a5bf-93d0f3f9c902 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.658415 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4bdf010b-4352-4a06-8004-2ab0814dfd0a req-63c70790-06ed-4fe9-a5bf-93d0f3f9c902 service nova] Creating event network-vif-deleted:aa54580e-7150-490e-994f-7fa8b5a90a94 for instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa on n-h2-854924-5 Aug 30 03:34:21.665375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4bdf010b-4352-4a06-8004-2ab0814dfd0a req-63c70790-06ed-4fe9-a5bf-93d0f3f9c902 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227963 Aug 30 03:34:21.667313 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1172/2332] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:21.677002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:21.678321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:21.686710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.687563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.688623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.689751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.690842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.691497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.741991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.742890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.743915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.747545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lazy-loading 'fault' on Instance uuid 3acf69eb-abe5-478c-b51a-80fe5d8d16aa {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:34:21.808901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:21.820343 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-73f8b8ed-8241-488d-b862-2ab760b1915c tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 200 len: 1308 microversion: 2.1 time: 0.149150 Aug 30 03:34:21.821511 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1173/2333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:21 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:21.828481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:21.829733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:21.858506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.859775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.861054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.862959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:21.863612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:21.864501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:21.896200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:22.205337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:22.224371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b595a5b7-22b9-47a4-bba4-87b646dadfa6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.400173 Aug 30 03:34:22.224951 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1174/2334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:21 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:22.256275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f738c6fe-b2d1-46bd-81df-0683db16e6b3 req-b30fd64d-4732-4b83-b42c-dcb3bd4db7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d009a60-8954-4751-af6b-79a70c09279b", "name": "network-vif-plugged", "status": "completed", "tag": "4b8f4bde-8510-4e8b-b73e-9905279f3349"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:22.267730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f738c6fe-b2d1-46bd-81df-0683db16e6b3 req-b30fd64d-4732-4b83-b42c-dcb3bd4db7c3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:22.268526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f738c6fe-b2d1-46bd-81df-0683db16e6b3 req-b30fd64d-4732-4b83-b42c-dcb3bd4db7c3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:22.269180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f738c6fe-b2d1-46bd-81df-0683db16e6b3 req-b30fd64d-4732-4b83-b42c-dcb3bd4db7c3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:22.299605 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f738c6fe-b2d1-46bd-81df-0683db16e6b3 req-b30fd64d-4732-4b83-b42c-dcb3bd4db7c3 service nova] Creating event network-vif-plugged:4b8f4bde-8510-4e8b-b73e-9905279f3349 for instance 2d009a60-8954-4751-af6b-79a70c09279b on n-h1-854924-5 Aug 30 03:34:22.306640 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f738c6fe-b2d1-46bd-81df-0683db16e6b3 req-b30fd64d-4732-4b83-b42c-dcb3bd4db7c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068678 Aug 30 03:34:22.308419 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1175/2335] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:22.316042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:22.316982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:22.324171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:22.324901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:22.325530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:22.326391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:22.326989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:22.327553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:22.666855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:22.676600 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74bb27c9-113b-4a4e-84fc-9b3299cc2cb1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1501 microversion: 2.1 time: 0.366801 Aug 30 03:34:22.690956 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1176/2336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:22 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:22.714538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2086408505"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:22.715115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:22.732604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:22.736615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:22.737071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:22.739560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:22.743209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:22.745182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:23.112911 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Adding security group a22ffd8a-457a-4569-9d47-5d81447c63c7 to port 918b0f91-cf85-45f5-bac3-5562e487dd8c Aug 30 03:34:23.661572 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2eaf58e5-c1e0-41e6-b3ea-dbfc658902e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428/action" status: 202 len: 0 microversion: 2.1 time: 0.963546 Aug 30 03:34:23.662965 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1177/2337] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:22 2022] POST /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:34:23.668472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:23.669099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 3acf69eb-abe5-478c-b51a-80fe5d8d16aa] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:23.688770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:23.689219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:23.689697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:23.690429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:23.693427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:23.693891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:23.714007 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] HTTP exception thrown: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa could not be found. Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Request method failure captured: Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa HTTP/1.1 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUAn9XtiNK9wal9V06qG59xTTjpWmAbl0NABZFaf5347AxYdry4Gaz3L1rOTOZDfM4TaN0d_8ui6B5E7NJJnOoBQeE-HcQ8mL24TGdPI_TxplpsPcNoLkfn_EtkRkGRQcNlj78tqg2_jp5LZbLFEHkIocUW69abndaU7cVGfLRn35M Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 166951db958c4bbb86c5808b3e6bbd00 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-LiveMigrationNegativeTest-1794803104 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/166951db958c4bbb86c5808b3e6bbd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/166951db958c4bbb86c5808b3e6bbd00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_166951db958c4bbb86c5808b3e6bbd00", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/166951db958c4bbb86c5808b3e6bbd00"}]}] Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-LiveMigrationNegativeTest-1794803104 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 166951db958c4bbb86c5808b3e6bbd00 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1794803104 Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-LiveMigrationNegativeTest-1794803104-project Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: f5d032f3a8994127b3ffc36dc35133ba Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-LiveMigrationNegativeTest-1794803104-project Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa could not be found. Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3acf69eb-abe5-478c-b51a-80fe5d8d16aa'} Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa could not be found. Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa could not be found. Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:23.720323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa could not be found. Aug 30 03:34:23.725679 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:23.727347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Returning 404 to user: Instance 3acf69eb-abe5-478c-b51a-80fe5d8d16aa could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:23.728581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5295e62c-6886-4377-8395-9e43622658aa tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa" status: 404 len: 111 microversion: 2.1 time: 0.064513 Aug 30 03:34:23.733456 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1178/2338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:23 2022] GET /compute/v2.1/servers/3acf69eb-abe5-478c-b51a-80fe5d8d16aa => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:34:23.739790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:23.740664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:23.748382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:23.749271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:23.749921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:23.750790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:23.751401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:23.751977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:23.989267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:24.002316 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-feb2079d-c717-4f45-8217-bb80d40525e4 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1309 microversion: 2.1 time: 0.267426 Aug 30 03:34:24.018717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1179/2339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:23 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:24.028943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-216798423"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:24.030777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:24.039095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:24.040292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:24.041256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:24.042909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:24.043747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:24.050392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:24.380894 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Adding security group c4393717-d620-4459-a1e5-65a4c7d483dc to port 918b0f91-cf85-45f5-bac3-5562e487dd8c Aug 30 03:34:24.981295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e66da72-cdeb-45a5-bae6-f3116e7356fa tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428/action" status: 202 len: 0 microversion: 2.1 time: 0.961009 Aug 30 03:34:24.982877 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1180/2340] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:24 2022] POST /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428/action => generated 0 bytes in 963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:24.992134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4d2238b3-2d57-4b37-8e35-c18bc5c9db53 req-c8b40cc2-6799-4974-8ef2-757e17c0101f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc46ac6-8e36-41c3-81ee-8268d4bca428", "tag": "918b0f91-cf85-45f5-bac3-5562e487dd8c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:25.008820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d2238b3-2d57-4b37-8e35-c18bc5c9db53 req-c8b40cc2-6799-4974-8ef2-757e17c0101f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.011529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d2238b3-2d57-4b37-8e35-c18bc5c9db53 req-c8b40cc2-6799-4974-8ef2-757e17c0101f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.015151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d2238b3-2d57-4b37-8e35-c18bc5c9db53 req-c8b40cc2-6799-4974-8ef2-757e17c0101f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:25.036858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4d2238b3-2d57-4b37-8e35-c18bc5c9db53 req-c8b40cc2-6799-4974-8ef2-757e17c0101f service nova] Creating event network-changed:918b0f91-cf85-45f5-bac3-5562e487dd8c for instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 on n-h2-854924-5 Aug 30 03:34:25.052828 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4d2238b3-2d57-4b37-8e35-c18bc5c9db53 req-c8b40cc2-6799-4974-8ef2-757e17c0101f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068186 Aug 30 03:34:25.063180 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1181/2341] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:25.069773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:25.074307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:25.082926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.084916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.106642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:25.107594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.108152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.109449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:25.168060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:34:25.353319 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1dce50e-5d6a-49b3-a432-bec29064b319 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 204 len: 0 microversion: 2.1 time: 0.287840 Aug 30 03:34:25.354269 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1182/2342] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:34:25 2022] DELETE /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:34:25.367062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:25.367996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:25.381040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.381977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.383524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:25.385564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.387091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.389462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:25.760735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-586fb46b-58aa-47c3-bde3-352d45cfbd5b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.399288 Aug 30 03:34:25.762011 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1183/2343] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Aug 30 03:34:25 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428/os-security-groups => generated 1158 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:25.768875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:25.774986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:25.796241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.810123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.811851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:25.815344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:25.816063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:25.816710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:26.090411 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ec19e71-2fbb-468e-a17b-7c0c08b9b9e7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508/action" status: 202 len: 0 microversion: 2.1 time: 5.094389 Aug 30 03:34:26.101649 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1161/2344] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:20 2022] POST /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508/action => generated 0 bytes in 5106 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:34:26.116434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:26.117712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:26.136816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:26.137826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:26.138534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:26.139813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:26.140639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:26.142509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:26.928465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:26.940125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eeb5cda1-9a96-41bc-a7eb-84415786fd61 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1491 microversion: 2.1 time: 1.176779 Aug 30 03:34:26.948759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:26.956652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2be2e9d3-b8a3-40b9-98ed-ac48c648a924 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1474 microversion: 2.1 time: 0.851950 Aug 30 03:34:26.961785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1184/2345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:25 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1491 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:26.969683 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1162/2346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:26 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1474 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:26.974781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-320cdd69-dbeb-4617-87d5-5716d3613713 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897b64c9d0>, body: {"security_group": {"name": " tempest-securitygroup -331339004 ", "description": "tempest-description-900756595"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:26.984833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5de8f8a4-0f2f-4143-a380-b95d85b16915 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae7f700>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:27.076991 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5de8f8a4-0f2f-4143-a380-b95d85b16915 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1414 microversion: 2.1 time: 0.098435 Aug 30 03:34:27.085973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1163/2347] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:26 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:27.094319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:27.094930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:27.117984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:27.118492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:27.120225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:27.121052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:27.121612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:27.122052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:27.636606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:27.650685 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-91aa3895-1c4e-472c-aba8-85ba4c8c66a5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 0.562928 Aug 30 03:34:27.653040 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1164/2348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:27 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:27.659288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1635855213", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:27.749928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:34:27.819779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:28.000099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-320cdd69-dbeb-4617-87d5-5716d3613713 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.036841 Aug 30 03:34:28.000714 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1185/2349] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:26 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:28.005708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8e5c1f52-97ed-41a3-868b-91e01370eee4 req-b767cebd-4d0e-4e47-ab6e-d452cf68e52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc46ac6-8e36-41c3-81ee-8268d4bca428", "tag": "918b0f91-cf85-45f5-bac3-5562e487dd8c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:28.027337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8e5c1f52-97ed-41a3-868b-91e01370eee4 req-b767cebd-4d0e-4e47-ab6e-d452cf68e52a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.028376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8e5c1f52-97ed-41a3-868b-91e01370eee4 req-b767cebd-4d0e-4e47-ab6e-d452cf68e52a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.028975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8e5c1f52-97ed-41a3-868b-91e01370eee4 req-b767cebd-4d0e-4e47-ab6e-d452cf68e52a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:28.049288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8e5c1f52-97ed-41a3-868b-91e01370eee4 req-b767cebd-4d0e-4e47-ab6e-d452cf68e52a service nova] Creating event network-changed:918b0f91-cf85-45f5-bac3-5562e487dd8c for instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 on n-h2-854924-5 Aug 30 03:34:28.055174 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8e5c1f52-97ed-41a3-868b-91e01370eee4 req-b767cebd-4d0e-4e47-ab6e-d452cf68e52a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053083 Aug 30 03:34:28.056222 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1186/2350] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:28.156132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-83c45b15-d50d-49b5-a2a9-3619aa521fc8 req-3342e796-07bc-4653-b83f-bf25c02671dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b", "name": "network-vif-deleted", "tag": "0cb0b50e-d394-4a82-ae71-4c77a8c85b43"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:28.169318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-83c45b15-d50d-49b5-a2a9-3619aa521fc8 req-3342e796-07bc-4653-b83f-bf25c02671dd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.170151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-83c45b15-d50d-49b5-a2a9-3619aa521fc8 req-3342e796-07bc-4653-b83f-bf25c02671dd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.170789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-83c45b15-d50d-49b5-a2a9-3619aa521fc8 req-3342e796-07bc-4653-b83f-bf25c02671dd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:28.185483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-83c45b15-d50d-49b5-a2a9-3619aa521fc8 req-3342e796-07bc-4653-b83f-bf25c02671dd service nova] Creating event network-vif-deleted:0cb0b50e-d394-4a82-ae71-4c77a8c85b43 for instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b on n-h2-854924-5 Aug 30 03:34:28.199967 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-83c45b15-d50d-49b5-a2a9-3619aa521fc8 req-3342e796-07bc-4653-b83f-bf25c02671dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141894 Aug 30 03:34:28.201494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1187/2351] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:28.212793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:28.214105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:28.222782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.223286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.223730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:28.224505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.224991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.225491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:28.285638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.286781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.287171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:28.287635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lazy-loading 'fault' on Instance uuid 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:34:28.529319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d032f3a8994127b3ffc36dc35133ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166951db958c4bbb86c5808b3e6bbd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:28.536623 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1e918b8-b24a-49d2-ba90-0e84b919eeba tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 200 len: 1308 microversion: 2.1 time: 0.329746 Aug 30 03:34:28.538027 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1188/2352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:28 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:28.546131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9a51de36-0b10-47e9-b765-7b4c1a42bbb6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897bf33ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:28.781170 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9a51de36-0b10-47e9-b765-7b4c1a42bbb6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8" status: 200 len: 222 microversion: 2.1 time: 0.241765 Aug 30 03:34:28.782099 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1189/2353] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:34:28 2022] GET /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8 => generated 222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:28.786874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37b23a03-6b29-44f8-ab35-5e6c4c5dce3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b847940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:28.838796 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37b23a03-6b29-44f8-ab35-5e6c4c5dce3b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1414 microversion: 2.1 time: 0.055377 Aug 30 03:34:28.839675 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1190/2354] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:28 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:28.850648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:28.851571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:28.862988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.863699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.864411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:28.865383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:28.866060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:28.867050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:29.238072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:29.253125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8ebe312d-e683-4e05-8e99-921b1c768fa3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.411956 Aug 30 03:34:29.272220 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1191/2355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:28 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:29.281336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98f07de0-2f5d-44f6-9b9f-9267dc6c45c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ba328b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:29.340833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:34:29.341942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:34:29.343103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:34:29.343683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:34:29.344311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:34:29.358984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:29.359501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:29.360101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:29.361531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:29.362113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:29.362595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:29.383019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:34:29.395443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:34:29.411793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:34:29.415891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:34:29.491650 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92aeef19-6151-4d1f-9333-91c55ea92f00 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.837144 Aug 30 03:34:29.493160 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1165/2356] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:34:29.499828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-900944077"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:29.502700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:29.510766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:29.511664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:29.512918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:29.514399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:29.515025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:29.515804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:29.804675 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98f07de0-2f5d-44f6-9b9f-9267dc6c45c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8" status: 202 len: 0 microversion: 2.1 time: 0.530825 Aug 30 03:34:29.805911 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1192/2357] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:34:29 2022] DELETE /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:29.811739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02c0f6b5-8ab5-46b9-a735-e4e0cdf1490c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:29.812872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02c0f6b5-8ab5-46b9-a735-e4e0cdf1490c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:29.929330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75dcd68c-351d-4fb7-a5dd-1dff7d6bc7f1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.434689 Aug 30 03:34:29.933129 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1166/2358] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:34:29 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 03:34:29.942706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02c0f6b5-8ab5-46b9-a735-e4e0cdf1490c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:29.950934 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02c0f6b5-8ab5-46b9-a735-e4e0cdf1490c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1209 microversion: 2.1 time: 0.143913 Aug 30 03:34:29.958733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:29.962514 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1193/2359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:29 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:29.965696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] [instance: 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:29.971794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f8983d4a3a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:29.988434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:29.988937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:29.989402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:29.994178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:29.994872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:29.995486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:30.028700 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] HTTP exception thrown: Instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b could not be found. Aug 30 03:34:30.030421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Request method failure captured: Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b HTTP/1.1 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUAn9XtiNK9wal9V06qG59xTTjpWmAbl0NABZFaf5347AxYdry4Gaz3L1rOTOZDfM4TaN0d_8ui6B5E7NJJnOoBQeE-HcQ8mL24TGdPI_TxplpsPcNoLkfn_EtkRkGRQcNlj78tqg2_jp5LZbLFEHkIocUW69abndaU7cVGfLRn35M Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 166951db958c4bbb86c5808b3e6bbd00 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveMigrationNegativeTest-1794803104 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/166951db958c4bbb86c5808b3e6bbd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/166951db958c4bbb86c5808b3e6bbd00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_166951db958c4bbb86c5808b3e6bbd00", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/166951db958c4bbb86c5808b3e6bbd00"}]}] Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveMigrationNegativeTest-1794803104 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 166951db958c4bbb86c5808b3e6bbd00 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1794803104 Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveMigrationNegativeTest-1794803104-project Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: f5d032f3a8994127b3ffc36dc35133ba Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveMigrationNegativeTest-1794803104-project Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b could not be found. Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b'} Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b could not be found. Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b could not be found. Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:30.030943 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b could not be found. Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] Returning 404 to user: Instance 5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:30.035786 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93333263-7d27-4dcb-8fa7-abce77790d10 tempest-LiveMigrationNegativeTest-1794803104 tempest-LiveMigrationNegativeTest-1794803104-project] 10.222.0.30 "GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b" status: 404 len: 111 microversion: 2.1 time: 0.100979 Aug 30 03:34:30.037191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:34:30.037329 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1167/2360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:29 2022] GET /compute/v2.1/servers/5f93bd0d-04f9-4f4f-abbe-90b3a0d9aa2b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:34:30.037509 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.037509 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8 HTTP/1.1 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '54cfadde-aa6a-470d-b17c-cba00a16dfb8'} Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:34:30.040277 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-3320a916-87a5-431d-9b74-3052732f69c9'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:30.050478 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ba5b76f-4a7c-4530-9df4-8fd025f25cdb tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8" status: 404 len: 194 microversion: 2.1 time: 0.075462 Aug 30 03:34:30.055634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fed4565b-0a4c-40b6-bed1-4ed5fba5eec3 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae88b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:30.056274 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1194/2361] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:34:29 2022] GET /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:34:30.058726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b10c2411-d155-41bd-ba51-b6588c308391 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897b240790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1755490716", "description": "tempest-description-198272181"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:30.115099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fed4565b-0a4c-40b6-bed1-4ed5fba5eec3 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1414 microversion: 2.1 time: 0.070549 Aug 30 03:34:30.116462 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1168/2362] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:30 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:30.974822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:30.975585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:30.991137 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b10c2411-d155-41bd-ba51-b6588c308391 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.935194 Aug 30 03:34:30.991794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:30.992557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:30.993214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:30.994258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:30.997529 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1195/2363] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:30.998414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:30.998871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:31.025566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-980dc488-1dd6-4ca0-a09c-e56a85685e47 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897b7b0ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-331566149", "description": "tempest-description-103251067"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:31.166211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:31.181498 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e0fe69e-5dcd-407e-b5d3-8b306d3e1107 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1261 microversion: 2.1 time: 0.211414 Aug 30 03:34:31.183695 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1169/2364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:30 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:34:31.200651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33fc8855-1034-4b6d-9879-716d5848ef3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae884c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:31.290756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33fc8855-1034-4b6d-9879-716d5848ef3e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1414 microversion: 2.1 time: 0.102632 Aug 30 03:34:31.292059 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1170/2365] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:31 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:31.452869 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-980dc488-1dd6-4ca0-a09c-e56a85685e47 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.445064 Aug 30 03:34:31.460278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1196/2366] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:31 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:31.470993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-717f86ab-926a-4d6b-8dd8-4c6d3994c189 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897bd28af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1308568466", "description": "tempest-description-1117234985"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:31.846594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-09a690cc-11d6-4fac-bafa-5657fa20453b req-3ea4217f-2995-412a-942f-37b831b5eee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:31.867705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-09a690cc-11d6-4fac-bafa-5657fa20453b req-3ea4217f-2995-412a-942f-37b831b5eee1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:31.874805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-09a690cc-11d6-4fac-bafa-5657fa20453b req-3ea4217f-2995-412a-942f-37b831b5eee1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:31.875522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-09a690cc-11d6-4fac-bafa-5657fa20453b req-3ea4217f-2995-412a-942f-37b831b5eee1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:31.901409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-09a690cc-11d6-4fac-bafa-5657fa20453b req-3ea4217f-2995-412a-942f-37b831b5eee1 service nova] Creating event network-vif-unplugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:34:31.915262 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-09a690cc-11d6-4fac-bafa-5657fa20453b req-3ea4217f-2995-412a-942f-37b831b5eee1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074095 Aug 30 03:34:31.917030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1197/2367] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:32.129415 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-717f86ab-926a-4d6b-8dd8-4c6d3994c189 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.664705 Aug 30 03:34:32.137643 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1171/2368] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:32.142912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f6bb931-8d34-470a-a520-1b334ad5e55b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b7aa310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:32.206735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:32.207649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:32.219108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:32.220080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:32.220701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:32.221652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:32.222299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:32.222881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:32.351717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:32.363134 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-44ec52f4-f24a-411d-925a-642a78987da5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1267 microversion: 2.1 time: 0.160361 Aug 30 03:34:32.366048 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1172/2369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:32 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:32.381751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed2a14fe-add7-4540-b62c-cb97f04c363e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae8aca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:32.499849 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ed2a14fe-add7-4540-b62c-cb97f04c363e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1414 microversion: 2.1 time: 0.130610 Aug 30 03:34:32.501945 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1173/2370] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:32 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:32.873229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f6bb931-8d34-470a-a520-1b334ad5e55b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.734013 Aug 30 03:34:32.874730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1198/2371] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:34:32 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:32.890240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7462ac32-bbf0-4c70-a0b0-45c7ff4efd41 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ae88a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:33.384766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:33.386418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:33.400138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:33.400642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:33.401120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:33.404724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:33.407254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:33.407714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:33.517889 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7462ac32-bbf0-4c70-a0b0-45c7ff4efd41 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e" status: 202 len: 0 microversion: 2.1 time: 0.633237 Aug 30 03:34:33.519902 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1174/2372] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:34:32 2022] DELETE /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:33.528079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1e48c69b-6b10-44d1-8c10-bba8d68cc9db tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b7d6820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:34.508530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:34.538836 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-32ae9f90-27cb-4277-8c95-bba95e5176a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1309 microversion: 2.1 time: 1.156550 Aug 30 03:34:34.543574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1199/2373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:33 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1309 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:34:34.576811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897bb53820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:34.710495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:34:34.711293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:34:34.712047 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.712047 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e HTTP/1.1 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c98903ab-f18e-404a-b0a2-9f2fc7bb696e'} Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:34:34.716433 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] Aug 30 03:34:34.720019 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:34.725646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:34:34.725646 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-2f3dab63-5e68-4590-b091-faec777cf0d4'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:34.727855 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09e79189-dc13-47e9-bfb7-3c4dd19b4aca tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e" status: 404 len: 194 microversion: 2.1 time: 0.182661 Aug 30 03:34:34.728798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1200/2374] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:34:34 2022] GET /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e => generated 194 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:34:34.740715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c8fa2b4b-2165-480a-be82-e06bbec3f16b req-f68c0c1f-0335-4b27-a99f-aab972050993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db50094-5c80-4366-b3d6-2af379db8508", "name": "network-vif-plugged", "status": "completed", "tag": "7eb03b16-3328-4e92-a75e-2af01c5cfdd3"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:34.777418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c8fa2b4b-2165-480a-be82-e06bbec3f16b req-f68c0c1f-0335-4b27-a99f-aab972050993 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:34.780654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c8fa2b4b-2165-480a-be82-e06bbec3f16b req-f68c0c1f-0335-4b27-a99f-aab972050993 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:34.782398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c8fa2b4b-2165-480a-be82-e06bbec3f16b req-f68c0c1f-0335-4b27-a99f-aab972050993 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:34.826416 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c8fa2b4b-2165-480a-be82-e06bbec3f16b req-f68c0c1f-0335-4b27-a99f-aab972050993 service nova] Creating event network-vif-plugged:7eb03b16-3328-4e92-a75e-2af01c5cfdd3 for instance 3db50094-5c80-4366-b3d6-2af379db8508 on n-h1-854924-5 Aug 30 03:34:34.837022 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c8fa2b4b-2165-480a-be82-e06bbec3f16b req-f68c0c1f-0335-4b27-a99f-aab972050993 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106157 Aug 30 03:34:34.843477 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1201/2375] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:34.857770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fbdbbdd0-8b5d-4638-bcf3-026d2469cc7e tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ba328b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:35.356784 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fbdbbdd0-8b5d-4638-bcf3-026d2469cc7e tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8" status: 202 len: 0 microversion: 2.1 time: 0.511672 Aug 30 03:34:35.357742 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1202/2376] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:34:34 2022] DELETE /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:35.365800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b240e50>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:35.449795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:34:35.451002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group 700e98db-0af5-4fc7-915b-106b424556a8 not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:34:35.451678 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.451678 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8 HTTP/1.1 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '700e98db-0af5-4fc7-915b-106b424556a8'} Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:34:35.453870 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-a471f1b7-0d35-4c97-b938-274af4a73460'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99be2425-7b16-4f04-a962-6f02334b78c2 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8" status: 404 len: 194 microversion: 2.1 time: 0.094036 Aug 30 03:34:35.460993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1203/2377] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:34:35 2022] GET /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:34:35.475505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4418fbeb-7b24-4dcd-af6f-05c14d510663 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b240c10>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:36.634436 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4418fbeb-7b24-4dcd-af6f-05c14d510663 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717" status: 202 len: 0 microversion: 2.1 time: 1.173363 Aug 30 03:34:36.635167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1204/2378] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:34:35 2022] DELETE /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717 => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:34:36.639704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:36.640438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:36.643636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:36.658030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:36.658528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:36.658957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:36.661830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:36.662147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:36.662579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:37.043929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:37.057797 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-88a1512b-ea93-444e-a0e4-df25858b869b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1309 microversion: 2.1 time: 0.421637 Aug 30 03:34:37.061294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1205/2379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:36 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1309 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:37.286007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d54a4a59-ffdd-47dd-b472-9efed0211153 tempest-NetworksTest-949530785 tempest-NetworksTest-949530785-project-admin] Calling method '.version_select at 0x7f897be1f280>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:37.607886 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d54a4a59-ffdd-47dd-b472-9efed0211153 tempest-NetworksTest-949530785 tempest-NetworksTest-949530785-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 7411 microversion: 2.1 time: 0.544894 Aug 30 03:34:37.608878 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1206/2380] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:34:37 2022] GET /compute/v2.1/os-networks => generated 7411 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:37.614732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b7a1c10>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:37.770293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:34:37.771715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:34:37.772420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.772420 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717 HTTP/1.1 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c7c1d74c-702f-4a63-840e-4a0a6ae6a717'} Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:34:37.775304 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] Aug 30 03:34:37.780273 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:34:37.784137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:34:37.784137 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-b0eaf905-ebf2-406f-b322-c640df85c978'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:34:37.785253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-112df7ae-d606-41c1-b949-e6d101acb308 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717" status: 404 len: 194 microversion: 2.1 time: 0.175069 Aug 30 03:34:37.786003 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1207/2381] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:34:37 2022] GET /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:34:37.796190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-efe31d0d-bc1d-4d2d-8d07-20c8333e72e7 req-c97f4595-b6f6-4649-a80b-f53861c1f417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72b0843-1012-4770-b507-632e0a551d5a", "tag": "92578ceb-723a-47ee-8ad0-56d99123adb4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:37.811297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-efe31d0d-bc1d-4d2d-8d07-20c8333e72e7 req-c97f4595-b6f6-4649-a80b-f53861c1f417 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:37.811786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-efe31d0d-bc1d-4d2d-8d07-20c8333e72e7 req-c97f4595-b6f6-4649-a80b-f53861c1f417 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:37.812219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-efe31d0d-bc1d-4d2d-8d07-20c8333e72e7 req-c97f4595-b6f6-4649-a80b-f53861c1f417 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:37.833270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-efe31d0d-bc1d-4d2d-8d07-20c8333e72e7 req-c97f4595-b6f6-4649-a80b-f53861c1f417 service nova] Creating event network-changed:92578ceb-723a-47ee-8ad0-56d99123adb4 for instance f72b0843-1012-4770-b507-632e0a551d5a on n-h2-854924-5 Aug 30 03:34:37.842332 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-efe31d0d-bc1d-4d2d-8d07-20c8333e72e7 req-c97f4595-b6f6-4649-a80b-f53861c1f417 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055002 Aug 30 03:34:37.843503 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1208/2382] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:37.853042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1839325220", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "790c575c-89a4-4f37-8094-cadf2b9c79fa"}], "block_device_mapping_v2": [{"uuid": "ca29f4d7-23b0-4875-bbf5-8e9547dbdbbb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:37.965781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] validate_networks() for [('790c575c-89a4-4f37-8094-cadf2b9c79fa', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:34:39.371593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:39.386699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:34:39.387751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:34:39.388432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:34:39.389009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:34:39.389872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:34:39.409669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:39.411084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:39.413859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:39.414711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:39.415519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:39.415991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:39.416454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:39.462916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:34:39.482178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Getting quotas for user 90a88f0a70ca48f59450dae1c9165417 and project 0e260d308f384ae5a6b7437e21055c75. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:34:39.597945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:34:39.602135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca29f4d7-23b0-4875-bbf5-8e9547dbdbbb',volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:34:39.899866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd17bc5d-922d-41bc-8592-4294fcfc922c tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.054896 Aug 30 03:34:39.914850 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1209/2383] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:34:39.921369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a842d2d-74ff-4508-a41e-0a5fda91491c tempest-NetworksTest-949530785 tempest-NetworksTest-949530785-project-admin] Calling method '.version_select at 0x7f897b7a1550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:40.312437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a842d2d-74ff-4508-a41e-0a5fda91491c tempest-NetworksTest-949530785 tempest-NetworksTest-949530785-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/21bf2f3d-b99c-4490-94eb-bf6494e7e47d" status: 200 len: 652 microversion: 2.1 time: 0.390966 Aug 30 03:34:40.313203 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1210/2384] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:34:39 2022] GET /compute/v2.1/os-networks/21bf2f3d-b99c-4490-94eb-bf6494e7e47d => generated 652 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:40.332354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fd5907c-6cb2-4b67-9ecb-c4d3a9ad55ff tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b65d430>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:40.910926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fd5907c-6cb2-4b67-9ecb-c4d3a9ad55ff tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.584965 Aug 30 03:34:40.910926 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1211/2385] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:34:40 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:40.926318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:40.927017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:40.943317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:40.959392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:40.961407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:40.965106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:40.965756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:40.966256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:41.320785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:41.324827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:41.347359 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e4284bf-104c-465f-8ce1-72843d085691 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1309 microversion: 2.1 time: 0.425153 Aug 30 03:34:41.348144 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1212/2386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:40 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:41.358886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:41.372423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:41.395703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:41.401854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:41.402480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:41.405781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:41.407783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:41.409777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:41.559873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:41.573270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:41.574812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:41.576804 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4de8b849-4789-4c5b-918c-275804ceb736 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1233 microversion: 2.25 time: 0.222090 Aug 30 03:34:41.579951 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1213/2387] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:41 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1233 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:41.586247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-31acc904-1b5a-4d85-9a30-76cdf6595fd0 req-1d21932a-d7a8-4f23-b202-370d197e3183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:41.599506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31acc904-1b5a-4d85-9a30-76cdf6595fd0 req-1d21932a-d7a8-4f23-b202-370d197e3183 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:41.600630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31acc904-1b5a-4d85-9a30-76cdf6595fd0 req-1d21932a-d7a8-4f23-b202-370d197e3183 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:41.601303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31acc904-1b5a-4d85-9a30-76cdf6595fd0 req-1d21932a-d7a8-4f23-b202-370d197e3183 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:41.614085 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-31acc904-1b5a-4d85-9a30-76cdf6595fd0 req-1d21932a-d7a8-4f23-b202-370d197e3183 service nova] Creating event network-vif-plugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:34:41.622364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-31acc904-1b5a-4d85-9a30-76cdf6595fd0 req-1d21932a-d7a8-4f23-b202-370d197e3183 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041127 Aug 30 03:34:41.623333 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1214/2388] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:41.630773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2b824d4f-fe95-419e-9be7-92e86e8d269e tempest-NetworksTest-949530785 tempest-NetworksTest-949530785-project-admin] Calling method '.version_select at 0x7f897ba32b80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:41.889884 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2b824d4f-fe95-419e-9be7-92e86e8d269e tempest-NetworksTest-949530785 tempest-NetworksTest-949530785-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 7411 microversion: 2.1 time: 0.265099 Aug 30 03:34:41.891306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1215/2389] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:34:41 2022] GET /compute/v2.1/os-networks => generated 7411 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:41.896875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-113e8174-6754-4fe1-80f4-0f448ed283fe tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897bab1820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-984857238", "description": "tempest-description-1821927714"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:42.216887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:42.357098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:42.395161 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-113e8174-6754-4fe1-80f4-0f448ed283fe tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.502691 Aug 30 03:34:42.398006 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1216/2390] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:42.405864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:42.409542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:42.430246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:42.431539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:42.433301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:42.437006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:42.440990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:42.442122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:42.920261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:42.934936 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f16ab00-ca27-4a08-8393-6a50eff8b182 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1309 microversion: 2.1 time: 0.535470 Aug 30 03:34:42.937614 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1217/2391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:42 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:42.957909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0262c3b9-a439-4939-aa56-815c66430f2b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897bd968b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1623902269", "description": "tempest-description-1449098466"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:44.898706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0262c3b9-a439-4939-aa56-815c66430f2b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.959261 Aug 30 03:34:44.915772 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1218/2392] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:34:42 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:44.994009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:44.998886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:45.038885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:45.047839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:45.049900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:45.058192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:45.062187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:45.062826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:45.263671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:45.311378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:45.327624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:45.340024 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9df30aff-9f47-4bd6-adaa-8d24afe9875f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1251 microversion: 2.25 time: 0.377661 Aug 30 03:34:45.340862 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1219/2393] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:44 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1251 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:45.357002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-290a55b6-5560-4c1a-94f7-a68667d42463 req-192ca985-96bc-42bc-af18-294d61f01905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72b0843-1012-4770-b507-632e0a551d5a", "name": "network-vif-plugged", "status": "completed", "tag": "92578ceb-723a-47ee-8ad0-56d99123adb4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:45.421851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-290a55b6-5560-4c1a-94f7-a68667d42463 req-192ca985-96bc-42bc-af18-294d61f01905 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:45.427213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-290a55b6-5560-4c1a-94f7-a68667d42463 req-192ca985-96bc-42bc-af18-294d61f01905 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:45.427824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-290a55b6-5560-4c1a-94f7-a68667d42463 req-192ca985-96bc-42bc-af18-294d61f01905 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:45.475288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-290a55b6-5560-4c1a-94f7-a68667d42463 req-192ca985-96bc-42bc-af18-294d61f01905 service nova] Creating event network-vif-plugged:92578ceb-723a-47ee-8ad0-56d99123adb4 for instance f72b0843-1012-4770-b507-632e0a551d5a on n-h2-854924-5 Aug 30 03:34:45.513923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-290a55b6-5560-4c1a-94f7-a68667d42463 req-192ca985-96bc-42bc-af18-294d61f01905 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161163 Aug 30 03:34:45.522610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1220/2394] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:45.536227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:45.555462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:45.576645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:45.585494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:45.586554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:45.589706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:45.590282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:45.590812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:46.209711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:46.248017 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a016cd49-ed17-487b-934c-59f29594a755 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1309 microversion: 2.1 time: 0.690434 Aug 30 03:34:46.301678 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1221/2395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:45 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1309 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:46.344642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1744015514", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "dd88f3b5-60f8-4e83-bf63-1610edcfa8b9"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:47.336794 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1e48c69b-6b10-44d1-8c10-bba8d68cc9db tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1414 microversion: 2.1 time: 13.814719 Aug 30 03:34:47.338569 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1175/2396] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:33 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1414 bytes in 13818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:47.359399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] validate_networks() for [('dd88f3b5-60f8-4e83-bf63-1610edcfa8b9', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:34:47.361487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:47.367562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:47.401295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:47.401906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:47.404119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:47.408328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:47.409006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:47.410524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:48.328290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:48.355335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:48.366476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:48.371803 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf631864-5375-4535-95ab-9496f6d580fa tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1293 microversion: 2.25 time: 1.030649 Aug 30 03:34:48.375218 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1176/2397] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:47 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1293 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:48.397908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:48.398529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:48.433589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:48.434095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:48.434534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:48.435242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:48.435696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:48.436117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:48.860557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:48.879093 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9681d6e6-8a84-49fb-9b38-5950ba451365 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1491 microversion: 2.1 time: 0.502085 Aug 30 03:34:48.879740 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1177/2398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:48 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1491 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:48.893258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-71b75af7-5d25-45d4-8b4b-b3291b8d4c76 req-fc9f11d5-2fd4-4478-98b1-c37f2c05e016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544a5e62-2526-4cf2-b66c-12031771336b", "tag": "76e3a72c-44fb-4c4b-927d-4ffc06541f0e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:48.918669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71b75af7-5d25-45d4-8b4b-b3291b8d4c76 req-fc9f11d5-2fd4-4478-98b1-c37f2c05e016 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:48.922436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71b75af7-5d25-45d4-8b4b-b3291b8d4c76 req-fc9f11d5-2fd4-4478-98b1-c37f2c05e016 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:48.923096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71b75af7-5d25-45d4-8b4b-b3291b8d4c76 req-fc9f11d5-2fd4-4478-98b1-c37f2c05e016 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:48.960961 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-71b75af7-5d25-45d4-8b4b-b3291b8d4c76 req-fc9f11d5-2fd4-4478-98b1-c37f2c05e016 service nova] Creating event network-changed:76e3a72c-44fb-4c4b-927d-4ffc06541f0e for instance 544a5e62-2526-4cf2-b66c-12031771336b on n-h2-854924-5 Aug 30 03:34:48.977095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-71b75af7-5d25-45d4-8b4b-b3291b8d4c76 req-fc9f11d5-2fd4-4478-98b1-c37f2c05e016 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092978 Aug 30 03:34:48.982242 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1178/2399] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:49.008972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13bf055e-ca8e-4e80-8ae6-c4612e8f90ee tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b7ebe50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:49.272257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:34:49.273555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:34:49.274234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:34:49.276954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:34:49.277707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:34:49.305475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:49.306482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:49.308941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:49.310248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:49.312045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:49.314385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:49.401127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Getting quotas for project d40a94656bfd4ebeba785fbf8be1a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:34:49.424293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Getting quotas for user 9ad10e8a5ee24e44bb60c03014adf1d3 and project d40a94656bfd4ebeba785fbf8be1a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:34:49.469237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:34:49.473672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:34:49.650639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c6ce6eb-b3e9-438a-81e3-2c40d58b24e8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.365614 Aug 30 03:34:49.662544 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1222/2400] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:34:49.956692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-157c1bc5-e90e-4958-84ce-6ce4909f42fe tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] Calling method '.version_select at 0x7f897b3194c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:49.998806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-157c1bc5-e90e-4958-84ce-6ce4909f42fe tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.334295 Aug 30 03:34:50.010520 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1223/2401] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:34:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:50.032638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:50.033255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:50.064774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:50.068102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:50.070733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:50.074812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:50.076373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:50.077067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:50.590244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:50.626032 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85aef5f6-3874-4ceb-ba2e-5195cc9c50c6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1491 microversion: 2.1 time: 0.591123 Aug 30 03:34:50.638711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1224/2402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:50 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1491 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:50.643943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:50.662685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:50.692417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:50.699432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:50.702443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:50.706479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:50.706479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:50.714255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:51.182799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:51.194511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:51.196367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:51.200490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eacd9dcf-756a-4c06-8f0f-8f4a4c8223af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1293 microversion: 2.25 time: 0.560579 Aug 30 03:34:51.202554 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1225/2403] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:50 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1293 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:51.222848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:51.224957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:51.234989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:51.236290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:51.236950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:51.242549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:51.243368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:51.244025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:51.486522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:51.496336 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea28ff63-7ca6-4120-a8f6-894f09e90884 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1268 microversion: 2.1 time: 0.292463 Aug 30 03:34:51.515765 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1226/2404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:51 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1268 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:51.536974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b32120e4-2e48-443b-8c38-9d9dcb8304e1 tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] Action: 'update', calling method: .version_select at 0x7f897b16b430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:52.329205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=12,nova_api:UPDATE=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:52.389330 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b32120e4-2e48-443b-8c38-9d9dcb8304e1 tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.868599 Aug 30 03:34:52.392391 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1227/2405] 10.222.0.30 () {60 vars in 1206 bytes} [Tue Aug 30 03:34:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:52.406581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:52.407214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:52.437064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:52.437588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:52.438028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:52.438739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:52.439195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:52.439620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:53.381816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:53.396831 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed770f4b-e349-45ff-a89b-92806131f911 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1491 microversion: 2.1 time: 1.002039 Aug 30 03:34:53.414799 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1228/2406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:52 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1491 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:53.422559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:53.423242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:53.442683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:53.444937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:53.445930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:53.448269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:53.449679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:53.450207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:54.022157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:54.031159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:54.032609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:54.062376 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67ef49b6-99b3-47b9-a323-ace30826b83f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1293 microversion: 2.25 time: 0.617807 Aug 30 03:34:54.063629 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1229/2407] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:53 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1293 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:54.077781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b4cd5a1-0e55-47ae-af59-8a771f17dae7 tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] Calling method '.version_select at 0x7f897b6ef940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:54.128866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b4cd5a1-0e55-47ae-af59-8a771f17dae7 tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.054466 Aug 30 03:34:54.129897 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1230/2408] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:34:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:54.146949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:54.147569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:54.168246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:54.168853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:54.169275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:54.170167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:54.170653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:54.171093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:54.946536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:54.963398 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8451266a-03da-4d7c-b385-12f3c14edfc8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1274 microversion: 2.1 time: 0.832057 Aug 30 03:34:54.965050 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1231/2409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:54 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1274 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:54.990540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:54.993671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:55.013228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:55.014303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:55.014909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:55.016267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:55.017754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:55.019562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:55.086808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:34:55.303666 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1cf54a93-6690-4423-a3e4-cecabab5da3a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 204 len: 0 microversion: 2.1 time: 0.332803 Aug 30 03:34:55.305052 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1232/2410] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:34:54 2022] DELETE /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:34:55.311124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bd39b75d-1170-4c4c-80d5-d5dd284ea34e tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] Action: 'update', calling method: .version_select at 0x7f897bf339d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:55.556270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=42,nova_cell0:UPDATE=7 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:55.613518 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bd39b75d-1170-4c4c-80d5-d5dd284ea34e tempest-QuotaClassesAdminTestJSON-2083196019 tempest-QuotaClassesAdminTestJSON-2083196019-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.287481 Aug 30 03:34:55.613518 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1233/2411] 10.222.0.30 () {60 vars in 1206 bytes} [Tue Aug 30 03:34:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:55.620698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:55.622005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:55.643487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:55.644186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:55.644558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:55.645746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:55.646214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:55.646828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:56.030316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:56.043147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:56.044695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:56.045906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78e470c0-f960-412b-8021-65685f874229 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1281 microversion: 2.25 time: 0.449887 Aug 30 03:34:56.070615 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1234/2412] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:55 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:56.101183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:56.112905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:56.122736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:56.123836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:56.124390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:56.125006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:56.125513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:56.125950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:56.312007 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13bf055e-ca8e-4e80-8ae6-c4612e8f90ee tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1423 microversion: 2.1 time: 7.310067 Aug 30 03:34:56.312007 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1179/2413] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:48 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1423 bytes in 7318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:56.313839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:56.314661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:56.324909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:56.325831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:56.328125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:56.329723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:56.330515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:56.331580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:56.614985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:56.625751 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77f5275c-5bd6-4e26-a9de-e2620de80733 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1497 microversion: 2.1 time: 0.553493 Aug 30 03:34:56.628486 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1235/2414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:56 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1497 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:56.664276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98b0c5c0-fe8b-49c0-9335-eeab1443d507 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b6e4d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:56.778194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98b0c5c0-fe8b-49c0-9335-eeab1443d507 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 200 len: 1423 microversion: 2.1 time: 0.147917 Aug 30 03:34:56.779261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1236/2415] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:34:56 2022] GET /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 1423 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:56.793163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab17edaa-4e0c-4990-99df-7707bf0eab94 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b8b63a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:57.276581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:57.290545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7bd4e96-7eb8-41c4-9ef8-8ae6f52dd13f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1316 microversion: 2.1 time: 0.986422 Aug 30 03:34:57.294183 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1180/2416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:56 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1316 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:57.310276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:57.316138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:57.337320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:57.340371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:57.341076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:57.344162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:57.344907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:57.345842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:58.620142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:58.637769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:58.639888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:58.641361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db03f6fe-c5bd-4413-bc53-4954670a42d0 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1281 microversion: 2.25 time: 1.345006 Aug 30 03:34:58.657009 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1181/2417] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:57 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1281 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:34:58.685328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:58.704874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:58.715092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab17edaa-4e0c-4990-99df-7707bf0eab94 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 204 len: 0 microversion: 2.1 time: 1.926348 Aug 30 03:34:58.716737 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1237/2418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:56 2022] DELETE /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 0 bytes in 1929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:34:58.721873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:58.726738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:58.735172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:58.735444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:58.735889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:58.736598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:58.737051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:58.737520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:58.750286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:58.775297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:58.777562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:58.782273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:58.783171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:58.783716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:59.245249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:59.257970 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48179cab-0482-46d0-aeba-ebb269dd7ebf tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 200 len: 1455 microversion: 2.1 time: 0.598832 Aug 30 03:34:59.275303 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1182/2419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:58 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 1455 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:59.299831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:59.300672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:59.309467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:59.312119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:59.313172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:59.315746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:59.316222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:59.316660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:59.352782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:59.366717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:34:59.425018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:34:59.431355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:34:59.438896 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a04e39a-79ee-48ce-a678-c55597dc1b25 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1316 microversion: 2.1 time: 0.720696 Aug 30 03:34:59.449052 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1238/2420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:34:58 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1316 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:34:59.462332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3c767d7f-496a-47b6-b49e-5995611f1d5d req-3b10a319-69b4-4452-b521-d6b0b938046c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72b0843-1012-4770-b507-632e0a551d5a", "name": "network-vif-deleted", "tag": "92578ceb-723a-47ee-8ad0-56d99123adb4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:59.508367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3c767d7f-496a-47b6-b49e-5995611f1d5d req-3b10a319-69b4-4452-b521-d6b0b938046c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:59.510541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3c767d7f-496a-47b6-b49e-5995611f1d5d req-3b10a319-69b4-4452-b521-d6b0b938046c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:59.511371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3c767d7f-496a-47b6-b49e-5995611f1d5d req-3b10a319-69b4-4452-b521-d6b0b938046c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:59.515931 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-246c4cd0-70fc-483a-8fe8-cfdee867ace8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 204 len: 0 microversion: 2.1 time: 0.237925 Aug 30 03:34:59.519503 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1183/2421] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:34:59 2022] DELETE /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:34:59.536549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3c767d7f-496a-47b6-b49e-5995611f1d5d req-3b10a319-69b4-4452-b521-d6b0b938046c service nova] Creating event network-vif-deleted:92578ceb-723a-47ee-8ad0-56d99123adb4 for instance f72b0843-1012-4770-b507-632e0a551d5a on n-h2-854924-5 Aug 30 03:34:59.545700 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3c767d7f-496a-47b6-b49e-5995611f1d5d req-3b10a319-69b4-4452-b521-d6b0b938046c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094009 Aug 30 03:34:59.547084 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1239/2422] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:34:59.674539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:34:59.678244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:34:59.694446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:59.698393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:59.701853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:59.704495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:34:59.708740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:34:59.711231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:34:59.738749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-461105696", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b426cd56-ffb2-4a75-8914-dc1bc200de06"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:34:59.944168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] validate_networks() for [('b426cd56-ffb2-4a75-8914-dc1bc200de06', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:35:00.389090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:00.410341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:00.412179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:00.414007 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3556f58e-cbbd-4112-a39d-88717c61eafe tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1281 microversion: 2.25 time: 0.746514 Aug 30 03:35:00.427660 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1184/2423] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:34:59 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1281 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:00.442634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:00.443600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:00.451734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:00.452511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:00.453604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:00.454604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:00.455342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:00.456026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:00.477225 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a HTTP/1.1 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f72b0843-1012-4770-b507-632e0a551d5a'} Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:00.481643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:35:00.485687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:00.488831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:35:00.490325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75a99673-1827-40e6-b924-c66325e05f02 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 404 len: 111 microversion: 2.1 time: 0.051664 Aug 30 03:35:00.491417 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1185/2424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:00 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:35:00.498911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:00.500282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:00.509279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:00.510680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:00.511326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:00.512493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:00.513841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:00.514473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:01.628849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:01.658372 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ee61cb1-38a7-406d-bd9b-fc55b89e4b7f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1316 microversion: 2.1 time: 1.165655 Aug 30 03:35:01.660293 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1186/2425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:00 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1316 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:01.670567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:01.674665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:01.687673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:01.688180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:01.689912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:01.691336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:01.693136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:01.694770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:01.768806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:35:01.958859 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-89121261-2e03-407f-aafb-a6d8d3a87046 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 204 len: 0 microversion: 2.1 time: 0.293741 Aug 30 03:35:01.968859 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1187/2426] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:35:01 2022] DELETE /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:35:02.007460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:02.008780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:02.029719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.030223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.030684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:02.031416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.031912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.032461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:02.585934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:35:02.586903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:35:02.587385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:35:02.588341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:35:02.588758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:35:02.600524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.601696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.602379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:02.604087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.604832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.605466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:02.625901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:35:02.632604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for user cdbd4bfb488c475dac2862ea5df0fe70 and project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:35:02.647798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:35:02.652342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:35:02.705629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:02.707771 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b71880c-426f-4ec3-9ec4-80e628f29015 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.974051 Aug 30 03:35:02.708989 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1240/2427] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:35:02.716872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a929ea99-2270-4a8e-8baa-9613f8d6f0af req-b9ae813a-e01a-46d0-8865-e059256475e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1", "tag": "84f61186-31ab-469b-988f-f81ca6669df1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:02.724013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:02.727422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:02.731655 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42833007-1cf9-40cb-b470-ee7486814ffd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1281 microversion: 2.25 time: 0.760769 Aug 30 03:35:02.732948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a929ea99-2270-4a8e-8baa-9613f8d6f0af req-b9ae813a-e01a-46d0-8865-e059256475e9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.733834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a929ea99-2270-4a8e-8baa-9613f8d6f0af req-b9ae813a-e01a-46d0-8865-e059256475e9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.734018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1188/2428] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:01 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1281 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:02.734587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a929ea99-2270-4a8e-8baa-9613f8d6f0af req-b9ae813a-e01a-46d0-8865-e059256475e9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:02.749026 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a929ea99-2270-4a8e-8baa-9613f8d6f0af req-b9ae813a-e01a-46d0-8865-e059256475e9 service nova] Creating event network-changed:84f61186-31ab-469b-988f-f81ca6669df1 for instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 on n-h2-854924-5 Aug 30 03:35:02.758491 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a929ea99-2270-4a8e-8baa-9613f8d6f0af req-b9ae813a-e01a-46d0-8865-e059256475e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048084 Aug 30 03:35:02.762048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1241/2429] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:02.787369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:02.788756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:02.806069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.806886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.807595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:02.811653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:02.814371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:02.818830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:03.056908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Action: 'update', calling method: .version_select at 0x7f897b758430>, body: {"quota_set": {"ram": "5120"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:03.301597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:03.305211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:03.308496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:03.309684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:03.311019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:03.313004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:03.474786 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31e64063-845f-49d9-be1e-adf11edee819 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f" status: 200 len: 240 microversion: 2.36 time: 0.738075 Aug 30 03:35:03.484960 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1189/2430] 10.222.0.30 () {62 vars in 1303 bytes} [Tue Aug 30 03:35:02 2022] PUT /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f => generated 240 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:35:03.496512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c055f1ab-edf8-465c-9942-7c689de7a456 req-4b5dec06-7c73-4452-98b1-7f5ca0291b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db50094-5c80-4366-b3d6-2af379db8508", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb03b16-3328-4e92-a75e-2af01c5cfdd3"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:03.543772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c055f1ab-edf8-465c-9942-7c689de7a456 req-4b5dec06-7c73-4452-98b1-7f5ca0291b5e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:03.546810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c055f1ab-edf8-465c-9942-7c689de7a456 req-4b5dec06-7c73-4452-98b1-7f5ca0291b5e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:03.548103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c055f1ab-edf8-465c-9942-7c689de7a456 req-4b5dec06-7c73-4452-98b1-7f5ca0291b5e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:03.602530 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c055f1ab-edf8-465c-9942-7c689de7a456 req-4b5dec06-7c73-4452-98b1-7f5ca0291b5e service nova] Creating event network-vif-unplugged:7eb03b16-3328-4e92-a75e-2af01c5cfdd3 for instance 3db50094-5c80-4366-b3d6-2af379db8508 on n-h1-854924-5 Aug 30 03:35:03.621146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c055f1ab-edf8-465c-9942-7c689de7a456 req-4b5dec06-7c73-4452-98b1-7f5ca0291b5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134294 Aug 30 03:35:03.622223 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1190/2431] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:03.643361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:03.644119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:03.653413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:03.653923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:03.654361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:03.655068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:03.655522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:03.656697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:04.590761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:04.611905 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f9684cc-93a4-43e3-b71d-773cc3e0e8c9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1497 microversion: 2.1 time: 1.837801 Aug 30 03:35:04.626548 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1242/2432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:02 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1497 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:04.632069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:04.633218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:04.640283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:04.641107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:04.641784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:04.642714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:04.643358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:04.643989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:04.888349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:04.900223 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c34c57e4-1e2e-4fc9-b7ee-e3a63c40b77c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1259 microversion: 2.1 time: 0.272126 Aug 30 03:35:04.903361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1243/2433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:04 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:04.921179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Calling method '.version_select at 0x7f897ba32b80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:05.034820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:05.052057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-82ad8d38-10bf-4f93-a59e-c731440d55c8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1316 microversion: 2.1 time: 1.425334 Aug 30 03:35:05.052660 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1191/2434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:03 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1316 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:05.071388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:05.072033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:05.098270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.098751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.099186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.099904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.100345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.102275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.104192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.105301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.110908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.111669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.112139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.121709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.216452 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d518c8c-0421-4b5b-b261-c7d354efe47f tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f/detail" status: 200 len: 672 microversion: 2.36 time: 0.300944 Aug 30 03:35:05.217167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1244/2435] 10.222.0.30 () {60 vars in 1304 bytes} [Tue Aug 30 03:35:04 2022] GET /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f/detail => generated 672 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:35:05.587257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Action: 'update', calling method: .version_select at 0x7f897b802040>, body: {"quota_set": {"ram": "2048"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:05.719711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.733401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.735525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.738657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.740456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.742114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.826915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.827878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.828477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.829393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.830008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.830827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.880084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:UPDATE=13 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:05.917139 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e01f8f55-afbd-4137-b0c9-194c334ddd80 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f?user_id=2ec1897bf9c342fbabf26135141d3211" status: 200 len: 240 microversion: 2.36 time: 0.333770 Aug 30 03:35:05.923872 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1245/2436] 10.222.0.30 () {62 vars in 1384 bytes} [Tue Aug 30 03:35:05 2022] PUT /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f?user_id=2ec1897bf9c342fbabf26135141d3211 => generated 240 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:35:05.923872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:05.924443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:05.933038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.933697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.934386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:05.935282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:05.935953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:05.936485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:06.826844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:06.833685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:06.851774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:06.857707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:06.861833 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fae168a8-2373-4eaa-a370-483af654c7a7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1281 microversion: 2.25 time: 1.795288 Aug 30 03:35:06.886843 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1192/2437] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:05 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1281 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:06.893459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-71535186-081b-47de-8725-73c1e64b9274 req-bd4fa500-aa91-431d-9ffd-e347705b72e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544a5e62-2526-4cf2-b66c-12031771336b", "name": "network-vif-plugged", "status": "completed", "tag": "76e3a72c-44fb-4c4b-927d-4ffc06541f0e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:06.907419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71535186-081b-47de-8725-73c1e64b9274 req-bd4fa500-aa91-431d-9ffd-e347705b72e4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:06.911416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71535186-081b-47de-8725-73c1e64b9274 req-bd4fa500-aa91-431d-9ffd-e347705b72e4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:06.912465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71535186-081b-47de-8725-73c1e64b9274 req-bd4fa500-aa91-431d-9ffd-e347705b72e4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:06.927221 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-71535186-081b-47de-8725-73c1e64b9274 req-bd4fa500-aa91-431d-9ffd-e347705b72e4 service nova] Creating event network-vif-plugged:76e3a72c-44fb-4c4b-927d-4ffc06541f0e for instance 544a5e62-2526-4cf2-b66c-12031771336b on n-h2-854924-5 Aug 30 03:35:06.935018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-71535186-081b-47de-8725-73c1e64b9274 req-bd4fa500-aa91-431d-9ffd-e347705b72e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046408 Aug 30 03:35:06.936594 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1193/2438] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:06.969328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:06.970322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:06.978678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:06.979561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:06.980192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:06.981846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:06.983440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:06.984049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:07.140404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:07.156939 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b200d50-e47d-444e-bd8a-e18001df30f5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1497 microversion: 2.1 time: 1.237468 Aug 30 03:35:07.169989 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1246/2439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:05 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1497 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:07.181948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b64dda7d-9e5b-4bd9-8690-cda9c2340285 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] Calling method '.version_select at 0x7f897baa5ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:07.324893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:07.347228 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-363296d8-ba3e-4ec8-bf95-2c6f9a2ff62d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1265 microversion: 2.1 time: 0.408431 Aug 30 03:35:07.347832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1194/2440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:06 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1265 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:07.354126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:07.354771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:07.408181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:07.408691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:07.409131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:07.409893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:07.418465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:07.423356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:07.429803 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b64dda7d-9e5b-4bd9-8690-cda9c2340285 tempest-QuotasAdminTestV236-484908711 tempest-QuotasAdminTestV236-484908711-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f?user_id=2ec1897bf9c342fbabf26135141d3211" status: 200 len: 282 microversion: 2.36 time: 0.249209 Aug 30 03:35:07.434376 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1247/2441] 10.222.0.30 () {60 vars in 1364 bytes} [Tue Aug 30 03:35:07 2022] GET /compute/v2.1/os-quota-sets/c724f815158c4de4a5b54202120fa87f?user_id=2ec1897bf9c342fbabf26135141d3211 => generated 282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:35:07.451799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6beba92c-6b9c-4e6b-99b1-bc26cf071c1c req-dd14ca05-c21b-4f48-99c3-5399101cbcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db50094-5c80-4366-b3d6-2af379db8508", "name": "network-vif-deleted", "tag": "7eb03b16-3328-4e92-a75e-2af01c5cfdd3"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:07.493900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6beba92c-6b9c-4e6b-99b1-bc26cf071c1c req-dd14ca05-c21b-4f48-99c3-5399101cbcb2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:07.507875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6beba92c-6b9c-4e6b-99b1-bc26cf071c1c req-dd14ca05-c21b-4f48-99c3-5399101cbcb2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:07.512426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6beba92c-6b9c-4e6b-99b1-bc26cf071c1c req-dd14ca05-c21b-4f48-99c3-5399101cbcb2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:07.562715 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6beba92c-6b9c-4e6b-99b1-bc26cf071c1c req-dd14ca05-c21b-4f48-99c3-5399101cbcb2 service nova] Creating event network-vif-deleted:7eb03b16-3328-4e92-a75e-2af01c5cfdd3 for instance 3db50094-5c80-4366-b3d6-2af379db8508 on n-h1-854924-5 Aug 30 03:35:07.584858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6beba92c-6b9c-4e6b-99b1-bc26cf071c1c req-dd14ca05-c21b-4f48-99c3-5399101cbcb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149097 Aug 30 03:35:07.590823 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1248/2442] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:07.894834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:07.896039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:07.917563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:07.919099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:07.921980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:07.934807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:07.936608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:07.939521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:08.398916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:08.412756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5bb3e9cb-5bf4-4dde-8a5e-01854447b0ce tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1316 microversion: 2.1 time: 1.063849 Aug 30 03:35:08.413364 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1195/2443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:07 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1316 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:08.442282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:08.442907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:08.500498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:08.501554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:08.509202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:08.510553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:08.513526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:08.515370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:08.653903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:08.659224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:08.663408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:08.663937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lazy-loading 'fault' on Instance uuid 2d009a60-8954-4751-af6b-79a70c09279b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:35:08.855905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:08.872453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:08.881700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:08.883674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:08.885821 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d46a02e4-caff-4e94-bdb3-d65efa21489b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1281 microversion: 2.25 time: 0.995942 Aug 30 03:35:08.888936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-928124e9-2b14-4ddb-b011-4e9dc473620d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 200 len: 1299 microversion: 2.1 time: 0.450375 Aug 30 03:35:08.892590 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1196/2444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:08 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 1299 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:08.901878 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1249/2445] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:07 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1281 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:35:08.911445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:08.914039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:08.937711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:08.938891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:08.940944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:08.944925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:08.945482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:08.946077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:09.118087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:09.133921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-012537fa-1398-49a1-9044-2102eac72b1c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1265 microversion: 2.1 time: 0.237441 Aug 30 03:35:09.152632 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1197/2446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:08 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:09.440062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:09.443020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:09.496255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:09.497008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:09.506477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:09.507711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:09.508371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:09.508985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:09.637258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-084eb4bc-5a03-407a-9586-202ccf1323cd req-81ca10f1-5544-4449-bdbe-4ccfa9bac40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d009a60-8954-4751-af6b-79a70c09279b", "name": "network-vif-deleted", "tag": "4b8f4bde-8510-4e8b-b73e-9905279f3349"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:09.677760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-084eb4bc-5a03-407a-9586-202ccf1323cd req-81ca10f1-5544-4449-bdbe-4ccfa9bac40f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:09.678601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-084eb4bc-5a03-407a-9586-202ccf1323cd req-81ca10f1-5544-4449-bdbe-4ccfa9bac40f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:09.681121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-084eb4bc-5a03-407a-9586-202ccf1323cd req-81ca10f1-5544-4449-bdbe-4ccfa9bac40f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:09.743608 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-084eb4bc-5a03-407a-9586-202ccf1323cd req-81ca10f1-5544-4449-bdbe-4ccfa9bac40f service nova] Creating event network-vif-deleted:4b8f4bde-8510-4e8b-b73e-9905279f3349 for instance 2d009a60-8954-4751-af6b-79a70c09279b on n-h1-854924-5 Aug 30 03:35:09.765690 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-084eb4bc-5a03-407a-9586-202ccf1323cd req-81ca10f1-5544-4449-bdbe-4ccfa9bac40f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134465 Aug 30 03:35:09.767376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1198/2447] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:09.803756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6fdb7961-bcf9-4acb-82b1-076e048dd815 req-5428f604-06e5-409b-ab87-719df9671b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1", "name": "network-vif-plugged", "status": "completed", "tag": "84f61186-31ab-469b-988f-f81ca6669df1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:09.852304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6fdb7961-bcf9-4acb-82b1-076e048dd815 req-5428f604-06e5-409b-ab87-719df9671b89 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:09.855508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6fdb7961-bcf9-4acb-82b1-076e048dd815 req-5428f604-06e5-409b-ab87-719df9671b89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:09.855820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6fdb7961-bcf9-4acb-82b1-076e048dd815 req-5428f604-06e5-409b-ab87-719df9671b89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:09.883796 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6fdb7961-bcf9-4acb-82b1-076e048dd815 req-5428f604-06e5-409b-ab87-719df9671b89 service nova] Creating event network-vif-plugged:84f61186-31ab-469b-988f-f81ca6669df1 for instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 on n-h2-854924-5 Aug 30 03:35:09.890727 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6fdb7961-bcf9-4acb-82b1-076e048dd815 req-5428f604-06e5-409b-ab87-719df9671b89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121367 Aug 30 03:35:09.891901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1199/2448] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:09.933964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:09.934676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:09.950326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:09.951092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:09.953054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:09.954112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:09.954578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:09.955169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.183371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:10.210145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-25cf9f82-0575-4963-ae8f-1d3b1a05bd1d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1316 microversion: 2.1 time: 0.776433 Aug 30 03:35:10.211101 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1250/2449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:09 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:10.243419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:10.250796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:10.276374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:10.279481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:10.280113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.281013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:10.285060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:10.285762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.329404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:35:10.333935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b HTTP/1.1 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2d009a60-8954-4751-af6b-79a70c09279b'} Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:10.339479 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff1c9030-ca38-4fa2-b095-d67ffb6ac7ad tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 404 len: 111 microversion: 2.1 time: 0.111262 Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1251/2450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:10 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:10.359127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:10.364396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:10.366183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:10.367685 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ee2af48-5008-4770-8b24-efa0a583d46e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1476 microversion: 2.25 time: 0.454709 Aug 30 03:35:10.381372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1200/2451] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:09 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1476 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:10.395395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:10.395395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:10.395395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.395395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:10.395395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:10.405957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.813373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:10.814705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:10.823464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:10.824691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:10.825765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.835058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:10.837000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:10.840508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:10.965536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:10.974903 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2709d3c-d062-4bc8-9921-32187fb1a8ad tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1307 microversion: 2.1 time: 0.630692 Aug 30 03:35:10.975873 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1252/2452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:10 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1307 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:11.008079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-33241390", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:11.133024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid 544a5e62-2526-4cf2-b66c-12031771336b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:35:11.133272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:35:11.159737 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e8b2fbf-22b3-47c0-938c-8a31ac403d06 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1969 microversion: 2.25 time: 0.762810 Aug 30 03:35:11.160904 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1201/2453] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:10 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1969 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:11.189399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:11.190491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:11.199781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:11.201572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:11.202304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:11.203297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:11.204056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:11.204848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:11.756897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid 544a5e62-2526-4cf2-b66c-12031771336b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:35:11.796691 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13989c94-1960-45a2-8586-0d3073213dda tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1969 microversion: 2.25 time: 0.610357 Aug 30 03:35:11.797376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1202/2454] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:11 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1969 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:35:11.806774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:11.807516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:11.831551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:11.832171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:11.832472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:11.833179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:11.833794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:11.834090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:12.383843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:12.396127 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4fb92ed8-dbc3-45ea-b334-e4cb12e71329 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1503 microversion: 2.1 time: 0.597384 Aug 30 03:35:12.397593 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1203/2455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:11 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1503 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:12.414211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:12.416456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:12.421051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:12.430058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:12.430725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:12.431276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:12.432199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:12.433522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:12.434235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:12.965762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:35:12.968080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:35:12.968879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:35:12.969664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:35:12.971450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:35:12.992007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:12.992007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:12.993101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:12.993101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:12.995161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:12.995161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.033156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:35:13.050251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:35:13.075971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:35:13.079895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:35:13.177911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:13.178728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31c53024-b5ba-42f4-be75-3b42a301919f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201002 Aug 30 03:35:13.179603 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1253/2456] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:35:13.185638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:13.190275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.191148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.191763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.192870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.193507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.194082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.205987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4900c8ca-4d2a-4ff2-b297-db66d46eae64 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.806885 Aug 30 03:35:13.207082 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1204/2457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:12 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:13.215319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:13.216064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:13.221995 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-978f494a-171e-4fd5-b6f7-21b36be0ba81 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041072 Aug 30 03:35:13.223466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1254/2458] 10.222.0.30 () {60 vars in 1217 bytes} [Tue Aug 30 03:35:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:35:13.227013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.227740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.228407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.228975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-02507aa0-4c93-4c62-b44f-8d74e0f6aebc req-7b1dcfff-bb67-4a9d-b9c3-07ad6869e24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a21bb6-011c-42df-89e9-55d0bc3e76cc", "tag": "a1f58aef-2a54-4f46-a712-048e3effe96f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:13.229532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.230163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.230638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.240366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-02507aa0-4c93-4c62-b44f-8d74e0f6aebc req-7b1dcfff-bb67-4a9d-b9c3-07ad6869e24d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.241040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-02507aa0-4c93-4c62-b44f-8d74e0f6aebc req-7b1dcfff-bb67-4a9d-b9c3-07ad6869e24d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.241682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-02507aa0-4c93-4c62-b44f-8d74e0f6aebc req-7b1dcfff-bb67-4a9d-b9c3-07ad6869e24d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.256264 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-02507aa0-4c93-4c62-b44f-8d74e0f6aebc req-7b1dcfff-bb67-4a9d-b9c3-07ad6869e24d service nova] Creating event network-changed:a1f58aef-2a54-4f46-a712-048e3effe96f for instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc on n-h1-854924-5 Aug 30 03:35:13.262310 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-02507aa0-4c93-4c62-b44f-8d74e0f6aebc req-7b1dcfff-bb67-4a9d-b9c3-07ad6869e24d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037301 Aug 30 03:35:13.263971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1255/2459] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:13.271689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-984857238"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:13.273075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:13.282063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.282899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.283654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.284991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:13.285881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:13.286591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:13.338692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:13.460627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:13.793800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Adding security group d7fe2607-6d9b-4583-ad19-7f1c778816dd to port 84f61186-31ab-469b-988f-f81ca6669df1 Aug 30 03:35:13.871937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:13.888143 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23200356-9be0-4194-a336-22418b435356 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1307 microversion: 2.1 time: 0.676902 Aug 30 03:35:13.902693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1205/2460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:13 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1307 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:13.922822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bec00a3-699c-4032-8a81-0b2373dd8df6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:13.925312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4bec00a3-699c-4032-8a81-0b2373dd8df6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:14.056094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bec00a3-699c-4032-8a81-0b2373dd8df6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:14.070549 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bec00a3-699c-4032-8a81-0b2373dd8df6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1207 microversion: 2.1 time: 0.166399 Aug 30 03:35:14.072362 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1206/2461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:13 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1207 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:14.078173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1685095194"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:14.081288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:14.091492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:14.092289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:14.092879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:14.093756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:14.094357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:14.094950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:14.334626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5599a69f-79c2-4a5d-b553-8ce825139094 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.260507 Aug 30 03:35:14.335963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1207/2462] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:35:14 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 03:35:14.343041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854924-5", "block_migration": "auto"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:14.346469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:14.353233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:14.353837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:14.354347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:14.355357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:14.356022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:14.356638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:14.392258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'flavor' on Instance uuid 544a5e62-2526-4cf2-b66c-12031771336b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:35:14.408890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Going to try to live migrate instance to n-h1-854924-5 {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 03:35:14.442920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c78358cc-4cec-4585-b23a-b3f44d80280f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1/action" status: 202 len: 0 microversion: 2.1 time: 1.176780 Aug 30 03:35:14.444123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1256/2463] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:35:13 2022] POST /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1/action => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:35:14.455758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:14.456729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:14.472319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:14.473117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:14.473800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:14.474780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:14.475438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:14.476064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:14.551404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:14.752069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:14.765176 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-79cbe900-0430-4407-b91d-83fb6d7e7c3f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 0.319194 Aug 30 03:35:14.766637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1257/2464] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:14 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:14.783328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb08be20-9904-404c-8911-9541360a07e0 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f89801fadc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:14.985794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-cb08be20-9904-404c-8911-9541360a07e0 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use.", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:35:14.986947 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-cb08be20-9904-404c-8911-9541360a07e0 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:14.986947 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb08be20-9904-404c-8911-9541360a07e0 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd HTTP/1.1 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: exception: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd7fe2607-6d9b-4583-ad19-7f1c778816dd'} Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:35:14.990101 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] Aug 30 03:35:14.995439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:15.000366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb08be20-9904-404c-8911-9541360a07e0 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 400 to user: Security Group d7fe2607-6d9b-4583-ad19-7f1c778816dd in use. Aug 30 03:35:15.000366 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-89f4bfb3-0e00-4b55-89d2-14506a422d80'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:35:15.001912 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb08be20-9904-404c-8911-9541360a07e0 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd" status: 400 len: 185 microversion: 2.1 time: 0.233911 Aug 30 03:35:15.002820 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1258/2465] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:35:14 2022] DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd => generated 185 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:35:15.014754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:15.015863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:15.033873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.034428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.035154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.035692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.036731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.037408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.294614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:15.305781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3bb037fc-c8c8-45fd-8124-ef58b138b1b2 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1307 microversion: 2.1 time: 0.300863 Aug 30 03:35:15.306959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1259/2466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:15 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1307 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:15.312856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:15.315601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:15.322252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.322996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.323701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.324701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.325176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.325687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.458468 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd1bc159-d791-4e4b-99f8-06c60411b692 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1/action" status: 202 len: 0 microversion: 2.1 time: 0.148952 Aug 30 03:35:15.462106 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1260/2467] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:35:15 2022] POST /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:35:15.471257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:15.472354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:15.487828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.488897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.490539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.492104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.494412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.495121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.647859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:15.675281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bfaad0d-2376-4f16-9dd8-cd65e05190a9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1203 microversion: 2.1 time: 0.211262 Aug 30 03:35:15.681285 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1261/2468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:15 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1203 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:15.698126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3d5881ec-e99a-42ab-8e34-be36d1ce760f req-96aae9d9-23cf-45d4-94ad-6e9a053dd1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1", "tag": "84f61186-31ab-469b-988f-f81ca6669df1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:15.719028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5881ec-e99a-42ab-8e34-be36d1ce760f req-96aae9d9-23cf-45d4-94ad-6e9a053dd1a4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.720045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5881ec-e99a-42ab-8e34-be36d1ce760f req-96aae9d9-23cf-45d4-94ad-6e9a053dd1a4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.722339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5881ec-e99a-42ab-8e34-be36d1ce760f req-96aae9d9-23cf-45d4-94ad-6e9a053dd1a4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.745205 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3d5881ec-e99a-42ab-8e34-be36d1ce760f req-96aae9d9-23cf-45d4-94ad-6e9a053dd1a4 service nova] Creating event network-changed:84f61186-31ab-469b-988f-f81ca6669df1 for instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 on n-h2-854924-5 Aug 30 03:35:15.760990 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3d5881ec-e99a-42ab-8e34-be36d1ce760f req-96aae9d9-23cf-45d4-94ad-6e9a053dd1a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074827 Aug 30 03:35:15.761952 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1262/2469] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:15.772786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:15.774307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:15.827336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.828818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.829748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.830986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:15.831772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:15.832265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:15.873392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:16.495484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:16.511585 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dfe742cc-6ad7-4dbc-8028-139d184692a8 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1573 microversion: 2.1 time: 0.748037 Aug 30 03:35:16.515019 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1263/2470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:15 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1573 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:16.528883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:16.529674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:16.555871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:16.561582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:16.561839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:16.562599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:16.567590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:16.568368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:17.588970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:17.604394 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6833d681-405e-40dc-8626-d655cb335b76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.085433 Aug 30 03:35:17.618579 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1264/2471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:16 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:17.636007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:17.636643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:17.678599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:17.688477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:17.689208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:17.690262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:17.690889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:17.691472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.331638 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-faee9bbf-f1af-4154-9aeb-b33b34b5b2b2 tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b/action" status: 202 len: 0 microversion: 2.25 time: 3.993356 Aug 30 03:35:18.336537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1208/2472] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:35:14 2022] POST /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b/action => generated 0 bytes in 4000 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:35:18.346630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:18.347256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:18.358722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.359218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.359657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.360366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.360826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.361255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.647212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:18.670951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-602638b0-ca5c-4d7e-987e-d03dfd7ae82a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1265 microversion: 2.1 time: 0.331676 Aug 30 03:35:18.682917 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1209/2473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:18 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:18.693671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-286f9775-6552-445d-92c5-8f7c6a4dcbe4 req-f35679bc-ae33-4b79-8a0e-96459b6eb510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:18.711438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-286f9775-6552-445d-92c5-8f7c6a4dcbe4 req-f35679bc-ae33-4b79-8a0e-96459b6eb510 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.713191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-286f9775-6552-445d-92c5-8f7c6a4dcbe4 req-f35679bc-ae33-4b79-8a0e-96459b6eb510 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.713971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-286f9775-6552-445d-92c5-8f7c6a4dcbe4 req-f35679bc-ae33-4b79-8a0e-96459b6eb510 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.732578 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-286f9775-6552-445d-92c5-8f7c6a4dcbe4 req-f35679bc-ae33-4b79-8a0e-96459b6eb510 service nova] Creating event network-vif-unplugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:35:18.738963 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-286f9775-6552-445d-92c5-8f7c6a4dcbe4 req-f35679bc-ae33-4b79-8a0e-96459b6eb510 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050504 Aug 30 03:35:18.741264 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1210/2474] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:18.750176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:18.751767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:18.762251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.763907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.765508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.766920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.768231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.769372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.819758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:18.848338 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37ff56c7-642f-4387-81fb-e7ef4c4b8fdd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1307 microversion: 2.1 time: 1.221138 Aug 30 03:35:18.852419 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1265/2475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:17 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1307 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:18.868445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:18.868967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:18.875385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.876121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.876752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:18.877696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:18.879772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:18.880412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:20.121630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:20.160078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-486dac66-ab2f-4aca-b42b-15bb124fb61d tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1571 microversion: 2.1 time: 1.417041 Aug 30 03:35:20.165266 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1211/2476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:18 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1571 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:20.181727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:20.184974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:20.205542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:20.207754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:20.209464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:20.213978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:20.214800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:20.215606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:20.611815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:20.643434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:20.650378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:20.662890 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a5dd397d-0e9b-4b89-a709-6cd2241dcdcf tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 1.803589 Aug 30 03:35:20.678792 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1266/2477] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:18 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:20.719067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:20.726476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:20.762292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:20.765460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:20.770192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:20.773070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:20.776559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:20.777744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:21.158157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:21.180105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12d400e1-c64d-41a9-853e-559fd12821a1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1265 microversion: 2.1 time: 0.499983 Aug 30 03:35:21.180707 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1267/2478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:20 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1265 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:21.221082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:21.221861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:21.258314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:21.263626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:21.264161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:21.264962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:21.265398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:21.265829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:22.266915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:22.278275 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a28e4aa0-ef60-4e5a-a08c-be0d44abe267 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1688 microversion: 2.1 time: 2.110077 Aug 30 03:35:22.279470 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1212/2479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:20 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1688 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:22.284716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1623902269"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:22.288232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:22.301667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:22.307527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:22.308259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:22.314950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:22.315675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:22.318035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:23.065981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=31 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:23.108561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:23.118817 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a13b805-b8c7-4727-95da-d9046341db35 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1307 microversion: 2.1 time: 1.936954 Aug 30 03:35:23.119417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1268/2480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:21 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1307 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:23.138811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:23.148308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:23.167636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:23.168382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:23.168826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:23.169570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:23.170508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:23.171140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:23.203441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=13 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:23.360100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.network.security_group_api [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Adding security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac to port 84f61186-31ab-469b-988f-f81ca6669df1 Aug 30 03:35:24.069930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:24.593699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:24.625256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:24.640511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:24.649615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f41f8e58-9775-474d-9fe0-3d3c147e673a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 1.525885 Aug 30 03:35:24.667617 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1269/2481] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:23 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:24.681510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:24.683023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:24.701588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:24.702411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:24.705139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:24.706213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:24.707157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:24.707781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:25.461995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-19807183-dc85-4e49-93da-cb8df19ebdbd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1/action" status: 202 len: 0 microversion: 2.1 time: 3.181174 Aug 30 03:35:25.462695 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1213/2482] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:35:22 2022] POST /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1/action => generated 0 bytes in 3183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:35:25.469587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:25.470017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:25.485408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:25.489066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:25.492034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:25.492888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:25.493372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:25.496969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:25.533940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:25.560390 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-055c0f8c-0f16-4d23-8d5b-5efce5fd594b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 0.891306 Aug 30 03:35:25.560993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1270/2483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:24 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:25.601017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-eb923b9d-365c-4fde-8678-ed7dad17b1c5 req-fe6691d0-8bf3-455b-87bd-755d15d16667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a21bb6-011c-42df-89e9-55d0bc3e76cc", "name": "network-vif-plugged", "status": "completed", "tag": "a1f58aef-2a54-4f46-a712-048e3effe96f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:25.633470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb923b9d-365c-4fde-8678-ed7dad17b1c5 req-fe6691d0-8bf3-455b-87bd-755d15d16667 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:25.634360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb923b9d-365c-4fde-8678-ed7dad17b1c5 req-fe6691d0-8bf3-455b-87bd-755d15d16667 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:25.635420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb923b9d-365c-4fde-8678-ed7dad17b1c5 req-fe6691d0-8bf3-455b-87bd-755d15d16667 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:25.671463 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-eb923b9d-365c-4fde-8678-ed7dad17b1c5 req-fe6691d0-8bf3-455b-87bd-755d15d16667 service nova] Creating event network-vif-plugged:a1f58aef-2a54-4f46-a712-048e3effe96f for instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc on n-h1-854924-5 Aug 30 03:35:25.687590 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-eb923b9d-365c-4fde-8678-ed7dad17b1c5 req-fe6691d0-8bf3-455b-87bd-755d15d16667 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105673 Aug 30 03:35:25.691330 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1271/2484] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:25.701923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:25.702654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:25.724621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:25.725124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:25.728877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:25.729969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:25.730321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:25.730709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:25.912370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:25.926102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c7dfc601-d5d8-4f97-b3cf-8581b70654cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1688 microversion: 2.1 time: 0.462231 Aug 30 03:35:25.927078 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1214/2485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:25 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1688 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:25.938509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed6ceeae-9903-4041-8dcf-4f02beb81b2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ae88ca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:26.454334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:26.470260 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74ea3c61-6678-4404-9d8e-88186a00f955 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1307 microversion: 2.1 time: 0.777203 Aug 30 03:35:26.470949 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1272/2486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:25 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1307 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:26.486002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-bb687f20-c597-42b7-b780-594b04a99c88 req-273dfb16-b6d8-4d46-8574-090b31a726b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1", "tag": "84f61186-31ab-469b-988f-f81ca6669df1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:26.506605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bb687f20-c597-42b7-b780-594b04a99c88 req-273dfb16-b6d8-4d46-8574-090b31a726b4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:26.514860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bb687f20-c597-42b7-b780-594b04a99c88 req-273dfb16-b6d8-4d46-8574-090b31a726b4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:26.515496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bb687f20-c597-42b7-b780-594b04a99c88 req-273dfb16-b6d8-4d46-8574-090b31a726b4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:26.539667 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-bb687f20-c597-42b7-b780-594b04a99c88 req-273dfb16-b6d8-4d46-8574-090b31a726b4 service nova] Creating event network-changed:84f61186-31ab-469b-988f-f81ca6669df1 for instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 on n-h2-854924-5 Aug 30 03:35:26.547712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-bb687f20-c597-42b7-b780-594b04a99c88 req-273dfb16-b6d8-4d46-8574-090b31a726b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073495 Aug 30 03:35:26.548596 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1273/2487] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:26.557944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:26.558886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:26.566980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:26.567719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:26.568387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:26.569387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:26.570013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:26.570683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:27.585418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-ed6ceeae-9903-4041-8dcf-4f02beb81b2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use.", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:35:27.586766 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ed6ceeae-9903-4041-8dcf-4f02beb81b2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.586766 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed6ceeae-9903-4041-8dcf-4f02beb81b2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac HTTP/1.1 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: exception: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '6ca884f0-628b-4a06-a4fd-28f0c1a395ac'} Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:35:27.590102 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] Aug 30 03:35:27.594071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:35:27.600709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed6ceeae-9903-4041-8dcf-4f02beb81b2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 400 to user: Security Group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac in use. Aug 30 03:35:27.600709 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-51fda391-a1ed-42c5-97d3-aadcfb4e6b17'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:35:27.603268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ed6ceeae-9903-4041-8dcf-4f02beb81b2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac" status: 400 len: 185 microversion: 2.1 time: 1.674450 Aug 30 03:35:27.604670 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1215/2488] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:35:25 2022] DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac => generated 185 bytes in 1676 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:35:27.615638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5782229d-4d28-438f-824b-20abb364d9be tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Action: 'create', calling method: .version_select at 0x7f897ae89ee0>, body: {"keypair": {"name": "tempest-keypair-1188981609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0nJ9lH94sN3ZEROuj/D66EoD9KqGVYX3nGKG/t9OzZWAVBipJ3Iaz8Fcd5sz7KtC6de2lktACpZZUutb8oEwmT+lNDi+/EZboH+puoUFt0gjD68wro8Gvqa0O06gLK7g=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:27.622858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:27.643053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:27.644809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:27.646281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af6e4d47-4135-4c61-a086-8ff1e0708cec tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 1.096258 Aug 30 03:35:27.647022 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1274/2489] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:26 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:27.653126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:27.662345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:27.668995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:27.674262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:27.675132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:27.676137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:27.676863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:27.677609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:27.711263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5782229d-4d28-438f-824b-20abb364d9be tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Getting quotas for project 4353d8911fc24ecab08fa31c69ed67f9. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:35:27.747789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5782229d-4d28-438f-824b-20abb364d9be tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Getting quotas for user a42c27b343c949b7bc4fd507565f43f4 and project 4353d8911fc24ecab08fa31c69ed67f9. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:35:27.801900 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5782229d-4d28-438f-824b-20abb364d9be tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.194721 Aug 30 03:35:27.804147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1216/2490] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:35:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:35:27.817865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:27.818941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:27.832443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:27.835235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:27.836152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:27.838268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:27.839012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:27.839691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:29.158600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:29.168139 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4de36a73-85d9-4bae-89a6-7dd2ec97e77a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 1.361179 Aug 30 03:35:29.170949 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1217/2491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:27 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:29.191215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:29.192274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:29.201956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:29.202978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:29.203607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:29.206204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:29.207058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:29.207680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:29.432752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:29.452382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4dfa9be-de3f-4921-8ade-393a0bb42be2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 1.801641 Aug 30 03:35:29.457013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1275/2492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:27 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:29.473090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:29.477034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:29.514949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:29.515831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:29.516495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:29.517458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:29.518116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:29.518784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:29.633673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:35:30.027887 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-778a32b6-dedd-4933-ba85-52dbf85be638 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 204 len: 0 microversion: 2.1 time: 0.568717 Aug 30 03:35:30.046346 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1276/2493] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:35:29 2022] DELETE /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:35:30.071035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-946cf9eb-6eb2-4641-b758-18f857752774 req-c0834f37-6c8e-4927-b498-170e995297eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-plugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:30.146571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-946cf9eb-6eb2-4641-b758-18f857752774 req-c0834f37-6c8e-4927-b498-170e995297eb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:30.153655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-946cf9eb-6eb2-4641-b758-18f857752774 req-c0834f37-6c8e-4927-b498-170e995297eb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:30.154602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-946cf9eb-6eb2-4641-b758-18f857752774 req-c0834f37-6c8e-4927-b498-170e995297eb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:30.162788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:30.176137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c823c9a4-6f87-48a6-9019-cf14639ae07c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1487 microversion: 2.1 time: 1.002655 Aug 30 03:35:30.181859 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1218/2494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:29 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1487 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:30.199650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:30.199870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-946cf9eb-6eb2-4641-b758-18f857752774 req-c0834f37-6c8e-4927-b498-170e995297eb service nova] Creating event network-vif-plugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:35:30.201543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:30.223228 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-946cf9eb-6eb2-4641-b758-18f857752774 req-c0834f37-6c8e-4927-b498-170e995297eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177481 Aug 30 03:35:30.224134 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1277/2495] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:30.228909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:30.229839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:30.234447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:30.235460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:30.246881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:30.247638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:30.248399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:30.249505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:30.275696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:30.276186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:30.276624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:30.277323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:30.277794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:30.278345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:30.995613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:31.007686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:31.025801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:31.034678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ee12191-0905-4544-839e-3728a84256f7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 0.849114 Aug 30 03:35:31.038585 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1219/2496] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:30 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:31.052288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e8af0c87-2a73-4ad2-98c6-1de9c0dfff7a req-23ba9860-b257-4f0e-be31-385fcefe0c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2530254-b35e-43c2-a451-e490dcc99184", "tag": "c8307140-9631-4d8a-90d7-341a8a295e3f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:31.076723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e8af0c87-2a73-4ad2-98c6-1de9c0dfff7a req-23ba9860-b257-4f0e-be31-385fcefe0c4e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:31.078880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e8af0c87-2a73-4ad2-98c6-1de9c0dfff7a req-23ba9860-b257-4f0e-be31-385fcefe0c4e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:31.080553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e8af0c87-2a73-4ad2-98c6-1de9c0dfff7a req-23ba9860-b257-4f0e-be31-385fcefe0c4e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:31.112873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e8af0c87-2a73-4ad2-98c6-1de9c0dfff7a req-23ba9860-b257-4f0e-be31-385fcefe0c4e service nova] Creating event network-changed:c8307140-9631-4d8a-90d7-341a8a295e3f for instance d2530254-b35e-43c2-a451-e490dcc99184 on n-h1-854924-5 Aug 30 03:35:31.127821 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e8af0c87-2a73-4ad2-98c6-1de9c0dfff7a req-23ba9860-b257-4f0e-be31-385fcefe0c4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084195 Aug 30 03:35:31.128718 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1220/2497] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:31.140637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:31.145771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:31.160152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:31.161937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:31.162906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:31.169011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:31.170041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:31.172110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:31.218331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:31.238469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02a6bbe7-80ff-4a34-a594-1d923f1f7b3b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1646 microversion: 2.1 time: 1.011965 Aug 30 03:35:31.243255 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1278/2498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:30 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1646 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:31.262609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-226fe1d3-9860-4a48-9371-2d0ead013341 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:31.299687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-226fe1d3-9860-4a48-9371-2d0ead013341 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:31.310117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-226fe1d3-9860-4a48-9371-2d0ead013341 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:31.310934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-226fe1d3-9860-4a48-9371-2d0ead013341 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:31.520025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-226fe1d3-9860-4a48-9371-2d0ead013341 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Going to try to stop instance {{(pid=122168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:35:31.598374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:31.642902 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-226fe1d3-9860-4a48-9371-2d0ead013341 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc/action" status: 202 len: 0 microversion: 2.1 time: 0.394710 Aug 30 03:35:31.644211 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1279/2499] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:35:31 2022] POST /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:35:31.675360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:31.678712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:31.695474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:31.696210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:31.696842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:31.697915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:31.698625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:31.699315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:32.010046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:32.047652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9145bdc-12b0-4cdf-bd96-0adf56591b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 0.915508 Aug 30 03:35:32.058018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1221/2500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:31 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:32.081689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:32.092625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:32.125449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:32.126339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:32.140274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:32.141793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:32.142695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:32.143499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:34.225098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:34.237356 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-55dec92a-4f72-4d27-b7d9-c5c3e39d1948 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 2.591560 Aug 30 03:35:34.238893 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1280/2501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:31 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 2594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:34.275410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:34.287737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:34.294011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:34.322299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:34.326145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:34.327058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:34.327983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:34.328605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:34.329185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:34.679368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:34.697881 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-59850370-7a69-4733-a83b-1c040bc9d489 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 2.637462 Aug 30 03:35:34.701222 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1222/2502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:32 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:34.711579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:34.714883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:34.736200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:34.738014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:34.739389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:34.753146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:34.754604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:34.756504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:36.584901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:36.674927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:36.680933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:36.682412 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-47d07eaa-a547-45f3-b04e-233ec0d3352e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 2.424419 Aug 30 03:35:36.686112 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1281/2503] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:34 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:36.708062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:36.708974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:36.727941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:36.728502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:36.729198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:36.731794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:36.732407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:36.732851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:37.669712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:37.682889 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8bdc563-43d7-4802-b4b1-3f2604a42e2f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 200 len: 1646 microversion: 2.1 time: 2.979946 Aug 30 03:35:37.686105 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1223/2504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:34 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 1646 bytes in 2984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:37.719706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:37.720831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:37.734860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:37.744705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:37.745506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:37.746480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:37.747135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:37.747771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:37.761063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:38.775041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:38.787887 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-038e273c-8c02-40e1-94b3-d5598c9340bd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 2.096605 Aug 30 03:35:38.801829 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1282/2505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:36 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:38.815936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:38.821216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:38.835480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:38.838594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:38.842054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:38.844256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:38.844958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:38.845664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.534220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:39.543397 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8ffb7b8-98c8-400c-9c10-da2d72dfc634 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 0.740031 Aug 30 03:35:39.548747 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1283/2506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:38 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:39.550917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:39.556777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a2d1f3d5-4916-42d7-896f-b2a0feb65407 req-30b9dc11-9f0d-4a3e-85a3-c70dd6bb447e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1", "name": "network-vif-deleted", "tag": "84f61186-31ab-469b-988f-f81ca6669df1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:39.562161 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-705508b8-afa5-4389-b3b7-a9250e1cd2ec tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 1.854102 Aug 30 03:35:39.577802 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1224/2507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:37 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:39.595322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:39.598972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:39.601315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a2d1f3d5-4916-42d7-896f-b2a0feb65407 req-30b9dc11-9f0d-4a3e-85a3-c70dd6bb447e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.606036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a2d1f3d5-4916-42d7-896f-b2a0feb65407 req-30b9dc11-9f0d-4a3e-85a3-c70dd6bb447e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.606761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a2d1f3d5-4916-42d7-896f-b2a0feb65407 req-30b9dc11-9f0d-4a3e-85a3-c70dd6bb447e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.633641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.634175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.634620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.635339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.635796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.636224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.651885 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a2d1f3d5-4916-42d7-896f-b2a0feb65407 req-30b9dc11-9f0d-4a3e-85a3-c70dd6bb447e service nova] Creating event network-vif-deleted:84f61186-31ab-469b-988f-f81ca6669df1 for instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 on n-h2-854924-5 Aug 30 03:35:39.671136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a2d1f3d5-4916-42d7-896f-b2a0feb65407 req-30b9dc11-9f0d-4a3e-85a3-c70dd6bb447e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118558 Aug 30 03:35:39.676404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1284/2508] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:39.695005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:39.700170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:39.735213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.746738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.750201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.751117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.751719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.752318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.810125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 HTTP/1.1 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1'} Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:35:39.814259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:35:39.823912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:35:39.829048 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f94f9bdf-676c-4eb6-ad39-c153792e1392 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 404 len: 111 microversion: 2.1 time: 0.147084 Aug 30 03:35:39.829048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1285/2509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:39 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:35:39.879752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:39.882025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:39.909467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.910849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.911301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:39.915200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:39.916284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:39.920378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:40.975008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:40.998087 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-863b8884-18cc-4198-a762-8a401c0c24e6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 1.162588 Aug 30 03:35:41.000278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1286/2510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:39 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:41.019504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecf11443-8672-45bd-839b-acbcff2b7c1c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b485310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:41.901602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:41.940662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:41.948929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:41.953325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d88c016-86d3-4fdd-9fbe-9c826c68dc90 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 2.373991 Aug 30 03:35:41.955189 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1225/2511] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:39 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:41.969911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:41.972590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:42.000240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:42.002727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:42.005811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:42.007365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:42.010357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:42.016228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:43.436184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:43.466743 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8549ec8b-4bd5-42b7-bae7-cb237bd2a0b0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 1.509834 Aug 30 03:35:43.467368 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1226/2512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:41 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:43.490276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:43.491032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:43.510416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:43.515011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:43.515541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:43.526131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:43.529903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:43.530420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:43.530863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:44.001448 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ecf11443-8672-45bd-839b-acbcff2b7c1c tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd" status: 202 len: 0 microversion: 2.1 time: 2.997871 Aug 30 03:35:44.002985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1287/2513] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:35:41 2022] DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd => generated 0 bytes in 3000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:35:44.015118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:44.016286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:44.037555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:44.041892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:44.042819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:44.043989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:44.044709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:44.045442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:44.239072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:44.260769 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-498aeb11-c5dd-4454-acb5-bfd042dc7a09 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 0.782894 Aug 30 03:35:44.261896 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1227/2514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:43 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:44.280409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:44.298301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:44.326431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:44.327110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:44.330771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:44.331926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:44.332636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:44.333457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:44.401726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:44.404029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:44.415099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9ff3d8c-b782-420b-8dbd-439ddc3b7d2d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 0.410564 Aug 30 03:35:44.420286 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1288/2515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:44 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:44.443060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1918870542", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2df88c14-5d1d-46dd-9c4f-d55cd48a4959"}, {"port": "9eb8cf2f-0133-4274-beb4-c81c48632192", "tag": "port-1"}, {"port": "92b69d35-61a6-4c5b-96ac-c8a4490071bd", "tag": "port-2"}, {"uuid": "22b7729f-69bd-45ce-bb02-1dcc8f33ae45", "tag": "net-1"}, {"uuid": "22b7729f-69bd-45ce-bb02-1dcc8f33ae45"}, {"uuid": "f33f7f00-b03e-422a-baae-efc1a166706f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f33f7f00-b03e-422a-baae-efc1a166706f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "45a75b26-e6e7-4ad6-a5d6-704bff8bb6dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "05a65150-6f86-4e78-9088-83cad3c719e0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5c0f8ade-a1cb-481c-a4b6-a7d1fffcb222", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--243002299"}], "key_name": "tempest-keypair-1188981609", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:44.793377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] validate_networks() for [('2df88c14-5d1d-46dd-9c4f-d55cd48a4959', None, None, None, None, None), (None, None, '9eb8cf2f-0133-4274-beb4-c81c48632192', None, None, None), (None, None, '92b69d35-61a6-4c5b-96ac-c8a4490071bd', None, None, None), ('22b7729f-69bd-45ce-bb02-1dcc8f33ae45', None, None, None, None, None), ('22b7729f-69bd-45ce-bb02-1dcc8f33ae45', None, None, None, None, None), ('f33f7f00-b03e-422a-baae-efc1a166706f', '10.2.2.100', None, None, None, None), ('f33f7f00-b03e-422a-baae-efc1a166706f', '10.2.2.200', None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:35:44.908080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:44.957566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:44.964258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:44.966724 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3fa86b9c-986b-4f0b-a9a6-81bb3c6f2ebd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 0.703335 Aug 30 03:35:44.981372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1228/2516] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:44 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:44.988640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64e2573f-fd40-4740-a0a8-d96a495d53ff tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ae621f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:46.262672 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64e2573f-fd40-4740-a0a8-d96a495d53ff tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac" status: 202 len: 0 microversion: 2.1 time: 1.293901 Aug 30 03:35:46.263312 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1229/2517] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:35:44 2022] DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac => generated 0 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:35:46.268492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:46.270008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:46.292510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:46.296246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:46.298650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:46.310172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:46.311078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:46.312768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:47.233817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:47.245867 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1d370ca-58da-4056-bfe4-953d1373ea23 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 0.981235 Aug 30 03:35:47.246468 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1230/2518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:46 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:47.283047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:47.283734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:47.315397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:47.323454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:47.326682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:47.331324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:47.332418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:47.333495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:48.515375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:48.530417 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d977a7b-8f17-4607-9491-3d4b6baeb2dd tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 1.273715 Aug 30 03:35:48.565549 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1231/2519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:47 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:48.575976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:48.582845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:48.603295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:48.604789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:48.605887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:48.607436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:48.610684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:48.611865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:49.420883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:49.437257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d72f287-0d0e-481f-8bad-4851045f4cff tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 0.868518 Aug 30 03:35:49.438641 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1232/2520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:48 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:49.445225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:49.451566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:49.468421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:49.469980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:49.473310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:49.475495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:49.476140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:49.478240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:50.053392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:50.087972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:50.093280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:50.107626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e36ad818-e02a-4bc5-b918-70920116f509 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 0.667692 Aug 30 03:35:50.121168 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1233/2521] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:49 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:50.134723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4f5de9b7-c651-46ea-87aa-dda79784a6e5 req-7e4e34e2-bb97-4e78-96be-abe2fb8412f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2530254-b35e-43c2-a451-e490dcc99184", "name": "network-vif-plugged", "status": "completed", "tag": "c8307140-9631-4d8a-90d7-341a8a295e3f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:50.174248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4f5de9b7-c651-46ea-87aa-dda79784a6e5 req-7e4e34e2-bb97-4e78-96be-abe2fb8412f9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:50.177551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4f5de9b7-c651-46ea-87aa-dda79784a6e5 req-7e4e34e2-bb97-4e78-96be-abe2fb8412f9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:50.178509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4f5de9b7-c651-46ea-87aa-dda79784a6e5 req-7e4e34e2-bb97-4e78-96be-abe2fb8412f9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:50.265193 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4f5de9b7-c651-46ea-87aa-dda79784a6e5 req-7e4e34e2-bb97-4e78-96be-abe2fb8412f9 service nova] Creating event network-vif-plugged:c8307140-9631-4d8a-90d7-341a8a295e3f for instance d2530254-b35e-43c2-a451-e490dcc99184 on n-h1-854924-5 Aug 30 03:35:50.298949 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4f5de9b7-c651-46ea-87aa-dda79784a6e5 req-7e4e34e2-bb97-4e78-96be-abe2fb8412f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168585 Aug 30 03:35:50.300931 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1234/2522] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:50.323660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccf06ae1-c7af-43f2-8ac4-23e39f5223c1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'create', calling method: .version_select at 0x7f897ae78ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1553707764", "description": "tempest-description-1359104324"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:51.661024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccf06ae1-c7af-43f2-8ac4-23e39f5223c1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.355806 Aug 30 03:35:51.662142 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1235/2523] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:35:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:51.678978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a6c47f73-c309-4ff1-9145-2ac9a78e18da req-7c4b5d4d-7f34-4612-96ae-9b9125c39ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544a5e62-2526-4cf2-b66c-12031771336b", "name": "network-vif-unplugged", "status": "completed", "tag": "76e3a72c-44fb-4c4b-927d-4ffc06541f0e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:51.716806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a6c47f73-c309-4ff1-9145-2ac9a78e18da req-7c4b5d4d-7f34-4612-96ae-9b9125c39ff1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:51.723634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a6c47f73-c309-4ff1-9145-2ac9a78e18da req-7c4b5d4d-7f34-4612-96ae-9b9125c39ff1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:51.728805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a6c47f73-c309-4ff1-9145-2ac9a78e18da req-7c4b5d4d-7f34-4612-96ae-9b9125c39ff1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:51.777219 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a6c47f73-c309-4ff1-9145-2ac9a78e18da req-7c4b5d4d-7f34-4612-96ae-9b9125c39ff1 service nova] Creating event network-vif-unplugged:76e3a72c-44fb-4c4b-927d-4ffc06541f0e for instance 544a5e62-2526-4cf2-b66c-12031771336b on n-h2-854924-5 Aug 30 03:35:51.797994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a6c47f73-c309-4ff1-9145-2ac9a78e18da req-7c4b5d4d-7f34-4612-96ae-9b9125c39ff1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131762 Aug 30 03:35:51.803307 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1236/2524] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:51.845598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:51.857621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:51.886446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:51.892210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:51.894030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:51.895571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:51.896941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:51.897642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:52.291888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:52.312486 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aad21da8-751f-41ac-91f9-03361f723e92 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 0.506851 Aug 30 03:35:52.340924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1237/2525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:51 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:52.364913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:52.365775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:52.380816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:52.381435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:52.381824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:52.382549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:52.383014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:52.383441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:53.200979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:53.213055 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10bac4a3-c2ba-4351-b7cd-09ef44e87860 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1307 microversion: 2.1 time: 0.869292 Aug 30 03:35:53.225453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1238/2526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:52 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1307 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:53.239226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:53.240087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:53.258756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:53.261238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:53.265739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:53.267202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:53.267841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:53.268456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:54.074013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:54.087384 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b5754af0-d6ed-435a-b5bf-ef04cf9b3899 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 0.858596 Aug 30 03:35:54.089519 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1239/2527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:53 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:54.103309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:54.107794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:54.131022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:54.133560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:54.134178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:54.141923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:54.142754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:54.145492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:54.388711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:35:54.389316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:35:54.414327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:35:54.417651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:35:54.423756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:35:54.426213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:35:54.467823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:54.471316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:54.471774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:54.483013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:54.483791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:54.484418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:54.548778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Getting quotas for project 4353d8911fc24ecab08fa31c69ed67f9. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:35:54.574240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Getting quotas for user a42c27b343c949b7bc4fd507565f43f4 and project 4353d8911fc24ecab08fa31c69ed67f9. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:35:55.065932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:55.094051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:55.112299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:55.120880 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7ef59995-78e0-4161-8187-c6efdb7f4842 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 1.029836 Aug 30 03:35:55.123917 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1240/2528] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:54 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:55.154174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-01f363c7-13b4-46a4-940f-5902195b90f1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Action: 'update', calling method: .version_select at 0x7f897ae56d30>, body: {"security_group": {"name": "tempest-sg-hth-650469887", "description": "tempest-description-hth-108513499"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:55.247517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:35:55.255133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='45a75b26-e6e7-4ad6-a5d6-704bff8bb6dc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='05a65150-6f86-4e78-9088-83cad3c719e0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c0f8ade-a1cb-481c-a4b6-a7d1fffcb222',volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:35:56.028383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-01f363c7-13b4-46a4-940f-5902195b90f1 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/26b1ed4a-1b7e-4360-94c3-3d9c6256a954" status: 200 len: 216 microversion: 2.1 time: 0.897158 Aug 30 03:35:56.036741 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1241/2529] 10.222.0.30 () {60 vars in 1290 bytes} [Tue Aug 30 03:35:55 2022] PUT /compute/v2.1/os-security-groups/26b1ed4a-1b7e-4360-94c3-3d9c6256a954 => generated 216 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:56.042752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:56.043748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:56.073769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.075512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.077642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.079966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.081795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.082513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.111319 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85814865-47cd-485f-a21d-1dd1b10b99c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.689930 Aug 30 03:35:56.120905 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1289/2530] 10.222.0.30 () {62 vars in 1189 bytes} [Tue Aug 30 03:35:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 11700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:35:56.134128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-80fcc56b-58a3-4f05-bf38-f21b935e7be4 req-c650e07e-4e06-41ac-814e-e7f766749653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544a5e62-2526-4cf2-b66c-12031771336b", "tag": "76e3a72c-44fb-4c4b-927d-4ffc06541f0e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:56.180679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-80fcc56b-58a3-4f05-bf38-f21b935e7be4 req-c650e07e-4e06-41ac-814e-e7f766749653 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.185955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-80fcc56b-58a3-4f05-bf38-f21b935e7be4 req-c650e07e-4e06-41ac-814e-e7f766749653 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.186898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-80fcc56b-58a3-4f05-bf38-f21b935e7be4 req-c650e07e-4e06-41ac-814e-e7f766749653 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.238322 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-80fcc56b-58a3-4f05-bf38-f21b935e7be4 req-c650e07e-4e06-41ac-814e-e7f766749653 service nova] Creating event network-changed:76e3a72c-44fb-4c4b-927d-4ffc06541f0e for instance 544a5e62-2526-4cf2-b66c-12031771336b on n-h2-854924-5 Aug 30 03:35:56.260095 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-80fcc56b-58a3-4f05-bf38-f21b935e7be4 req-c650e07e-4e06-41ac-814e-e7f766749653 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130488 Aug 30 03:35:56.262832 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1290/2531] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:56.277108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:56.278293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:56.297380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.300373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.302750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.304227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.307600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.310903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.714727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:56.727317 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-885388b0-f969-4aed-b4e9-7759c0c02739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 0.688917 Aug 30 03:35:56.733755 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1242/2532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:56 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:56.778695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:56.786606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:56.829857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.838100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.845043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.848599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:56.855790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:56.857142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:56.891252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:56.911563 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-26d10c0e-482d-484d-9916-d49490da3d51 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1488 microversion: 2.1 time: 0.646024 Aug 30 03:35:56.912156 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1291/2533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:56 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1488 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:56.933448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59bdab89-8b6f-4ffa-9fc5-ab354fba0c0e tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b48d9d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:58.388435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:58.416379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a64f1cc6-89df-4e5f-b380-242c62c90a54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 1.677409 Aug 30 03:35:58.426021 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1243/2534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:56 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:58.448351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2078861-a6e8-4e7b-9735-42697763ee09 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:58.449292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2078861-a6e8-4e7b-9735-42697763ee09 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:58.512930 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59bdab89-8b6f-4ffa-9fc5-ab354fba0c0e tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/26b1ed4a-1b7e-4360-94c3-3d9c6256a954" status: 200 len: 216 microversion: 2.1 time: 1.591294 Aug 30 03:35:58.513459 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1292/2535] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:35:56 2022] GET /compute/v2.1/os-security-groups/26b1ed4a-1b7e-4360-94c3-3d9c6256a954 => generated 216 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:35:58.520247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:58.520866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:58.539093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:58.541805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:58.542473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:58.546621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:58.547378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:58.548771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:58.678696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2078861-a6e8-4e7b-9735-42697763ee09 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:58.722960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2078861-a6e8-4e7b-9735-42697763ee09 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:58.726998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2078861-a6e8-4e7b-9735-42697763ee09 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:35:58.740995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2078861-a6e8-4e7b-9735-42697763ee09 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1286 microversion: 2.42 time: 0.308255 Aug 30 03:35:58.745936 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1244/2536] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:58 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1286 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:35:58.779525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:35:58.799680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:58.849756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:58.850337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:58.850781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:58.851509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:58.851968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:58.852998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:58.990675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-187017db-ccaa-4490-b684-6cab6d5cf34f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "PUT /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1083 microversion: 2.1 time: 0.240644 Aug 30 03:35:58.995546 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1245/2537] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:35:58 2022] PUT /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1083 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:35:59.010400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:35:59.012433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:35:59.030045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:59.031181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:59.033227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:35:59.034406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:35:59.036621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:35:59.037258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:00.083955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:00.105892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:00.109866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:00.114299 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-816903f8-c080-40eb-9e66-f9c80a4f2739 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 1.599518 Aug 30 03:36:00.116065 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1293/2538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:35:58 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:00.128467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6a54698-a9b9-43b9-8fdd-84c012cb636f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b7b2700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:00.215162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:00.226715 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-28c11f0d-ee73-4233-898e-66743b351f3c tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1497 microversion: 2.1 time: 1.229659 Aug 30 03:36:00.245644 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1246/2539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:35:58 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1497 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:00.262986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:00.268705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:00.283128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:00.285421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:00.287515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:00.289056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:00.295653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:00.296595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:00.773316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:00.791190 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2627f410-447d-4702-883c-60350c8b7c15 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1509 microversion: 2.1 time: 0.541323 Aug 30 03:36:00.831779 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1247/2540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:00 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1509 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:00.850385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:00.854464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:00.890733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:00.893503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:00.894452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:00.897642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:00.905613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:00.906461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:02.024677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:02.054601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6a54698-a9b9-43b9-8fdd-84c012cb636f tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/26b1ed4a-1b7e-4360-94c3-3d9c6256a954" status: 202 len: 0 microversion: 2.1 time: 1.937199 Aug 30 03:36:02.056291 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1294/2541] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:00 2022] DELETE /compute/v2.1/os-security-groups/26b1ed4a-1b7e-4360-94c3-3d9c6256a954 => generated 0 bytes in 1939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:36:02.062873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:02.064109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:02.086221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:02.090767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:02.091465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:02.093526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:02.094468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1686ea8-b737-4018-bcbb-da060f51fc73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1683 microversion: 2.1 time: 1.260979 Aug 30 03:36:02.098600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:02.100516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:02.100916 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1248/2542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:00 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1683 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:02.114726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:02.131692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:02.165755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:02.167294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:02.168351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:02.170725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:02.176728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:02.177909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:02.467741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:02.511712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:02.528346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:02.537017 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7436ea7b-c7c1-4de1-b743-2c62ef2c2e4f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1594 microversion: 2.42 time: 0.478320 Aug 30 03:36:02.540445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1295/2543] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:02 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1594 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:02.554644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:02.557695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:02.585289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:02.589398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:02.591382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:02.594777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:02.597161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:02.597855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:03.245219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:03.259463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:03.264354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:03.265862 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee631cd2-38e6-4548-8fd5-e40477bb1c47 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 0.724401 Aug 30 03:36:03.269004 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1296/2544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:02 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:03.277894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:03.283439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:03.298788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:03.299627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:03.300271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:03.301225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:03.301848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:03.302421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:03.402339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:03.406082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:03.418387 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-749ef1e4-a02b-4668-af4b-c0f0c89fd68f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1509 microversion: 2.1 time: 1.316110 Aug 30 03:36:03.418996 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1249/2545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:02 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1509 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:03.428401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:03.428897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:03.451367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:03.451946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:03.452387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:03.453307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:03.465745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:03.466212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:03.545247 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 HTTP/1.1 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1'} Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:36:03.564141 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:03.569439 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:03.575122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:03.579073 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66d5dcc4-eaeb-4b54-be7a-cb011ab28ebd tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 404 len: 111 microversion: 2.1 time: 0.154410 Aug 30 03:36:03.585482 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1250/2546] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:36:03 2022] DELETE /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:03.610999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:03.614514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:03.629790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:03.630322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:03.630770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:03.631493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:03.637995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:03.638598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.080030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:04.099233 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56a19279-24b9-41ad-a409-d53ee6c6a715 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 200 len: 1474 microversion: 2.1 time: 0.828918 Aug 30 03:36:04.122429 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1297/2547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:03 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 1474 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:04.142078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:04.142596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:04.173280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.174143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.174985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.192953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.198636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.204654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.347711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:36:04.509715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:04.513051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:04.532178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba9a20ad-a209-483e-951f-cf7d1cce3666 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.945283 Aug 30 03:36:04.536034 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1251/2548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:03 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:04.554521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:04.558349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:04.583254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.583746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.584182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.588944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.589615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.590066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.622821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:04.623752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:04.667650 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1de0a846-6b34-42b3-b90c-451dbf102990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 204 len: 0 microversion: 2.1 time: 0.540654 Aug 30 03:36:04.672023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1298/2549] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:36:04 2022] DELETE /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:36:04.680027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:04.682208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:04.698442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.706132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.706898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.707843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.708623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.709256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.750705 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 HTTP/1.1 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1'} Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:04.755811 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. Aug 30 03:36:04.761776 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:04.763863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Instance 7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:04.765390 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6a037a66-fe46-421b-9857-ca885e147188 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1" status: 404 len: 111 microversion: 2.1 time: 0.091494 Aug 30 03:36:04.766631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1299/2550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:04 2022] GET /compute/v2.1/servers/7ee8e4c8-e2b1-4b8d-a6e0-6598e617a7f1 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:04.774406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-130239920"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:04.777195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:04.785626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.786326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.786936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.788511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:04.789221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:04.789890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:04.968354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:05.042937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:05.061295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:05.071797 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7db75b35-29c2-464f-9dff-bb928aa97fe8 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1594 microversion: 2.42 time: 0.531282 Aug 30 03:36:05.085453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1252/2551] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:04 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1594 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:05.116704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:05.120158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:05.163023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:05.168159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:05.171219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:05.178853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:05.180780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:05.181602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:05.645535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae34e957-5792-4db9-93b2-c2e8da9cf3a0 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc/action" status: 202 len: 0 microversion: 2.1 time: 0.877352 Aug 30 03:36:05.658671 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1300/2552] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:36:04 2022] POST /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:36:05.668265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:05.686505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:05.717750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:05.722505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:05.723379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:05.729153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:05.733526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:05.752327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:06.273561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:06.294374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:06.302460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:06.304935 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c10061bf-6304-441d-b4ef-6a4241177372 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 1.224309 Aug 30 03:36:06.329892 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1253/2553] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:05 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:06.341628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ae7bf70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:06.440270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:36:06.442711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:36:06.443517 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.443517 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac HTTP/1.1 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: exception: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '6ca884f0-628b-4a06-a4fd-28f0c1a395ac'} Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:36:06.446867 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] Aug 30 03:36:06.451653 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:06.457496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group 6ca884f0-628b-4a06-a4fd-28f0c1a395ac does not exist Aug 30 03:36:06.457496 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-c986067c-920f-4417-a8b0-27e72693581f'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:06.458659 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1e3739c-7812-41ff-990f-084d4970e7b9 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac" status: 404 len: 194 microversion: 2.1 time: 0.127664 Aug 30 03:36:06.462932 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1254/2554] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:06 2022] DELETE /compute/v2.1/os-security-groups/6ca884f0-628b-4a06-a4fd-28f0c1a395ac => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:06.473664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:06.474692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:06.496548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:06.499480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:06.500186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:06.502015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:06.502717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:06.505946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:06.783706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:06.800621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1d2dba7-a9e4-423e-a6e8-3132079baebe tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1515 microversion: 2.1 time: 1.132323 Aug 30 03:36:06.802534 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1301/2555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:05 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1515 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:06.818264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73290080-390a-4d51-8068-03b58a29cf03 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b21eaf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:06.937247 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-73290080-390a-4d51-8068-03b58a29cf03 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1413 microversion: 2.1 time: 0.130309 Aug 30 03:36:06.938427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1302/2556] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:06 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:06.948979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:06.951451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:06.971032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:06.972685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:06.973400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:06.974977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:06.976835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:06.980424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:07.244323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:07.265446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:07.268636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:07.275009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d988fe0-5bb9-45c5-a079-10ed42ee1efe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1594 microversion: 2.42 time: 0.333782 Aug 30 03:36:07.281012 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1303/2557] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:06 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1594 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:07.294442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b802a60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:07.382877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:07.401818 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1ada902a-2f14-4844-a394-333ce4db2515 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.937354 Aug 30 03:36:07.406043 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1255/2558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:06 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:07.408030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:36:07.408836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group d7fe2607-6d9b-4583-ad19-7f1c778816dd not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:36:07.409599 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.409599 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd HTTP/1.1 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd7fe2607-6d9b-4583-ad19-7f1c778816dd'} Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:36:07.411883 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] Aug 30 03:36:07.417048 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.421634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8aef18fe-cffb-4817-8352-5a9de8dd3132 req-fe35ae60-6945-4e44-bc25-fb8cc256ebdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:07.423261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group d7fe2607-6d9b-4583-ad19-7f1c778816dd does not exist Aug 30 03:36:07.423261 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-8293bb35-4273-4165-bffe-4aa126706ff0'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:07.424611 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-939343d9-1db3-4337-9f8c-d6cfc1749256 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd" status: 404 len: 194 microversion: 2.1 time: 0.139050 Aug 30 03:36:07.428879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1304/2559] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:07 2022] DELETE /compute/v2.1/os-security-groups/d7fe2607-6d9b-4583-ad19-7f1c778816dd => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:07.439154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:07.440226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:07.457557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:07.459231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:07.459923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:07.462133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:07.464792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:07.465856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:07.489220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8aef18fe-cffb-4817-8352-5a9de8dd3132 req-fe35ae60-6945-4e44-bc25-fb8cc256ebdb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:07.490595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8aef18fe-cffb-4817-8352-5a9de8dd3132 req-fe35ae60-6945-4e44-bc25-fb8cc256ebdb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:07.493487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8aef18fe-cffb-4817-8352-5a9de8dd3132 req-fe35ae60-6945-4e44-bc25-fb8cc256ebdb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:07.536457 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8aef18fe-cffb-4817-8352-5a9de8dd3132 req-fe35ae60-6945-4e44-bc25-fb8cc256ebdb service nova] Creating event network-vif-unplugged:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:36:07.561386 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8aef18fe-cffb-4817-8352-5a9de8dd3132 req-fe35ae60-6945-4e44-bc25-fb8cc256ebdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153493 Aug 30 03:36:07.564110 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1256/2560] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:07.592271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897ae56310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:07.833211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:36:07.834170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:36:07.835029 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.835029 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717 HTTP/1.1 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: exception: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c7c1d74c-702f-4a63-840e-4a0a6ae6a717'} Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:36:07.839242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group c7c1d74c-702f-4a63-840e-4a0a6ae6a717 does not exist Aug 30 03:36:07.843784 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-78533258-60ad-49ec-aca2-81b0af09da9b'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:07.853617 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ffedc88-9069-43fe-93fa-59a62d083202 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717" status: 404 len: 194 microversion: 2.1 time: 0.279976 Aug 30 03:36:07.854733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1257/2561] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:07 2022] DELETE /compute/v2.1/os-security-groups/c7c1d74c-702f-4a63-840e-4a0a6ae6a717 => generated 194 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:07.877161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:07.878893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:07.911254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:07.912641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:07.913651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:07.918487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:07.919216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:07.919907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:08.707470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:09.542160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:09.569403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:09.572713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:09.574354 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6484e0cc-9de2-4161-915b-adcce689f19d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 2.144294 Aug 30 03:36:09.585727 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1305/2562] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:07 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:09.606222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b7b2af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:09.848311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:36:09.849244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group 700e98db-0af5-4fc7-915b-106b424556a8 not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:36:09.850352 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.850352 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8 HTTP/1.1 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '700e98db-0af5-4fc7-915b-106b424556a8'} Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:36:09.852875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] Aug 30 03:36:09.856624 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:09.863917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group 700e98db-0af5-4fc7-915b-106b424556a8 does not exist Aug 30 03:36:09.863917 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-a4b54b4b-c31a-4c38-9de0-d587d6e67d2f'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:09.865194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc6e775f-abe8-467f-bc1c-aaa175fbd082 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8" status: 404 len: 194 microversion: 2.1 time: 0.277097 Aug 30 03:36:09.866409 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1306/2563] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:09 2022] DELETE /compute/v2.1/os-security-groups/700e98db-0af5-4fc7-915b-106b424556a8 => generated 194 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:09.885597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffd30f9f-b4fc-4153-93c5-ec876ce6d50d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f8983d06160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:09.979307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffd30f9f-b4fc-4153-93c5-ec876ce6d50d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1413 microversion: 2.1 time: 0.110583 Aug 30 03:36:09.980257 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1307/2564] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:09 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:09.988519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:09.991350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:10.010486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:10.011553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:10.013239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:10.014238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:10.016760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:10.017463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:10.122189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:10.156792 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-424bc156-2c42-4295-a81e-9f847b1a1ae5 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1515 microversion: 2.1 time: 2.299475 Aug 30 03:36:10.163704 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1258/2565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:07 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1515 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:10.203834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:10.205518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:10.241466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:10.250437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:10.251256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:10.252585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:10.267123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:10.268197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:11.083090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:11.134265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:11.137806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:11.146790 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09e98d57-cbc7-43ef-8f47-f240ab019ec0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1661 microversion: 2.42 time: 1.164950 Aug 30 03:36:11.156718 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1308/2566] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:09 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1661 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:11.165373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b16a9d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:11.552317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:36:11.554879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:36:11.557571 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.557571 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e HTTP/1.1 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c98903ab-f18e-404a-b0a2-9f2fc7bb696e'} Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:36:11.562129 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group c98903ab-f18e-404a-b0a2-9f2fc7bb696e does not exist Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-d1311f6f-1e8b-449e-a610-f4751130211c'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a733093d-44d7-4de3-87b1-8cebfb97e45b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e" status: 404 len: 194 microversion: 2.1 time: 0.405486 Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1309/2567] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:11 2022] DELETE /compute/v2.1/os-security-groups/c98903ab-f18e-404a-b0a2-9f2fc7bb696e => generated 194 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:11.614151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:11.617218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:11.617218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:11.617218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:11.617218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:11.617218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:11.617218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:11.730429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:11.751254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2d3e9c5-0a59-4fd8-a094-2d5cb23d6b61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.582367 Aug 30 03:36:11.757111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1259/2568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:10 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:11.782263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f2fc0741-63f1-482e-b1af-8ddb8d57a0c1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae568b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:11.899806 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f2fc0741-63f1-482e-b1af-8ddb8d57a0c1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1413 microversion: 2.1 time: 0.136342 Aug 30 03:36:11.900939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1260/2569] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:11 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:11.905904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:11.906786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:11.915800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:11.916491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:11.917117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:11.926984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:11.929093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:11.931898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:11.986671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:11.987741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:11.988755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:11.990660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lazy-loading 'fault' on Instance uuid d2530254-b35e-43c2-a451-e490dcc99184 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:36:12.132960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:12.148230 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1cd0883b-5c64-435b-8b47-c7936fbea460 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 200 len: 1318 microversion: 2.1 time: 0.243990 Aug 30 03:36:12.149739 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1261/2570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:11 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:12.165970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e1725012-b62c-4274-b218-269e0ff86eae req-2ba33d24-9022-4996-8f25-54c029e988f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2530254-b35e-43c2-a451-e490dcc99184", "name": "network-vif-deleted", "tag": "c8307140-9631-4d8a-90d7-341a8a295e3f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:12.190303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e1725012-b62c-4274-b218-269e0ff86eae req-2ba33d24-9022-4996-8f25-54c029e988f1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:12.190795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e1725012-b62c-4274-b218-269e0ff86eae req-2ba33d24-9022-4996-8f25-54c029e988f1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:12.190919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:12.191392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e1725012-b62c-4274-b218-269e0ff86eae req-2ba33d24-9022-4996-8f25-54c029e988f1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:12.203612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:12.210763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:12.212815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0feae478-b99b-4071-be2f-6ee02b5added tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1486 microversion: 2.25 time: 0.643811 Aug 30 03:36:12.213810 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1310/2571] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:11 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1486 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:12.218524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b21e0d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:12.235313 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e1725012-b62c-4274-b218-269e0ff86eae req-2ba33d24-9022-4996-8f25-54c029e988f1 service nova] Creating event network-vif-deleted:c8307140-9631-4d8a-90d7-341a8a295e3f for instance d2530254-b35e-43c2-a451-e490dcc99184 on n-h1-854924-5 Aug 30 03:36:12.251257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e1725012-b62c-4274-b218-269e0ff86eae req-2ba33d24-9022-4996-8f25-54c029e988f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100219 Aug 30 03:36:12.256013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1262/2572] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:12.267348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:12.268111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:12.284613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:12.287252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:12.287879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:12.290575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:36:12.291455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Neutron security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:36:12.292145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.292145 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8 HTTP/1.1 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '54cfadde-aa6a-470d-b17c-cba00a16dfb8'} Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:36:12.294380 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] Aug 30 03:36:12.298964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:12.306477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Security group 54cfadde-aa6a-470d-b17c-cba00a16dfb8 does not exist Aug 30 03:36:12.306477 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-6ee39bfe-1df7-4d13-b9f6-879f29099890'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:12.309479 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ebdb43e-2f0a-4554-86b9-bdd7c2a9c9b6 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8" status: 404 len: 194 microversion: 2.1 time: 0.092020 Aug 30 03:36:12.310655 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1311/2573] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:12 2022] DELETE /compute/v2.1/os-security-groups/54cfadde-aa6a-470d-b17c-cba00a16dfb8 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:12.314984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:12.318393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:12.322207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:12.332938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:12.338438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:12.362813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:12.363560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:12.365748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:12.366721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:12.367215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:12.368180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:12.447793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:12.997500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:13.035185 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5dd19d3c-f47c-4f3d-bdba-887e718cf086 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.759245 Aug 30 03:36:13.049945 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1263/2574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:12 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:13.075000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:13.096063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:13.141488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:13.142493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:13.150301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:13.152116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:13.156120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:13.157283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:13.244702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:36:13.379274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:13.409206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:13.421632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:13.425294 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f162346-4aa5-4aa5-bf96-2f105c275d7f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1661 microversion: 2.42 time: 1.112267 Aug 30 03:36:13.432326 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1312/2575] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:12 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1661 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:13.462471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b68f60a-2059-4136-baf4-1882accb5186 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b802ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:13.535467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c3a138a-7596-4224-b47d-030258c3ef48 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 204 len: 0 microversion: 2.1 time: 0.480065 Aug 30 03:36:13.537810 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1264/2576] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:36:13 2022] DELETE /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:36:13.565156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:13.566463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:13.585234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:13.586575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:13.588613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:13.590315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:13.596461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:13.597705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:14.158544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:14.189721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2988da83-7ac8-4cda-99a0-48d64cc45bbf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.650069 Aug 30 03:36:14.198332 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1265/2577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:13 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:14.219283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:14.220179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:14.222433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:14.240644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:14.243695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:14.244465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:14.245564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:14.249418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:14.250184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:14.285975 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 HTTP/1.1 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'd2530254-b35e-43c2-a451-e490dcc99184'} Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:14.288072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:36:14.293107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:14.296763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:14.298046 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03b2311a-ffa7-4b9e-b2f5-8f480048c922 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 404 len: 111 microversion: 2.1 time: 0.095778 Aug 30 03:36:14.302436 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1266/2578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:14 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:14.321662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:14.322454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:14.339148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:14.339895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:14.340500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:14.341480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:14.342092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:14.342674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:15.938251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:15.951620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:15.959787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:15.961641 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd886fe7-4b16-4248-8c25-9b743fb891bd tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1476 microversion: 2.25 time: 1.657982 Aug 30 03:36:15.962715 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1267/2579] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:14 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1476 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:15.981500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:15.990772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:16.011812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:16.015341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:16.015806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:16.016552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:16.017011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:16.025534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:17.169365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad10e8a5ee24e44bb60c03014adf1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40a94656bfd4ebeba785fbf8be1a6cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:17.188869 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-279be36f-17a5-443f-b95c-8d906308462b tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 200 len: 1644 microversion: 2.1 time: 1.224684 Aug 30 03:36:17.216264 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1268/2580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:15 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 1644 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:17.239897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-427836ba-46ac-48a3-9860-2f4d047626a5 req-e93ca772-108b-4d04-ab38-654eb9d49529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a21bb6-011c-42df-89e9-55d0bc3e76cc", "name": "network-vif-plugged", "status": "completed", "tag": "a1f58aef-2a54-4f46-a712-048e3effe96f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:17.305892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-427836ba-46ac-48a3-9860-2f4d047626a5 req-e93ca772-108b-4d04-ab38-654eb9d49529 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:17.306523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-427836ba-46ac-48a3-9860-2f4d047626a5 req-e93ca772-108b-4d04-ab38-654eb9d49529 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:17.307073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-427836ba-46ac-48a3-9860-2f4d047626a5 req-e93ca772-108b-4d04-ab38-654eb9d49529 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:17.395820 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-427836ba-46ac-48a3-9860-2f4d047626a5 req-e93ca772-108b-4d04-ab38-654eb9d49529 service nova] Creating event network-vif-plugged:a1f58aef-2a54-4f46-a712-048e3effe96f for instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc on n-h1-854924-5 Aug 30 03:36:17.425365 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-427836ba-46ac-48a3-9860-2f4d047626a5 req-e93ca772-108b-4d04-ab38-654eb9d49529 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195277 Aug 30 03:36:17.426363 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1269/2581] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:17.439765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:17.455758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:17.479132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:17.492850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:17.493771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:17.494838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:17.495492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:17.496100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:17.580552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:17.770177 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec79da47-98d2-4270-8ecd-9b93b037f95b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.341865 Aug 30 03:36:17.779404 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1270/2582] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:36:17 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:36:17.811927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:17.819272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:17.863998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:17.871683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:17.872604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:17.877734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:17.878481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:17.879136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:19.493865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:19.504205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:19.511920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:19.514628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b82d580-95d8-4ce0-8af4-15ac39dab8f4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1753 microversion: 2.42 time: 1.732094 Aug 30 03:36:19.531520 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1271/2583] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:17 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1753 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:19.544757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-311356739", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "97caa173-2767-49ad-92a3-6618c107fb50"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:22.347336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:23.386013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:26.657060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b68f60a-2059-4136-baf4-1882accb5186 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1413 microversion: 2.1 time: 13.219712 Aug 30 03:36:26.657991 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1313/2584] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:13 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1413 bytes in 13224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:26.676105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-789a7210-8f7e-44b8-92ed-09fb335a98ae tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '.version_select at 0x7f897b21e700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:26.679699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-789a7210-8f7e-44b8-92ed-09fb335a98ae tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:26.680178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-789a7210-8f7e-44b8-92ed-09fb335a98ae tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:26.701475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] validate_networks() for [('97caa173-2767-49ad-92a3-6618c107fb50', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:36:26.708782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-789a7210-8f7e-44b8-92ed-09fb335a98ae tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:26.743675 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-789a7210-8f7e-44b8-92ed-09fb335a98ae tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.082423 Aug 30 03:36:26.745561 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1314/2585] 10.222.0.30 () {60 vars in 1184 bytes} [Tue Aug 30 03:36:26 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:26.759655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:26.762356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:26.793408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:26.795604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:26.797325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:26.798916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:26.802824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:26.803517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:27.384434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:27.408568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3822bc6-c35c-4dc3-be46-be73612afdc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.661606 Aug 30 03:36:27.414178 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1315/2586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:26 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:27.435583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8a9e75b4-c3ae-4064-8b02-a75bd881ea4e req-d4ed2ec4-db77-4690-a779-d5c0cdcde77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc46ac6-8e36-41c3-81ee-8268d4bca428", "name": "network-vif-deleted", "tag": "918b0f91-cf85-45f5-bac3-5562e487dd8c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:27.455628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8a9e75b4-c3ae-4064-8b02-a75bd881ea4e req-d4ed2ec4-db77-4690-a779-d5c0cdcde77a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:27.456460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8a9e75b4-c3ae-4064-8b02-a75bd881ea4e req-d4ed2ec4-db77-4690-a779-d5c0cdcde77a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:27.458365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8a9e75b4-c3ae-4064-8b02-a75bd881ea4e req-d4ed2ec4-db77-4690-a779-d5c0cdcde77a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:27.472673 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8a9e75b4-c3ae-4064-8b02-a75bd881ea4e req-d4ed2ec4-db77-4690-a779-d5c0cdcde77a service nova] Creating event network-vif-deleted:918b0f91-cf85-45f5-bac3-5562e487dd8c for instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 on n-h2-854924-5 Aug 30 03:36:27.480936 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8a9e75b4-c3ae-4064-8b02-a75bd881ea4e req-d4ed2ec4-db77-4690-a779-d5c0cdcde77a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063781 Aug 30 03:36:27.482388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1316/2587] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:27.487929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:27.488361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] [instance: 3fc46ac6-8e36-41c3-81ee-8268d4bca428] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:27.511059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:27.513740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:27.514234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:27.515080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:27.515554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:27.515983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:27.567323 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] HTTP exception thrown: Instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 could not be found. Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Request method failure captured: Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 HTTP/1.1 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUnCjzJS4G-9CCGe2OCEydYRMFCyH73wXJj-g6o2gK9vrTvYOx24CwbeC4pgySBHgO1NIp1C4XKIxBvUZz1ToIzx4SACUDVPl5T9DEFJediLVu93Ft6qPg7j_9V1CYbjo_tatYsPs8xULB_ln_gvw7_qndA8B379GO2-W_EDtW061o Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d40a94656bfd4ebeba785fbf8be1a6cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d40a94656bfd4ebeba785fbf8be1a6cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d40a94656bfd4ebeba785fbf8be1a6cb"}]}] Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d40a94656bfd4ebeba785fbf8be1a6cb Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-111063558 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9ad10e8a5ee24e44bb60c03014adf1d3 Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsTestJSON-111063558-project Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 could not be found. Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3fc46ac6-8e36-41c3-81ee-8268d4bca428'} Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 could not be found. Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 could not be found. Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:27.569046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 could not be found. Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Returning 404 to user: Instance 3fc46ac6-8e36-41c3-81ee-8268d4bca428 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:27.575161 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d793663-b024-4477-9ee0-ffba88bbbe15 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428" status: 404 len: 111 microversion: 2.1 time: 0.086998 Aug 30 03:36:27.586731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1317/2588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:27 2022] GET /compute/v2.1/servers/3fc46ac6-8e36-41c3-81ee-8268d4bca428 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:36:27.612631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:27.613766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:27.637549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:27.641315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:27.642153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:27.643509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:27.644184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:27.644801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:28.333595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:28.360964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:28.365883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:28.371325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6ad87b3a-6e4c-432d-8659-e3a668547b93 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1866 microversion: 2.42 time: 0.781321 Aug 30 03:36:28.375026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1318/2589] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:27 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1866 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:28.441503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:36:28.442014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:36:28.442382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:36:28.442778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:36:28.443182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:36:28.466229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:28.466724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:28.467155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:28.472031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:28.473059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:28.476588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:28.520059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:36:28.531396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Getting quotas for user 765c0a336f1742378782776c586a21ba and project f087142847e24d46a189056d9718e4e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:36:28.561789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:36:28.565232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:36:28.697003 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7f6cfb4-2e9f-480b-8dd6-3e6e282fc4ba tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.162782 Aug 30 03:36:28.699980 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1272/2590] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:36:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 9168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:36:28.712753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:28.715255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:28.727909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:28.730679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:28.733371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:28.735657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:28.739230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:28.739874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:28.863300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8eff5f7a-8ac9-4268-b797-6a7e09fbb8bd tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Action: 'create', calling method: .version_select at 0x7f897b535280>, body: {"keypair": {"name": "tempest-keypair-136766646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoYxsBEKDAnCTpL+LdZsVMGlq9WzTqPaMJMA7k2Rb/WX1IHbSORRYwejB2UmCd5g6oVbeFqXhFgb09Pc4DC6w3fRjceXFQ8VLNtxZCw+wGc8B1Z15ca9W3V79KwdMF+vQ=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:28.882587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-8eff5f7a-8ac9-4268-b797-6a7e09fbb8bd tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Getting quotas for project 25a99877ec344f79a46d640cd2982446. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:36:28.890667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-8eff5f7a-8ac9-4268-b797-6a7e09fbb8bd tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Getting quotas for user d59d52840f644528a11d81621131cdf2 and project 25a99877ec344f79a46d640cd2982446. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:36:28.927526 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8eff5f7a-8ac9-4268-b797-6a7e09fbb8bd tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.551120 Aug 30 03:36:28.937779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1319/2591] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:36:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:28.951655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:28.956863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:28.965931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:28.966682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:28.967270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:28.968553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:28.969665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:28.970264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:29.064297 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f595ff1-501f-40a0-b6fd-909eae8292e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 200 len: 324 microversion: 2.1 time: 0.124104 Aug 30 03:36:29.069913 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1320/2592] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:36:28 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 324 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:29.075596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-20c6b55c-2a9e-46d4-b5c5-a7e39ca334c3 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b1fb550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:29.096999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] Lazy-loading 'services' on Instance uuid 544a5e62-2526-4cf2-b66c-12031771336b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:36:29.143036 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac557fac-ed9c-4b81-8b4a-7dc834cb3eee tempest-LiveAutoBlockMigrationV225Test-1121981341 tempest-LiveAutoBlockMigrationV225Test-1121981341-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1969 microversion: 2.25 time: 0.439566 Aug 30 03:36:29.145785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1273/2593] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:28 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1969 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:29.158835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fef5de90-632f-472b-98df-15dc53bd7deb tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae3bb80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:29.279577 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fef5de90-632f-472b-98df-15dc53bd7deb tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1413 microversion: 2.1 time: 0.132146 Aug 30 03:36:29.287791 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1274/2594] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:29 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:29.301169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-371e640f-b510-4e16-b412-04df70cff164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:29.302054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-371e640f-b510-4e16-b412-04df70cff164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:29.432041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-371e640f-b510-4e16-b412-04df70cff164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:29.441606 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-371e640f-b510-4e16-b412-04df70cff164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1208 microversion: 2.1 time: 0.151059 Aug 30 03:36:29.444361 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1275/2595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:29 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:29.451016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:29.452403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:29.466632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:29.468800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:29.470929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:29.472516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:29.474168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:29.475327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.120359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:30.133578 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4dfce96b-0754-458f-849b-01cc89f9ba46 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.687087 Aug 30 03:36:30.134466 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1276/2596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:29 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:30.147600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:30.151254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:30.165084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.168054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.170000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.170954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.173781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.174456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.237585 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-20c6b55c-2a9e-46d4-b5c5-a7e39ca334c3 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c4393717-d620-4459-a1e5-65a4c7d483dc" status: 202 len: 0 microversion: 2.1 time: 1.166065 Aug 30 03:36:30.240721 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1321/2597] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:29 2022] DELETE /compute/v2.1/os-security-groups/c4393717-d620-4459-a1e5-65a4c7d483dc => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:36:30.247550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:36:30.247793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:30.249208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:30.271820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.272601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.274701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.276563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.277317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.279602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.532465 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c796eab-3234-444a-baa6-e167045484af tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "DELETE /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 204 len: 0 microversion: 2.25 time: 0.393781 Aug 30 03:36:30.535321 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1277/2598] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:36:30 2022] DELETE /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:36:30.552467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "848a0abf-622c-49ee-b610-7c1c4641e0ef"}, {"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "9eb8cf2f-0133-4274-beb4-c81c48632192"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:30.569873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.570975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.571583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.587224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] Creating event network-changed:848a0abf-622c-49ee-b610-7c1c4641e0ef for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:30.588143 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] Creating event network-changed:9eb8cf2f-0133-4274-beb4-c81c48632192 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:30.598220 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9a01db5b-afb3-4086-a55c-db896710a5c6 req-5262248d-c724-4b29-a8bc-002b90c38efe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056423 Aug 30 03:36:30.600452 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1278/2599] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:30.626244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:30.627997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:30.637676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.639495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.640194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:30.641320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:30.642214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:30.643393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:31.403468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:31.422521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:31.430871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:31.432364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-737a9c3c-ae42-4610-9f6c-dff1d92ab608 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1887 microversion: 2.42 time: 1.189920 Aug 30 03:36:31.433093 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1322/2600] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:30 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1887 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:31.450074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cef6bd08-36cf-4d7d-a65e-cff291307e88 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] Calling method '.version_select at 0x7f897b146790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:31.550049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:31.590454 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a1f575d-dcc2-443e-beb0-a348eeda714e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.985388 Aug 30 03:36:31.596173 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1279/2601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:30 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:31.632565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfa491b2-bc43-4ff3-8fc7-39828937aec6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae78d30>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:31.745760 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfa491b2-bc43-4ff3-8fc7-39828937aec6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1413 microversion: 2.1 time: 0.145213 Aug 30 03:36:31.748901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1280/2602] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:31 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1413 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:31.778953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:31.784061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:31.812475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:31.814536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:31.817419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:31.818528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:31.821973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:31.824751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:32.685704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:32.694635 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57baa697-015d-4b1a-b49c-d5ab1cb719e0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1278 microversion: 2.1 time: 0.942925 Aug 30 03:36:32.698877 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1281/2603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:31 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1278 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:32.706482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:32.707144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:32.745811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:32.747023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:32.749993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:32.752316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:32.754370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:32.755317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:33.795782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:33.812798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:33.820678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:33.825885 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04e8e90a-476b-4411-a1df-c4c15247c50d tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1482 microversion: 2.25 time: 1.124189 Aug 30 03:36:33.827707 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1282/2604] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:32 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1482 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:33.841681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:33.842669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:33.858660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:33.862025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:33.862752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:33.864485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:33.866026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:33.870166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:33.880997 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cef6bd08-36cf-4d7d-a65e-cff291307e88 tempest-SecurityGroupsTestJSON-111063558 tempest-SecurityGroupsTestJSON-111063558-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a22ffd8a-457a-4569-9d47-5d81447c63c7" status: 202 len: 0 microversion: 2.1 time: 2.445121 Aug 30 03:36:33.883220 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1323/2605] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:36:31 2022] DELETE /compute/v2.1/os-security-groups/a22ffd8a-457a-4569-9d47-5d81447c63c7 => generated 0 bytes in 2448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:36:33.893530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:33.894590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:33.920870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:33.923706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:33.924326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:33.926919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:33.927576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:33.929066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:34.440806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:34.455564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:34.457144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:34.458452 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-663a77a3-9eab-4952-b6a2-c713b173b2a2 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1887 microversion: 2.42 time: 0.573966 Aug 30 03:36:34.469800 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1324/2606] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:33 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1887 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:34.477358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-307348433", "imageRef": "ac5deacd-40b7-476b-bb50-816f41ca4a43", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cbe27b5b-df3d-4c2e-8aae-6c6956ceefc5"}], "security_groups": [{"name": "tempest-securitygroup--512666398"}], "key_name": "tempest-keypair-136766646", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:34.862955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:34.874710 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa448c1b-d324-45e9-812c-487c1814ac95 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.044281 Aug 30 03:36:34.875364 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1283/2607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:33 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:34.882452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a02c772f-8ef2-4acf-8bcc-9f8af9daedb9 req-206bef5e-c49c-4d50-b003-869bca8b0146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "92b69d35-61a6-4c5b-96ac-c8a4490071bd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:34.906379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a02c772f-8ef2-4acf-8bcc-9f8af9daedb9 req-206bef5e-c49c-4d50-b003-869bca8b0146 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:34.906887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a02c772f-8ef2-4acf-8bcc-9f8af9daedb9 req-206bef5e-c49c-4d50-b003-869bca8b0146 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:34.907311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a02c772f-8ef2-4acf-8bcc-9f8af9daedb9 req-206bef5e-c49c-4d50-b003-869bca8b0146 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:34.929325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a02c772f-8ef2-4acf-8bcc-9f8af9daedb9 req-206bef5e-c49c-4d50-b003-869bca8b0146 service nova] Creating event network-changed:92b69d35-61a6-4c5b-96ac-c8a4490071bd for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:34.959317 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a02c772f-8ef2-4acf-8bcc-9f8af9daedb9 req-206bef5e-c49c-4d50-b003-869bca8b0146 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082772 Aug 30 03:36:34.960301 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1284/2608] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:34.978261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-163aff88-2224-4847-b02c-27da3ccba57a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b78dca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:35.043180 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-163aff88-2224-4847-b02c-27da3ccba57a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1422 microversion: 2.1 time: 0.081511 Aug 30 03:36:35.052442 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1285/2609] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:34 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:35.057688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:35.058653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:35.065938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:35.066731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:35.067349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:35.068238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:35.068842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:35.069495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:35.475611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] validate_networks() for [('cbe27b5b-df3d-4c2e-8aae-6c6956ceefc5', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:36:35.528688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:35.550525 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be225704-a21f-4e19-81cb-d4dbbcfdbc21 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1266 microversion: 2.1 time: 0.496699 Aug 30 03:36:35.553232 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1286/2610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:35 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1266 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:35.561400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:35.562297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:35.569833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:35.571218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:35.571918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:35.572843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:35.573718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:35.574380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:35.913616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:35.935915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:35.940717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:35.945753 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5a33cd10-9fad-4c71-afe6-9287948878f1 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1440 microversion: 2.25 time: 0.390200 Aug 30 03:36:35.948233 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1287/2611] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:35 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1440 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:35.958870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:35.959737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:35.974390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:35.976905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:35.977932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:35.979650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:35.982453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:35.983313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:36.814205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:36.832483 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1dff43b2-a4d9-4491-87b5-820a451dcabb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.882319 Aug 30 03:36:36.838132 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1288/2612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:35 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:36.852543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8dd1e963-37b1-4dbf-83f3-ff09e68b5fd5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ade41f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:36.920398 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8dd1e963-37b1-4dbf-83f3-ff09e68b5fd5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 200 len: 1422 microversion: 2.1 time: 0.078280 Aug 30 03:36:36.921395 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1289/2613] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:36:36 2022] GET /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:36.935043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:36.936772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:36.954924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:36.957768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:36.958804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:36.963328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:36.966396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:36.968319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:37.669148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:37.679549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:37.689427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:37.689803 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb0a10bd-766e-4164-a1e1-2375d5fc2310 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.767012 Aug 30 03:36:37.690501 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1290/2614] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:36 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:37.702030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:37.702840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:37.717170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:37.717858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:37.719983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:37.720796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:37.724262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:37.724857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:37.761084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:38.498647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:38.902050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:39.006554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:39.019685 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c76095d6-cbde-4f83-87a6-b561377f69f1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1308 microversion: 2.1 time: 1.327587 Aug 30 03:36:39.029261 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1291/2615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:37 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1308 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:39.037460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0408c4e-d7c2-4e83-b48e-0d867f3252af tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897adc6c10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:39.057061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:36:39.057961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:36:39.058448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:36:39.058851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:36:39.059257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:36:39.108330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:39.108790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:39.113214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:39.116136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:39.116936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:39.118902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:39.160826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Getting quotas for project 25a99877ec344f79a46d640cd2982446. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:36:39.168300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Getting quotas for user d59d52840f644528a11d81621131cdf2 and project 25a99877ec344f79a46d640cd2982446. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:36:39.184288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:36:39.188175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ac5deacd-40b7-476b-bb50-816f41ca4a43',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:36:39.275310 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d70416a8-fb84-426c-ab1e-526249875743 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.803136 Aug 30 03:36:39.277886 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1325/2616] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:36:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 4807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:36:39.285710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:39.286914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:39.306831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:39.309936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:39.310830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:39.312120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:39.313908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:39.317947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:39.440760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:39.642261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:39.656980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:39.658566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:39.659675 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e3fd440-cec9-4f1b-b66d-d4b279446a56 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1266 microversion: 2.25 time: 0.380473 Aug 30 03:36:39.660219 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1326/2617] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:39 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:39.702862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1618645813", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "e6a4f0d7-59ea-445f-abb0-b63795f79159"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:39.826981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] validate_networks() for [('e6a4f0d7-59ea-445f-abb0-b63795f79159', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:36:40.289087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0408c4e-d7c2-4e83-b48e-0d867f3252af tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 204 len: 0 microversion: 2.1 time: 1.257733 Aug 30 03:36:40.290052 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1292/2618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:39 2022] DELETE /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 0 bytes in 1260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:36:40.296914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e"}, {"server_uuid": "544a5e62-2526-4cf2-b66c-12031771336b", "name": "network-vif-deleted", "tag": "76e3a72c-44fb-4c4b-927d-4ffc06541f0e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:40.329805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:40.331139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:40.335407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:40.372632 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] Creating event network-changed:57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:40.374399 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] Creating event network-vif-deleted:76e3a72c-44fb-4c4b-927d-4ffc06541f0e for instance 544a5e62-2526-4cf2-b66c-12031771336b on n-h1-854924-5 Aug 30 03:36:40.416213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-514fdee4-0b4f-4bba-b69f-fcc06a77331d req-87c53878-ce52-44bb-be76-7b4f45e072f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.120081 Aug 30 03:36:40.422015 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1293/2619] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:40.446213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:40.448827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:40.475149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:40.477246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:40.479867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:40.481172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:40.481893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:40.482574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.090069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:42.101977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:42.113155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:42.114496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26eab410-5d48-41fd-902a-26412dfb6217 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 1.689697 Aug 30 03:36:42.130925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1294/2620] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:40 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:42.136441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:42.142363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:42.156125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.156956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.157600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.158509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.159143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.161483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.404408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:42.413484 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2058cd4f-6779-4459-b062-0ea648c9101b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1304 microversion: 2.1 time: 0.280915 Aug 30 03:36:42.415670 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1295/2621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:42 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:42.437173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3133a8db-342d-45ec-af39-d57acec83a38 req-1cd3acf9-67fa-4f25-90f5-de675b645920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a21bb6-011c-42df-89e9-55d0bc3e76cc", "name": "network-vif-unplugged", "status": "completed", "tag": "a1f58aef-2a54-4f46-a712-048e3effe96f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:42.463666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3133a8db-342d-45ec-af39-d57acec83a38 req-1cd3acf9-67fa-4f25-90f5-de675b645920 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.466073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3133a8db-342d-45ec-af39-d57acec83a38 req-1cd3acf9-67fa-4f25-90f5-de675b645920 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.466776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3133a8db-342d-45ec-af39-d57acec83a38 req-1cd3acf9-67fa-4f25-90f5-de675b645920 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.496883 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3133a8db-342d-45ec-af39-d57acec83a38 req-1cd3acf9-67fa-4f25-90f5-de675b645920 service nova] Creating event network-vif-unplugged:a1f58aef-2a54-4f46-a712-048e3effe96f for instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc on n-h1-854924-5 Aug 30 03:36:42.510031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3133a8db-342d-45ec-af39-d57acec83a38 req-1cd3acf9-67fa-4f25-90f5-de675b645920 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078195 Aug 30 03:36:42.518611 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1296/2622] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:42.524723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:42.525842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:42.542565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.544442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.546388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.550362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.551394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.552587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.916050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:36:42.917663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:36:42.918712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:36:42.919732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:36:42.920666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:36:42.932272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.935061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.936080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.937106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:42.937936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:42.938565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:42.972871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:36:42.986932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for user a681b194cdb24b6fbb49eb39711ffa1c and project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:36:43.045561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:36:43.047804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:36:43.247432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-417ea6e8-d15b-4335-80ab-d9e1b160a15e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.559973 Aug 30 03:36:43.248919 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1327/2623] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:36:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:36:43.260735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:43.261520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:43.281648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:43.282459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:43.283159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:43.294359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:43.294844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:43.295283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:43.382245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:36:43.642445 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d53304d-0911-47ae-a361-a4d912343db4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 204 len: 0 microversion: 2.1 time: 0.390241 Aug 30 03:36:43.645726 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1328/2624] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:36:43 2022] DELETE /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:36:43.664933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:43.667719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:43.686225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:43.689113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:43.690588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:43.694175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:43.696250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:43.697812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:44.798745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:44.818499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:44.823735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:44.827655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9215d34b-e49f-4434-8339-e0397dda6939 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 200 len: 1266 microversion: 2.25 time: 1.178967 Aug 30 03:36:44.828964 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1329/2625] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:43 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 1266 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:44.844829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-58190446-392e-4d78-b496-708d157d060e req-d89ad7e9-c494-460b-9818-583b89dd394e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "d49ca1e1-d171-473d-86f2-efabad830021"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:44.870762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-58190446-392e-4d78-b496-708d157d060e req-d89ad7e9-c494-460b-9818-583b89dd394e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:44.871449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-58190446-392e-4d78-b496-708d157d060e req-d89ad7e9-c494-460b-9818-583b89dd394e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:44.871906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-58190446-392e-4d78-b496-708d157d060e req-d89ad7e9-c494-460b-9818-583b89dd394e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:44.923621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-58190446-392e-4d78-b496-708d157d060e req-d89ad7e9-c494-460b-9818-583b89dd394e service nova] Creating event network-changed:d49ca1e1-d171-473d-86f2-efabad830021 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:44.958458 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-58190446-392e-4d78-b496-708d157d060e req-d89ad7e9-c494-460b-9818-583b89dd394e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120200 Aug 30 03:36:44.962349 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1330/2626] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:44.980620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:44.982073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:45.021243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:45.025767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:45.027804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:45.030169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:45.034584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:45.035509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:46.661053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:46.678082 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c031167a-d412-4630-a353-fe66c0cafd8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1308 microversion: 2.1 time: 4.157734 Aug 30 03:36:46.678675 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1297/2627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:42 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1308 bytes in 4159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:46.686143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:46.702376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:46.718087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:46.719988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:46.720488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:46.720937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:46.727535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:46.728119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:46.728587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:47.345572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:47.360969 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1e3bbf5-6e25-490a-b38a-6e610934aa66 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1275 microversion: 2.1 time: 0.678386 Aug 30 03:36:47.362797 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1298/2628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:46 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1275 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:47.376103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:47.377066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:47.394301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:47.395077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:47.395675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:47.396520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:47.397127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:47.402413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:48.022539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:48.038235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:48.050344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:48.052313 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-83cd9f7e-c953-4ddd-acf2-5e0043a4c244 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 3.085151 Aug 30 03:36:48.053495 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1331/2629] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:44 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 3090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:48.069473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-339664437", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b426cd56-ffb2-4a75-8914-dc1bc200de06"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:48.200039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] validate_networks() for [('b426cd56-ffb2-4a75-8914-dc1bc200de06', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:36:50.245737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:50.284644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0fef957f-7532-4456-ac57-8b357e4a7649 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 2.914818 Aug 30 03:36:50.289064 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1299/2630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:47 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 2925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:50.309638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:50.310255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 544a5e62-2526-4cf2-b66c-12031771336b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:50.336973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:50.345259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:50.345804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:50.346614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:50.347086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:50.347525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:50.408791 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] HTTP exception thrown: Instance 544a5e62-2526-4cf2-b66c-12031771336b could not be found. Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Request method failure captured: Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b HTTP/1.1 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQCzL-qtiKzoA81xqtH-pgIcvDekq1vuDZUoU1Vq_QG6QkpzcLlE9mjMmu3bwSu1G5FYEzQwgGxwwpA9FrfdAoecGbO-58xhiA7VSwo6sZrVP5HvcnkE1sjbgsBCwyK7dn7LfJFaeVxlExPu_ZjwDSgeWbNjdujlc_efz77jeO_00s Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e260d308f384ae5a6b7437e21055c75", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}] Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 90a88f0a70ca48f59450dae1c9165417 Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 544a5e62-2526-4cf2-b66c-12031771336b could not be found. Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '544a5e62-2526-4cf2-b66c-12031771336b'} Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544a5e62-2526-4cf2-b66c-12031771336b could not be found. Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544a5e62-2526-4cf2-b66c-12031771336b could not be found. Aug 30 03:36:50.413368 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544a5e62-2526-4cf2-b66c-12031771336b could not be found. Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:36:50.419388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Returning 404 to user: Instance 544a5e62-2526-4cf2-b66c-12031771336b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:36:50.420204 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79f839ae-1578-4060-8b4e-b03bd879bc36 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b" status: 404 len: 111 microversion: 2.25 time: 0.126685 Aug 30 03:36:50.421911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1300/2631] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:50 2022] GET /compute/v2.1/servers/544a5e62-2526-4cf2-b66c-12031771336b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:36:50.461271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a483ce97-6e90-4037-ac34-1fdb2b21b50c", "tag": "6a9f381f-881e-4d29-90b6-9283d9a86b3c"}, {"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:50.496338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:50.502125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:50.502670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:50.546730 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] Creating event network-changed:6a9f381f-881e-4d29-90b6-9283d9a86b3c for instance a483ce97-6e90-4037-ac34-1fdb2b21b50c on n-h1-854924-5 Aug 30 03:36:50.547503 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] Creating event network-changed:03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:50.580166 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9b4267c5-4c26-41a5-b32c-693649f8a99c req-db60d8d2-6f59-48a2-9ccb-93f9c6a5605d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.142365 Aug 30 03:36:50.582419 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1301/2632] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:50.599230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:50.605206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:50.618875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:50.619767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:50.620480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:50.621933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:50.625525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:50.626242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:52.658447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:52.700428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1cf2154-39e8-4414-94c6-13b114add4e9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1308 microversion: 2.1 time: 2.109979 Aug 30 03:36:52.727411 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1302/2633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:50 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1308 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:52.947985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:53.015072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:53.320836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:53.321531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:53.342134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:53.348242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:53.353224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:53.356583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:53.358147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:53.362464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:53.509105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:36:53.510288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:36:53.511196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:36:53.511922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:36:53.512991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:36:53.533914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:53.615561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:53.628768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:53.631381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:53.636532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:53.639988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:53.643109 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1218a7a9-8c02-4c15-b6ed-de62bbde3d37 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1273 microversion: 2.1 time: 0.912621 Aug 30 03:36:53.644322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:53.657018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1303/2634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:52 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1273 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:53.657253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:53.667042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:53.669511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:53.696874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:53.700138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:53.702969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:53.704211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:53.710893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:53.712614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:53.730587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:53.820064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:36:53.853785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for user cdbd4bfb488c475dac2862ea5df0fe70 and project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:36:53.918256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:36:53.925888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:36:54.033685 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3aef7396-176c-48d3-ac00-a4addcbef5a9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.977493 Aug 30 03:36:54.057260 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1332/2635] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 6002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:36:54.064786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:54.072643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:54.105301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:54.108771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:54.109297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:54.111990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:54.112476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:54.112915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:55.534459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:55.559753 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf2128e3-cc3c-4b02-b5a1-8ca7f900dbb9 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 1.500934 Aug 30 03:36:55.567985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1333/2636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:54 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:55.581181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e5301dab-0ff1-4362-9a50-b28b73f3e5d9 req-d30f3330-007b-463e-89e1-4943f819ffd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a21bb6-011c-42df-89e9-55d0bc3e76cc", "name": "network-vif-deleted", "tag": "a1f58aef-2a54-4f46-a712-048e3effe96f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:55.589312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:55.607384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e5301dab-0ff1-4362-9a50-b28b73f3e5d9 req-d30f3330-007b-463e-89e1-4943f819ffd6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:55.609404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e5301dab-0ff1-4362-9a50-b28b73f3e5d9 req-d30f3330-007b-463e-89e1-4943f819ffd6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:55.610049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e5301dab-0ff1-4362-9a50-b28b73f3e5d9 req-d30f3330-007b-463e-89e1-4943f819ffd6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:55.632262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:55.634943 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e5301dab-0ff1-4362-9a50-b28b73f3e5d9 req-d30f3330-007b-463e-89e1-4943f819ffd6 service nova] Creating event network-vif-deleted:a1f58aef-2a54-4f46-a712-048e3effe96f for instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc on n-h1-854924-5 Aug 30 03:36:55.639346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:55.645169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba848622-c21c-440b-9c1f-59bdf95a3f4b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 1.998046 Aug 30 03:36:55.649696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e5301dab-0ff1-4362-9a50-b28b73f3e5d9 req-d30f3330-007b-463e-89e1-4943f819ffd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080547 Aug 30 03:36:55.650822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1334/2637] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:55.652690 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1304/2638] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:53 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:55.665133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:55.668266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:55.676692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:55.678534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:55.701424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:55.702089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:55.704081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:55.706119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:55.710853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:55.711624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:55.718662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:55.725452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:55.727396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:55.729504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:55.731366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:55.734017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:56.138824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:56.155974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1ea5a691-f3c6-4d7e-8d39-2062b7668f89 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1203 microversion: 2.1 time: 0.501699 Aug 30 03:36:56.156674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1305/2639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:55 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1203 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:56.174859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:56.175855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:56.199848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:56.200707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:56.201527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:56.202960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:56.203736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:56.204368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.049968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:57.058270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f166a293-4a86-482e-8016-209cd147784f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1308 microversion: 2.1 time: 1.406093 Aug 30 03:36:57.058849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1335/2640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:55 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1308 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:57.073509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:57.076617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:57.091623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.094639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.095268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.096143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.096747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.097330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.265214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:57.274020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f65324e7-3ca0-4abd-bf81-4c916110c2a1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 1.107293 Aug 30 03:36:57.280126 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1306/2641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:56 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:57.285296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:57.290705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:57.309650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.310412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.311004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.312150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.312642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.313069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.534399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:57.551052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f40928fd-3ceb-4862-b9ac-0e6c8aeba1f3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 0.487326 Aug 30 03:36:57.551957 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1336/2642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:57 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:57.557161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f67dffb8-edf2-4efc-a2f3-190481d4e928 req-67adf1cc-9157-4fa1-aeb6-823310f491b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759deeae-beb8-4920-901b-9bdf27637178", "tag": "0cc7510f-0a08-4609-a7ee-f1814e36225d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:57.593480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f67dffb8-edf2-4efc-a2f3-190481d4e928 req-67adf1cc-9157-4fa1-aeb6-823310f491b0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.594261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f67dffb8-edf2-4efc-a2f3-190481d4e928 req-67adf1cc-9157-4fa1-aeb6-823310f491b0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.594851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f67dffb8-edf2-4efc-a2f3-190481d4e928 req-67adf1cc-9157-4fa1-aeb6-823310f491b0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.617699 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f67dffb8-edf2-4efc-a2f3-190481d4e928 req-67adf1cc-9157-4fa1-aeb6-823310f491b0 service nova] Creating event network-changed:0cc7510f-0a08-4609-a7ee-f1814e36225d for instance 759deeae-beb8-4920-901b-9bdf27637178 on n-h2-854924-5 Aug 30 03:36:57.631488 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f67dffb8-edf2-4efc-a2f3-190481d4e928 req-67adf1cc-9157-4fa1-aeb6-823310f491b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078268 Aug 30 03:36:57.632775 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1337/2643] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:57.638213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:57.639179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:57.658614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.659583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.660086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.660977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.661678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.662265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.878242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:57.891104 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc4cd511-85ac-4610-931e-06555a38bafe tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1277 microversion: 2.1 time: 0.256803 Aug 30 03:36:57.891979 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1338/2644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:57 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:57.900944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:57.902410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:57.926212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.927433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.928112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.929489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:57.930132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:57.930909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:57.978576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:36:58.084360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.125972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.129436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.134754 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8407fbd9-09b2-4355-8f1a-08a8978f6ffe tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.853264 Aug 30 03:36:58.137069 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1307/2645] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:57 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:58.154506 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f34ca904-23b5-420f-a944-e053f6f793c7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 204 len: 0 microversion: 2.25 time: 0.258502 Aug 30 03:36:58.156781 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1339/2646] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:36:57 2022] DELETE /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:36:58.164003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-38ca47e8-aa0c-44e1-841e-b1ca6ebf6a71 req-15262bda-f27c-41fa-8b30-984402ad0e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "f0b367c2-c520-4f6e-b251-798e702ebbe1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:58.167862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2271b04f-296e-4d7c-b091-fdb389adf224 req-2decdd4f-c386-493b-ae3e-7e5b824358e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ce97-6e90-4037-ac34-1fdb2b21b50c", "name": "network-vif-plugged", "status": "completed", "tag": "6a9f381f-881e-4d29-90b6-9283d9a86b3c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:36:58.189429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-38ca47e8-aa0c-44e1-841e-b1ca6ebf6a71 req-15262bda-f27c-41fa-8b30-984402ad0e4f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.192298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2271b04f-296e-4d7c-b091-fdb389adf224 req-2decdd4f-c386-493b-ae3e-7e5b824358e5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.192437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-38ca47e8-aa0c-44e1-841e-b1ca6ebf6a71 req-15262bda-f27c-41fa-8b30-984402ad0e4f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.193562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-38ca47e8-aa0c-44e1-841e-b1ca6ebf6a71 req-15262bda-f27c-41fa-8b30-984402ad0e4f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.195103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2271b04f-296e-4d7c-b091-fdb389adf224 req-2decdd4f-c386-493b-ae3e-7e5b824358e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.195807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2271b04f-296e-4d7c-b091-fdb389adf224 req-2decdd4f-c386-493b-ae3e-7e5b824358e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.215234 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-38ca47e8-aa0c-44e1-841e-b1ca6ebf6a71 req-15262bda-f27c-41fa-8b30-984402ad0e4f service nova] Creating event network-changed:f0b367c2-c520-4f6e-b251-798e702ebbe1 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:36:58.224952 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2271b04f-296e-4d7c-b091-fdb389adf224 req-2decdd4f-c386-493b-ae3e-7e5b824358e5 service nova] Creating event network-vif-plugged:6a9f381f-881e-4d29-90b6-9283d9a86b3c for instance a483ce97-6e90-4037-ac34-1fdb2b21b50c on n-h1-854924-5 Aug 30 03:36:58.225971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-38ca47e8-aa0c-44e1-841e-b1ca6ebf6a71 req-15262bda-f27c-41fa-8b30-984402ad0e4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086825 Aug 30 03:36:58.228305 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1308/2647] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:58.236430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:58.237688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:58.238430 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2271b04f-296e-4d7c-b091-fdb389adf224 req-2decdd4f-c386-493b-ae3e-7e5b824358e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078672 Aug 30 03:36:58.240642 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1340/2648] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:36:58.246648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.247715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.248350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.249369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.250625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.251228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.252893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:58.256867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:58.271079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.271979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.272687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.274213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.278198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.278960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.684953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.693184 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-198883ff-b909-4875-b6f6-dc94e5054359 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1308 microversion: 2.1 time: 0.463338 Aug 30 03:36:58.693840 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1309/2649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:58 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:58.712554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:58.713449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:58.720275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.721034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.721671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.722548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.723165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.723752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.863871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.875537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.879324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:58.881202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-153dede1-b41a-452a-89d0-42bb6b4bc98e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1727 microversion: 2.25 time: 0.639096 Aug 30 03:36:58.882846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1341/2650] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:58 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1727 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:36:58.887775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:58.888563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:58.899997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.900118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.900513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:58.901219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:58.901836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:58.902259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.390782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:59.399823 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca90145f-6ae1-4967-ba73-30bd5f958fe6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.691033 Aug 30 03:36:59.400499 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1310/2651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:58 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:59.405438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:59.406219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:59.414498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:59.415432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:59.416026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.416900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:59.417362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:59.417981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.428853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:59.436621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0888d050-6e7e-4eea-b3cc-fedb600ed657 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 0.552490 Aug 30 03:36:59.450098 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1342/2652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:58 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:59.455202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:59.455924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:59.463078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:59.463865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:59.464543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.465616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:59.466149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:59.466894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.513657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:36:59.522383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c840f527-c494-4b2f-83e0-f24ef4c31f2b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1265 microversion: 2.1 time: 0.120527 Aug 30 03:36:59.523503 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1311/2653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:59 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:36:59.715411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:36:59.717090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:36:59.724592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:59.725536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:59.727368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.728332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:36:59.729277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:36:59.730786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:36:59.754080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:36:59.993070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.003932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.006367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.008485 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1dbf44ee-84a2-4a23-9ae0-8824798c1e6e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.557030 Aug 30 03:37:00.009686 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1343/2654] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:36:59 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:00.019495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:00.020886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:00.029537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.030558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.031206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:00.032245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.033014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.034226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:00.118455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.127972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f9946e0-86f4-4881-9d31-5040fb2708d2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1308 microversion: 2.1 time: 0.416651 Aug 30 03:37:00.128659 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1312/2655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:36:59 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1308 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:00.264851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-64cc18c8-c9d1-4b9b-9381-4b8dd4f18187 req-7c844aff-af17-45b6-ad81-ee34ce75d360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf21208-d87a-4ef0-b2a0-405d26661c6d", "tag": "ee0895c9-832c-4a9a-90b6-bf5eeb4c5f42"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:00.274583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64cc18c8-c9d1-4b9b-9381-4b8dd4f18187 req-7c844aff-af17-45b6-ad81-ee34ce75d360 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.275061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64cc18c8-c9d1-4b9b-9381-4b8dd4f18187 req-7c844aff-af17-45b6-ad81-ee34ce75d360 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.275487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64cc18c8-c9d1-4b9b-9381-4b8dd4f18187 req-7c844aff-af17-45b6-ad81-ee34ce75d360 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:00.287970 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-64cc18c8-c9d1-4b9b-9381-4b8dd4f18187 req-7c844aff-af17-45b6-ad81-ee34ce75d360 service nova] Creating event network-changed:ee0895c9-832c-4a9a-90b6-bf5eeb4c5f42 for instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d on n-h1-854924-5 Aug 30 03:37:00.293325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-64cc18c8-c9d1-4b9b-9381-4b8dd4f18187 req-7c844aff-af17-45b6-ad81-ee34ce75d360 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032454 Aug 30 03:37:00.294260 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1313/2656] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:00.431359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:00.432072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:00.448640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.449147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.449609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:00.450322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.452383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.453074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:00.856016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.869832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.871581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:00.873061 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3422ed34-5d2c-4cff-9eb1-d8c4dca9dfb4 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1727 microversion: 2.25 time: 0.862036 Aug 30 03:37:00.887655 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1344/2657] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:00 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1727 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:00.898436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:00.899177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:00.906170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.906374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.906832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:00.907834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:00.908364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:00.908858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:01.364562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:01.381213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-caef6575-5732-4849-adf8-5ece2644aa00 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.953604 Aug 30 03:37:01.402587 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1314/2658] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:00 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:01.413082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:01.414667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:01.431152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:01.431985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:01.432844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:01.433800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:01.434594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:01.435788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:01.631400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:01.646979 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a629956-b198-49bf-9241-15885f4539d4 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 0.756992 Aug 30 03:37:01.649546 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1345/2659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:00 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:01.656369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:01.657537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:01.668469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:01.669409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:01.671246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:01.673169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:01.674102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:01.675263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.124651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.133625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90f97e27-2ec1-4836-b174-412d01721bdc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.728834 Aug 30 03:37:02.146514 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1315/2660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:01 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:02.152024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:02.152914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:02.167328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.167848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.168293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.169226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.169724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.170600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.265692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.276364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.278840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.280377 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-452af753-a908-47aa-8e6d-7933b9d89386 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.628930 Aug 30 03:37:02.281133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1346/2661] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:01 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:02.287718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:02.289111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:02.307241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.310038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.312819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.314105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.315216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.315607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.525710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.538006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.540041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.540921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:02.548876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7bc2d6c2-63b4-4c1e-bb1b-fef65d13c65b tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1660 microversion: 2.25 time: 0.264796 Aug 30 03:37:02.549734 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1347/2662] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:02 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1660 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:02.554726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:02.558801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:02.577169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.578405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.579042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.579963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.582013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.586323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.591498 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34127253-af6b-4f1a-b099-f5f380364e0b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1489 microversion: 2.1 time: 0.443394 Aug 30 03:37:02.596803 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1316/2663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:02 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1489 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:02.618425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-217434159"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:02.622706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:02.657107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.662913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.664243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.666060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.666837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.668193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.830069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f9defa3-126a-4c0d-a676-b8292a0a4049 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "PUT /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1074 microversion: 2.1 time: 0.215314 Aug 30 03:37:02.832399 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1317/2664] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:37:02 2022] PUT /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1074 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:02.845058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:02.846176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:02.857200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.858324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.859099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:02.861821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:02.862649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:02.863626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.421950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:03.431572 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a200c473-32df-4caf-bb37-8328aa89ebb2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.880472 Aug 30 03:37:03.432171 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1348/2665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:02 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:03.438625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:03.439489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:03.447838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.448333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.449510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.450262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.450715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.451323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.696467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:03.708818 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-293966fd-d55e-40cc-930c-4833d4b315b3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 0.874844 Aug 30 03:37:03.709906 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1318/2666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:02 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:03.716918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8947716f-eac1-4bcf-91a9-56014bbcf108 req-fd436e72-67d7-4792-8bda-7813245e8e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8978264-05e7-42a1-8232-bc6575cdd4ab", "tag": "b2557c8c-be04-4c4b-a0d5-324e68b95fe4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:03.727764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:03.744826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8947716f-eac1-4bcf-91a9-56014bbcf108 req-fd436e72-67d7-4792-8bda-7813245e8e8d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.745629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8947716f-eac1-4bcf-91a9-56014bbcf108 req-fd436e72-67d7-4792-8bda-7813245e8e8d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.746070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8947716f-eac1-4bcf-91a9-56014bbcf108 req-fd436e72-67d7-4792-8bda-7813245e8e8d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.777819 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8947716f-eac1-4bcf-91a9-56014bbcf108 req-fd436e72-67d7-4792-8bda-7813245e8e8d service nova] Creating event network-changed:b2557c8c-be04-4c4b-a0d5-324e68b95fe4 for instance e8978264-05e7-42a1-8232-bc6575cdd4ab on n-h2-854924-5 Aug 30 03:37:03.782971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8947716f-eac1-4bcf-91a9-56014bbcf108 req-fd436e72-67d7-4792-8bda-7813245e8e8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071820 Aug 30 03:37:03.794025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1319/2667] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:03.799358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:03.800068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:03.819708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.820213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.820655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.821397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.821864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.822296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.895322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:03.955635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:03.957891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:03.966674 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30276628-6153-47bf-920f-2e3ec1556451 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1500 microversion: 2.1 time: 0.533082 Aug 30 03:37:03.967854 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1349/2668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:03 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1500 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:03.973051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:03.973932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:03.983468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.984181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.985467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:03.986437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:03.987564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:03.988186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.258355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.271729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34a63dcf-086d-4b60-8697-73cbc4a5cdf1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.474154 Aug 30 03:37:04.275102 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1320/2669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:03 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:04.280018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:04.284255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:04.296103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.296679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.297541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.298507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.299155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.300020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.494487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.520409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.524487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.527627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ec8243c-1e1c-43ea-a752-35bfa6021d61 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1660 microversion: 2.25 time: 0.248170 Aug 30 03:37:04.528906 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1321/2670] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:04 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1660 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:04.534796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6210faa8-f001-4dfe-905d-e895137879bf req-49b852a3-dfb0-440a-8535-66ea8b988dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759deeae-beb8-4920-901b-9bdf27637178", "name": "network-vif-plugged", "status": "completed", "tag": "0cc7510f-0a08-4609-a7ee-f1814e36225d"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:04.553317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6210faa8-f001-4dfe-905d-e895137879bf req-49b852a3-dfb0-440a-8535-66ea8b988dac service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.555132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6210faa8-f001-4dfe-905d-e895137879bf req-49b852a3-dfb0-440a-8535-66ea8b988dac service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.556930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6210faa8-f001-4dfe-905d-e895137879bf req-49b852a3-dfb0-440a-8535-66ea8b988dac service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.580668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.592994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6210faa8-f001-4dfe-905d-e895137879bf req-49b852a3-dfb0-440a-8535-66ea8b988dac service nova] Creating event network-vif-plugged:0cc7510f-0a08-4609-a7ee-f1814e36225d for instance 759deeae-beb8-4920-901b-9bdf27637178 on n-h2-854924-5 Aug 30 03:37:04.603528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.611044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:04.613263 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6210faa8-f001-4dfe-905d-e895137879bf req-49b852a3-dfb0-440a-8535-66ea8b988dac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082784 Aug 30 03:37:04.614501 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce68ade2-c9f0-4caa-a69e-2c16f72a3bf0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.645243 Aug 30 03:37:04.619256 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1350/2671] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:03 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:04.619891 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1322/2672] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:04.632681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:04.635624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:04.640043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:04.641383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:04.656598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.660328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.660853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.663070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.664311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.664786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.665215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.667812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.668263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:04.669004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:04.677942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:04.678523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.267150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:05.280006 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6f2546e0-722c-497e-9798-7fe7ee35af04 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.656512 Aug 30 03:37:05.281243 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1323/2673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:04 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:05.286430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:05.287285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:05.297111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.297686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.298120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.298936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.300235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.300668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.514779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:05.542330 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d229026-5b8c-4565-a38f-556cae4e245f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1500 microversion: 2.1 time: 0.921368 Aug 30 03:37:05.545551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1351/2674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:04 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1500 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:05.558562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:05.559185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:05.577768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.584820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.585991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.586820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.590619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.591197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.707282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:05.715744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ecc353f1-0ea6-42a0-841a-0fc03d0608d3 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 0.433116 Aug 30 03:37:05.716424 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1324/2675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:05 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:05.721112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:05.722267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:05.730607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.731277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.731848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.732639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.733169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.733767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.769774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.770422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.770958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.771481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lazy-loading 'fault' on Instance uuid dc569f42-9c15-4496-b658-3d65b1c112cf {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:37:05.888198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:05.901033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:05.910950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:05.912642 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2ba1a90-ac6b-4363-8229-1f8e624ddc11 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 200 len: 1374 microversion: 2.25 time: 0.195289 Aug 30 03:37:05.927348 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1325/2676] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:05 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 1374 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:05.932837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e6ef51b-2d9f-45f8-ade1-a08f7bf82206 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:05.939807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e6ef51b-2d9f-45f8-ade1-a08f7bf82206 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:05.940509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e6ef51b-2d9f-45f8-ade1-a08f7bf82206 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:05.941100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e6ef51b-2d9f-45f8-ade1-a08f7bf82206 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:05.990607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:06.000627 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a7b78b6d-68d2-46da-8ddf-70b261c6539d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.453670 Aug 30 03:37:06.021192 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1352/2677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:05 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:06.027285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:06.028282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:06.029112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3e6ef51b-2d9f-45f8-ade1-a08f7bf82206 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Going to try to stop instance {{(pid=122167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:37:06.042903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.043805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.044522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.045526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.047346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.048006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.106604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e6ef51b-2d9f-45f8-ade1-a08f7bf82206 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "POST /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c/action" status: 202 len: 0 microversion: 2.1 time: 0.177819 Aug 30 03:37:06.107211 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1326/2678] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:37:05 2022] POST /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:37:06.112622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c8ece890-c33e-4ff3-98d2-fb975aef4f51 req-56b4bb53-fb78-458c-ab50-fb67cbc64be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc569f42-9c15-4496-b658-3d65b1c112cf", "name": "network-vif-deleted", "tag": "412dd46c-5445-4790-a0c1-f64b221547a6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:06.142351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c8ece890-c33e-4ff3-98d2-fb975aef4f51 req-56b4bb53-fb78-458c-ab50-fb67cbc64be6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.144504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c8ece890-c33e-4ff3-98d2-fb975aef4f51 req-56b4bb53-fb78-458c-ab50-fb67cbc64be6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.144956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c8ece890-c33e-4ff3-98d2-fb975aef4f51 req-56b4bb53-fb78-458c-ab50-fb67cbc64be6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.166517 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c8ece890-c33e-4ff3-98d2-fb975aef4f51 req-56b4bb53-fb78-458c-ab50-fb67cbc64be6 service nova] Creating event network-vif-deleted:412dd46c-5445-4790-a0c1-f64b221547a6 for instance dc569f42-9c15-4496-b658-3d65b1c112cf on n-h1-854924-5 Aug 30 03:37:06.174915 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c8ece890-c33e-4ff3-98d2-fb975aef4f51 req-56b4bb53-fb78-458c-ab50-fb67cbc64be6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063760 Aug 30 03:37:06.175807 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1327/2679] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:06.182698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:06.183465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:06.192332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.192885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.193409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.194273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.196183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.196624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.545887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:06.558345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:06.572089 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64580c6c-c753-4960-ab33-f7d43da9fa96 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.394983 Aug 30 03:37:06.573424 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1328/2680] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:06 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:06.579287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:06.584472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:06.585375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:06.592402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:06.596947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.597526 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e443375-5a34-4ea6-85e5-8776c4478d2f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.572236 Aug 30 03:37:06.598846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.599253 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1353/2681] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:06 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:06.599766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.600584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.601821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.602346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.739162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:06.739960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:06.747103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.747858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.748602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.749471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.749989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.750727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.894012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:06.902461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:06.916999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca766c02-13d7-4fee-8d3a-ebd93790868c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.340451 Aug 30 03:37:06.930590 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1329/2682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:06 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:06.939572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:06.940457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: dc569f42-9c15-4496-b658-3d65b1c112cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:06.949445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.950505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.951330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.952216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:06.953297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:06.954986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:06.974598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] HTTP exception thrown: Instance dc569f42-9c15-4496-b658-3d65b1c112cf could not be found. Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Request method failure captured: Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf HTTP/1.1 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQCzL-qtiKzoA81xqtH-pgIcvDekq1vuDZUoU1Vq_QG6QkpzcLlE9mjMmu3bwSu1G5FYEzQwgGxwwpA9FrfdAoecGbO-58xhiA7VSwo6sZrVP5HvcnkE1sjbgsBCwyK7dn7LfJFaeVxlExPu_ZjwDSgeWbNjdujlc_efz77jeO_00s Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e260d308f384ae5a6b7437e21055c75", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}] Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 90a88f0a70ca48f59450dae1c9165417 Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance dc569f42-9c15-4496-b658-3d65b1c112cf could not be found. Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'dc569f42-9c15-4496-b658-3d65b1c112cf'} Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc569f42-9c15-4496-b658-3d65b1c112cf could not be found. Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc569f42-9c15-4496-b658-3d65b1c112cf could not be found. Aug 30 03:37:06.977437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc569f42-9c15-4496-b658-3d65b1c112cf could not be found. Aug 30 03:37:06.982648 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:06.985533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Returning 404 to user: Instance dc569f42-9c15-4496-b658-3d65b1c112cf could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:06.987801 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ecb4b86d-7372-4f0b-bada-92e65157a5d2 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf" status: 404 len: 111 microversion: 2.25 time: 0.052006 Aug 30 03:37:06.989123 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1330/2683] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:06 2022] GET /compute/v2.1/servers/dc569f42-9c15-4496-b658-3d65b1c112cf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:37:06.999341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee113efb-9638-4983-b727-f61c4c83a548 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '.version_select at 0x7f897ae3a160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:07.024932 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee113efb-9638-4983-b727-f61c4c83a548 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625714692" status: 204 len: 0 microversion: 2.25 time: 0.031281 Aug 30 03:37:07.026868 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1331/2684] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Aug 30 03:37:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625714692 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 03:37:07.048313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:07.049622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:07.070248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:07.071702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:07.072176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:07.075108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:07.075612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:07.077929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:07.270262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:07.290991 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a92212ec-654f-40b2-8527-3341f54c10f6 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1369 microversion: 2.1 time: 0.556848 Aug 30 03:37:07.292135 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1354/2685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:06 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1369 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:07.359059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:07.367639 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c7b69018-11f5-41db-a1a7-8063bdfe1981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.338896 Aug 30 03:37:07.368151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1332/2686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:07 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:07.595917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:07.596536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:07.603696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:07.604203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:07.604643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:07.605568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:07.606026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:07.607261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:07.629903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:07.633553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:07.641157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:07.641998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:07.642705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:07.643771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:07.645087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:07.645721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.210875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.237234 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f269e1b-a5af-4ccd-ae57-06ace78042a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.645174 Aug 30 03:37:08.247016 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1355/2687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:07 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:08.280797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.281680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:08.282311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:08.295845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.297603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.298994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4f3db96e-c39e-4382-841b-270d22ed9695 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.678399 Aug 30 03:37:08.300176 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1333/2688] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:07 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:08.311915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:08.313232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:08.320452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.321183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.321836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.322914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.324445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.325054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.326189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.330361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.331227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.334785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.337828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.338466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.633227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.642932 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c73a4026-2081-400b-b2b3-cd753b1f5c47 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.389138 Aug 30 03:37:08.643881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1356/2689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:08 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:08.649796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:08.650545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:08.659514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.660021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.661100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.661217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.661779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.662355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.870800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.885745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49abfcf2-fa4f-4630-a311-e6db798e8739 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.239187 Aug 30 03:37:08.887597 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1357/2690] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:08 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:08.932213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:08.940879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b5c8df2-931a-4985-9cee-c2f8973f99fc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1554 microversion: 2.1 time: 0.633263 Aug 30 03:37:08.958994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1334/2691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:08 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1554 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:08.966217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:08.966934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:08.974543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.976607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.976607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.977027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:08.978012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:08.978942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:08.983098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1027879102", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:09.071119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] validate_networks() for [('9674f167-e88d-4709-95e1-1809c91932c0', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:37:09.083218 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3263e0d-cf0f-447b-888b-d7aeee263352 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121408 Aug 30 03:37:09.093928 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1335/2692] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:37:08 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:37:09.271169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:09.271964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:09.280123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:09.280699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:09.281168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:09.283072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:09.286436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:09.290113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:09.611672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:09.629667 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2cc5ef3a-acc4-4d01-a7f6-25aa2a6196b6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.356412 Aug 30 03:37:09.631689 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1336/2693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:09 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:09.642628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:09.643199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:09.655265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:09.656869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:09.661766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:09.663767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:09.664858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:09.665483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.174302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:10.184740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:10.186614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:10.188146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb17d5f6-91ae-46cf-8dee-87181ea89a20 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.554945 Aug 30 03:37:10.202092 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1337/2694] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:09 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:10.210678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:10.211657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:10.218312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.219061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.219657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.220570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.221199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.221835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.353303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:37:10.353938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:37:10.354214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:37:10.354618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:37:10.355020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:37:10.368838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.370454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.371647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.372817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.373534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.374218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.404067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Getting quotas for project b9b41bf3c5464c9b93a97afc7a00a708. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:37:10.410685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Getting quotas for user 0c031703afa842c3891785e086792cb7 and project b9b41bf3c5464c9b93a97afc7a00a708. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:37:10.425898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:37:10.429495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:37:10.433789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:10.444233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4ef6d12-9100-450a-b1eb-63648fcc29f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.240491 Aug 30 03:37:10.461271 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1338/2695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:10 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:10.476196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:10.482272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:10.495492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.497174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.497653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.499084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.504619 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74000eb2-f886-40af-9d52-3fb1b7027129 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614705 Aug 30 03:37:10.513509 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1358/2696] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:37:10.514814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.520963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:10.521830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:10.522271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.535985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.536733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.537631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.538985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.539553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.540111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:10.579751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:37:10.754075 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5301835b-ad8b-4f63-9eba-3d5bdcb9448a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 204 len: 0 microversion: 2.25 time: 0.290923 Aug 30 03:37:10.758185 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1339/2697] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:37:10 2022] DELETE /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:37:10.772003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4b2cbf22-310f-4a9d-877f-deeca8762d9d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:10.774628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4b2cbf22-310f-4a9d-877f-deeca8762d9d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:10.931248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4b2cbf22-310f-4a9d-877f-deeca8762d9d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:10.943170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4b2cbf22-310f-4a9d-877f-deeca8762d9d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1217 microversion: 2.1 time: 0.181129 Aug 30 03:37:10.956810 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1340/2698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:10 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:10.963446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d16b07ef-c37e-44a9-b0ee-bc0ffa14bddb req-271f137e-1dff-4864-95f4-54fadafcce86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8978264-05e7-42a1-8232-bc6575cdd4ab", "name": "network-vif-plugged", "status": "completed", "tag": "b2557c8c-be04-4c4b-a0d5-324e68b95fe4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:10.986279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d16b07ef-c37e-44a9-b0ee-bc0ffa14bddb req-271f137e-1dff-4864-95f4-54fadafcce86 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:10.987161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d16b07ef-c37e-44a9-b0ee-bc0ffa14bddb req-271f137e-1dff-4864-95f4-54fadafcce86 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:10.990067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d16b07ef-c37e-44a9-b0ee-bc0ffa14bddb req-271f137e-1dff-4864-95f4-54fadafcce86 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:11.010610 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d16b07ef-c37e-44a9-b0ee-bc0ffa14bddb req-271f137e-1dff-4864-95f4-54fadafcce86 service nova] Creating event network-vif-plugged:b2557c8c-be04-4c4b-a0d5-324e68b95fe4 for instance e8978264-05e7-42a1-8232-bc6575cdd4ab on n-h2-854924-5 Aug 30 03:37:11.016478 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d16b07ef-c37e-44a9-b0ee-bc0ffa14bddb req-271f137e-1dff-4864-95f4-54fadafcce86 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057854 Aug 30 03:37:11.017509 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1341/2699] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:11.042940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:11.062169 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-081fdbe7-715a-48a7-a4ca-97054c8da3dc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.542351 Aug 30 03:37:11.076314 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1359/2700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:10 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:11.085967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:11.101212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:11.108817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:11.109315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:11.109773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:11.110918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:11.111901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:11.112405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:11.283630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:11.285038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:11.290183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:11.308145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:11.308799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:11.309329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:11.310431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:11.311346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:11.312200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:12.059754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.076639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.082536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.085042 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-75fbad3f-6891-41ef-a2f3-2c4edc914f91 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1546 microversion: 2.25 time: 1.013650 Aug 30 03:37:12.104463 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1360/2701] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:11 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1546 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:12.114765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:12.116285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:12.124320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:12.125094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:12.125918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:12.126811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:12.127415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:12.127998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:12.634493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.646067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad0c418a-64cf-45b6-810e-71e83fbc7918 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 1.627062 Aug 30 03:37:12.657280 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1342/2702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:11 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:12.675886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:12.676778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:12.695490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:12.697902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:12.698745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:12.703993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:12.705151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:12.711994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:12.729019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.764408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.766159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:12.767529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddbb3d4c-da16-4feb-a4f0-75210b58bc5c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.659936 Aug 30 03:37:12.768269 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1361/2703] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:12 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:12.773672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:12.774522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:12.789282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:12.789829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:12.790271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:12.791307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:12.791441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:12.791947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.055437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:13.074415 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc30041e-9376-4bd7-9c5d-cbf8cad3c4f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1275 microversion: 2.1 time: 0.304815 Aug 30 03:37:13.075154 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1362/2704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:12 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:13.080056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:13.080664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:13.095723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.096235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.096670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.097403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.097860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.098351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.473282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:13.500490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8260ec0f-09c3-4baa-84cc-9b7135e73edd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.841642 Aug 30 03:37:13.514446 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1343/2705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:12 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:13.514446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fb28359f-6097-4669-b558-39efa27fa9fe req-7b9fdeac-c576-47bb-b2f4-fdcea8657e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bfd063-daa2-4ee8-b1a5-de09b35fac42", "name": "network-vif-deleted", "tag": "c235ea13-5e46-47b0-91e9-1f9f753d3ce4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:13.517208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fb28359f-6097-4669-b558-39efa27fa9fe req-7b9fdeac-c576-47bb-b2f4-fdcea8657e21 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.517797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fb28359f-6097-4669-b558-39efa27fa9fe req-7b9fdeac-c576-47bb-b2f4-fdcea8657e21 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.518343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fb28359f-6097-4669-b558-39efa27fa9fe req-7b9fdeac-c576-47bb-b2f4-fdcea8657e21 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.539097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:13.562362 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fb28359f-6097-4669-b558-39efa27fa9fe req-7b9fdeac-c576-47bb-b2f4-fdcea8657e21 service nova] Creating event network-vif-deleted:c235ea13-5e46-47b0-91e9-1f9f753d3ce4 for instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 on n-h2-854924-5 Aug 30 03:37:13.565474 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d5ae1261-8ada-4e75-be2f-4daa6b6e9112 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1307 microversion: 2.1 time: 0.487842 Aug 30 03:37:13.585166 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1363/2706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:13 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1307 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:13.588125 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fb28359f-6097-4669-b558-39efa27fa9fe req-7b9fdeac-c576-47bb-b2f4-fdcea8657e21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085273 Aug 30 03:37:13.588832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1344/2707] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:13.593065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0cf6c0a9-223f-4cfa-af02-7d1477dacfe1 req-36431910-2db0-4e8d-8eca-dc48de154bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf21208-d87a-4ef0-b2a0-405d26661c6d", "name": "network-vif-plugged", "status": "completed", "tag": "ee0895c9-832c-4a9a-90b6-bf5eeb4c5f42"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:13.602254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:13.604665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:13.624361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.626377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.627768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.631043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0cf6c0a9-223f-4cfa-af02-7d1477dacfe1 req-36431910-2db0-4e8d-8eca-dc48de154bcd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.631855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0cf6c0a9-223f-4cfa-af02-7d1477dacfe1 req-36431910-2db0-4e8d-8eca-dc48de154bcd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.632363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0cf6c0a9-223f-4cfa-af02-7d1477dacfe1 req-36431910-2db0-4e8d-8eca-dc48de154bcd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.633795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.635206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.640470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.657743 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0cf6c0a9-223f-4cfa-af02-7d1477dacfe1 req-36431910-2db0-4e8d-8eca-dc48de154bcd service nova] Creating event network-vif-plugged:ee0895c9-832c-4a9a-90b6-bf5eeb4c5f42 for instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d on n-h1-854924-5 Aug 30 03:37:13.664658 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0cf6c0a9-223f-4cfa-af02-7d1477dacfe1 req-36431910-2db0-4e8d-8eca-dc48de154bcd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077948 Aug 30 03:37:13.665875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1364/2708] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:13.686129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-44cf1468-c555-4bc1-9f6f-c5e23003a20b req-1525e7df-4d39-48c5-bbf5-a5699baf30f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759deeae-beb8-4920-901b-9bdf27637178", "tag": "0cc7510f-0a08-4609-a7ee-f1814e36225d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:13.710544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-44cf1468-c555-4bc1-9f6f-c5e23003a20b req-1525e7df-4d39-48c5-bbf5-a5699baf30f9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.711788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-44cf1468-c555-4bc1-9f6f-c5e23003a20b req-1525e7df-4d39-48c5-bbf5-a5699baf30f9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.712578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-44cf1468-c555-4bc1-9f6f-c5e23003a20b req-1525e7df-4d39-48c5-bbf5-a5699baf30f9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.750823 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-44cf1468-c555-4bc1-9f6f-c5e23003a20b req-1525e7df-4d39-48c5-bbf5-a5699baf30f9 service nova] Creating event network-changed:0cc7510f-0a08-4609-a7ee-f1814e36225d for instance 759deeae-beb8-4920-901b-9bdf27637178 on n-h2-854924-5 Aug 30 03:37:13.762957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.765839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.767259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.770755 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-44cf1468-c555-4bc1-9f6f-c5e23003a20b req-1525e7df-4d39-48c5-bbf5-a5699baf30f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091749 Aug 30 03:37:13.771077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lazy-loading 'fault' on Instance uuid d7bfd063-daa2-4ee8-b1a5-de09b35fac42 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:37:13.779108 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1365/2709] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:13.790871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:13.791870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:13.799260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:13.807587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.812593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.813468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.816493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.817868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.820581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.854549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:13.862515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:13.863962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:13.865146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-152bb1c7-10c3-4fbc-9f6f-3ba60d0bd30a tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 200 len: 1351 microversion: 2.25 time: 0.272496 Aug 30 03:37:13.865760 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1345/2710] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:13 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 1351 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:13.896919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:13.897836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:13.916102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.916964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.917684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:13.918822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:13.919431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:13.919995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.401669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:14.423890 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dd1cbd70-c1d1-4ae1-a857-ec61611f49a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.642713 Aug 30 03:37:14.426418 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1366/2711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:13 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:14.436890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:14.455538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:14.488068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.489523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.490821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.493845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.494044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:14.496824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.499530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.511856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:14.513531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:14.514909 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33dc7853-275b-4a9d-90b6-7d1d80b06858 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.622152 Aug 30 03:37:14.515645 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1346/2712] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:13 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:14.543770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:14.544643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:14.563319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.563777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.564436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.565151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.565636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.566068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.765606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:14.782736 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0e5feac6-4c7b-4ffb-9523-329cff5d28e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1275 microversion: 2.1 time: 0.353547 Aug 30 03:37:14.784174 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1367/2713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:14 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1275 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:14.793633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:14.795060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:14.808166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.809837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.810602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.811708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.812326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.812900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.844502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:14.905131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:14.912982 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8e5d497-539b-4d0f-bb70-03fd23ee1939 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1315 microversion: 2.1 time: 0.373088 Aug 30 03:37:14.927373 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1347/2714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:14 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:14.933430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:14.934716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: d7bfd063-daa2-4ee8-b1a5-de09b35fac42] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:14.943782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.944736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.945356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.946307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.946974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.947554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.963987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] HTTP exception thrown: Instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 could not be found. Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Request method failure captured: Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 HTTP/1.1 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQCzL-qtiKzoA81xqtH-pgIcvDekq1vuDZUoU1Vq_QG6QkpzcLlE9mjMmu3bwSu1G5FYEzQwgGxwwpA9FrfdAoecGbO-58xhiA7VSwo6sZrVP5HvcnkE1sjbgsBCwyK7dn7LfJFaeVxlExPu_ZjwDSgeWbNjdujlc_efz77jeO_00s Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e260d308f384ae5a6b7437e21055c75", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}] Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 90a88f0a70ca48f59450dae1c9165417 Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 could not be found. Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'd7bfd063-daa2-4ee8-b1a5-de09b35fac42'} Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 could not be found. Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 could not be found. Aug 30 03:37:14.966242 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 could not be found. Aug 30 03:37:14.970961 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:14.972454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Returning 404 to user: Instance d7bfd063-daa2-4ee8-b1a5-de09b35fac42 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:14.973506 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c4aef93-d04f-43b8-acdb-172d193bced7 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42" status: 404 len: 111 microversion: 2.25 time: 0.044763 Aug 30 03:37:14.974559 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1348/2715] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:14 2022] GET /compute/v2.1/servers/d7bfd063-daa2-4ee8-b1a5-de09b35fac42 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:37:14.984206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:14.984792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:14.993227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:14.993843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:14.996659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:14.997562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.001608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.002249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.029055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:15.044794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:37:15.140837 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b279de82-7181-470b-aeee-87831e38dd9e tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 204 len: 0 microversion: 2.25 time: 0.160565 Aug 30 03:37:15.141693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1349/2716] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:37:14 2022] DELETE /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:37:15.155233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:15.156322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:15.172857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.173794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.174748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.182812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.183779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.184527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.230131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:15.240563 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76d86daf-a49c-4e4f-820d-75e5e2d8541e tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1487 microversion: 2.1 time: 0.453844 Aug 30 03:37:15.259708 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1368/2717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:14 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1487 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:15.264538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:15.265405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:15.275858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.276584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.277386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.278507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.279313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.279950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.325566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lazy-loading 'flavor' on Instance uuid e8978264-05e7-42a1-8232-bc6575cdd4ab {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:37:15.411452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:15.453816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:15.473721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90a88f0a70ca48f59450dae1c9165417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e260d308f384ae5a6b7437e21055c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:15.475951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ce0b42f-82af-44cc-bab3-21f3bdc3c12f tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 200 len: 1563 microversion: 2.25 time: 0.328910 Aug 30 03:37:15.476699 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1350/2718] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:15 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 1563 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:15.490021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:15.503538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:15.527550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.528059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.531491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.532306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.535046 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab2d8f79-8ef5-4496-8acc-20562705a9a7 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab/action" status: 202 len: 0 microversion: 2.1 time: 0.274354 Aug 30 03:37:15.535717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.535717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.537419 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1369/2719] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:37:15 2022] POST /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:37:15.553130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:15.554941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:15.564931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.566152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.567081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:15.573166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:15.574226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:15.575584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:16.188119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:16.204083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:16.222407 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1e7a310-f032-4d76-be75-5d99a5193823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1495 microversion: 2.1 time: 0.680522 Aug 30 03:37:16.226971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f9cb9d61-c177-4b37-83e1-8db52b251990 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.743393 Aug 30 03:37:16.242415 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1370/2720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:15 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1495 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:16.243140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1351/2721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:15 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:16.249563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:16.253830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:16.254743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:16.255953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:16.269703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:16.270583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:16.271387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:16.273407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:16.273595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:16.274179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:16.274430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:16.275238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:16.276225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:16.276351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:16.277209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:16.278021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:16.764999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:16.773578 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca5efeca-bc2c-4526-99f7-7f8414db0f7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.528463 Aug 30 03:37:16.774219 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1371/2722] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:16 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:16.779996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:16.782522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:16.791838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:16.792709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:16.793397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:16.794377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:16.795097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:16.795793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.150285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:17.160201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:17.161739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:17.163965 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c00ae538-ff98-4d12-81da-e50694d7cdc7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.917334 Aug 30 03:37:17.178320 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1352/2723] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:16 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:17.186060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c39cd91d-39eb-40d9-ac19-22271915a89f req-f3b3731d-8f63-42ff-91c6-557859fd4a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81", "name": "network-vif-deleted", "tag": "bccaf1c7-13e7-4503-bce9-4f0db1080a87"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:17.198840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c39cd91d-39eb-40d9-ac19-22271915a89f req-f3b3731d-8f63-42ff-91c6-557859fd4a15 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.200252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c39cd91d-39eb-40d9-ac19-22271915a89f req-f3b3731d-8f63-42ff-91c6-557859fd4a15 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.200656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c39cd91d-39eb-40d9-ac19-22271915a89f req-f3b3731d-8f63-42ff-91c6-557859fd4a15 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.213394 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c39cd91d-39eb-40d9-ac19-22271915a89f req-f3b3731d-8f63-42ff-91c6-557859fd4a15 service nova] Creating event network-vif-deleted:bccaf1c7-13e7-4503-bce9-4f0db1080a87 for instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 on n-h2-854924-5 Aug 30 03:37:17.221776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c39cd91d-39eb-40d9-ac19-22271915a89f req-f3b3731d-8f63-42ff-91c6-557859fd4a15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039743 Aug 30 03:37:17.222860 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1353/2724] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:17.231558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:17.233019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] [instance: 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:17.242644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.243739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.244202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.244945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.245442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.245900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.262853 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] HTTP exception thrown: Instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 could not be found. Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Request method failure captured: Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 HTTP/1.1 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYQCzL-qtiKzoA81xqtH-pgIcvDekq1vuDZUoU1Vq_QG6QkpzcLlE9mjMmu3bwSu1G5FYEzQwgGxwwpA9FrfdAoecGbO-58xhiA7VSwo6sZrVP5HvcnkE1sjbgsBCwyK7dn7LfJFaeVxlExPu_ZjwDSgeWbNjdujlc_efz77jeO_00s Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e260d308f384ae5a6b7437e21055c75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e260d308f384ae5a6b7437e21055c75", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e260d308f384ae5a6b7437e21055c75"}]}] Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 0e260d308f384ae5a6b7437e21055c75 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 90a88f0a70ca48f59450dae1c9165417 Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1772364877-project Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 could not be found. Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81'} Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 could not be found. Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 could not be found. Aug 30 03:37:17.264467 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 could not be found. Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] Returning 404 to user: Instance 8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9f810385-4ac0-43da-8145-5f3eccc3d446 tempest-LiveAutoBlockMigrationV225Test-1772364877 tempest-LiveAutoBlockMigrationV225Test-1772364877-project] 10.222.0.30 "GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81" status: 404 len: 111 microversion: 2.25 time: 0.039352 Aug 30 03:37:17.269121 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1354/2725] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:17 2022] GET /compute/v2.1/servers/8cc7ecc7-2c4d-49d8-86e3-1a6fb5906b81 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:37:17.271927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:17.272583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:17.281394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.281996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.282613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.283332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.283788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.284459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.521901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:17.532000 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b6e9808-ab76-4df3-b0ff-92efe814c5d9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1503 microversion: 2.1 time: 0.756158 Aug 30 03:37:17.533361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1372/2726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:16 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1503 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:17.538478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:17.539437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:17.555241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.556147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.556855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.558665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.559248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.559780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.720135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:17.730761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a31c975-93db-4be8-bdf6-a9e9eba81d72 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.462631 Aug 30 03:37:17.774035 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1355/2727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:17 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:17.781040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2f27135-1401-414e-95f0-b54b6b61433e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:17.788618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f27135-1401-414e-95f0-b54b6b61433e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.789249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f27135-1401-414e-95f0-b54b6b61433e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.791346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f27135-1401-414e-95f0-b54b6b61433e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.823868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2f27135-1401-414e-95f0-b54b6b61433e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Going to try to stop instance {{(pid=122167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:37:17.906231 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2f27135-1401-414e-95f0-b54b6b61433e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.130753 Aug 30 03:37:17.906888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1356/2728] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:37:17 2022] POST /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:37:17.945965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:17.951883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:17.972526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.974098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.975362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:17.977305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:17.982132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:17.988426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:17.988881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.001777 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e323898e-76cc-41e0-bafe-708e996490f9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 200 len: 1478 microversion: 2.1 time: 0.466990 Aug 30 03:37:18.002656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1373/2729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:17 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 1478 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:18.010340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:18.011319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:18.034012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.035197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.035935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.036896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.037857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.039589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.728547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:18.737473 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75c38c9e-f50d-4d1a-b707-9ce85766e05c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.809646 Aug 30 03:37:18.738073 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1357/2730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:17 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:18.756429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-713899844"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:18.764978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:18.775037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:18.779731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.782461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.783372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.788972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.789704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.790309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.795149 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53c99195-8b8a-4126-8184-6323b7075ad3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.791105 Aug 30 03:37:18.796497 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1374/2731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:18 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:18.806398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-03498898-5151-4057-9e79-d81e87b45c33 req-790e86cf-acbd-45cc-aead-7480f3e77cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:18.837932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-03498898-5151-4057-9e79-d81e87b45c33 req-790e86cf-acbd-45cc-aead-7480f3e77cd2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.838544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-03498898-5151-4057-9e79-d81e87b45c33 req-790e86cf-acbd-45cc-aead-7480f3e77cd2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.839123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-03498898-5151-4057-9e79-d81e87b45c33 req-790e86cf-acbd-45cc-aead-7480f3e77cd2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.852707 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-03498898-5151-4057-9e79-d81e87b45c33 req-790e86cf-acbd-45cc-aead-7480f3e77cd2 service nova] Creating event network-changed:1d231e72-c1f2-4b64-96eb-d5a4fa229659 for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db on n-h1-854924-5 Aug 30 03:37:18.865581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-03498898-5151-4057-9e79-d81e87b45c33 req-790e86cf-acbd-45cc-aead-7480f3e77cd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067257 Aug 30 03:37:18.867373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1375/2732] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:18.873413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:18.874381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:18.881999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.882814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.883408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:18.884324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:18.886397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:18.887641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:19.055771 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23103486-bc4a-434d-b15c-e8717caf46c9 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab/action" status: 202 len: 0 microversion: 2.1 time: 0.311999 Aug 30 03:37:19.062012 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1358/2733] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:37:18 2022] POST /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:37:19.071021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:19.073371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:19.082020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:19.082931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:19.083312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:19.084072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:19.084830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:19.085859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:19.454070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:19.468431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:19.470674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:19.472326 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8dda255-8a60-4c7b-9c0d-903bea801185 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.603081 Aug 30 03:37:19.473594 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1376/2734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:18 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:19.478869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e75f326e-3dcd-4da9-bd25-d254083f1ce4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b21e5e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:19.546122 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e75f326e-3dcd-4da9-bd25-d254083f1ce4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.070884 Aug 30 03:37:19.547348 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1377/2735] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:19 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:19.605221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:19.614578 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42c0c815-8cfc-4844-be7f-ee4fec0155b9 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.551089 Aug 30 03:37:19.616024 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1359/2736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:19 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:19.764825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:19.770817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:19.793686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:19.795350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:19.795808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:19.799563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:19.800723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:19.800723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:19.823992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:19.824631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:19.837375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:19.843270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:19.845004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:19.846080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:19.846590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:19.847013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:20.211401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:20.217901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:20.221588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0cb6e874-fcd1-4c44-b962-fbdd57ed1c85 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.466046 Aug 30 03:37:20.226931 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c23399c-7068-4631-9d4b-5b323ddfd8f7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.409701 Aug 30 03:37:20.235614 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1378/2737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:19 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:20.240490 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1360/2738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:19 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:20.512782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:20.514212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:20.517146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:20.521605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:20.534950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:20.535696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:20.536365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:20.537301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:20.538731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:20.539233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:20.561128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25024cb3-2730-4e34-b88f-7658747ca0bd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ad9af70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:20.623114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25024cb3-2730-4e34-b88f-7658747ca0bd tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.065787 Aug 30 03:37:20.623821 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1361/2739] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:20 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:20.635351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:20.636155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:20.643326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:20.644063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:20.644765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:20.645825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:20.646617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:20.647152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:20.942739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:20.971270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:20.978553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:21.005243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:21.010662 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-41bc64f7-326e-4018-a88c-262aff88b97d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.376621 Aug 30 03:37:21.011447 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1362/2740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:20 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:21.015839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:21.022482 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-00b6334e-2596-4790-a508-94b4542494a9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.517213 Aug 30 03:37:21.033529 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1379/2741] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:20 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:21.248985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:21.249848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:21.250658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:21.251608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:21.268664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:21.269834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:21.270464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:21.271643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:21.272039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:21.273227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:21.274396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:21.275406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:21.276227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:21.276870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:21.279199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:21.279951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:21.902542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:21.912625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:21.922275 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-81ed18c0-3f5d-4b77-b21c-935f896563c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.682719 Aug 30 03:37:21.922903 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1363/2742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:21 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:21.923827 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e921ef33-5eec-4db0-a200-dcb6a33c5b7f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.679300 Aug 30 03:37:21.943123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1380/2743] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:21 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:21.945995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1cea53c6-e2b7-49ed-9430-79f3ebc392c3 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897adc5430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:22.028916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1cea53c6-e2b7-49ed-9430-79f3ebc392c3 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.094218 Aug 30 03:37:22.033178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:22.034236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:22.038744 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1364/2744] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:21 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:22.046332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.046840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.047285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.047987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.049944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.055187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.055387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:22.056146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:22.073494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.074563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.075681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.077152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.077861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.078488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.132946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:22.689764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:22.713706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:22.722423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:22.723926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ccf0a38-9e7f-42d2-8c17-d4d226545d63 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.673508 Aug 30 03:37:22.724691 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1365/2745] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:22 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:22.740160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:22.763801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34dfc1ca-4a29-48e5-8166-4d2136d5dd95 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.736041 Aug 30 03:37:22.782659 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1381/2746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:22 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:22.946789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:22.947426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:22.947904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:22.948634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:22.961969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.964445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.964913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.965706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.966168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.966592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.975103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.979768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.980468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:22.981337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:22.982118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:22.984281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:23.486035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:23.496289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f606ec32-d178-404f-a10d-b438494f2664 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.553286 Aug 30 03:37:23.498352 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1366/2747] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:22 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:23.505001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c980d6d0-37ea-4e0e-8a80-4fc3fffdc02d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae7bc10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:23.570526 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c980d6d0-37ea-4e0e-8a80-4fc3fffdc02d tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.070269 Aug 30 03:37:23.578168 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1367/2748] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:23 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:23.639051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:23.650447 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db99f278-da63-4403-bf0c-38207f3ee246 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.707512 Aug 30 03:37:23.666844 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1382/2749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:22 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:23.751351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:23.752081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:23.794418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:23.796900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:23.799529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:23.800429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:23.800732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:23.801989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:23.805632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:23.806177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:23.821238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:23.821763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:23.822192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:23.822892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:23.823338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:23.823755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:24.416352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:24.433554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:24.438199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:24.443106 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9bc09a29-99c4-4246-a9c5-ed2b5e3ef45a tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.698031 Aug 30 03:37:24.459393 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1368/2750] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:23 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:24.519701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:24.520897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:24.534202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:24.535370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:24.537052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:24.540902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:24.541893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:24.545300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:24.563817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:24.575480 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7c81e20-a08d-48eb-b0b6-4b28fa0a90df tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.780183 Aug 30 03:37:24.586328 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1383/2751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:23 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:24.607680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3ec4bd1-12cc-457e-99b0-5700975895f1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b4a1310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:24.708217 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3ec4bd1-12cc-457e-99b0-5700975895f1 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.120253 Aug 30 03:37:24.708818 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1384/2752] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:24 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:24.715224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e08a918c-91f6-4d01-a197-e4aaa79e7a06 req-4f2251f9-b377-4d3e-9ffd-5cdeede8a071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8978264-05e7-42a1-8232-bc6575cdd4ab", "name": "network-vif-plugged", "status": "completed", "tag": "b2557c8c-be04-4c4b-a0d5-324e68b95fe4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:24.759625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e08a918c-91f6-4d01-a197-e4aaa79e7a06 req-4f2251f9-b377-4d3e-9ffd-5cdeede8a071 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:24.759625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e08a918c-91f6-4d01-a197-e4aaa79e7a06 req-4f2251f9-b377-4d3e-9ffd-5cdeede8a071 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:24.762036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e08a918c-91f6-4d01-a197-e4aaa79e7a06 req-4f2251f9-b377-4d3e-9ffd-5cdeede8a071 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:24.794508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e08a918c-91f6-4d01-a197-e4aaa79e7a06 req-4f2251f9-b377-4d3e-9ffd-5cdeede8a071 service nova] Creating event network-vif-plugged:b2557c8c-be04-4c4b-a0d5-324e68b95fe4 for instance e8978264-05e7-42a1-8232-bc6575cdd4ab on n-h2-854924-5 Aug 30 03:37:24.806235 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e08a918c-91f6-4d01-a197-e4aaa79e7a06 req-4f2251f9-b377-4d3e-9ffd-5cdeede8a071 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096131 Aug 30 03:37:24.808744 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1385/2753] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:24.826558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:24.827503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:24.836954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:24.837721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:24.839088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:24.839988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:24.841371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:24.842003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:25.596399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:25.605948 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e9b7893-5e76-4fbc-a7d4-a8383b9d9b8f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 1.090017 Aug 30 03:37:25.610535 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1369/2754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:24 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:25.621199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:25.621854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:25.637107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:25.637635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:25.638080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:25.638790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:25.639254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:25.639721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:25.806117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:25.813392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:25.816193 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cdb66618-7a0d-40a8-8d99-c4ef072847c3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 1.005697 Aug 30 03:37:25.829448 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1386/2755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:24 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:25.829448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:25.829448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:25.843142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:25.843646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:25.844088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:25.844799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:25.845256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:25.845708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:26.210983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:26.232835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:26.234819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:26.236208 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4ac05fb-fb9b-431c-b40f-adcc1aaf6899 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.624586 Aug 30 03:37:26.236801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:26.237578 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1370/2756] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:25 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:26.242368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4be305c-bbb0-4a6b-afbe-40376010ce20 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae79790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:26.258703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54212d1e-78f8-4d24-bc8f-bf14dadf7f8c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.440824 Aug 30 03:37:26.262143 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1387/2757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:25 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:26.300124 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4be305c-bbb0-4a6b-afbe-40376010ce20 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.061016 Aug 30 03:37:26.300706 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1371/2758] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:26 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:26.637587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:26.639074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:26.655084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:26.656775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:26.656775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:26.657438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:26.659145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:26.660595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:26.840474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:26.844041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:26.856503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:26.860325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:26.860863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:26.862777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:26.864607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:26.865686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:27.228044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:27.246483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd596242-c368-4cb2-9564-e5ee754ecbc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.616369 Aug 30 03:37:27.247695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1388/2759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:26 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:27.261852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:27.262750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:27.271137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:27.274089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:27.274754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:27.276074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:27.276547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:27.276977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:27.317176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:27.331258 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c21b2029-58ec-4ba7-a3f7-b3647f4a41a4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.492639 Aug 30 03:37:27.333960 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1372/2760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:26 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:27.347992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:27.348911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:27.374404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:27.375083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:27.375767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:27.376714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:27.377411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:27.378065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:27.815390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:27.823479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:27.831692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f92a56c0-18d3-4f02-8e41-564d5977810b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.495693 Aug 30 03:37:27.834371 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1373/2761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:27 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:27.839608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e98398b6-1a7e-4257-9839-7e35eba185de tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae7b3a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:27.863431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:27.864789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:27.866409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a6f6082-2d44-46b6-a7e4-baee189e28f5 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.608361 Aug 30 03:37:27.867467 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1389/2762] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:27 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:37:27.872881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f6caaf7a-2154-4232-8b7c-66d77e7c23ad req-3e777c22-d3ee-4fb1-ab77-6a89aa9115a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "name": "network-vif-plugged", "status": "completed", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:27.903319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6caaf7a-2154-4232-8b7c-66d77e7c23ad req-3e777c22-d3ee-4fb1-ab77-6a89aa9115a5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:27.905685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6caaf7a-2154-4232-8b7c-66d77e7c23ad req-3e777c22-d3ee-4fb1-ab77-6a89aa9115a5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:27.906315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6caaf7a-2154-4232-8b7c-66d77e7c23ad req-3e777c22-d3ee-4fb1-ab77-6a89aa9115a5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:27.912577 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e98398b6-1a7e-4257-9839-7e35eba185de tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.076593 Aug 30 03:37:27.921780 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1374/2763] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:27 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:27.925987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f6caaf7a-2154-4232-8b7c-66d77e7c23ad req-3e777c22-d3ee-4fb1-ab77-6a89aa9115a5 service nova] Creating event network-vif-plugged:1d231e72-c1f2-4b64-96eb-d5a4fa229659 for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db on n-h1-854924-5 Aug 30 03:37:27.935538 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f6caaf7a-2154-4232-8b7c-66d77e7c23ad req-3e777c22-d3ee-4fb1-ab77-6a89aa9115a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066633 Aug 30 03:37:27.936159 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1390/2764] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:28.269801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:28.270424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:28.281791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.282309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.282753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.283539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.284004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.284433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.359799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:28.361478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:28.390622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.398518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.399182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.402797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.405815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.408149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.661063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:28.671978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-064038eb-4f20-4dbb-a24b-0a1c96ed5bc2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.407646 Aug 30 03:37:28.674512 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1375/2765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:28 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:28.781275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:28.794857 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd87116c-72d4-4ee8-95c5-de41033b7490 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.443871 Aug 30 03:37:28.795502 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1391/2766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:28 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:28.864944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:28.866590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:28.876445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.877208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.878739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.879855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.881094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.881961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.891374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:28.892286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:28.905320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.906208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.908032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:28.908962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:28.911735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:28.914048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:29.350099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:29.370431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:29.371968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:29.373205 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27a45f67-458a-4da3-9508-f559e787f44e tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.486018 Aug 30 03:37:29.381170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:29.396852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8fdc6ea8-ea33-4ec4-b822-0c8532e475b8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.541411 Aug 30 03:37:29.398076 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1392/2767] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:28 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:29.413481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1376/2768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:28 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:29.428268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1d685a3-6793-4904-bd6a-4cfd32962af4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b802ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:29.510903 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1d685a3-6793-4904-bd6a-4cfd32962af4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.110265 Aug 30 03:37:29.519454 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1393/2769] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:29 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:29.697053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:29.697704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:29.708025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:29.711076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:29.711705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:29.712826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:29.715626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:29.716315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:29.818854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:29.820012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:29.830382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:29.831271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:29.831916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:29.832839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:29.833836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:29.834549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:30.121157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:30.133286 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79f7645d-a9ec-4c37-8282-eb0fa40e76fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.441208 Aug 30 03:37:30.134436 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1377/2770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:29 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:30.238115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:30.252579 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-625f0ff9-b8ab-4104-adf4-745c0b225a01 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1317 microversion: 2.1 time: 0.437722 Aug 30 03:37:30.254695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1394/2771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:30.400042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:30.401068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:30.420366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:30.421537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:30.424049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:30.425597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:30.426822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:30.427607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:30.432684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:30.433296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:30.449701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:30.450606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:30.451264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:30.452220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:30.453283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:30.454619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:30.836631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:30.848253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8ecb5a5-a4bc-4e94-b56e-1046640157f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.421511 Aug 30 03:37:30.861386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1395/2772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:30 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:30.875591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af2e2aae-02bd-47ea-8d0d-6b1342d3b2ab tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b1635e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:30.919644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:30.944024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:30.945741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:30.947854 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-545d25e5-1739-4c28-b814-3cb167297742 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.553684 Aug 30 03:37:30.949144 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1378/2773] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:30 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:30.962512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af2e2aae-02bd-47ea-8d0d-6b1342d3b2ab tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.099113 Aug 30 03:37:30.963826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1396/2774] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:30 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:31.155936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:31.156558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:31.166926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:31.167500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:31.167943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:31.168651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:31.169190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:31.169710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:31.274972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:31.275584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:31.290014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:31.290587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:31.291025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:31.292077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:31.292202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:31.292604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:31.526453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:31.534590 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1bd3f1f7-abdd-494c-9a21-9bf602603149 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.263902 Aug 30 03:37:31.535594 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1397/2775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:31 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:31.564602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:31.574898 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23f9af35-87b3-4ced-a40f-7a4f9d590ecd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.423029 Aug 30 03:37:31.575999 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1379/2776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:31 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:31.785933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-174198477", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:31.872558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:31.873610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:31.894683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:31.900389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:31.902355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:31.904647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:31.914003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] validate_networks() for [('9674f167-e88d-4709-95e1-1809c91932c0', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:37:31.919255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:31.919894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:32.312661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:32.337953 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34b98355-ff1a-4786-a152-4518b839468b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.469051 Aug 30 03:37:32.345814 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1380/2777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:31 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:32.356549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:32.359409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:32.370713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:32.373013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:32.373928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:32.378201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:32.378929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:32.379566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:32.905015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:32.920074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:32.925846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:32.928493 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e49a5753-3322-4314-a4df-3b8c2750aba4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.579615 Aug 30 03:37:32.929298 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1381/2778] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:32 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:32.937392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50878a2f-d88c-4271-9650-a72b5238a210 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae04af0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:33.021981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:37:33.023522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:37:33.025264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:37:33.026242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:37:33.027501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:37:33.057113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:33.058956 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-50878a2f-d88c-4271-9650-a72b5238a210 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.125072 Aug 30 03:37:33.059621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:33.060819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:33.061166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1382/2779] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:32 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:33.066310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:33.071135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:33.072292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:33.074262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:33.076682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:33.086331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:33.087353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:33.087974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:33.089514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:33.090288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:33.091173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:33.143772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Getting quotas for project b9b41bf3c5464c9b93a97afc7a00a708. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:37:33.159013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Getting quotas for user 0c031703afa842c3891785e086792cb7 and project b9b41bf3c5464c9b93a97afc7a00a708. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:37:33.189625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:37:33.201712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:37:33.283138 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bb705300-a066-4378-8883-ff290451c6f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502507 Aug 30 03:37:33.286252 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1398/2780] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:37:33.353208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:33.370222 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d49b6149-3863-4920-a104-ad43d09aec30 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.305713 Aug 30 03:37:33.374981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1383/2781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:33 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:33.389397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7a9a47a-40c0-46dd-b67c-6c6e15eaa669 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:33.390409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f7a9a47a-40c0-46dd-b67c-6c6e15eaa669 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:33.507885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f7a9a47a-40c0-46dd-b67c-6c6e15eaa669 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:33.524117 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7a9a47a-40c0-46dd-b67c-6c6e15eaa669 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1216 microversion: 2.1 time: 0.147186 Aug 30 03:37:33.525019 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1384/2782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:33 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:33.529718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:33.530330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:33.539514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:33.542235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:33.549802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:33.555164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:33.555846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:33.557266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:33.565815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1717209765", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:33.687521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:37:33.977951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:33.988215 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e547ad4-85f3-4f20-9dab-25187afb947a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.461993 Aug 30 03:37:33.994813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1385/2783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:33 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:34.009430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:34.010981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:34.026947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.030312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.031047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.032469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.034378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.036739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.259743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:37:34.260281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:37:34.260636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:37:34.261057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:37:34.261504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:37:34.281073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.288657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.293888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.294913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.295539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.296141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.362602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Getting quotas for project 2c588323936a43ddaa305a1a71354065. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:37:34.377724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Getting quotas for user 147195c1f0cd4e2db5394323583afa92 and project 2c588323936a43ddaa305a1a71354065. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:37:34.410343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:37:34.413443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:37:34.457220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:34.478996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:34.481037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:34.483665 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b02a406-21ff-4371-9a6b-337db950d785 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.483940 Aug 30 03:37:34.485992 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1386/2784] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:33 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:34.495544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f01e5dd1-344c-4407-9466-339198754d46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae78940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:34.527418 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c26b3304-c79a-45c3-800d-f85fbfa27a3c tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239841 Aug 30 03:37:34.534291 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1399/2785] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:37:34.545938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:34.547116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:34.555163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.556042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.556719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.557804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.558545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.559193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.594994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f01e5dd1-344c-4407-9466-339198754d46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.107245 Aug 30 03:37:34.629938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1387/2786] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:34 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:34.664899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-19e25a08-7cac-4bd1-aac9-f876335c1829 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:34.670338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-19e25a08-7cac-4bd1-aac9-f876335c1829 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:34.807544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-19e25a08-7cac-4bd1-aac9-f876335c1829 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:34.830495 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-19e25a08-7cac-4bd1-aac9-f876335c1829 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1223 microversion: 2.1 time: 0.195760 Aug 30 03:37:34.834574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1388/2787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:34 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1223 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:34.849243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:34.861508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:34.862133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:34.873469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3fe86e74-b4b8-40a6-af1e-56c362221b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.337684 Aug 30 03:37:34.875632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1400/2788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:34 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:34.894355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.894869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.895317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.896851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:34.897371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:34.897870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:34.912862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:35.001084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:35.010588 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-65e35742-2c7f-4e5c-bd44-d4b9ebc9c1e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1268 microversion: 2.1 time: 0.162459 Aug 30 03:37:35.011477 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1389/2789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:34 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:35.022625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:35.023420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:35.039815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:35.046727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:35.047296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:35.048301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:35.048853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:35.049418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:35.273961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:35.284454 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b74e188-2b9f-490b-8ab3-ee3d75c207ed tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.265145 Aug 30 03:37:35.285637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1401/2790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:35 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:35.509581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:35.510204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:35.523969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:35.524470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:35.524908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:35.525654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:35.526106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:35.526522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:35.644713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ec9f776-5bdf-43ad-9690-6decd458d29f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f8983b61310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:35.712618 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ec9f776-5bdf-43ad-9690-6decd458d29f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.071688 Aug 30 03:37:35.716864 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1402/2791] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:35 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:35.855438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:35.855966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:35.872625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:35.873073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:35.873558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:35.874261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:35.882827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:35.883319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.159191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:36.184545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:36.186226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:36.193872 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03baf62c-6998-4a1d-a64f-955aa73734cf tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.682326 Aug 30 03:37:36.198063 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1390/2792] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:35 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:36.218432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:36.219043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:36.238199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:36.239004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:36.241928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.242878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:36.243512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:36.244475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.278230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:36.292853 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4a935d1-b659-49d8-a0ac-24bbb58227cb tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1219 microversion: 2.1 time: 0.440169 Aug 30 03:37:36.293968 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1403/2793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:35 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1219 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:36.310419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:36.311223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:36.323476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:36.323476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:36.323476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.326104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:36.326805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:36.329240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.479782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:36.489098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe6e223a-92b0-44e4-9e45-fc9eae90e474 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1274 microversion: 2.1 time: 0.191458 Aug 30 03:37:36.510076 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1404/2794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:36 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:36.516243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:36.518068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:36.550252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:36.550704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:36.557037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.557817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:36.559551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:36.559994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:36.640879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:36.659463 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa5f5916-8e81-4e65-ae26-e0eb6f835802 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.444762 Aug 30 03:37:36.671001 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1391/2795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:36 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:36.729775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e60468c5-453f-4fb3-8469-38266dd8bf60 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae7b310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:36.821885 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e60468c5-453f-4fb3-8469-38266dd8bf60 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.096182 Aug 30 03:37:36.822338 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1392/2796] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:36 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:37.222799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:37.224650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:37.254596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:37.257596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:37.261137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:37.263042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:37.264633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:37.268286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:37.374873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:37.383957 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7728bb1a-dec0-4833-9ff9-74c29a0aab4d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1510 microversion: 2.1 time: 0.887308 Aug 30 03:37:37.402550 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1405/2797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:36 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1510 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:37.407592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:37.408219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:37.425246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:37.425709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:37.430049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:37.430872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:37.431385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:37.431849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:37.752696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:37.771442 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8257057d-a729-4157-8207-c81e7881bdb0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1275 microversion: 2.1 time: 0.365839 Aug 30 03:37:37.772568 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1406/2798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:37 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:37.796956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:37.798265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:37.806205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:37.808397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:37.809332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:37.810586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:37.811788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:37.812527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:37.813256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:37.989510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:38.003599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:38.005086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:38.007256 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a207e293-da3d-4011-b909-6861974503c9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.789558 Aug 30 03:37:38.015070 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1393/2799] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:37 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:38.019904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:38.020514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:38.027321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:38.031327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:38.047239 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07c9da00-45a5-44f0-9081-a1e053442693 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1274 microversion: 2.1 time: 0.269397 Aug 30 03:37:38.047465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:38.047465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:38.047877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:38.048852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:38.049532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:38.050118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:38.066794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1407/2800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:37 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:38.073786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-048648c9-65de-4063-ae23-95590e9036b5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f8983b90dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:38.184051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-048648c9-65de-4063-ae23-95590e9036b5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.115965 Aug 30 03:37:38.191342 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1408/2801] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:38 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:38.410490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:38.411156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:38.431115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:38.436378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:38.440544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:38.441644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:38.447917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:38.450297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:38.542618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:38.771150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:38.808279 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-760d88ec-ff84-4c04-b14e-753e9f84660b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.789365 Aug 30 03:37:38.809772 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1394/2802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:38 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:38.836168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:38.840645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:38.855159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:38.856170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:38.856775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:38.861071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:38.861787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:38.862542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.171819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:39.184999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e970a9e-6d84-4088-a112-9506ff227efc tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1281 microversion: 2.1 time: 0.373811 Aug 30 03:37:39.189075 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1395/2803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:38 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1281 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:39.199580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:39.200225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:39.212372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.213090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.213673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.218658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:39.219838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.220577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.221036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.235017 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fa22e8a3-f25a-4a6b-abe7-915d5e07cdb6 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1487 microversion: 2.1 time: 0.824443 Aug 30 03:37:39.250421 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1409/2804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:38 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1487 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:39.262268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:39.263137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:39.274311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.274981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.275508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.276325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.276882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.277450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.647602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:39.657689 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0903452d-ca47-4352-ab53-5bbe8a19396a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1274 microversion: 2.1 time: 0.405667 Aug 30 03:37:39.664898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1410/2805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:39 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1274 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:39.673713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b7d69f92-a4df-4e5b-b5ac-1fc8e4a2e67d req-6e75888f-1114-4e20-88bb-0655e4baccca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "d49ca1e1-d171-473d-86f2-efabad830021"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:39.701459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b7d69f92-a4df-4e5b-b5ac-1fc8e4a2e67d req-6e75888f-1114-4e20-88bb-0655e4baccca service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.702255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b7d69f92-a4df-4e5b-b5ac-1fc8e4a2e67d req-6e75888f-1114-4e20-88bb-0655e4baccca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.703482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b7d69f92-a4df-4e5b-b5ac-1fc8e4a2e67d req-6e75888f-1114-4e20-88bb-0655e4baccca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.732499 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b7d69f92-a4df-4e5b-b5ac-1fc8e4a2e67d req-6e75888f-1114-4e20-88bb-0655e4baccca service nova] Creating event network-vif-plugged:d49ca1e1-d171-473d-86f2-efabad830021 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:39.745361 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b7d69f92-a4df-4e5b-b5ac-1fc8e4a2e67d req-6e75888f-1114-4e20-88bb-0655e4baccca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078563 Aug 30 03:37:39.746700 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1411/2806] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:39.762308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56f818db-8f14-42c3-ab33-9a824a676823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f8983b70d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:39.846409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56f818db-8f14-42c3-ab33-9a824a676823 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.098248 Aug 30 03:37:39.847478 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1412/2807] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:39 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:39.856902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-709557511"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:39.867777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:39.876825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.882358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.885602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:39.886571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:39.887218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:39.893288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:40.048020 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d4a8040-93fd-4bdd-8a5e-74b58f62e075 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "PUT /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1060 microversion: 2.1 time: 0.199141 Aug 30 03:37:40.060794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1413/2808] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:37:39 2022] PUT /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1060 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:40.060794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:40.060794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:40.074229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:40.074729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:40.075165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:40.077055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:40.077600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:40.078078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:40.186801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:40.202622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:40.214134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:40.215739 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b10b8eb6-7bbb-413d-a74d-dc0b34e105a0 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 1.025609 Aug 30 03:37:40.217161 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1396/2809] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:39 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:40.226288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:40.227472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:40.245679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:40.246526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:40.248325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:40.251540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:40.252226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:40.252820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:40.562191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:40.578132 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f11795e6-bafb-4247-988f-eb697c83e9bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.527339 Aug 30 03:37:40.581233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1414/2810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:40 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:40.589766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:40.590684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:40.598800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:40.599599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:40.600930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:40.601904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:40.602575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:40.603214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:41.058101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:41.066392 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c23a168c-ca40-41e5-bf4e-f4d6693fd12f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1487 microversion: 2.1 time: 0.847869 Aug 30 03:37:41.066971 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1397/2811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:40 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1487 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:41.091600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:41.110077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:41.123689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:41.124200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:41.124643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:41.125375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:41.125843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:41.126400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:41.319966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:41.341320 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b348d540-b71b-431b-8012-4451d272d4e5 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.757479 Aug 30 03:37:41.344079 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1415/2812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:40 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:41.349947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b84511ce-239d-46e5-90c9-e08e1e95eed5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f8983bc4f70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:41.431652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b84511ce-239d-46e5-90c9-e08e1e95eed5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1439 microversion: 2.1 time: 0.085921 Aug 30 03:37:41.432653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1416/2813] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:41 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:41.440765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:41.449850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:41.460688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:41.461982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:41.468969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:41.470269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:41.474272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:41.475682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:41.833749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:41.848515 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-086e9aea-13cd-4f45-9f3b-9dd78c83ae1d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.756802 Aug 30 03:37:41.850839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1398/2814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:41 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:41.865852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:41.867108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:41.879609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:41.880513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:41.882669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:41.885801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:41.886494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:41.889455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.082747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:42.091229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed57f665-5b25-4462-97ec-b9e15cc45b9b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1487 microversion: 2.1 time: 0.656238 Aug 30 03:37:42.095210 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1417/2815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:41 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1487 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:42.125870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:42.127379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:42.144935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.148390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.149245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.152016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.154512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.157392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.542126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:42.557094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:42.559898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:42.561146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b9e959e3-4570-4841-bde9-48d8bda03862 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.708979 Aug 30 03:37:42.561781 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1399/2816] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:41 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:42.573313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "f0b367c2-c520-4f6e-b251-798e702ebbe1"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "848a0abf-622c-49ee-b610-7c1c4641e0ef"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "9eb8cf2f-0133-4274-beb4-c81c48632192"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:42.586274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.586922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.587595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.602063 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Creating event network-vif-plugged:57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:42.602669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Creating event network-vif-plugged:f0b367c2-c520-4f6e-b251-798e702ebbe1 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:42.603381 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Creating event network-vif-plugged:03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:42.604076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Creating event network-vif-plugged:848a0abf-622c-49ee-b610-7c1c4641e0ef for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:42.604777 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] Creating event network-vif-plugged:9eb8cf2f-0133-4274-beb4-c81c48632192 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:42.611921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-214ac015-37ca-4985-99d8-1f8d8b9e5205 req-1cf7fe2f-7a48-41e8-9ca5-3b8d25bb9b07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.044367 Aug 30 03:37:42.612682 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1400/2817] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:42.619942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:42.620706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:42.628673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.629171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.629755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.630533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.631565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.632095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.665704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:37:42.769453 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a20342a6-5815-4d37-b230-db11bae339e2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 204 len: 0 microversion: 2.1 time: 0.154745 Aug 30 03:37:42.771009 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1401/2818] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:42 2022] DELETE /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:37:42.777762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:42.778907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:42.786274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.787186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.788465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:42.789738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:42.790415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:42.791127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.154221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:43.170166 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4718992-b380-4a35-81a7-b5c3d32e321b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 1.062399 Aug 30 03:37:43.189778 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1418/2819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:42 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:43.195925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2dfba734-f723-4ae8-b042-fd4dc479cb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b68c430>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:43.246804 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2dfba734-f723-4ae8-b042-fd4dc479cb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1448 microversion: 2.1 time: 0.055083 Aug 30 03:37:43.247388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1419/2820] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:43 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1448 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:43.252169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:43.252930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:43.262651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:43.263481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:43.264714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.265621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:43.266082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:43.266511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.368886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:43.377999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ccc6d20-fc56-40b5-8774-0552bca4f368 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.605212 Aug 30 03:37:43.378730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1402/2821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:42 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:43.384363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:43.385213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:43.394287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:43.394965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:43.395520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.396461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:43.398376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:43.398376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.629971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:43.640881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64a56313-3177-49cc-993f-452a922d3641 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1493 microversion: 2.1 time: 0.392313 Aug 30 03:37:43.642115 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1420/2822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:43 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1493 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:43.648674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bab366a4-34c7-4dd2-ad9c-a5783822ee70 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b21e5e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:43.698405 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bab366a4-34c7-4dd2-ad9c-a5783822ee70 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 200 len: 1448 microversion: 2.1 time: 0.055079 Aug 30 03:37:43.699991 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1421/2823] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:37:43 2022] GET /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 1448 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:43.705372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:43.706558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:43.717430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:43.718097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:43.718824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.719588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:43.720166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:43.721536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:43.755161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:43.772669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c836301-e404-463b-8748-51ef35a0eaa0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.392517 Aug 30 03:37:43.788148 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1403/2824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:43 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:43.793252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3414df71-5885-46ac-9aa3-6828c347eff5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ae788b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:44.128038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:44.155182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:44.159393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:44.162220 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-55287cb6-0ff0-4f4c-a6b8-7a979208cb92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.460440 Aug 30 03:37:44.181496 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1422/2825] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:43 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:44.203623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-05fe2b94-b4d7-4306-a502-746258d17f67 req-bd954d47-e384-424b-af67-a7ea93dff604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e74adc-c2ac-414c-a28f-8988acf80515", "tag": "b853b5d7-3fa6-419d-929c-d0ed28bbbc01"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:44.222305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-05fe2b94-b4d7-4306-a502-746258d17f67 req-bd954d47-e384-424b-af67-a7ea93dff604 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.223096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-05fe2b94-b4d7-4306-a502-746258d17f67 req-bd954d47-e384-424b-af67-a7ea93dff604 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.224200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-05fe2b94-b4d7-4306-a502-746258d17f67 req-bd954d47-e384-424b-af67-a7ea93dff604 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.245510 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-05fe2b94-b4d7-4306-a502-746258d17f67 req-bd954d47-e384-424b-af67-a7ea93dff604 service nova] Creating event network-changed:b853b5d7-3fa6-419d-929c-d0ed28bbbc01 for instance 99e74adc-c2ac-414c-a28f-8988acf80515 on n-h1-854924-5 Aug 30 03:37:44.254303 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-05fe2b94-b4d7-4306-a502-746258d17f67 req-bd954d47-e384-424b-af67-a7ea93dff604 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070294 Aug 30 03:37:44.255809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1423/2826] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:44.265540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:44.267034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:44.277874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.278735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.279507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.280741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.282106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.282353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.338718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:44.403078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:44.710954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3414df71-5885-46ac-9aa3-6828c347eff5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 204 len: 0 microversion: 2.1 time: 0.921260 Aug 30 03:37:44.711911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1404/2827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:43 2022] DELETE /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:37:44.719848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:44.720776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:44.727965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.729308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.730040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.731066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.731787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.732446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.827666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:44.868967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:44.878336 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-de720941-154d-4e6a-9eb8-1bbefbdec2eb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.620274 Aug 30 03:37:44.878919 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1424/2828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:44 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:44.888098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4b66b254-2a97-48bd-980b-58867d4bd150 req-ec47c3e6-40fc-4603-8f68-36697f86df10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-plugged", "status": "completed", "tag": "92b69d35-61a6-4c5b-96ac-c8a4490071bd"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:44.903674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4b66b254-2a97-48bd-980b-58867d4bd150 req-ec47c3e6-40fc-4603-8f68-36697f86df10 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.904143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4b66b254-2a97-48bd-980b-58867d4bd150 req-ec47c3e6-40fc-4603-8f68-36697f86df10 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.904791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4b66b254-2a97-48bd-980b-58867d4bd150 req-ec47c3e6-40fc-4603-8f68-36697f86df10 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.921088 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4b66b254-2a97-48bd-980b-58867d4bd150 req-ec47c3e6-40fc-4603-8f68-36697f86df10 service nova] Creating event network-vif-plugged:92b69d35-61a6-4c5b-96ac-c8a4490071bd for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:44.926773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4b66b254-2a97-48bd-980b-58867d4bd150 req-ec47c3e6-40fc-4603-8f68-36697f86df10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046484 Aug 30 03:37:44.927634 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1425/2829] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:44.933833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:44.934542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:44.942620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.943113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.944620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:44.945537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:44.946012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:44.946423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:45.450601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:45.464340 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c5aedc96-bb10-422b-8d52-9f5f7f8c5603 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.750852 Aug 30 03:37:45.465961 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1405/2830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:44 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:45.473282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:45.474156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:45.493849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:45.494619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:45.495618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:45.497253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:45.498328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:45.499307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:45.557047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:37:45.563798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:45.588566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:45.601241 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f76b7c48-2b77-4e0f-89c9-6b82e68a5169 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1493 microversion: 2.1 time: 0.672046 Aug 30 03:37:45.601873 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1426/2831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:44 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1493 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:45.620125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:45.620746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:45.627265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:45.628159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:45.628889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:45.629874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:45.630524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:45.631442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:45.698315 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8f453c4-d616-4e37-961f-de03c17525b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 204 len: 0 microversion: 2.1 time: 0.230545 Aug 30 03:37:45.699083 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1406/2832] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:45 2022] DELETE /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:37:45.704653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:45.705715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:45.719647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:45.720268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:45.721015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:45.722627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:45.723312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:45.723909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:46.218920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:46.230107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b7a4ab86-f23d-46cf-85bd-e44529b7ab73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.614345 Aug 30 03:37:46.232866 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1427/2833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:45 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:46.248632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:46.249554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:46.256377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:46.257317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:46.257934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:46.258833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:46.259260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:46.259846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:46.420718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:46.430654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:46.432105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:46.433881 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3252b16f-2da6-4296-81f3-d4445f843b37 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.733215 Aug 30 03:37:46.435251 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1407/2834] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:45 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:46.440492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-504586835", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b426cd56-ffb2-4a75-8914-dc1bc200de06"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:46.525227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] validate_networks() for [('b426cd56-ffb2-4a75-8914-dc1bc200de06', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:37:47.033883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:47.043170 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9390bea-3135-49a2-9a80-ac417c584dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.798088 Aug 30 03:37:47.057220 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1428/2835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:46 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:47.064965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-eb75b30d-4299-4ab8-9499-e2262262f3e7 req-91353331-be90-4bee-b348-a51f91befe32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4201312f-7911-4558-ba51-701afafeea27", "tag": "938bb9bd-97b1-46a6-abba-0a0da532f202"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:47.079116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb75b30d-4299-4ab8-9499-e2262262f3e7 req-91353331-be90-4bee-b348-a51f91befe32 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.079884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb75b30d-4299-4ab8-9499-e2262262f3e7 req-91353331-be90-4bee-b348-a51f91befe32 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.084184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb75b30d-4299-4ab8-9499-e2262262f3e7 req-91353331-be90-4bee-b348-a51f91befe32 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.100744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-eb75b30d-4299-4ab8-9499-e2262262f3e7 req-91353331-be90-4bee-b348-a51f91befe32 service nova] Creating event network-changed:938bb9bd-97b1-46a6-abba-0a0da532f202 for instance 4201312f-7911-4558-ba51-701afafeea27 on n-h1-854924-5 Aug 30 03:37:47.108246 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-eb75b30d-4299-4ab8-9499-e2262262f3e7 req-91353331-be90-4bee-b348-a51f91befe32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049084 Aug 30 03:37:47.110387 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1429/2836] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:47.116771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:47.118129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:47.129466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.130226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.130821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.132467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.133071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.133718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.439915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:47.455080 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9e33c094-f243-4203-be45-7704d6b5f45d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.342632 Aug 30 03:37:47.456922 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1430/2837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:47 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:47.466160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:47.467657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:47.479250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.480405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.480850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.482545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.483019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.483443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.624888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:47.639306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be51926b-aeff-4962-8a5d-7c7122ed4c78 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1451 microversion: 2.1 time: 0.180354 Aug 30 03:37:47.640233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1431/2838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:47 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:47.645907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-884a742e-0766-44c0-b2db-3ff511a09a8e req-300309f5-a570-4299-a6c8-bf44f90a6392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8978264-05e7-42a1-8232-bc6575cdd4ab", "name": "network-vif-unplugged", "status": "completed", "tag": "b2557c8c-be04-4c4b-a0d5-324e68b95fe4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:47.660798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-884a742e-0766-44c0-b2db-3ff511a09a8e req-300309f5-a570-4299-a6c8-bf44f90a6392 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.661389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-884a742e-0766-44c0-b2db-3ff511a09a8e req-300309f5-a570-4299-a6c8-bf44f90a6392 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.661816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-884a742e-0766-44c0-b2db-3ff511a09a8e req-300309f5-a570-4299-a6c8-bf44f90a6392 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.680125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:47.681418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:37:47.682241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:37:47.683116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:37:47.683895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:37:47.684712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-884a742e-0766-44c0-b2db-3ff511a09a8e req-300309f5-a570-4299-a6c8-bf44f90a6392 service nova] Creating event network-vif-unplugged:b2557c8c-be04-4c4b-a0d5-324e68b95fe4 for instance e8978264-05e7-42a1-8232-bc6575cdd4ab on n-h2-854924-5 Aug 30 03:37:47.684961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:37:47.691696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-884a742e-0766-44c0-b2db-3ff511a09a8e req-300309f5-a570-4299-a6c8-bf44f90a6392 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049552 Aug 30 03:37:47.692328 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1432/2839] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:47.697953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:47.698673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:47.705886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.706631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.707062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.707958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.708417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.708845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.710280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.711089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.711776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.712971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.713823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.714568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.749766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:37:47.764959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Getting quotas for user cdbd4bfb488c475dac2862ea5df0fe70 and project a54084d3ce364898bae3dc8d2f257ceb. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:37:47.796151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:37:47.799347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:37:47.862950 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6aca3d5-2f70-4a1c-b47f-92647e6155b6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426579 Aug 30 03:37:47.871667 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1408/2840] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:37:47.885569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:47.887092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:47.898874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.899602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.900469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.901769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:47.902672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:47.903523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:47.935934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:47.948012 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-215aea8a-4b6d-48b5-b48b-1e8817257e06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.254434 Aug 30 03:37:47.961251 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1433/2841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:47 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:47.961251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43a7c384-15d8-4937-b8ef-261b72fd179a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:47.961251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43a7c384-15d8-4937-b8ef-261b72fd179a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:48.121808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43a7c384-15d8-4937-b8ef-261b72fd179a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:48.134971 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43a7c384-15d8-4937-b8ef-261b72fd179a tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1207 microversion: 2.1 time: 0.180635 Aug 30 03:37:48.141449 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1434/2842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:47 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1207 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:48.146245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:48.149499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:48.159534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:48.162136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:48.162956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:48.165195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:48.166638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:48.167836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:48.417991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:48.435411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:48.441029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:48.444935 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d4d5b560-3e4c-4f17-b6fb-83623fb90a72 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1875 microversion: 2.42 time: 0.570273 Aug 30 03:37:48.447090 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1409/2843] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:47 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1875 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:48.480762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:48.481513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:48.498669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:48.499229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:48.500050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:48.500860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:48.501397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:48.502067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:48.606175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:48.615345 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bb47cadf-a201-4270-87e1-dc199127d07f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1513 microversion: 2.1 time: 0.476016 Aug 30 03:37:48.621453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1435/2844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:48 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1513 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:48.671313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:48.673956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:48.682541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:48.683701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:48.684361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:48.686043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:48.687760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:48.699156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.077226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:49.091000 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bb708ba6-d1c6-4b45-9c33-03f1f4579a08 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1451 microversion: 2.1 time: 0.427520 Aug 30 03:37:49.105772 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1436/2845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:48 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1451 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:49.123329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:49.124290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:49.130501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.130995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.132257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.132970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.133461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.134074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.174563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:49.186740 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-62121dee-4346-4911-9e8a-5bdeb3e6f871 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.711480 Aug 30 03:37:49.196956 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1410/2846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:48 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:49.207494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:49.208402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:49.215338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.216063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.216709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.218858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.219573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.220791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.498640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:49.509270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:49.523409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9eb5f602-1386-44fc-a1bf-fcf56729c1ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.415057 Aug 30 03:37:49.542993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1437/2847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:49 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:49.543917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2f04ce96-f938-4aba-987e-909f9a242e79 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1259 microversion: 2.1 time: 0.345698 Aug 30 03:37:49.544761 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1411/2848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:49 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1259 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:49.549962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:49.550862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:49.560876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5d8b68da-b1a6-4ec0-962b-08adc16d48f8 req-17f76f94-3030-447d-b880-70f96b88c28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ce97-6e90-4037-ac34-1fdb2b21b50c", "name": "network-vif-deleted", "tag": "6a9f381f-881e-4d29-90b6-9283d9a86b3c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:49.562509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.563128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.563678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.564501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.565066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.565638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.587570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d8b68da-b1a6-4ec0-962b-08adc16d48f8 req-17f76f94-3030-447d-b880-70f96b88c28d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.588391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d8b68da-b1a6-4ec0-962b-08adc16d48f8 req-17f76f94-3030-447d-b880-70f96b88c28d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.590318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5d8b68da-b1a6-4ec0-962b-08adc16d48f8 req-17f76f94-3030-447d-b880-70f96b88c28d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.623646 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5d8b68da-b1a6-4ec0-962b-08adc16d48f8 req-17f76f94-3030-447d-b880-70f96b88c28d service nova] Creating event network-vif-deleted:6a9f381f-881e-4d29-90b6-9283d9a86b3c for instance a483ce97-6e90-4037-ac34-1fdb2b21b50c on n-h1-854924-5 Aug 30 03:37:49.644063 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5d8b68da-b1a6-4ec0-962b-08adc16d48f8 req-17f76f94-3030-447d-b880-70f96b88c28d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093463 Aug 30 03:37:49.646820 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1438/2849] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:49.700799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:49.704864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:49.728548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.730079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.732694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:49.734682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:49.735488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:49.736311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:50.197587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:50.211804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:50.217650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:50.224152 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-14ef3250-5f04-4b81-9e75-43732bdb5efd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2832 microversion: 2.42 time: 0.678006 Aug 30 03:37:50.225039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1412/2850] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:37:49 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2832 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:50.236377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:50.239798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:50.264539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:50.272774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:50.276014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:50.276971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:50.277622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:50.278233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:50.399927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:50.421906 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12f9e428-7c6e-42cd-ad2b-4a8d6ea3e391 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1291 microversion: 2.1 time: 0.195568 Aug 30 03:37:50.432829 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1413/2851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:50 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1291 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:50.444807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:50.447191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:50.454258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:50.454925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:50.455760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:50.456917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:50.457576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:50.458160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:50.759475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:50.786491 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cddf144d-b104-4c6b-a5fd-98d7d32522ad tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1490 microversion: 2.1 time: 1.107873 Aug 30 03:37:50.788429 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1439/2852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:49 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1490 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:50.814333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:50.815470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:50.848569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:50.851717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:50.853065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:50.857625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:50.860369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:50.862036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.294982 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9ce3a58-2775-446a-809b-0c63bdf349cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.491829 Aug 30 03:37:51.309379 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1440/2853] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:37:50 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983/os-interface => generated 1832 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:37:51.309379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4d77d2b2-7983-4ada-9799-8f5da2906d6d req-ad7002f5-f8f2-447a-b5be-38be94b41b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8978264-05e7-42a1-8232-bc6575cdd4ab", "name": "network-vif-deleted", "tag": "b2557c8c-be04-4c4b-a0d5-324e68b95fe4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:51.324187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d77d2b2-7983-4ada-9799-8f5da2906d6d req-ad7002f5-f8f2-447a-b5be-38be94b41b08 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.324437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d77d2b2-7983-4ada-9799-8f5da2906d6d req-ad7002f5-f8f2-447a-b5be-38be94b41b08 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.325064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d77d2b2-7983-4ada-9799-8f5da2906d6d req-ad7002f5-f8f2-447a-b5be-38be94b41b08 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.355709 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4d77d2b2-7983-4ada-9799-8f5da2906d6d req-ad7002f5-f8f2-447a-b5be-38be94b41b08 service nova] Creating event network-vif-deleted:b2557c8c-be04-4c4b-a0d5-324e68b95fe4 for instance e8978264-05e7-42a1-8232-bc6575cdd4ab on n-h2-854924-5 Aug 30 03:37:51.374393 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4d77d2b2-7983-4ada-9799-8f5da2906d6d req-ad7002f5-f8f2-447a-b5be-38be94b41b08 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077147 Aug 30 03:37:51.375698 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1441/2854] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:51.382523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:51.383486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:51.399903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.400670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.401330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.402272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.402830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.403375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.584926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:51.624386 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab793417-5c26-4377-a7fa-885a5c5abfc3 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 1.188118 Aug 30 03:37:51.626823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1414/2855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:50 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:51.643808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:51.649541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:51.663647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.664926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.667056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.668774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.669969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.670980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.923900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:51.936702 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d076693-09e9-4f2b-952f-a9106651c921 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1265 microversion: 2.1 time: 0.305815 Aug 30 03:37:51.937938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1415/2856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:51 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:51.949180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:51.954366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:51.968144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.969016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.969720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:51.970592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:51.971216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:51.971835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.140753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:52.154717 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71493bc8-cdc3-40b5-8db7-4a16ded47958 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.777220 Aug 30 03:37:52.157114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1442/2857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:51 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:52.183036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:52.186125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:52.204768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.206924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.208097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.208402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b13c0c68-224c-493e-9c04-c3050c2f789f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 200 len: 158 microversion: 2.1 time: 0.268410 Aug 30 03:37:52.209074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1416/2858] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:37:51 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 158 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:52.211286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.212489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.213780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.223183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:52.223886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:52.246362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.246855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.247280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.248352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.249021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.249625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.296039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.296753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.297805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.298705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lazy-loading 'fault' on Instance uuid a483ce97-6e90-4037-ac34-1fdb2b21b50c {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:37:52.587035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:52.604735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-980a9489-e072-4625-9c83-654b713dc0f2 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 200 len: 1309 microversion: 2.1 time: 0.445213 Aug 30 03:37:52.606103 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1443/2859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:52 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:52.616004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4da5b3d-34c5-49ca-b1a9-3a9e8ad68aa2"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:52.622555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:52.634015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.634889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.635701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:52.636920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:52.637836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:52.638615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.041713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63e9d16f-d40a-4841-b94f-04593655c14a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "POST /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433105 Aug 30 03:37:53.042471 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1444/2860] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:37:52 2022] POST /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:53.083935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:53.087499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:53.126581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.128351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.129017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.130669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.138495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.143401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.359800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:53.370338 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b9f87fbe-62fd-4fed-b0ea-94d849bd91b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.151839 Aug 30 03:37:53.375631 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1417/2861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:52 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:37:53.386540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:53.387595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:53.407000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.407686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.408137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.408860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.409318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.410033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.551743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:53.565159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-88888079-7b7d-4768-93b9-40c1acd63efa tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1265 microversion: 2.1 time: 0.188950 Aug 30 03:37:53.569427 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1418/2862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:53 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:53.575387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:53.576063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:53.584164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.585213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.585849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.586780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.587523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.588110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.642388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:53.652896 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9883f773-e869-4848-a6e7-8e12796e894b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.608692 Aug 30 03:37:53.653309 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1445/2863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:53 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:53.664705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:53.668308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:53.684177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.684918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.685598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:53.686810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:53.692122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:53.692764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.673688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:54.687115 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-153c4cf0-d5d7-4770-8214-d86f53289879 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 1.116273 Aug 30 03:37:54.696209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1419/2864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:53 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:54.701188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c8999a50-1bc6-483b-999c-a788b2d274e0 req-c0ea759a-e893-4596-ab89-25798dc4fdb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4201312f-7911-4558-ba51-701afafeea27", "name": "network-vif-plugged", "status": "completed", "tag": "938bb9bd-97b1-46a6-abba-0a0da532f202"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:54.731391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c8999a50-1bc6-483b-999c-a788b2d274e0 req-c0ea759a-e893-4596-ab89-25798dc4fdb3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.733094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c8999a50-1bc6-483b-999c-a788b2d274e0 req-c0ea759a-e893-4596-ab89-25798dc4fdb3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.733734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c8999a50-1bc6-483b-999c-a788b2d274e0 req-c0ea759a-e893-4596-ab89-25798dc4fdb3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.755726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:54.768074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5dd9c543-400f-45ec-9817-7b7200fdefc8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.111620 Aug 30 03:37:54.777999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c8999a50-1bc6-483b-999c-a788b2d274e0 req-c0ea759a-e893-4596-ab89-25798dc4fdb3 service nova] Creating event network-vif-plugged:938bb9bd-97b1-46a6-abba-0a0da532f202 for instance 4201312f-7911-4558-ba51-701afafeea27 on n-h1-854924-5 Aug 30 03:37:54.779014 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1446/2865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:53 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:54.793172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:54.794224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:54.805250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c8999a50-1bc6-483b-999c-a788b2d274e0 req-c0ea759a-e893-4596-ab89-25798dc4fdb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107717 Aug 30 03:37:54.808014 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1420/2866] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:54.813722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.818320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:54.824842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.825072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:54.825765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.826698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.827348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.827927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.842714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.843216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.843656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.844376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.844833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.845268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.855363 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c HTTP/1.1 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a483ce97-6e90-4037-ac34-1fdb2b21b50c'} Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:54.868219 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:54.872668 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:54.882474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:54.883666 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4c49e4f-fec0-4b62-b5e8-1e609450f164 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 404 len: 111 microversion: 2.1 time: 0.103323 Aug 30 03:37:54.884759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1447/2867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:54 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:54.889613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:54.890480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:54.911420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.912266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.913707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:54.915702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:54.916397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:54.919090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.522384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:55.528036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:55.535768 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6786811-414e-4a8c-8e32-1b8d77e30054 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.647335 Aug 30 03:37:55.537636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1448/2868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:54 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:55.541296 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a5584d8-3a8d-4bd2-83c3-cf6e0d1acc7f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.729969 Aug 30 03:37:55.559242 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1421/2869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:54 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:55.561713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:55.562483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:55.566457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:55.567267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:55.581380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.582284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.582976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.583968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.587538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.588377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.589052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.590024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.590498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.591244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.591711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.592135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.625774 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c HTTP/1.1 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a483ce97-6e90-4037-ac34-1fdb2b21b50c'} Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:55.634898 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.639398 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.642556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:55.644006 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-07ab1f39-ec6f-4f7e-9fca-1a4cdde6045b tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 404 len: 111 microversion: 2.1 time: 0.083161 Aug 30 03:37:55.645552 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1422/2870] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:55 2022] DELETE /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:55.660670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:55.666426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: a483ce97-6e90-4037-ac34-1fdb2b21b50c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:55.684010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.685366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.686043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.687017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.687819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.688337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.707222 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c HTTP/1.1 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a483ce97-6e90-4037-ac34-1fdb2b21b50c'} Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:55.709283 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. Aug 30 03:37:55.714687 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:55.718654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance a483ce97-6e90-4037-ac34-1fdb2b21b50c could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:55.719849 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dba1e763-5663-48b0-8fd5-e6a5a5bce907 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c" status: 404 len: 111 microversion: 2.1 time: 0.069600 Aug 30 03:37:55.720973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1423/2871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:55 2022] GET /compute/v2.1/servers/a483ce97-6e90-4037-ac34-1fdb2b21b50c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:37:55.726757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:55.727838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:55.734867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.735670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.736340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:55.737262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:55.738125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:55.738835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:56.597833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:56.614463 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e14910e-5f09-4f36-9396-ad28a96b585f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.060403 Aug 30 03:37:56.626881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1449/2872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:55 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:56.642559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:56.643365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:56.653001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:56.654554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:56.655224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:56.657276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:56.658113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:56.658893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:56.685803 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 HTTP/1.1 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd2530254-b35e-43c2-a451-e490dcc99184'} Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:56.687548 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72275970-7bd8-47f6-87c9-651fde333679 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 404 len: 111 microversion: 2.1 time: 0.058285 Aug 30 03:37:56.692971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1450/2873] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:56 2022] DELETE /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:56.695151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:56.695657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:56.702456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:56.702948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:56.703394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:56.704106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:56.704576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:56.704986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:56.861798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:56.866527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:56.875934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7ccc245-e1b3-4def-ad0f-66d24f24c6d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 1.153502 Aug 30 03:37:56.891216 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1424/2874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:55 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:56.910374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:56.911366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:56.918566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:56.919339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:56.921873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:56.925432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:56.925432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:56.925432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.144176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:57.148726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:57.182698 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31a40047-e97b-4cb2-9a88-63a62ab1815d tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1323 microversion: 2.1 time: 0.491148 Aug 30 03:37:57.183644 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1451/2875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:56 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:57.203247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.209846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.241516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.242778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.243724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.245297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.247269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.248257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.480527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:57.503158 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b092b9f-cb90-4593-ac29-2c8d58d1bb98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.610068 Aug 30 03:37:57.504770 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1425/2876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:56 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:57.513088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.514484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: d2530254-b35e-43c2-a451-e490dcc99184] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.526365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.527517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.528397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.529790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.530737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.532416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.572103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 HTTP/1.1 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'd2530254-b35e-43c2-a451-e490dcc99184'} Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.575178 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance d2530254-b35e-43c2-a451-e490dcc99184 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10a5de65-de3d-4b3f-87e5-4f2bd861f1b1 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184" status: 404 len: 111 microversion: 2.1 time: 0.070665 Aug 30 03:37:57.580377 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1426/2877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:57 2022] GET /compute/v2.1/servers/d2530254-b35e-43c2-a451-e490dcc99184 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:57.589579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-36298b8b-b564-4d5d-86e5-d257df02dd92 req-457bb0c5-25e5-4a51-bc44-54cfdeacaa5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "tag": "848a0abf-622c-49ee-b610-7c1c4641e0ef"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:57.610135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-36298b8b-b564-4d5d-86e5-d257df02dd92 req-457bb0c5-25e5-4a51-bc44-54cfdeacaa5f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.611034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-36298b8b-b564-4d5d-86e5-d257df02dd92 req-457bb0c5-25e5-4a51-bc44-54cfdeacaa5f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.611980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-36298b8b-b564-4d5d-86e5-d257df02dd92 req-457bb0c5-25e5-4a51-bc44-54cfdeacaa5f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.636622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-36298b8b-b564-4d5d-86e5-d257df02dd92 req-457bb0c5-25e5-4a51-bc44-54cfdeacaa5f service nova] Creating event network-changed:848a0abf-622c-49ee-b610-7c1c4641e0ef for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:37:57.646393 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-36298b8b-b564-4d5d-86e5-d257df02dd92 req-457bb0c5-25e5-4a51-bc44-54cfdeacaa5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064253 Aug 30 03:37:57.648489 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1427/2878] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:57.655003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7b7cd1a7-0879-495e-919f-d7e196ca4066 req-dcc00362-bf06-4501-a605-3c18aaed7b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e74adc-c2ac-414c-a28f-8988acf80515", "name": "network-vif-plugged", "status": "completed", "tag": "b853b5d7-3fa6-419d-929c-d0ed28bbbc01"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:57.666430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7b7cd1a7-0879-495e-919f-d7e196ca4066 req-dcc00362-bf06-4501-a605-3c18aaed7b0f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.667271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7b7cd1a7-0879-495e-919f-d7e196ca4066 req-dcc00362-bf06-4501-a605-3c18aaed7b0f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.667956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7b7cd1a7-0879-495e-919f-d7e196ca4066 req-dcc00362-bf06-4501-a605-3c18aaed7b0f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.687857 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7b7cd1a7-0879-495e-919f-d7e196ca4066 req-dcc00362-bf06-4501-a605-3c18aaed7b0f service nova] Creating event network-vif-plugged:b853b5d7-3fa6-419d-929c-d0ed28bbbc01 for instance 99e74adc-c2ac-414c-a28f-8988acf80515 on n-h1-854924-5 Aug 30 03:37:57.695397 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7b7cd1a7-0879-495e-919f-d7e196ca4066 req-dcc00362-bf06-4501-a605-3c18aaed7b0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044211 Aug 30 03:37:57.696709 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1428/2879] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:37:57.702595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.703535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.710594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.711471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.712152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.713086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.714376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.715030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.735885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:57.738100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a HTTP/1.1 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f72b0843-1012-4770-b507-632e0a551d5a'} Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:57.742421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.747888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:57.749692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bc3f6d2-f98e-46ba-8e56-855f9273851f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 404 len: 111 microversion: 2.1 time: 0.050468 Aug 30 03:37:57.754892 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1429/2880] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:57 2022] DELETE /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:57.767457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.770680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: f72b0843-1012-4770-b507-632e0a551d5a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.790184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.791082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.792523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.793820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.794472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.795098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.796015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:57.829822 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a HTTP/1.1 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f72b0843-1012-4770-b507-632e0a551d5a'} Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.831705 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. Aug 30 03:37:57.836697 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.839328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance f72b0843-1012-4770-b507-632e0a551d5a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:57.840619 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5e15bb7-5882-425b-9f5a-3c9c0458526a tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a" status: 404 len: 111 microversion: 2.1 time: 0.083056 Aug 30 03:37:57.842362 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1430/2881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:57 2022] GET /compute/v2.1/servers/f72b0843-1012-4770-b507-632e0a551d5a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:57.850950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.851821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.867792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.869041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.869521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.870240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.870697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.871134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.885544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:57.891661 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b HTTP/1.1 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2d009a60-8954-4751-af6b-79a70c09279b'} Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:57.895060 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5cc53cd9-5a65-4657-a79e-3390043239f8 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 404 len: 111 microversion: 2.1 time: 0.052190 Aug 30 03:37:57.902098 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1431/2882] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:57 2022] DELETE /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:37:57.904516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.905144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.913682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-38245711-35f3-4399-9a2e-1e49b07a3921 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.728084 Aug 30 03:37:57.915324 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1452/2883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:57 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:57.920852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.921479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 2d009a60-8954-4751-af6b-79a70c09279b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.929671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.930514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.930649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:57.931630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.932544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.933623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.934518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.947174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.947174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.947174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.948166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.948637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.949204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.954893 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b HTTP/1.1 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2d009a60-8954-4751-af6b-79a70c09279b'} Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:57.959829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 2d009a60-8954-4751-af6b-79a70c09279b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d798c26-d9a7-4108-b2db-d695ee0a9956 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b" status: 404 len: 111 microversion: 2.1 time: 0.047570 Aug 30 03:37:57.964802 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1453/2884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:57 2022] GET /compute/v2.1/servers/2d009a60-8954-4751-af6b-79a70c09279b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:57.974442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:57.974989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:57.982857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.983345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.983776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:57.984786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:57.986698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:57.987808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:58.019450 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc HTTP/1.1 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '92612d47-429e-44ad-8524-75d16dbdfcbc'} Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:58.021031 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.025225 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.026820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:58.027947 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62b0850e-7eb4-4c49-a01e-c53398708a3c tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 404 len: 111 microversion: 2.1 time: 0.058448 Aug 30 03:37:58.031421 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1454/2885] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:57 2022] DELETE /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:58.039142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:58.039782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 92612d47-429e-44ad-8524-75d16dbdfcbc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:58.052130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:58.053464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:58.054123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:58.055052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:58.055712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:58.056356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:58.080422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc HTTP/1.1 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '92612d47-429e-44ad-8524-75d16dbdfcbc'} Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:58.082901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. Aug 30 03:37:58.087894 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.089664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 92612d47-429e-44ad-8524-75d16dbdfcbc could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:58.090704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bb80069-ff8a-4fb6-96cc-06989af4bfe0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc" status: 404 len: 111 microversion: 2.1 time: 0.058121 Aug 30 03:37:58.091825 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1455/2886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:58 2022] GET /compute/v2.1/servers/92612d47-429e-44ad-8524-75d16dbdfcbc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:58.097088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1102478111", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "e6a4f0d7-59ea-445f-abb0-b63795f79159"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:37:58.134234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:58.175601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] validate_networks() for [('e6a4f0d7-59ea-445f-abb0-b63795f79159', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:37:58.636236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:58.648069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c75caa7-10f9-45b7-a04b-1ce7f3952db4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1316 microversion: 2.1 time: 0.747370 Aug 30 03:37:58.652109 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1432/2887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:57 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1316 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:58.657119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:58.659908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:58.691225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:58.692005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:58.692617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:58.693594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:58.694200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:58.694781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:58.717940 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b HTTP/1.1 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '3128b88b-1c97-43a5-91d6-c14a3a5a721b'} Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:58.725545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:58.731059 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:58.732784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:37:58.746700 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c38a57fa-c04d-46d4-8d5e-83b0e2548cc3 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 404 len: 111 microversion: 2.1 time: 0.093284 Aug 30 03:37:58.747531 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1433/2888] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:37:58 2022] DELETE /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:37:58.758777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:58.759676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:58.766816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:58.767507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:58.768715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:58.770375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:58.771123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:58.772735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.364439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:59.377185 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3308b14d-45f9-4f9c-a1bb-90c98017aad0 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1473 microversion: 2.1 time: 0.622625 Aug 30 03:37:59.378041 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1434/2889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:58 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:59.391035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:59.395467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:59.415489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:59.416283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:59.416944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.418781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:59.419433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:59.420050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.731863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:37:59.750248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:37:59.750905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:37:59.751747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:37:59.752876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:37:59.780760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:59.781280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:59.784642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.785437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:59.788200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:59.788820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.836171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:37:59.853994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93d61b62-3ca9-4e65-a445-b9537a4a1961 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.470928 Aug 30 03:37:59.855614 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1435/2890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:59 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:37:59.877012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:37:59.878105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 3128b88b-1c97-43a5-91d6-c14a3a5a721b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:37:59.884839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:37:59.920095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:59.921540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:59.929740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for user a681b194cdb24b6fbb49eb39711ffa1c and project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:37:59.930795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.934088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:37:59.935117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:37:59.939956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:37:59.948783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:37:59.982032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:37:59.986266 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:59.988533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b HTTP/1.1 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '3128b88b-1c97-43a5-91d6-c14a3a5a721b'} Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:37:59.994260 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. Aug 30 03:38:00.001591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.006849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 3128b88b-1c97-43a5-91d6-c14a3a5a721b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:00.010534 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25bccef8-6f7d-473b-a006-909f54a4f111 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b" status: 404 len: 111 microversion: 2.1 time: 0.149959 Aug 30 03:38:00.014372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1436/2891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:37:59 2022] GET /compute/v2.1/servers/3128b88b-1c97-43a5-91d6-c14a3a5a721b => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:00.021276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.022245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.030512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.031507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.032256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.033226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.034097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.035765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.067395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Request method failure captured: Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27/diagnostics HTTP/1.1 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYX69zz-7vnER4httnPJMB_SkDe5jfS-pVtaHI03hemYEJaA6irGD7YpXqztkKjAmxtxcv_CpuBfd7TbzvyJClxswzqtveeiZSOLUV7dcW8TJJ0UNr42tK3ox6UT1K9Veox_iBgoe7qpxhy_DwAzqgpV_l793BSemidg_iIc1wkX2TA Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 2c588323936a43ddaa305a1a71354065 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-987245132 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2c588323936a43ddaa305a1a71354065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2c588323936a43ddaa305a1a71354065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2c588323936a43ddaa305a1a71354065", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2c588323936a43ddaa305a1a71354065"}]}] Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-987245132 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 2c588323936a43ddaa305a1a71354065 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-987245132 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerDiagnosticsNegativeTest-987245132-project Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 147195c1f0cd4e2db5394323583afa92 Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-987245132-project Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '4201312f-7911-4558-ba51-701afafeea27'} Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.078790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.085794 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.085794 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.085794 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 03:38:00.085794 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 03:38:00.085794 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 03:38:00.085794 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.086676 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3f6a72a-f4d2-4d50-9f23-cc96641ea3fb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991284 Aug 30 03:38:00.089891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:00.091637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1456/2892] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:37:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:38:00.097136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.098602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.104384 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c9b740f-0f04-4973-bf45-aeb05a11a4b6 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.074955 Aug 30 03:38:00.106705 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1437/2893] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:38:00 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27/diagnostics => generated 117 bytes in 91 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:00.116269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.116994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.117605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.119128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.119873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.120549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.123505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-67d20e03-7ab6-41e0-a414-59034efcb7da req-fd605f5f-0620-4699-9a85-c265ceac8c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca", "tag": "ba46763b-9226-42ff-a57c-48533a857bc7"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:00.150867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-67d20e03-7ab6-41e0-a414-59034efcb7da req-fd605f5f-0620-4699-9a85-c265ceac8c4f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.151968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-67d20e03-7ab6-41e0-a414-59034efcb7da req-fd605f5f-0620-4699-9a85-c265ceac8c4f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.152690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-67d20e03-7ab6-41e0-a414-59034efcb7da req-fd605f5f-0620-4699-9a85-c265ceac8c4f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.210150 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-67d20e03-7ab6-41e0-a414-59034efcb7da req-fd605f5f-0620-4699-9a85-c265ceac8c4f service nova] Creating event network-changed:ba46763b-9226-42ff-a57c-48533a857bc7 for instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca on n-h2-854924-5 Aug 30 03:38:00.219505 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-67d20e03-7ab6-41e0-a414-59034efcb7da req-fd605f5f-0620-4699-9a85-c265ceac8c4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110737 Aug 30 03:38:00.221259 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1438/2894] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:00.231888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fc4040d-acb5-4b32-80c8-776dc0379005 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.233071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5fc4040d-acb5-4b32-80c8-776dc0379005 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.244337 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5fc4040d-acb5-4b32-80c8-776dc0379005 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fc4040d-acb5-4b32-80c8-776dc0379005 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f HTTP/1.1 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f'} Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:00.249325 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.257291 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.268518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fc4040d-acb5-4b32-80c8-776dc0379005 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:00.268518 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5fc4040d-acb5-4b32-80c8-776dc0379005 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f" status: 404 len: 111 microversion: 2.1 time: 0.039606 Aug 30 03:38:00.268518 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1439/2895] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:00 2022] DELETE /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:00.283815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-01389a08-802e-4f62-baf7-75c40ac4a82a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.285998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-01389a08-802e-4f62-baf7-75c40ac4a82a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.663442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-01389a08-802e-4f62-baf7-75c40ac4a82a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:00.716329 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-01389a08-802e-4f62-baf7-75c40ac4a82a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1215 microversion: 2.1 time: 0.442551 Aug 30 03:38:00.731532 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1440/2896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:00 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:00.743763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:00.757703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-173b1e21-dbc8-42f7-8fa1-16da01598633 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1505 microversion: 2.1 time: 0.664526 Aug 30 03:38:00.760976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.761763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.764700 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1457/2897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:00 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:00.783777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7bc7ef6-3838-4ddb-8058-a1d0321f4560 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.788425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7bc7ef6-3838-4ddb-8058-a1d0321f4560 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.812622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.814990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.815558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.820005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.823153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.825083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f7bc7ef6-3838-4ddb-8058-a1d0321f4560 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7bc7ef6-3838-4ddb-8058-a1d0321f4560 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f HTTP/1.1 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f'} Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:00.826818 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:00.832983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:00.832983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:00.832983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:00.832983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. Aug 30 03:38:00.832983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:00.833704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.849138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7bc7ef6-3838-4ddb-8058-a1d0321f4560 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:00.853811 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7bc7ef6-3838-4ddb-8058-a1d0321f4560 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f" status: 404 len: 111 microversion: 2.1 time: 0.085845 Aug 30 03:38:00.856473 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1458/2898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:00 2022] GET /compute/v2.1/servers/172c9e6c-bfbf-42ab-bd0b-41a1bcb9cf7f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:00.874732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:00.875238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:00.909526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.913206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.913966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.914898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:00.915529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:00.916801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:00.934703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:38:00.973174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:38:01.121095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57ebfc16-f5e2-4295-a231-24b2278fd2a4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 204 len: 0 microversion: 2.1 time: 0.371839 Aug 30 03:38:01.123775 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1441/2899] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:00 2022] DELETE /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:01.137833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:01.138794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:01.145591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.147900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.148532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.149437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.150053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.150675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.184268 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e697e71-3242-453e-8001-ec986a6a9fde tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 204 len: 0 microversion: 2.1 time: 0.325184 Aug 30 03:38:01.185026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1459/2900] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:00 2022] DELETE /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:01.197939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:01.200502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:01.216691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:38:01.218550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.221117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.221701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.222854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.226006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.226786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.525873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c1d3dd4-cacf-45fe-a3f7-743b7d8a6258 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 204 len: 0 microversion: 2.1 time: 0.398415 Aug 30 03:38:01.532965 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1442/2901] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:01 2022] DELETE /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:01.549690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:01.551596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:01.568092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.569660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.570577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.572014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.573062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.574116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.787144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:01.831029 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36a1258b-8dec-4a42-8fe4-1355bb101dbf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.641558 Aug 30 03:38:01.838353 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1460/2902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:01 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:01.854589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:01.855513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:01.867298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.868856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.869887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.872043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:01.876277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:01.876906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:01.969285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:01.986989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-104c7bf5-785b-4d80-ae0c-94899c9d8875 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1479 microversion: 2.1 time: 0.450651 Aug 30 03:38:01.988342 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1443/2903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:01 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1479 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:01.996955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:01.998274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:02.010174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:02.011398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:02.013156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:02.014497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:02.016019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:02.017253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:02.265268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:02.283005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-feca7c96-4169-4c00-9452-8cf5901dd870 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1511 microversion: 2.1 time: 0.441346 Aug 30 03:38:02.284212 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1461/2904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:01 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:02.294964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:02.299394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:02.317437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:02.318052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:02.319313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:02.320224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:02.321260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:02.321776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:02.536648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:02.547459 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d64659d-75e1-4b33-86d5-c076988d7865 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1267 microversion: 2.1 time: 0.261254 Aug 30 03:38:02.565445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1462/2905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:02 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:02.593096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:02.622206 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-526aad49-c7c8-410a-a15e-b331b91ecf3d tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1479 microversion: 2.1 time: 0.615550 Aug 30 03:38:02.623646 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1444/2906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:01 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1479 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:02.862346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:02.864142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:02.874524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:02.875035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:02.875481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:02.892584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:02.893168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:02.893651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.013264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:03.013927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:03.026416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.029020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.029970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.031463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.039797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.042509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.152566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:03.171979 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9427f196-0366-4a74-9ee2-ef3161a5a160 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.313852 Aug 30 03:38:03.184641 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1463/2907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:02 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:03.238494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:03.248674 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-081b033f-64fe-4eb4-a30b-2e1df36e8396 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1479 microversion: 2.1 time: 0.239471 Aug 30 03:38:03.250146 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1445/2908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:03 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1479 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:03.304513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:03.305129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:03.311563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.312197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.312592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.313288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.314077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.314659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.518716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:03.528399 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7068e040-e2b9-4120-8176-2e0c9f5bc736 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1511 microversion: 2.1 time: 0.227791 Aug 30 03:38:03.528992 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1464/2909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:03 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:03.573711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:03.574748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:03.584684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.585636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.586255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.587152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.587985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.588576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.611534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:03.645879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:03.647568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:03.655929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.666105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.666724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.667672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:03.668281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:03.668832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:03.894298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:03.907075 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67c09849-dedb-4afb-bb9d-ff9318ac52c1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.339625 Aug 30 03:38:03.910016 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1446/2910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:03 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:03.915687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:03.931592 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3645f92e-d87b-447a-a60f-77eb76d197a0 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1479 microversion: 2.1 time: 0.291030 Aug 30 03:38:03.932930 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1465/2911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:03 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1479 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:04.194027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:04.195250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:04.202124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.202623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.203069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.203803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.204262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.204688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.274259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:04.275510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:04.286133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.286963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.288669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.290508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.291267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.292078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.465660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:04.480879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-62386568-9c55-491b-89f2-2811cece99e8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.291018 Aug 30 03:38:04.482801 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1447/2912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:04 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:04.549229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:04.550281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:04.563398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.564143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.566394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.567451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.572537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.573149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.576390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:04.608659 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51c0fed7-89ac-4bf0-ac97-0d8ec4cf78f4 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1479 microversion: 2.1 time: 0.340925 Aug 30 03:38:04.611622 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1466/2913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:04 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1479 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:04.944119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:04.946322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:04.968076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.968888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.969541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:04.972268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:04.973251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:04.976829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:05.407253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:05.423988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f746cd8-4c5e-4cba-8940-ecf48c50517d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.488308 Aug 30 03:38:05.424712 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1467/2914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:04 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:05.431542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:05.442491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:05.449284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:05.456178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:05.457486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:05.466355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:05.467223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:05.468669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:05.714653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:05.725642 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9dd2edf9-9369-4bbc-8a86-2e9371ed5437 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1511 microversion: 2.1 time: 1.180619 Aug 30 03:38:05.726244 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1448/2915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:04 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1511 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:05.731220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:05.732534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:05.746517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:05.766335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:05.767276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:05.770008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:05.770766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:05.771456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.119121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:06.132670 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e37e0a1a-7250-4b15-87df-e3ea06fb1084 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1479 microversion: 2.1 time: 0.705599 Aug 30 03:38:06.133674 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1468/2916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:05 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1479 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:06.140268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:06.141122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:06.152178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.152693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.153457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.154562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.155203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.156775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.321740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:06.337326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e00a9b2-bf76-4c5e-a5fd-ed63342ed981 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.609732 Aug 30 03:38:06.356288 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1449/2917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:05 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:06.361645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d9b0b809-42d2-4c1a-87b9-1fca2ba2a12f req-eeff82d4-9081-4dd4-9419-0bdd62444203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb1e090-dbc1-44bc-8496-ee675e4960f0", "tag": "4e894a78-6f20-4251-8646-5dc37f92d806"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:06.373737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d9b0b809-42d2-4c1a-87b9-1fca2ba2a12f req-eeff82d4-9081-4dd4-9419-0bdd62444203 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.374598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d9b0b809-42d2-4c1a-87b9-1fca2ba2a12f req-eeff82d4-9081-4dd4-9419-0bdd62444203 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.375238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d9b0b809-42d2-4c1a-87b9-1fca2ba2a12f req-eeff82d4-9081-4dd4-9419-0bdd62444203 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.390990 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d9b0b809-42d2-4c1a-87b9-1fca2ba2a12f req-eeff82d4-9081-4dd4-9419-0bdd62444203 service nova] Creating event network-changed:4e894a78-6f20-4251-8646-5dc37f92d806 for instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 on n-h2-854924-5 Aug 30 03:38:06.397526 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d9b0b809-42d2-4c1a-87b9-1fca2ba2a12f req-eeff82d4-9081-4dd4-9419-0bdd62444203 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038554 Aug 30 03:38:06.398908 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1450/2918] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:06.450332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:06.452100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:06.467731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.468744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.469422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.470508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.473901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.474618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.661504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:06.675423 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fdcf60a-cf26-4460-bdc0-6ebfed5d874b tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1479 microversion: 2.1 time: 0.540441 Aug 30 03:38:06.676413 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1469/2919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:06 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1479 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:06.756682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:06.762050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:06.786621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.789834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.804292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.805185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:06.817887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:06.818901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:06.862729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:07.079507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:07.101716 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3512b822-192c-4fdc-9622-90e8388f03dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.650028 Aug 30 03:38:07.102952 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1451/2920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:06 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:07.159080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:07.159703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:07.185132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.185720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.186098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.186808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.187406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.192138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.207228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:07.256762 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45ccfa61-5a08-4e99-9c64-b753e367105d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 200 len: 1469 microversion: 2.1 time: 0.512263 Aug 30 03:38:07.262511 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1470/2921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:06 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 1469 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:07.278973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1477a9c0-8e42-4ab5-9fe1-1332696f4f33 req-4b5f523a-1b24-45b8-9d3e-8dd486a089ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8779a51b-60a6-4613-9000-8457ee7d8860", "name": "network-vif-deleted", "tag": "bd79ad2e-ddf2-4e69-9cd0-0bebd4416ccb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:07.332542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1477a9c0-8e42-4ab5-9fe1-1332696f4f33 req-4b5f523a-1b24-45b8-9d3e-8dd486a089ce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.333027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1477a9c0-8e42-4ab5-9fe1-1332696f4f33 req-4b5f523a-1b24-45b8-9d3e-8dd486a089ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.333514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1477a9c0-8e42-4ab5-9fe1-1332696f4f33 req-4b5f523a-1b24-45b8-9d3e-8dd486a089ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.366918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:07.401725 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40505fcd-add5-42a2-bfdc-0a8e49297c4f tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1437 microversion: 2.1 time: 0.231206 Aug 30 03:38:07.405269 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1477a9c0-8e42-4ab5-9fe1-1332696f4f33 req-4b5f523a-1b24-45b8-9d3e-8dd486a089ce service nova] Creating event network-vif-deleted:bd79ad2e-ddf2-4e69-9cd0-0bebd4416ccb for instance 8779a51b-60a6-4613-9000-8457ee7d8860 on n-h1-854924-5 Aug 30 03:38:07.406335 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1452/2922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:07 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1437 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:07.431383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:07.432530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:07.435713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1477a9c0-8e42-4ab5-9fe1-1332696f4f33 req-4b5f523a-1b24-45b8-9d3e-8dd486a089ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169382 Aug 30 03:38:07.438798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1471/2923] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:07.455069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.455880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.460693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.461889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.462902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.467550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.700548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:07.703409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:07.723874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.724374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.726471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.727510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.730134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.732370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.750796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:07.770147 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a58a483c-5634-4193-a122-68c24e635d07 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.362417 Aug 30 03:38:07.771090 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1453/2924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:07 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:07.811028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:07.811699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:07.812301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:07.812916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lazy-loading 'fault' on Instance uuid 4201312f-7911-4558-ba51-701afafeea27 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:38:07.866721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147195c1f0cd4e2db5394323583afa92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c588323936a43ddaa305a1a71354065', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:07.878298 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d969cfb4-a9d1-41b0-a333-b42e289853a9 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 200 len: 1313 microversion: 2.1 time: 0.183615 Aug 30 03:38:07.879490 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1472/2925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:07 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:07.983316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:07.987626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.010421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.012103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.012580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.014605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.015086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.015528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.082040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9824064-5802-45cd-9526-614b55fdbe8d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109751 Aug 30 03:38:08.082920 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1454/2926] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:38:07 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:08.095048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:08.095545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.110831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.111343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.111778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.112480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.112922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.113336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.131636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:08.132465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.153145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.156721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.158692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.161528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.164719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.166729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.323320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lazy-loading 'services' on Instance uuid 759deeae-beb8-4920-901b-9bdf27637178 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:38:08.502438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:08.526903 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-807bc885-29a9-445c-a8d7-54ba494629f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.396930 Aug 30 03:38:08.543281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b3e37b8-4f48-46ce-a103-8db2d4b1c3c1 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments/e4da5b3d-34c5-49ca-b1a9-3a9e8ad68aa2" status: 202 len: 0 microversion: 2.1 time: 0.452932 Aug 30 03:38:08.547500 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1473/2927] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:38:08 2022] DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments/e4da5b3d-34c5-49ca-b1a9-3a9e8ad68aa2 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:08.549521 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1455/2928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:08 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:08.577944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-107f355c-6f36-4595-af63-19baea4d8d86 req-f019712e-b8e7-420b-84ee-eac3be97372e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca", "name": "network-vif-plugged", "status": "completed", "tag": "ba46763b-9226-42ff-a57c-48533a857bc7"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:08.584587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:08.589093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.620412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.623279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.624104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.627212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.627825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-107f355c-6f36-4595-af63-19baea4d8d86 req-f019712e-b8e7-420b-84ee-eac3be97372e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.628484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.629141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-107f355c-6f36-4595-af63-19baea4d8d86 req-f019712e-b8e7-420b-84ee-eac3be97372e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.630314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-107f355c-6f36-4595-af63-19baea4d8d86 req-f019712e-b8e7-420b-84ee-eac3be97372e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.635677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.664127 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-107f355c-6f36-4595-af63-19baea4d8d86 req-f019712e-b8e7-420b-84ee-eac3be97372e service nova] Creating event network-vif-plugged:ba46763b-9226-42ff-a57c-48533a857bc7 for instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca on n-h2-854924-5 Aug 30 03:38:08.673844 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-107f355c-6f36-4595-af63-19baea4d8d86 req-f019712e-b8e7-420b-84ee-eac3be97372e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122284 Aug 30 03:38:08.675168 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1456/2929] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:08.677072 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 HTTP/1.1 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '99e74adc-c2ac-414c-a28f-8988acf80515'} Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:08.679846 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:08.685728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff5153ff-3e9d-4f4e-bc1c-4ed0a355d742 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 404 len: 111 microversion: 2.1 time: 0.132052 Aug 30 03:38:08.707395 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1474/2930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:08 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:08.708501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:08.713918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fbaeb02b-af48-4651-be3e-7cb39ecc15ee req-c61f70b9-d456-415f-805b-d0e29a42b393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e74adc-c2ac-414c-a28f-8988acf80515", "name": "network-vif-deleted", "tag": "b853b5d7-3fa6-419d-929c-d0ed28bbbc01"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:08.716626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.730096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.731112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.731569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.736796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.739271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.742878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.749622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fbaeb02b-af48-4651-be3e-7cb39ecc15ee req-c61f70b9-d456-415f-805b-d0e29a42b393 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.751376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fbaeb02b-af48-4651-be3e-7cb39ecc15ee req-c61f70b9-d456-415f-805b-d0e29a42b393 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.751909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fbaeb02b-af48-4651-be3e-7cb39ecc15ee req-c61f70b9-d456-415f-805b-d0e29a42b393 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.792273 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fbaeb02b-af48-4651-be3e-7cb39ecc15ee req-c61f70b9-d456-415f-805b-d0e29a42b393 service nova] Creating event network-vif-deleted:b853b5d7-3fa6-419d-929c-d0ed28bbbc01 for instance 99e74adc-c2ac-414c-a28f-8988acf80515 on n-h1-854924-5 Aug 30 03:38:08.805152 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fbaeb02b-af48-4651-be3e-7cb39ecc15ee req-c61f70b9-d456-415f-805b-d0e29a42b393 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094810 Aug 30 03:38:08.810365 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1475/2931] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:08.824517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:08.825232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.833327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.834350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.835072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.835782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lazy-loading 'fault' on Instance uuid 8779a51b-60a6-4613-9000-8457ee7d8860 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:38:08.839699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.843618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.844077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.844798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.857049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.858927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.905171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765c0a336f1742378782776c586a21ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f087142847e24d46a189056d9718e4e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:08.916258 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-043491d5-ba67-48b9-9e26-13ab6b979461 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 200 len: 1282 microversion: 2.1 time: 0.238067 Aug 30 03:38:08.916987 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1457/2932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:08 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 1282 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:08.922609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:08.923467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:08.936358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.948598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.950152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:08.951754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:08.952194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:08.952964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.308620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:09.344507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-213e298d-44ee-4019-b6df-3ba502e925f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.530987 Aug 30 03:38:09.347336 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1476/2933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:08 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:09.360817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:09.384160 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2552c4f-4415-470a-aed5-8a3526e7e35b tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.465466 Aug 30 03:38:09.398135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:09.399136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] [instance: 4201312f-7911-4558-ba51-701afafeea27] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:09.399559 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1458/2934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:08 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:09.434514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.439058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.439959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.456713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ab668ccf-589a-4a4b-8068-755c73a3b428 req-746e1f17-283b-4051-aeaf-d6f946b04420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4201312f-7911-4558-ba51-701afafeea27", "name": "network-vif-deleted", "tag": "938bb9bd-97b1-46a6-abba-0a0da532f202"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:09.463772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.464527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.465206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.502540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ab668ccf-589a-4a4b-8068-755c73a3b428 req-746e1f17-283b-4051-aeaf-d6f946b04420 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.504876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ab668ccf-589a-4a4b-8068-755c73a3b428 req-746e1f17-283b-4051-aeaf-d6f946b04420 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.513000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ab668ccf-589a-4a4b-8068-755c73a3b428 req-746e1f17-283b-4051-aeaf-d6f946b04420 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.534828 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] HTTP exception thrown: Instance 4201312f-7911-4558-ba51-701afafeea27 could not be found. Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Request method failure captured: Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 HTTP/1.1 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYX69zz-7vnER4httnPJMB_SkDe5jfS-pVtaHI03hemYEJaA6irGD7YpXqztkKjAmxtxcv_CpuBfd7TbzvyJClxswzqtveeiZSOLUV7dcW8TJJ0UNr42tK3ox6UT1K9Veox_iBgoe7qpxhy_DwAzqgpV_l793BSemidg_iIc1wkX2TA Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 2c588323936a43ddaa305a1a71354065 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-987245132 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2c588323936a43ddaa305a1a71354065"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2c588323936a43ddaa305a1a71354065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2c588323936a43ddaa305a1a71354065", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2c588323936a43ddaa305a1a71354065"}]}] Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-987245132 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 2c588323936a43ddaa305a1a71354065 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-987245132 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiagnosticsNegativeTest-987245132-project Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 147195c1f0cd4e2db5394323583afa92 Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-987245132-project Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 4201312f-7911-4558-ba51-701afafeea27 could not be found. Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '4201312f-7911-4558-ba51-701afafeea27'} Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4201312f-7911-4558-ba51-701afafeea27 could not be found. Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4201312f-7911-4558-ba51-701afafeea27 could not be found. Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.537706 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4201312f-7911-4558-ba51-701afafeea27 could not be found. Aug 30 03:38:09.542684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.543380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] Returning 404 to user: Instance 4201312f-7911-4558-ba51-701afafeea27 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:09.545275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ec7fb9f-f22e-411c-bc50-243d9a3fda11 tempest-ServerDiagnosticsNegativeTest-987245132 tempest-ServerDiagnosticsNegativeTest-987245132-project] 10.222.0.30 "GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27" status: 404 len: 111 microversion: 2.1 time: 0.196550 Aug 30 03:38:09.548235 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1477/2935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:09 2022] GET /compute/v2.1/servers/4201312f-7911-4558-ba51-701afafeea27 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:09.552233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ab668ccf-589a-4a4b-8068-755c73a3b428 req-746e1f17-283b-4051-aeaf-d6f946b04420 service nova] Creating event network-vif-deleted:938bb9bd-97b1-46a6-abba-0a0da532f202 for instance 4201312f-7911-4558-ba51-701afafeea27 on n-h1-854924-5 Aug 30 03:38:09.558473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:09.559091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:09.572910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ab668ccf-589a-4a4b-8068-755c73a3b428 req-746e1f17-283b-4051-aeaf-d6f946b04420 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123828 Aug 30 03:38:09.573553 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1459/2936] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:38:09.591418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.591918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.592354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.593160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.593671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.594089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.641027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34aeb196-3bb6-4700-bd77-33858a2585ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34aeb196-3bb6-4700-bd77-33858a2585ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 163 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": 12345, "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 12345 Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:09.645681 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34aeb196-3bb6-4700-bd77-33858a2585ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:09.656214 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34aeb196-3bb6-4700-bd77-33858a2585ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011876 Aug 30 03:38:09.661151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1460/2937] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:09 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:38:09.680404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:09.685217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:09.708555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.712156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.713963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.716802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:09.717769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:09.720356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:09.852314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:09.966571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:10.064006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:10.073137 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-386a126b-1e50-4c72-8ba4-544f1fd0274b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.522953 Aug 30 03:38:10.077383 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1478/2938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:09 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:10.084178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:10.089950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] [instance: 8779a51b-60a6-4613-9000-8457ee7d8860] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:10.109986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:10.113167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:10.113702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:10.114646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:10.116419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:10.118235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:10.147231 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] HTTP exception thrown: Instance 8779a51b-60a6-4613-9000-8457ee7d8860 could not be found. Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Request method failure captured: Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 HTTP/1.1 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYS6wLi0p42VxeOj0pXRsoRFD8-8eeXuf9OrRmNwZDmpvCDAhfdyBeWKib8PYBXrJoWrfEfgw9eM0UOO1asqSFsz9VKEJmJui5LlbvqpWUg6LV6RVdy_UF9_L8XZJXJFOQNgls7bdtyGy-9OyETd6CWMRDI6sHHBfEf1yKZ76OPfRWE Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f087142847e24d46a189056d9718e4e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f087142847e24d46a189056d9718e4e7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f087142847e24d46a189056d9718e4e7"}]}] Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-1703417431 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f087142847e24d46a189056d9718e4e7 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-1703417431 Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-1703417431-project Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 765c0a336f1742378782776c586a21ba Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-1703417431-project Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 8779a51b-60a6-4613-9000-8457ee7d8860 could not be found. Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '8779a51b-60a6-4613-9000-8457ee7d8860'} Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8779a51b-60a6-4613-9000-8457ee7d8860 could not be found. Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8779a51b-60a6-4613-9000-8457ee7d8860 could not be found. Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:10.149185 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8779a51b-60a6-4613-9000-8457ee7d8860 could not be found. Aug 30 03:38:10.153659 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:10.158345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] Returning 404 to user: Instance 8779a51b-60a6-4613-9000-8457ee7d8860 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:10.165623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:10.165800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-73ede00a-ea9a-46d2-8e84-645ebd2d9938 tempest-ServersTestJSON-1703417431 tempest-ServersTestJSON-1703417431-project] 10.222.0.30 "GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860" status: 404 len: 111 microversion: 2.1 time: 0.085752 Aug 30 03:38:10.166279 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1479/2939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:10 2022] GET /compute/v2.1/servers/8779a51b-60a6-4613-9000-8457ee7d8860 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:10.181469 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d630cb49-23b5-4dda-8a08-3ed636cc0561 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.517007 Aug 30 03:38:10.214536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1461/2940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:09 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:10.215003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:10.215625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:10.229999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:10.230494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:10.230931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:10.231640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:10.232208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:10.232512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:10.410094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:10.410721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:10.425762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:10.426251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:10.428514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:10.430097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:10.432318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:10.433017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:10.533968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:10.547269 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a71bbaf-1e54-45bc-9561-d71a8006d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.336061 Aug 30 03:38:10.558681 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1480/2941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:10 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:10.691153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:10.762920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:10.772689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca5a6ef2-4951-453c-8eb0-47842cc70e58 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1307 microversion: 2.1 time: 0.368585 Aug 30 03:38:10.773209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1462/2942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:10 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:11.101651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:11.102539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:11.117097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:11.117927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:11.122561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:11.123626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:11.124265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:11.124858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:11.799533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:11.800173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:11.809033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:11.820561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:11.821269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:11.822225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:11.822893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:11.825751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:12.165332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:12.175465 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-afdcc4da-d39f-47c2-bb95-7e2ed05cca8b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 1.079184 Aug 30 03:38:12.189388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1481/2943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:11 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:12.296737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:12.323595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ed494c9-16f6-45d7-95a0-afb23fcca067 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1488 microversion: 2.1 time: 0.534603 Aug 30 03:38:12.344441 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1463/2944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:11 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1488 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:12.369867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1471066282"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:12.382341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:12.398525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:12.399847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:12.402675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:12.405837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:12.406534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:12.407147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:12.843729 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e86be09-7f2d-4968-905c-ad4ed1763dde tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "POST /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca/action" status: 202 len: 0 microversion: 2.1 time: 0.478500 Aug 30 03:38:12.845067 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1482/2945] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:12 2022] POST /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:38:12.859367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58f9e78e-220f-48a2-b4fa-98b16aeb58b8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b758940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:12.949810 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-58f9e78e-220f-48a2-b4fa-98b16aeb58b8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2" status: 200 len: 1414 microversion: 2.1 time: 0.095764 Aug 30 03:38:12.954180 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1464/2946] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:38:12 2022] GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:12.968727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a49fa3a4-5558-4ce7-91ea-bc7e539891ac tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897abde160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:13.031704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a49fa3a4-5558-4ce7-91ea-bc7e539891ac tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2" status: 200 len: 1414 microversion: 2.1 time: 0.067170 Aug 30 03:38:13.032657 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1483/2947] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:38:12 2022] GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 => generated 1414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:13.051079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6cc8f1fd-de62-43a2-a300-bc7b06b65d98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b7ca1f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:13.202847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:13.203768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:13.223100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:13.243859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:13.251132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:13.252108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:13.259476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:13.260109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:13.341181 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6cc8f1fd-de62-43a2-a300-bc7b06b65d98 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2" status: 204 len: 0 microversion: 2.1 time: 0.296504 Aug 30 03:38:13.341840 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1465/2948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:13 2022] DELETE /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:13.350577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a1bb5a0-6ef9-415a-9167-91900acd265f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897b7d60d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:13.416789 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-1a1bb5a0-6ef9-415a-9167-91900acd265f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Image not found. Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a1bb5a0-6ef9-415a-9167-91900acd265f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 HTTP/1.1 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: exception: Image not found. Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '8ce59173-82ee-4543-b7a4-0802cf8e34b2'} Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8ce59173-82ee-4543-b7a4-0802cf8e34b2 Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 03:38:13.419631 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ce59173-82ee-4543-b7a4-0802cf8e34b2 could not be found. Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:38:13.424789 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:13.437887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a1bb5a0-6ef9-415a-9167-91900acd265f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Image not found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:13.440941 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a1bb5a0-6ef9-415a-9167-91900acd265f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2" status: 404 len: 62 microversion: 2.1 time: 0.094913 Aug 30 03:38:13.442761 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1466/2949] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:38:13 2022] GET /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:38:13.456509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:13.457453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:13.474560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:13.475882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:13.476626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:13.477608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:13.478237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:13.478919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:13.726362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:13.756766 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cec1f7fc-fdd1-40db-9cf1-409c9184a719 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.557545 Aug 30 03:38:13.765559 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1484/2950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:13 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:14.124357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5666532c-e2a2-453b-be80-5ebe36ac1be7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1591671413", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "634be257-84d0-4a19-ad98-46d950cfc8c9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:14.250284 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5666532c-e2a2-453b-be80-5ebe36ac1be7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Block Device 634be257-84d0-4a19-ad98-46d950cfc8c9 is not bootable. Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5666532c-e2a2-453b-be80-5ebe36ac1be7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 358 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1591671413", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "634be257-84d0-4a19-ad98-46d950cfc8c9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: exception: Block Device 634be257-84d0-4a19-ad98-46d950cfc8c9 is not bootable. Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1591671413', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '634be257-84d0-4a19-ad98-46d950cfc8c9'}], 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 634be257-84d0-4a19-ad98-46d950cfc8c9 is not bootable. Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:14.260841 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 634be257-84d0-4a19-ad98-46d950cfc8c9 is not bootable. Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 634be257-84d0-4a19-ad98-46d950cfc8c9 is not bootable. Aug 30 03:38:14.264748 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:14.270383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5666532c-e2a2-453b-be80-5ebe36ac1be7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Block Device 634be257-84d0-4a19-ad98-46d950cfc8c9 is not bootable. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:14.271566 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5666532c-e2a2-453b-be80-5ebe36ac1be7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.151115 Aug 30 03:38:14.272946 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1485/2951] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:14 2022] POST /compute/v2.1/servers => generated 110 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:14.283101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:14.284345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:14.304042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:14.305231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:14.306379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:14.307607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:14.308253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:14.308777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:14.376950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:14.393069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a712dfd-8ecc-4a3c-b1d0-7389ddc65e46 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1500 microversion: 2.1 time: 0.940979 Aug 30 03:38:14.396101 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1467/2952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:13 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1500 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:14.796365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:14.796998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:14.805019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:14.805557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:14.806005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:14.806725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:14.807178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:14.819335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:15.597486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:15.615983 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df2205cb-df3c-49f4-9a42-533cb40bdf84 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.337410 Aug 30 03:38:15.618568 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1486/2953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:14 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:15.631421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:15.632747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:15.654816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:15.657334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:15.657998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:15.660225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:15.662742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:15.663405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:16.039623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:16.046911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:16.056404 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7578cc7d-7e20-426b-814c-c384167c71cb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 1.263958 Aug 30 03:38:16.085748 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1468/2954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:14 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:16.093030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:16.107883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:16.123495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:16.129959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:16.131290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:16.132738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:16.133399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:16.134174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:16.826400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:16.839183 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f7adecd-d326-434a-a520-6bb3c41f7dc8 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1506 microversion: 2.1 time: 1.219222 Aug 30 03:38:16.848523 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1487/2955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:15 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1506 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:16.860242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f92aff02-317d-4cc7-9a2e-4315b6633b0f req-275d4551-d538-4a09-be95-5f9128a5b6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb1e090-dbc1-44bc-8496-ee675e4960f0", "name": "network-vif-plugged", "status": "completed", "tag": "4e894a78-6f20-4251-8646-5dc37f92d806"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:16.886795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f92aff02-317d-4cc7-9a2e-4315b6633b0f req-275d4551-d538-4a09-be95-5f9128a5b6b9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:16.897094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f92aff02-317d-4cc7-9a2e-4315b6633b0f req-275d4551-d538-4a09-be95-5f9128a5b6b9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:16.897705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f92aff02-317d-4cc7-9a2e-4315b6633b0f req-275d4551-d538-4a09-be95-5f9128a5b6b9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:16.932288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f92aff02-317d-4cc7-9a2e-4315b6633b0f req-275d4551-d538-4a09-be95-5f9128a5b6b9 service nova] Creating event network-vif-plugged:4e894a78-6f20-4251-8646-5dc37f92d806 for instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 on n-h2-854924-5 Aug 30 03:38:16.947198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f92aff02-317d-4cc7-9a2e-4315b6633b0f req-275d4551-d538-4a09-be95-5f9128a5b6b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097317 Aug 30 03:38:16.952919 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1488/2956] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:16.962670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:16.976609 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2ce9650-114d-4043-9ca0-bf8b69096fc7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.884615 Aug 30 03:38:16.977636 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1469/2957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:16 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:17.105506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:17.106365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:17.128092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:17.131064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:17.135075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:17.137191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:17.143755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:17.145188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:17.939719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:17.953214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e847a857-81ae-4d90-b1ce-73140638dbed tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1315 microversion: 2.1 time: 0.872364 Aug 30 03:38:17.958325 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1489/2958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:17 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:17.969926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:17.973208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:17.986999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:17.989417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:17.990120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:17.992694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:17.993416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:17.996793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:18.008759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1572822201", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:18.119433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:38:19.111487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:19.120823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:19.135998 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f0e51b28-702f-4db1-b486-f6d419c673ef tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1488 microversion: 2.1 time: 1.175552 Aug 30 03:38:19.140153 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1490/2959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:17 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1488 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:19.168142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:19.168142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:19.190514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.198730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.199576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.200671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.201395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.202037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.232254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:38:19.232765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:38:19.233223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:38:19.233678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:38:19.234060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:38:19.252983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.254767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.255377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.258087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.258577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.259004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.310554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:19.325152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:19.350768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:38:19.364352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:38:19.455839 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7bbb7e0e-99a2-4223-9d05-ee2a428bbddd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634021 Aug 30 03:38:19.456482 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1470/2960] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:38:19.471190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:19.473337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:19.484024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:19.490479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:19.492081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.494598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.495526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.496126 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffa0a521-2f47-4f86-91ce-9fff867cd9a7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1502 microversion: 2.1 time: 0.354662 Aug 30 03:38:19.497788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.498444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.499059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.501685 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1491/2961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:19 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:19.508003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:19.511061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:19.539765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.540891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.542252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.545737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.546452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.547076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.599124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:38:19.624305 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-97150f19-8bcd-44d9-bcdd-b51104f9667b tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120961 Aug 30 03:38:19.625408 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1492/2962] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:38:19 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:19.638480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddbae7f1-8166-43cb-9587-986725372535 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:19.644632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ddbae7f1-8166-43cb-9587-986725372535 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:19.827566 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03beb597-d6b3-471f-9419-18c43b4b5edc tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 204 len: 0 microversion: 2.1 time: 0.364637 Aug 30 03:38:19.834528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1471/2963] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:19 2022] DELETE /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:19.844067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:19.847918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:19.866325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.867017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.867707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.868568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:19.869372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:19.870049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:19.977296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ddbae7f1-8166-43cb-9587-986725372535 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:19.986704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddbae7f1-8166-43cb-9587-986725372535 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1217 microversion: 2.1 time: 0.352810 Aug 30 03:38:19.987326 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1493/2964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:19 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1217 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:20.007990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c343dc8a-cce1-4bf0-887b-11c1bf17e407 req-25e6596e-f555-43e1-88b5-d068553ed96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca", "name": "network-vif-plugged", "status": "completed", "tag": "ba46763b-9226-42ff-a57c-48533a857bc7"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:20.041650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c343dc8a-cce1-4bf0-887b-11c1bf17e407 req-25e6596e-f555-43e1-88b5-d068553ed96a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.051916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c343dc8a-cce1-4bf0-887b-11c1bf17e407 req-25e6596e-f555-43e1-88b5-d068553ed96a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.052690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c343dc8a-cce1-4bf0-887b-11c1bf17e407 req-25e6596e-f555-43e1-88b5-d068553ed96a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:20.085129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c343dc8a-cce1-4bf0-887b-11c1bf17e407 req-25e6596e-f555-43e1-88b5-d068553ed96a service nova] Creating event network-vif-plugged:ba46763b-9226-42ff-a57c-48533a857bc7 for instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca on n-h2-854924-5 Aug 30 03:38:20.100848 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c343dc8a-cce1-4bf0-887b-11c1bf17e407 req-25e6596e-f555-43e1-88b5-d068553ed96a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102741 Aug 30 03:38:20.106674 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1494/2965] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:20.115457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:20.127347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:20.139793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.141977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.142556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:20.153671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.154228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.154745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:20.252552 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42fb758d-ef16-40c8-9c26-38224ebdcc7d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140889 Aug 30 03:38:20.254488 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1495/2966] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:38:20 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:20.280214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27904c50-1ca4-445a-9eb7-b5d184edae18 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f8983b33040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:20.351508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-27904c50-1ca4-445a-9eb7-b5d184edae18 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Image not found. Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27904c50-1ca4-445a-9eb7-b5d184edae18 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 HTTP/1.1 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '8ce59173-82ee-4543-b7a4-0802cf8e34b2'} Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8ce59173-82ee-4543-b7a4-0802cf8e34b2 to delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ce59173-82ee-4543-b7a4-0802cf8e34b2 could not be found. Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.353546 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27904c50-1ca4-445a-9eb7-b5d184edae18 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:20.358056 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27904c50-1ca4-445a-9eb7-b5d184edae18 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2" status: 404 len: 62 microversion: 2.1 time: 0.099758 Aug 30 03:38:20.361765 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1496/2967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:20 2022] DELETE /compute/v2.1/images/8ce59173-82ee-4543-b7a4-0802cf8e34b2 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:38:20.374498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea03d836-b6b3-4e9d-a2e6-61998ac9ac16 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941809430", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "destination_type": "local"}, {"source_type": "volume", "uuid": "ef2d2eb7-ef72-46eb-a804-7b61cc01b337", "destination_type": "invalid"}], "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea03d836-b6b3-4e9d-a2e6-61998ac9ac16 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 494 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941809430", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "destination_type": "local"}, {"source_type": "volume", "uuid": "ef2d2eb7-ef72-46eb-a804-7b61cc01b337", "destination_type": "invalid"}], "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-941809430', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ef2d2eb7-ef72-46eb-a804-7b61cc01b337', 'destination_type': 'invalid'}], 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:20.409312 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea03d836-b6b3-4e9d-a2e6-61998ac9ac16 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea03d836-b6b3-4e9d-a2e6-61998ac9ac16 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.047970 Aug 30 03:38:20.413224 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1497/2968] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:20 2022] POST /compute/v2.1/servers => generated 155 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:20.438469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:20.441384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:20.450023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.450605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.451106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:20.451879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.452399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.452941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:20.536597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:38:20.669061 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.compute.api [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Instance is already in deleting state, ignoring this request Aug 30 03:38:20.671850 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13abbcd1-4407-4866-ab0e-1b97d025958f tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 204 len: 0 microversion: 2.1 time: 0.244222 Aug 30 03:38:20.676264 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1498/2969] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:20 2022] DELETE /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:20.687258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:20.688915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:20.716882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.718379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.719219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:20.722283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:20.725271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:20.728111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.179974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:21.192518 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd37fd13-1f47-495f-b355-f96a638de607 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.514692 Aug 30 03:38:21.204756 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1499/2970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:20 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:21.216902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:21.217470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:21.228282 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d9cd81b-e943-4de7-b235-f68948a404e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 1.390843 Aug 30 03:38:21.233115 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1472/2971] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:19 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:21.246788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.247294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.247732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.248520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.248971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.251847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.257129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:21.257890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:21.271632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.272139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.272584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.273309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.282174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.282639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.344393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:38:21.507511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:21.548432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33db94c2-c96e-4601-85b8-bffb40c642e8 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 204 len: 0 microversion: 2.1 time: 0.341313 Aug 30 03:38:21.551528 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1500/2972] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:21 2022] DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:38:21.566819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:21.567837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:21.595118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:21.599836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.602893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.606957 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c034c549-c31a-4a13-90c8-6d0125d5cbdf tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1494 microversion: 2.1 time: 0.371602 Aug 30 03:38:21.607855 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1473/2973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:21 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1494 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:21.613066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:21.613233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.613936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.614402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.614658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:21.614887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.632439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.633936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.636038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.638811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.640210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.641702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.823537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:21.836470 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74fe8a9f-18fa-4543-acc5-cd602f76bb52 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1269 microversion: 2.1 time: 0.283454 Aug 30 03:38:21.837066 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1501/2974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:21 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:21.850043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:21.869891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:21.885891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.886797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.887552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:21.888460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:21.889086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:21.890333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:22.189704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:22.201943 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b03092d-9521-4acd-bde1-2cad44096640 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.592755 Aug 30 03:38:22.206357 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1474/2975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:21 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:22.240593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:22.242974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:22.263288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:22.263792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:22.264229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:22.264942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:22.265414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:22.266016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:22.335238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:22.343275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f790c65-a6ee-43e7-aecc-6d43e55bf072 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1678 microversion: 2.1 time: 0.503900 Aug 30 03:38:22.343857 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1502/2976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:21 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1678 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:22.361748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d277d4e4-e035-4a3a-8dec-ed4951468bbb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-844177482", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d277d4e4-e035-4a3a-8dec-ed4951468bbb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 491 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-844177482", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-844177482', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.367105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 03:38:22.370777 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:22.373678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d277d4e4-e035-4a3a-8dec-ed4951468bbb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:22.374702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d277d4e4-e035-4a3a-8dec-ed4951468bbb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.029938 Aug 30 03:38:22.375748 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1503/2977] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:22 2022] POST /compute/v2.1/servers => generated 624 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:22.383790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:22.384651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:22.392552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:22.393048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:22.398853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:22.400274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:22.401010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:22.401727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:22.793130 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16372491-3e09-4ab8-9df2-0485efb13c15 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.556873 Aug 30 03:38:22.794492 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1475/2978] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:22 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:38:22.800216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:22.801018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:22.842726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:22.843382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:22.845845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:22.846600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:22.847253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:22.847849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:23.140199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:23.149481 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3009beeb-a3ce-4995-8bdc-a38999881118 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.769488 Aug 30 03:38:23.159138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1504/2979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:22 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:23.170606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:23.171628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:23.191349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:23.191782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:23.194596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:23.197270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:23.198689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:23.199409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:23.336435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:23.341684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:23.350965 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4f8364dd-c58d-48d8-bf01-34847a017024 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1494 microversion: 2.1 time: 0.554916 Aug 30 03:38:23.353721 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a80360c9-e288-465b-a184-96cd17acfd57 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1275 microversion: 2.1 time: 0.188730 Aug 30 03:38:23.356623 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1505/2980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:23 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:23.369929 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1476/2981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:22 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1494 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:23.373642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:23.374461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:23.375772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:23.376826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:23.387146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:23.387642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:23.389054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:23.391706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:23.393439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:23.394297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:23.394429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:23.395049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:23.395470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:23.398216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:23.399221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:23.399881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.393306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:24.407730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b72b9289-58b1-4fa7-8da8-bccd1bcc2204 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.048616 Aug 30 03:38:24.409123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1506/2982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:23 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:24.416763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:24.419647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:24.420288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:24.429573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.431174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.431880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.432818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.433720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.434368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.438737 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7ee9b370-010d-4f43-9732-a4df851ce279 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1678 microversion: 2.1 time: 1.067316 Aug 30 03:38:24.460771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1477/2983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:23 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1678 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:24.490670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e4fd3809-437f-4d99-8137-c3581c4e45b2 req-6f24e02f-d96b-41b0-8c93-4b5ed50774e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca", "name": "network-vif-deleted", "tag": "ba46763b-9226-42ff-a57c-48533a857bc7"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:24.538655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e4fd3809-437f-4d99-8137-c3581c4e45b2 req-6f24e02f-d96b-41b0-8c93-4b5ed50774e8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.539145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e4fd3809-437f-4d99-8137-c3581c4e45b2 req-6f24e02f-d96b-41b0-8c93-4b5ed50774e8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.547086 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d1d21f85-1dfc-4690-ba17-8d6f8f5b7dcf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.136239 Aug 30 03:38:24.548432 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1507/2984] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:24 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:24.552127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e4fd3809-437f-4d99-8137-c3581c4e45b2 req-6f24e02f-d96b-41b0-8c93-4b5ed50774e8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.558320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:24.562834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:24.582849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.584710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.585460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.588111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.588843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.590501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.601893 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e4fd3809-437f-4d99-8137-c3581c4e45b2 req-6f24e02f-d96b-41b0-8c93-4b5ed50774e8 service nova] Creating event network-vif-deleted:ba46763b-9226-42ff-a57c-48533a857bc7 for instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca on n-h2-854924-5 Aug 30 03:38:24.636442 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e4fd3809-437f-4d99-8137-c3581c4e45b2 req-6f24e02f-d96b-41b0-8c93-4b5ed50774e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167031 Aug 30 03:38:24.649914 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1478/2985] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:24.656900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:24.658704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:24.680590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.681585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.683583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.684592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lazy-loading 'fault' on Instance uuid 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:38:24.702378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.702893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.703332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.706317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.708079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.708900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.857078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd4bfb488c475dac2862ea5df0fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54084d3ce364898bae3dc8d2f257ceb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:24.866398 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-634f84dc-7c85-487e-a201-e0a33ebb6ce5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 200 len: 1297 microversion: 2.1 time: 0.316293 Aug 30 03:38:24.868170 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1508/2986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:24 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 1297 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:24.887418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-524d13a7-c691-43b2-8d10-74e6e6d42176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-524d13a7-c691-43b2-8d10-74e6e6d42176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 416 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.891738 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:38:24.895640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:24.901170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-524d13a7-c691-43b2-8d10-74e6e6d42176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:24.902483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-524d13a7-c691-43b2-8d10-74e6e6d42176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028436 Aug 30 03:38:24.903617 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1509/2987] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:24 2022] POST /compute/v2.1/servers => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:24.917004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:24.919020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:24.935758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.936329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.936779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.937603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:24.938105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:24.938538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:24.951845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:25.021558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:25.039725 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc7c4b83-6fbd-45e5-9554-16321be493e4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1275 microversion: 2.1 time: 0.388232 Aug 30 03:38:25.040789 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1479/2988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:24 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1275 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:25.464910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:25.466370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:25.472716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:25.473651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:25.474835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:25.475782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:25.476509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:25.477149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:25.611373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:25.626962 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58232edd-d3e5-4f5e-9e1d-6d561ee77e0e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.718957 Aug 30 03:38:25.628799 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1510/2989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:24 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:25.638565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:25.642837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:25.654661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:25.655974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:25.658171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:25.664643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:25.665792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:25.666545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:25.750136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc521750-5103-4f9c-bc11-14a9dc6dea35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.118529 Aug 30 03:38:25.751247 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1511/2990] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:25 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:25.758293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:25.759593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:25.774920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:25.775698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:25.778144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:25.779695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:25.780704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:25.781821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.027280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:26.043350 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54f61968-9c90-4c12-a901-f590acfc4a48 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1678 microversion: 2.1 time: 0.581918 Aug 30 03:38:26.047504 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1480/2991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:25 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1678 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:26.057542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:26.058813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:26.067721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.069530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.070336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.071406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.072214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.072872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.093722 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca could not be found. Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca HTTP/1.1 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca could not be found. Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca'} Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca could not be found. Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca could not be found. Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.096162 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.100970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:26.100970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:26.100970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:26.100970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:26.100970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca could not be found. Aug 30 03:38:26.100970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.105077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance 50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:26.106759 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5dbf6ab0-7202-4b0b-9bdb-f4ce11c485f6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca" status: 404 len: 111 microversion: 2.1 time: 0.057294 Aug 30 03:38:26.115886 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1481/2992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:26 2022] GET /compute/v2.1/servers/50c57dd8-14c7-4bc7-b0d5-a31fbfd1d2ca => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:26.129805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:26.133679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:26.148264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.150733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.151228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.152158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.152674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.153109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.746420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:26.759512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-75b5a800-93b1-475a-b6ce-0c58dd2f732c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.006718 Aug 30 03:38:26.761030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1512/2993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:25 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:26.769627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-639b10fa-5f0a-4d07-8588-e53eac76b183 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897abaeaf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:26.812726 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-639b10fa-5f0a-4d07-8588-e53eac76b183 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Image not found. Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-639b10fa-5f0a-4d07-8588-e53eac76b183 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 HTTP/1.1 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'ffb1ed62-badb-4a98-9eb0-ea98935fe971'} Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ffb1ed62-badb-4a98-9eb0-ea98935fe971 to delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ffb1ed62-badb-4a98-9eb0-ea98935fe971 could not be found. Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.815419 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-639b10fa-5f0a-4d07-8588-e53eac76b183 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-639b10fa-5f0a-4d07-8588-e53eac76b183 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971" status: 404 len: 62 microversion: 2.1 time: 0.056344 Aug 30 03:38:26.820901 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1513/2994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:26 2022] DELETE /compute/v2.1/images/ffb1ed62-badb-4a98-9eb0-ea98935fe971 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:38:26.844745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:26.853448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:26.861479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.862091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.862896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.864432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.866225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.867188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.921168 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a3788d5-eb3f-404a-9d8c-4a4436f6fbbd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.099393 Aug 30 03:38:26.925389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1514/2995] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:26 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:26.933641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:26.934758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:26.943789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.948525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.949074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.950016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:26.951900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:26.953719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:26.984066 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab HTTP/1.1 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e8978264-05e7-42a1-8232-bc6575cdd4ab'} Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:26.986165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:26.990573 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:26.993482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:26.996469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-379a26c9-24a5-4c7b-a728-1c897ba28234 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 404 len: 111 microversion: 2.1 time: 0.069608 Aug 30 03:38:26.999030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1515/2996] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:26 2022] DELETE /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:27.000405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:27.015855 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3adb475e-ca46-4efa-8de4-e993405ae515 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.898344 Aug 30 03:38:27.016730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1482/2997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:26 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:27.022140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.027565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: e8978264-05e7-42a1-8232-bc6575cdd4ab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.037954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a65a2aee-dfc2-42f5-82d2-955536590cd7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-201777256", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": -1, "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:27.044711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.045213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.045789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.046503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.046953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.047376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.063767 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a65a2aee-dfc2-42f5-82d2-955536590cd7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Flavor -1 could not be found. Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a65a2aee-dfc2-42f5-82d2-955536590cd7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 205 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-201777256", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": -1, "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: exception: Flavor -1 could not be found. Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-201777256', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': -1, 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:27.065930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a65a2aee-dfc2-42f5-82d2-955536590cd7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.071354 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a65a2aee-dfc2-42f5-82d2-955536590cd7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.062257 Aug 30 03:38:27.073005 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1516/2998] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:26 2022] POST /compute/v2.1/servers => generated 73 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:38:27.077054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:27.078507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab HTTP/1.1 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e8978264-05e7-42a1-8232-bc6575cdd4ab'} Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.078669 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance e8978264-05e7-42a1-8232-bc6575cdd4ab could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.084545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aad56577-1890-459f-814d-17888993a070 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab" status: 404 len: 111 microversion: 2.1 time: 0.062239 Aug 30 03:38:27.101294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.103912 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1483/2999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] GET /compute/v2.1/servers/e8978264-05e7-42a1-8232-bc6575cdd4ab => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:27.109227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.109872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.110088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.111233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.111831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.112778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.113418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.114372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.147963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.148454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.148885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.149605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.150052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.150472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.385473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:27.404152 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-00e17649-cd29-4c57-bf07-6b6c6c95908a tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1611 microversion: 2.1 time: 0.329830 Aug 30 03:38:27.405772 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1517/3000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1611 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:27.412668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d227658-17fe-4dd3-b645-9600106165c6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ab4b9d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.460652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4d227658-17fe-4dd3-b645-9600106165c6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Image not found. Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d227658-17fe-4dd3-b645-9600106165c6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 HTTP/1.1 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8'} Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 to delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 could not be found. Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.462489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d227658-17fe-4dd3-b645-9600106165c6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d227658-17fe-4dd3-b645-9600106165c6 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8" status: 404 len: 62 microversion: 2.1 time: 0.056965 Aug 30 03:38:27.467501 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1518/3001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] DELETE /compute/v2.1/images/7f69d4d1-5e05-45d2-8d18-8fa6dda8f9b8 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:38:27.472024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.473297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.491776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.493121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.494897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.495903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.496767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.504035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.529788 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc HTTP/1.1 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '84a21bb6-011c-42df-89e9-55d0bc3e76cc'} Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:27.534407 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1255e03-2ee9-49c8-ada3-5a1a6d6b6035 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 404 len: 111 microversion: 2.1 time: 0.067560 Aug 30 03:38:27.544307 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1519/3002] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:27 2022] DELETE /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:27.549046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.551360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 84a21bb6-011c-42df-89e9-55d0bc3e76cc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.559256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.559967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.560645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.561571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.562035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.562910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.579143 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc HTTP/1.1 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '84a21bb6-011c-42df-89e9-55d0bc3e76cc'} Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.580872 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance 84a21bb6-011c-42df-89e9-55d0bc3e76cc could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.589543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d10387d3-8a50-487b-b3af-9cf77a70c684 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc" status: 404 len: 111 microversion: 2.1 time: 0.038810 Aug 30 03:38:27.591972 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1520/3003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] GET /compute/v2.1/servers/84a21bb6-011c-42df-89e9-55d0bc3e76cc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:27.596631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08aefab4-6d7e-431e-9c55-58e66ab8d2d5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '.version_select at 0x7f897ab8d0d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.624698 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-08aefab4-6d7e-431e-9c55-58e66ab8d2d5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Image not found. Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08aefab4-6d7e-431e-9c55-58e66ab8d2d5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 HTTP/1.1 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: exception: Image not found. Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '4ac8203f-b619-4671-a0a5-8c75d1bae646'} Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ac8203f-b619-4671-a0a5-8c75d1bae646 to delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ac8203f-b619-4671-a0a5-8c75d1bae646 could not be found. Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.626525 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08aefab4-6d7e-431e-9c55-58e66ab8d2d5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Image not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08aefab4-6d7e-431e-9c55-58e66ab8d2d5 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646" status: 404 len: 62 microversion: 2.1 time: 0.036216 Aug 30 03:38:27.634875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1521/3004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] DELETE /compute/v2.1/images/4ac8203f-b619-4671-a0a5-8c75d1bae646 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:38:27.641925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.642507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.650539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.651849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.652493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.653845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.655442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.655901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.689223 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 HTTP/1.1 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3db50094-5c80-4366-b3d6-2af379db8508'} Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:27.690733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.695907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.697455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.698584 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-24303ef4-3f59-49e7-a8ba-e66e09b666c4 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 404 len: 111 microversion: 2.1 time: 0.061762 Aug 30 03:38:27.699059 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1522/3005] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:27 2022] DELETE /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:27.708254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.708920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] [instance: 3db50094-5c80-4366-b3d6-2af379db8508] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.717942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.718550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.719313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.720406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.721028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.721619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.759614 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] HTTP exception thrown: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Request method failure captured: Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 HTTP/1.1 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUVXX8HoVtCr5dRQUbi_YEiBj4iKWTGny_l6phZq6Kdv89Ouo81Nt-xf3Mljzm8q8hzoHUfKzwL9pyNwXPsyEfKtAZY2NpPxQbnYs04yTqW_OPwZclZWeKeLKtMnxfvIuZJSy24M1ZFXsPaeIi_98Vo_2mn4C2E4eII3kpMZg6myqM Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a54084d3ce364898bae3dc8d2f257ceb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a54084d3ce364898bae3dc8d2f257ceb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a54084d3ce364898bae3dc8d2f257ceb"}]}] Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a54084d3ce364898bae3dc8d2f257ceb Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesTestJSON-1608543806 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cdbd4bfb488c475dac2862ea5df0fe70 Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesTestJSON-1608543806-project Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3db50094-5c80-4366-b3d6-2af379db8508'} Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.761744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] Returning 404 to user: Instance 3db50094-5c80-4366-b3d6-2af379db8508 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:27.766720 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ead0e62b-d197-4d45-b6e6-a650ca8c1e91 tempest-ImagesTestJSON-1608543806 tempest-ImagesTestJSON-1608543806-project] 10.222.0.30 "GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508" status: 404 len: 111 microversion: 2.1 time: 0.061662 Aug 30 03:38:27.768715 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1523/3006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] GET /compute/v2.1/servers/3db50094-5c80-4366-b3d6-2af379db8508 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:27.803834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:27.851659 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7810bad6-c2e1-4701-8083-072afe62a734 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.746215 Aug 30 03:38:27.853575 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1484/3007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:27.876484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:27.877272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.885488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.886147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.886948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.887821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.888283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.888718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.934412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:27.939988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:27.949178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.949890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.950352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:27.951118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:27.951780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:27.952427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.040381 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66349a4d-6ec3-41c0-a64f-2af8919316e0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.109846 Aug 30 03:38:28.044899 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1485/3008] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:27 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:38:28.050693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:28.051564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:28.060904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.061427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.061879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.063187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.063666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.064103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.382319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:28.399396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b18c442-893f-4000-a0a3-f9cb6e609ac1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.528955 Aug 30 03:38:28.413477 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1524/3009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:27 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:28.426719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b31a86f8-2e68-4231-8fa0-5282be683d4e req-12f83c55-32a3-40ed-a4bb-5ffa325561fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759deeae-beb8-4920-901b-9bdf27637178", "name": "network-vif-deleted", "tag": "0cc7510f-0a08-4609-a7ee-f1814e36225d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:28.439242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b31a86f8-2e68-4231-8fa0-5282be683d4e req-12f83c55-32a3-40ed-a4bb-5ffa325561fe service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.441979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b31a86f8-2e68-4231-8fa0-5282be683d4e req-12f83c55-32a3-40ed-a4bb-5ffa325561fe service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.445558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b31a86f8-2e68-4231-8fa0-5282be683d4e req-12f83c55-32a3-40ed-a4bb-5ffa325561fe service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.481925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b31a86f8-2e68-4231-8fa0-5282be683d4e req-12f83c55-32a3-40ed-a4bb-5ffa325561fe service nova] Creating event network-vif-deleted:0cc7510f-0a08-4609-a7ee-f1814e36225d for instance 759deeae-beb8-4920-901b-9bdf27637178 on n-h2-854924-5 Aug 30 03:38:28.524690 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b31a86f8-2e68-4231-8fa0-5282be683d4e req-12f83c55-32a3-40ed-a4bb-5ffa325561fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109667 Aug 30 03:38:28.525868 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1525/3010] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:28.532326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:28.540760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:28.560437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.561156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.561873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.562632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.563201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.563704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.653581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.654313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.655131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.656197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lazy-loading 'fault' on Instance uuid 759deeae-beb8-4920-901b-9bdf27637178 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:38:28.676586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:28.699139 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad213d36-a2af-4b42-bf8c-d513316b0783 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.651274 Aug 30 03:38:28.711661 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1486/3011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:28 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:28.719495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e5a236f-f58d-440e-8940-51c3b23789f8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-247016103", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e5a236f-f58d-440e-8940-51c3b23789f8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 172 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-247016103", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-247016103', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi -1 Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:28.745233 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:28.750700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e5a236f-f58d-440e-8940-51c3b23789f8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:28.754221 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e5a236f-f58d-440e-8940-51c3b23789f8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.048787 Aug 30 03:38:28.756733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1487/3012] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:28 2022] POST /compute/v2.1/servers => generated 145 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:28.776488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:28.778323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:28.800007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.800813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59d52840f644528a11d81621131cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a99877ec344f79a46d640cd2982446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:28.802692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.804159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.807028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:28.807764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:28.809066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:28.816935 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fdc93f9e-1706-4c5e-b537-2194740dc86d tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 200 len: 1330 microversion: 2.1 time: 0.289119 Aug 30 03:38:28.840242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1526/3013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:28 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 1330 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:28.859894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:29.054890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:29.058962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:29.067745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.069190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.069861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.071408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.072036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.072628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.134069 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f29c3c76-24e5-4559-a36f-b5f716c78eaa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.084157 Aug 30 03:38:29.138636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1527/3014] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:29 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:29.268794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:29.287261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:29.291527 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e8e4bbe-273e-4fa9-a3ac-f0039e023f2b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.528842 Aug 30 03:38:29.292737 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1488/3015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:28 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:29.316724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:29.317758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:29.327699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.328699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.329481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.330839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.331460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.332054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.571142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:29.596638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d757f3f-85d5-4c89-8fd0-575d666e6e49 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.284025 Aug 30 03:38:29.598936 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1528/3016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:29.687643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26668520-15c9-4601-a6f6-43f56caae0c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1974092594", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:29.701322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-26668520-15c9-4601-a6f6-43f56caae0c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26668520-15c9-4601-a6f6-43f56caae0c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 216 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1974092594", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1974092594', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:29.703701 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 03:38:29.710033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:29.713537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26668520-15c9-4601-a6f6-43f56caae0c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:29.714842 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26668520-15c9-4601-a6f6-43f56caae0c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033383 Aug 30 03:38:29.718715 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1489/3017] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:29 2022] POST /compute/v2.1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:29.724260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:29.727142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:29.727795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:29.733725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:29.734756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:29.741701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.744121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.744676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.745665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.746674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.746956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.747929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.748201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.748600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.751051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:29.751749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:29.752959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:29.982400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:30.120605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:30.135438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f282203-12aa-469a-a613-62ab8eb5f546 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.415245 Aug 30 03:38:30.136861 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1529/3018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:30.144356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:30.145413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:30.159106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.160458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.161303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.162281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:30.162769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.163799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.164594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.177810 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d6073af-60f6-4e1b-bad2-302293d92df9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.453898 Aug 30 03:38:30.186464 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1490/3019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:29 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:30.186464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:30.189024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:30.196711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.198992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.199650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.200569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.203937 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] HTTP exception thrown: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:30.204952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.205886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Request method failure captured: Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 HTTP/1.1 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYV8Ba_6ZvVZzlLyUgJcjmUW9tyjimT4ZGBoej62HZ76RBkS_T7bPJxkgkj9yBwTL8RQzpx5y01SKIJLNDtmEGDYw64lEok1xL1HW2Gg9HyUxXUWHeE4hqJcmEDbe52LHi7oqZ7H4UCQrrCyAfH2kS0--c0jdllbJttRpr-iRsDXLrI Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 25a99877ec344f79a46d640cd2982446 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25a99877ec344f79a46d640cd2982446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25a99877ec344f79a46d640cd2982446"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25a99877ec344f79a46d640cd2982446", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25a99877ec344f79a46d640cd2982446"}]}] Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 25a99877ec344f79a46d640cd2982446 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachSCSIVolumeTestJSON-1967857355-project Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d59d52840f644528a11d81621131cdf2 Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1967857355-project Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '759deeae-beb8-4920-901b-9bdf27637178'} Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:30.207033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:30.212887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Returning 404 to user: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:30.215552 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5f597d4b-b2a5-4b1f-8356-0ca4a3c93029 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 404 len: 111 microversion: 2.1 time: 0.077296 Aug 30 03:38:30.217113 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1530/3020] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:30 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:30.228382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:30.229129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:30.237255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.237841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.238361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.239399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.240523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.241052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.276788 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98324086-9b68-4794-acb2-4aee328ddf83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.096126 Aug 30 03:38:30.279672 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1491/3021] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:30 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:30.302039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3c8de236-abc0-41a5-938f-627d9d9cbe75 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '.version_select at 0x7f897b78e700>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:30.332058 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3c8de236-abc0-41a5-938f-627d9d9cbe75 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136766646" status: 202 len: 0 microversion: 2.1 time: 0.051043 Aug 30 03:38:30.333214 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1492/3022] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136766646 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:30.490815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:30.510051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9652126e-9cba-4bfd-a943-36e1c3efc206 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.285628 Aug 30 03:38:30.535554 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1531/3023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:30 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:30.602624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65656cbf-ddf0-444b-b860-74cdaffc31a6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730008952", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-key-581571165", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:30.644802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f6b5ed0e-2918-429d-9409-e48dde6ec8bf req-8f32eb4b-afc6-4028-9f88-d6e8f7cb61f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18f198dc-8871-4dff-bb85-142b689c1f0d", "tag": "89158373-130d-4051-abe6-d370804390be"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:30.669670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6b5ed0e-2918-429d-9409-e48dde6ec8bf req-8f32eb4b-afc6-4028-9f88-d6e8f7cb61f6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:30.670315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6b5ed0e-2918-429d-9409-e48dde6ec8bf req-8f32eb4b-afc6-4028-9f88-d6e8f7cb61f6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:30.671887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6b5ed0e-2918-429d-9409-e48dde6ec8bf req-8f32eb4b-afc6-4028-9f88-d6e8f7cb61f6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:30.691181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-65656cbf-ddf0-444b-b860-74cdaffc31a6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] validate_networks() for [('9674f167-e88d-4709-95e1-1809c91932c0', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:38:30.713665 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f6b5ed0e-2918-429d-9409-e48dde6ec8bf req-8f32eb4b-afc6-4028-9f88-d6e8f7cb61f6 service nova] Creating event network-changed:89158373-130d-4051-abe6-d370804390be for instance 18f198dc-8871-4dff-bb85-142b689c1f0d on n-h1-854924-5 Aug 30 03:38:30.730862 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f6b5ed0e-2918-429d-9409-e48dde6ec8bf req-8f32eb4b-afc6-4028-9f88-d6e8f7cb61f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090494 Aug 30 03:38:30.732313 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1532/3024] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:38:31.202827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:31.204248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:31.211511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:31.212300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:31.212916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:31.213834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:31.214445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:31.215028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:31.684197 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-65656cbf-ddf0-444b-b860-74cdaffc31a6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Invalid key_name provided. Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65656cbf-ddf0-444b-b860-74cdaffc31a6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 245 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730008952", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-key-581571165", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid key_name provided. Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-730008952', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'key_name': 'tempest-key-581571165', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-581571165 not found for user 0c031703afa842c3891785e086792cb7 Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:31.690805 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65656cbf-ddf0-444b-b860-74cdaffc31a6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid key_name provided. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-65656cbf-ddf0-444b-b860-74cdaffc31a6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.095265 Aug 30 03:38:31.695058 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1493/3025] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:30 2022] POST /compute/v2.1/servers => generated 70 bytes in 1097 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:38:31.702466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:31.704880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:31.712961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:31.713502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:31.713936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:31.714636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:31.715087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:31.715501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:31.765292 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f04f0faa-4ba5-47a6-bbfa-6c56f7b4ef4f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 14 microversion: 2.1 time: 0.067147 Aug 30 03:38:31.766415 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1494/3026] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:31 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:38:31.778229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:31.782906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:31.802081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:31.802830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:31.804790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:31.808401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:31.810050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:31.811624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.059139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:32.071727 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a841a529-e2c4-411e-958d-4a9e99a2b6f5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.872288 Aug 30 03:38:32.073158 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1533/3027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:31 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:32.142407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:32.158906 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3cf9057a-8dff-4fec-9945-f8036012f38a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.382505 Aug 30 03:38:32.163813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1495/3028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:31 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:32.180490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:32.181085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:32.187777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.188556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.189154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.190109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.195195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.195877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.551003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:32.567171 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b04ac8e6-5fca-46d5-99a0-1538355ce2d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.389782 Aug 30 03:38:32.567321 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1534/3029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:32 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:32.675238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-627a613b-ea62-409a-b106-cf85d8c66317 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-54417290", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:32.776757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:32.779102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:32.793192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.793716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.794137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.805129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.805658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.806102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.914069 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b7673572-05f4-4476-a5de-d6b4321d5375 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action" status: 200 len: 8207 microversion: 2.1 time: 0.141556 Aug 30 03:38:32.914900 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1535/3030] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:32 2022] POST /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0/action => generated 8207 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:32.924557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:32.925072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-627a613b-ea62-409a-b106-cf85d8c66317 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Neutron security group does_not_exist not found {{(pid=122167) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 30 03:38:32.925542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:32.926483 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-627a613b-ea62-409a-b106-cf85d8c66317 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-627a613b-ea62-409a-b106-cf85d8c66317 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 256 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-54417290", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-54417290', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 30 03:38:32.938411 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 30 03:38:32.944683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:32.952786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-627a613b-ea62-409a-b106-cf85d8c66317 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:32.954427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.954560 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-627a613b-ea62-409a-b106-cf85d8c66317 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.282979 Aug 30 03:38:32.954649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.954649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.955346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.955801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.956215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.959220 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1496/3031] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:32 2022] POST /compute/v2.1/servers => generated 106 bytes in 289 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:32.966633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:32.968121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:32.994969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.995662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.996282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:32.997776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:32.999082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:32.999711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:33.352939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:33.364095 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a1359c9-6b24-46ba-a77f-fe053e07da61 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.443589 Aug 30 03:38:33.367069 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1536/3032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:32 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:33.382719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:33.386518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:33.405447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:33.416846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:33.421820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:33.424954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:33.436100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:33.438740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:33.452789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:33.463299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:33.476094 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4b251d3d-6267-4ede-ac89-088ad3d961e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.515468 Aug 30 03:38:33.478410 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1497/3033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:32 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:33.488350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:33.495224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:33.517704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:33.521872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:33.523316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:33.531532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:33.543497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:33.544155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:33.982897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:33.998236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-391c2c26-d882-4f82-a3e3-451bd216ae15 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.628713 Aug 30 03:38:34.000183 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1537/3034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:33 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:34.008824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:34.009775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:34.018283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:34.018980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:34.019875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:34.020787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:34.021616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:34.022374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:34.128065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:34.138655 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bb0d537-1344-46d8-b7cc-c7c1f6e03ae4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.658864 Aug 30 03:38:34.161503 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1498/3035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:33 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:34.179959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:34.181575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:34.194281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:34.195769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:34.197639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:34.200786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:34.202903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:34.204387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:34.623118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:34.635629 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-97dc8d84-3862-4941-9658-45c5414774af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.470350 Aug 30 03:38:34.638819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1499/3036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:34 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:34.683783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:34.686903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:34.702134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:34.713267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:34.715659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:34.717687 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f94ce845-8f21-4d3f-b3e4-0e50ae67e8e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.711106 Aug 30 03:38:34.730109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:34.744046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:34.745248 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1538/3037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:34 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:34.745862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:34.747258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:34.763061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6b6822b-7eb4-43c3-ac79-76025da8908d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:34.764350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f6b6822b-7eb4-43c3-ac79-76025da8908d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 80dcd975-36e7-4751-9ef3-3a611e47a407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:34.798843 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f6b6822b-7eb4-43c3-ac79-76025da8908d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 80dcd975-36e7-4751-9ef3-3a611e47a407 could not be found. Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6b6822b-7eb4-43c3-ac79-76025da8908d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/80dcd975-36e7-4751-9ef3-3a611e47a407 HTTP/1.1 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 80dcd975-36e7-4751-9ef3-3a611e47a407 could not be found. Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '80dcd975-36e7-4751-9ef3-3a611e47a407'} Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dcd975-36e7-4751-9ef3-3a611e47a407 could not be found. Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dcd975-36e7-4751-9ef3-3a611e47a407 could not be found. Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:34.811800 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dcd975-36e7-4751-9ef3-3a611e47a407 could not be found. Aug 30 03:38:34.819196 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:34.822677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6b6822b-7eb4-43c3-ac79-76025da8908d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 80dcd975-36e7-4751-9ef3-3a611e47a407 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:34.823863 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6b6822b-7eb4-43c3-ac79-76025da8908d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80dcd975-36e7-4751-9ef3-3a611e47a407" status: 404 len: 111 microversion: 2.1 time: 0.075624 Aug 30 03:38:34.831081 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1539/3038] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:34 2022] DELETE /compute/v2.1/servers/80dcd975-36e7-4751-9ef3-3a611e47a407 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:34.843165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:34.846265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:35.363478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:35.364178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:35.364428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:35.365183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:35.365664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:35.366092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:35.426842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:35.440207 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c39020f-3a53-4213-8fb8-db29a721bb73 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.771493 Aug 30 03:38:35.440812 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1500/3039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:34 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:35.469338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:35.470287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:35.479424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:35.480871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:35.481582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:35.482504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:35.483430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:35.484089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:35.788150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:35.801679 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6e77913-50b8-42c9-886b-42ab635018d3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.969117 Aug 30 03:38:35.818461 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1540/3040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:34 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:35.824039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:35.824618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:35.846079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:35.846573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:35.847041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:35.848090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:35.848595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:35.855142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:35.963000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:35.995191 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4ea3f4c-6181-422b-b50b-501056dfb5b1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.531902 Aug 30 03:38:35.998433 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1501/3041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:35 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:36.008609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Locking {{(pid=122168) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 30 03:38:36.018399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:36.019038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:36.041278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.043463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.044024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.047383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.050094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.054837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.158002 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52f30c06-b205-427c-a8ad-c53369478b86 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.338126 Aug 30 03:38:36.161424 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1541/3042] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:35 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:36.171705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:36.172419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:36.183620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.190659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.191211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.192035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.192488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.192938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.602186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:36.610900 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3993ac72-d409-4f1c-829f-eebc74d821f9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.610581 Aug 30 03:38:36.622816 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1502/3043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:35 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:36.626048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:36.649849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-872b395b-8048-4e36-a653-0c66afd559e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:36.650814 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81ac0eeb-6282-402d-85f5-a3de789a9ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.485859 Aug 30 03:38:36.651727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-872b395b-8048-4e36-a653-0c66afd559e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:38:36.652170 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1542/3044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:36 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:36.652811 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-872b395b-8048-4e36-a653-0c66afd559e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-872b395b-8048-4e36-a653-0c66afd559e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 9223372036854775808 could not be found. Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '9223372036854775808'} Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:36.654848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:36.661791 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:36.661791 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:36.661791 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:36.661791 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 30 03:38:36.661791 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.664819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-872b395b-8048-4e36-a653-0c66afd559e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:36.666579 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-872b395b-8048-4e36-a653-0c66afd559e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.021773 Aug 30 03:38:36.668896 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1503/3045] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Aug 30 03:38:36 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:38:36.676547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:36.677290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:36.686767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.692032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:36.693117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.693697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.694506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.698601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.699356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.714680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.719197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.720187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.774737 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] HTTP exception thrown: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 is locked Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Request method failure captured: Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action HTTP/1.1 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 15 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSkRC7mvkSSQ1lX1xKrSIA6Mubx5KergXQoT7nSfZnNaFWcMfzumDAn7wYyYOFqXeGHWyB4zT_yXjaxq2zRFexhg_11fod4ch6JVlvqHzSRWHzvT3St1wbgClIcK8DYiIMjJB63vYlwtbk-27QA_Mt0S9ZgP694Yhodf7lAyPf0ZYk Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34b80862ddfb408fb212f9bd047a292a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}] Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-729372994 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a681b194cdb24b6fbb49eb39711ffa1c Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: {"os-stop": {}} Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 is locked Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5', 'body': {'os-stop': {}}} Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 is locked Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 is locked Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 is locked Aug 30 03:38:36.783715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:36.789959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Returning 409 to user: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 is locked {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:36.789959 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6583c911-c95f-407a-a954-2c8eb31d2f5f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 409 len: 107 microversion: 2.1 time: 0.096957 Aug 30 03:38:36.789959 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1504/3046] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:36 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 107 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:38:36.798887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:36.799729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:36.806531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.807252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.807927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.808800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:36.809706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:36.810296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:36.912019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Unlocking {{(pid=122167) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 03:38:37.066097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bcaf1bc3-0149-4487-8fd9-fd91bf8b0081 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.273546 Aug 30 03:38:37.068235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1505/3047] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:36 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:37.078166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:37.079192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:37.086030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.086757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.087378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:37.088302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.089104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.089737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:37.515742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:37.526387 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db9ad566-66e9-4f91-871a-324ebadb404a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.853277 Aug 30 03:38:37.527050 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1543/3048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:36 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:37.540667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddd90a7b-6f85-4c33-9f24-55c1637e882d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:37.571205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddd90a7b-6f85-4c33-9f24-55c1637e882d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.575196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddd90a7b-6f85-4c33-9f24-55c1637e882d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.575660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddd90a7b-6f85-4c33-9f24-55c1637e882d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:37.656521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ddd90a7b-6f85-4c33-9f24-55c1637e882d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Going to try to stop instance {{(pid=122168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:38:37.728202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:37.736129 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4af0427a-803a-4e3d-9ad2-411306dc5fd3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.666446 Aug 30 03:38:37.741661 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1506/3049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:37 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:37.754123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:37.754752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:37.779536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.781117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.782012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:37.784101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.784621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.785123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:37.794156 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddd90a7b-6f85-4c33-9f24-55c1637e882d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.262449 Aug 30 03:38:37.803503 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1544/3050] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:37 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:37.824729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:37.825751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:37.832859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.835544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.836155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:37.838281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:37.838906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:37.841567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:38.260022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:38.270431 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50241039-44f1-4180-8012-5f14fdb06adb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 0.461303 Aug 30 03:38:38.273124 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1545/3051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:37 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:38.293057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:38.305873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2cf17129-e6c3-4b32-ad26-da8f5bee87d7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.563044 Aug 30 03:38:38.306888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1507/3052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:37 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:38.332349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2113b684-49f3-4b49-9232-d8caab47a4ca tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:38.333371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2113b684-49f3-4b49-9232-d8caab47a4ca tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Failed to fetch instance by id -1 {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:38:38.334134 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2113b684-49f3-4b49-9232-d8caab47a4ca tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance -1 could not be found. Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2113b684-49f3-4b49-9232-d8caab47a4ca tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance -1 could not be found. Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '-1'} Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:38.336426 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:38.340757 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:38.340757 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:38.340757 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 30 03:38:38.340757 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:38.342037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2113b684-49f3-4b49-9232-d8caab47a4ca tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:38.345113 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2113b684-49f3-4b49-9232-d8caab47a4ca tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017977 Aug 30 03:38:38.347539 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1546/3053] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:38:38 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:38:38.357700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:38.359456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:38.370368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:38.371218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:38.371908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:38.373154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:38.373890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:38.375211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:38.765022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:38.765759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:38.788028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:38.788484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:38.789002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:38.789770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:38.790238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:38.790671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:39.192086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:39.195262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:39.205932 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-338789c2-03c8-4f7f-b94a-37d8572af7fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.854098 Aug 30 03:38:39.207330 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1508/3054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:38 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:39.230467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:39.233200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:39.258307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:39.262898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:39.270253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:39.273225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:39.277520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:39.286897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:39.679552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:39.688482 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1187b723-136c-48d8-a17b-8d67d5d9c27e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.930511 Aug 30 03:38:39.689070 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1547/3055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:38 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:39.714832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:39.715570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:39.737777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:39.740770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:39.741462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:39.742392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:39.743531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:39.744777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:40.580681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:40.594835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-419c14c0-b200-42ab-9fe3-aea6bc31ffd2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.368189 Aug 30 03:38:40.596246 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1509/3056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:39 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:40.610842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-203591d5-b8e7-4dce-9983-c9f9f6e89cb6 req-2194a76e-a53e-455c-8a6e-1d3f4a53418d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18f198dc-8871-4dff-bb85-142b689c1f0d", "name": "network-vif-plugged", "status": "completed", "tag": "89158373-130d-4051-abe6-d370804390be"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:40.650784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-203591d5-b8e7-4dce-9983-c9f9f6e89cb6 req-2194a76e-a53e-455c-8a6e-1d3f4a53418d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:40.652141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-203591d5-b8e7-4dce-9983-c9f9f6e89cb6 req-2194a76e-a53e-455c-8a6e-1d3f4a53418d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:40.653869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-203591d5-b8e7-4dce-9983-c9f9f6e89cb6 req-2194a76e-a53e-455c-8a6e-1d3f4a53418d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:40.698588 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-203591d5-b8e7-4dce-9983-c9f9f6e89cb6 req-2194a76e-a53e-455c-8a6e-1d3f4a53418d service nova] Creating event network-vif-plugged:89158373-130d-4051-abe6-d370804390be for instance 18f198dc-8871-4dff-bb85-142b689c1f0d on n-h1-854924-5 Aug 30 03:38:40.706750 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-203591d5-b8e7-4dce-9983-c9f9f6e89cb6 req-2194a76e-a53e-455c-8a6e-1d3f4a53418d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108260 Aug 30 03:38:40.708750 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1510/3057] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:40.716955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ef8b2de-9424-4046-88ac-e22b9908e63d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:40.718409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4ef8b2de-9424-4046-88ac-e22b9908e63d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 55c6cb10-ddf2-478a-bd69-0b9ef04ce984] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:40.726972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4ef8b2de-9424-4046-88ac-e22b9908e63d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 55c6cb10-ddf2-478a-bd69-0b9ef04ce984 could not be found. Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ef8b2de-9424-4046-88ac-e22b9908e63d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/55c6cb10-ddf2-478a-bd69-0b9ef04ce984/action HTTP/1.1 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 19 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: {"forceDelete": {}} Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 55c6cb10-ddf2-478a-bd69-0b9ef04ce984 could not be found. Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '55c6cb10-ddf2-478a-bd69-0b9ef04ce984', 'body': {'forceDelete': {}}} Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c6cb10-ddf2-478a-bd69-0b9ef04ce984 could not be found. Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c6cb10-ddf2-478a-bd69-0b9ef04ce984 could not be found. Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:40.738528 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c6cb10-ddf2-478a-bd69-0b9ef04ce984 could not be found. Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ef8b2de-9424-4046-88ac-e22b9908e63d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 55c6cb10-ddf2-478a-bd69-0b9ef04ce984 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4ef8b2de-9424-4046-88ac-e22b9908e63d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/55c6cb10-ddf2-478a-bd69-0b9ef04ce984/action" status: 404 len: 111 microversion: 2.1 time: 0.029665 Aug 30 03:38:40.743546 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1511/3058] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:40 2022] POST /compute/v2.1/servers/55c6cb10-ddf2-478a-bd69-0b9ef04ce984/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:40.762405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:40.764127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:40.780565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:40.781063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:40.781537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:40.782265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:40.782716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:40.783142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:40.841293 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] HTTP exception thrown: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Request method failure captured: Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 HTTP/1.1 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYV8Ba_6ZvVZzlLyUgJcjmUW9tyjimT4ZGBoej62HZ76RBkS_T7bPJxkgkj9yBwTL8RQzpx5y01SKIJLNDtmEGDYw64lEok1xL1HW2Gg9HyUxXUWHeE4hqJcmEDbe52LHi7oqZ7H4UCQrrCyAfH2kS0--c0jdllbJttRpr-iRsDXLrI Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 25a99877ec344f79a46d640cd2982446 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25a99877ec344f79a46d640cd2982446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25a99877ec344f79a46d640cd2982446"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25a99877ec344f79a46d640cd2982446", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25a99877ec344f79a46d640cd2982446"}]}] Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 25a99877ec344f79a46d640cd2982446 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachSCSIVolumeTestJSON-1967857355-project Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d59d52840f644528a11d81621131cdf2 Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1967857355-project Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '759deeae-beb8-4920-901b-9bdf27637178'} Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:40.844443 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:40.851782 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:40.860085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Returning 404 to user: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:40.861282 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d88684b0-a0e6-466e-a43d-e27826dc4016 tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 404 len: 111 microversion: 2.1 time: 0.118521 Aug 30 03:38:40.862406 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1512/3059] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:38:40 2022] DELETE /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:40.885961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:40.887213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:40.893558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:40.894119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:40.905062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:40.905915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:40.906411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:40.906856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.331230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:41.353896 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b208d24-0cb0-478a-b772-29d55cd2d732 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.653226 Aug 30 03:38:41.355226 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1548/3060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:39 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:41.376623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:41.377913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:41.392616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.393299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:41.393982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.394858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.395475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:41.396914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.712198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:41.722223 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfa671a0-2e6c-4c61-b3e3-abc971395f48 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.858531 Aug 30 03:38:41.725729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1513/3061] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:40 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:41.736866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:41.740092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] [instance: 759deeae-beb8-4920-901b-9bdf27637178] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:41.758107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.759263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:41.763199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.764204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.765186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:41.767988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.808028 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] HTTP exception thrown: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Request method failure captured: Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 HTTP/1.1 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYV8Ba_6ZvVZzlLyUgJcjmUW9tyjimT4ZGBoej62HZ76RBkS_T7bPJxkgkj9yBwTL8RQzpx5y01SKIJLNDtmEGDYw64lEok1xL1HW2Gg9HyUxXUWHeE4hqJcmEDbe52LHi7oqZ7H4UCQrrCyAfH2kS0--c0jdllbJttRpr-iRsDXLrI Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 25a99877ec344f79a46d640cd2982446 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25a99877ec344f79a46d640cd2982446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25a99877ec344f79a46d640cd2982446"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25a99877ec344f79a46d640cd2982446", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25a99877ec344f79a46d640cd2982446"}]}] Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 25a99877ec344f79a46d640cd2982446 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1967857355 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachSCSIVolumeTestJSON-1967857355-project Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d59d52840f644528a11d81621131cdf2 Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1967857355-project Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '759deeae-beb8-4920-901b-9bdf27637178'} Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:41.813670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. Aug 30 03:38:41.818909 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:41.822539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] Returning 404 to user: Instance 759deeae-beb8-4920-901b-9bdf27637178 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:41.823633 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fda838fa-0365-4126-a2c5-fc73d05093dc tempest-AttachSCSIVolumeTestJSON-1967857355 tempest-AttachSCSIVolumeTestJSON-1967857355-project] 10.222.0.30 "GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178" status: 404 len: 111 microversion: 2.1 time: 0.096727 Aug 30 03:38:41.825847 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1514/3062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:41 2022] GET /compute/v2.1/servers/759deeae-beb8-4920-901b-9bdf27637178 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:41.850794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:41.853126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:41.877884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.878996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:41.879672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.880640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.881946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:41.883934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:41.936982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:41.951303 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ee72a91-781b-49eb-a71f-20dc99051967 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.594105 Aug 30 03:38:41.954805 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1549/3063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:41 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:41.980785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:41.981488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:41.998698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:41.999857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:42.001820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:42.006195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:42.008435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:42.010406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:42.723332 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 03:38:42.724036 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 03:38:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db (ip 10.222.0.30) !!! Aug 30 03:38:42.849673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:42.886871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:42.893522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:42.897752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c893a209-776b-46a8-b148-1eb720846b9c tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2951 microversion: 2.42 time: 1.069716 Aug 30 03:38:42.901935 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1515/3064] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:38:41 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2951 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:38:42.909145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:42.910000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:42.954308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:42.955061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:42.956331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:42.957837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:42.959306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:42.960472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:43.046081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:43.073476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c24a2f36-dcbe-42a1-ab12-84e5d3839aff tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.084045 Aug 30 03:38:43.073476 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1550/3065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:41 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:43.074092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:43.076801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:43.108186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:43.108975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:43.109756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:43.110641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:43.111264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:43.111850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:43.656690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:43.665261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f50c7804-2479-4470-9738-0c30f3a3b67e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1317 microversion: 2.1 time: 0.602419 Aug 30 03:38:43.678888 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1551/3066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:43 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:43.684084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:43.684590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:43.686724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:43.692192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:43.693263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:43.694245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:43.695177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:43.696359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:43.697013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:43.702989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:43.904981 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65a46f7c-91e1-445b-a51a-d440b0f3cb15 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.224851 Aug 30 03:38:43.906834 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1552/3067] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:38:43 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983/os-interface => generated 1832 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:38:43.915529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f01bf91c-04b3-4231-a051-8997a1dc12fa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:43.921784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f01bf91c-04b3-4231-a051-8997a1dc12fa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 84172f17-52e5-4633-bf85-1c940ead08ef] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:43.925005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:43.930955 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f01bf91c-04b3-4231-a051-8997a1dc12fa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 84172f17-52e5-4633-bf85-1c940ead08ef could not be found. Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f01bf91c-04b3-4231-a051-8997a1dc12fa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/84172f17-52e5-4633-bf85-1c940ead08ef/action HTTP/1.1 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 39 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: {"os-getConsoleOutput": {"length": 10}} Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 84172f17-52e5-4633-bf85-1c940ead08ef could not be found. Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '84172f17-52e5-4633-bf85-1c940ead08ef', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84172f17-52e5-4633-bf85-1c940ead08ef could not be found. Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84172f17-52e5-4633-bf85-1c940ead08ef could not be found. Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:43.937549 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:43.945803 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:43.945803 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:43.945803 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:43.945803 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:43.945803 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84172f17-52e5-4633-bf85-1c940ead08ef could not be found. Aug 30 03:38:43.945803 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:43.946311 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d9fdf83-0f96-410d-b5c0-482be716a223 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.038859 Aug 30 03:38:43.946311 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1516/3068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:42 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:43.948282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f01bf91c-04b3-4231-a051-8997a1dc12fa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 84172f17-52e5-4633-bf85-1c940ead08ef could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:43.949544 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f01bf91c-04b3-4231-a051-8997a1dc12fa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/84172f17-52e5-4633-bf85-1c940ead08ef/action" status: 404 len: 111 microversion: 2.1 time: 0.041172 Aug 30 03:38:43.954228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1553/3069] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:43 2022] POST /compute/v2.1/servers/84172f17-52e5-4633-bf85-1c940ead08ef/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:43.959740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:43.960646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:43.969412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:43.970284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:43.970934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:43.971972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:43.972642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:43.973834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:44.065831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Calling method '.version_select at 0x7f897b7585e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:44.097667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:44.098175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:44.098873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:44.102438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:44.103102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:44.103725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:44.130547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:44.134145 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-370677b2-72ed-46fd-b518-0b0d62cce056 tempest-AbsoluteLimitsTestJSON-410838161 tempest-AbsoluteLimitsTestJSON-410838161-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.187080 Aug 30 03:38:44.145153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1517/3070] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Aug 30 03:38:43 2022] GET /compute/v2.1/limits => generated 511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:44.497572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:44.524785 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe7a02d8-473c-47e7-aa32-5ce1b4e2af1c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.566767 Aug 30 03:38:44.538256 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1554/3071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:43 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:44.557764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:44.570379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:44.578119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:44.578919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:44.579592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:44.580485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:44.581158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:44.581850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:44.686999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:44.687889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:44.696964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:44.703425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:44.704135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:44.705109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:44.705646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:44.706082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:45.611429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:45.624969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2108a1f5-f7a6-47fc-8000-4fc0e62092ca tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1466 microversion: 2.1 time: 0.941710 Aug 30 03:38:45.626508 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1555/3072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:44 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1466 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:45.642647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:45.644084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:45.668919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:45.669824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:45.670542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:45.678984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:45.679892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:45.680572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:45.774442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:45.783284 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-06b81e29-89a7-4b35-862f-2dfde7034216 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.233641 Aug 30 03:38:45.786036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1518/3073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:44 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:46.137003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:46.146711 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d9714c2-3de7-4526-a70e-fcac24cbf94e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 0.518842 Aug 30 03:38:46.156904 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1556/3074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:45 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:46.166026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e53dded7-7ab2-4271-bfc9-9d9d1fdc4589 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:46.180405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e53dded7-7ab2-4271-bfc9-9d9d1fdc4589 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: ba70f286-1012-4aa7-b004-bb724ceb7133] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:46.194704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e53dded7-7ab2-4271-bfc9-9d9d1fdc4589 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance ba70f286-1012-4aa7-b004-bb724ceb7133 could not be found. Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e53dded7-7ab2-4271-bfc9-9d9d1fdc4589 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/ba70f286-1012-4aa7-b004-bb724ceb7133 HTTP/1.1 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance ba70f286-1012-4aa7-b004-bb724ceb7133 could not be found. Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'ba70f286-1012-4aa7-b004-bb724ceb7133'} Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba70f286-1012-4aa7-b004-bb724ceb7133 could not be found. Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba70f286-1012-4aa7-b004-bb724ceb7133 could not be found. Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:46.196305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba70f286-1012-4aa7-b004-bb724ceb7133 could not be found. Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e53dded7-7ab2-4271-bfc9-9d9d1fdc4589 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance ba70f286-1012-4aa7-b004-bb724ceb7133 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:46.203537 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e53dded7-7ab2-4271-bfc9-9d9d1fdc4589 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/ba70f286-1012-4aa7-b004-bb724ceb7133" status: 404 len: 111 microversion: 2.1 time: 0.035695 Aug 30 03:38:46.211126 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1557/3075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:46 2022] GET /compute/v2.1/servers/ba70f286-1012-4aa7-b004-bb724ceb7133 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:46.216399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:46.217019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:46.244364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:46.244875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:46.245325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:46.246142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:46.246605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:46.247054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:46.301503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:46.302175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:46.308747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:46.309249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:46.309731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:46.310455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:46.310921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:46.311354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:47.978766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:47.992749 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61c7a910-6eb0-4742-b395-dab898e73c17 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.780427 Aug 30 03:38:47.993662 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1558/3076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:46 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:48.002351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:48.002975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:48.022854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:48.023361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:48.023806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:48.024522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:48.024988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:48.029524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:48.565735 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8928f24b-02bc-4326-9080-4391e02cefe4 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1617 microversion: 2.1 time: 2.775292 Aug 30 03:38:48.570324 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1519/3077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:45 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1617 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:48.578173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:48.591846 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72c02e08-6787-4b5d-bea4-863ce0184b54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 0.593172 Aug 30 03:38:48.605518 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1559/3078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:47 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:48.605518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b4dbd6b-4f8e-45b3-8893-0ff71b5aa3ac tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: .version_select at 0x7f8983cfadc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-24521856", "policies": ["affinity"]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:48.606048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:48.606048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:48.609248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:48.609783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:48.611756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:48.612624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:48.613103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:48.615764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:48.622368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b4dbd6b-4f8e-45b3-8893-0ff71b5aa3ac tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:48.628645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b4dbd6b-4f8e-45b3-8893-0ff71b5aa3ac tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:48.749652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b4dbd6b-4f8e-45b3-8893-0ff71b5aa3ac tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:48.756486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b4dbd6b-4f8e-45b3-8893-0ff71b5aa3ac tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:48.779115 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b4dbd6b-4f8e-45b3-8893-0ff71b5aa3ac tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.184722 Aug 30 03:38:48.793427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1560/3079] 10.222.0.30 () {60 vars in 1174 bytes} [Tue Aug 30 03:38:48 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:38:48.930065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2120008156", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "178ab86e-4bf2-4f52-892f-22c7f39eea16"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:49.077239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:38:49.157892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:49.173166 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-18b8d531-d019-47ee-bdd6-4b7306155141 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.601709 Aug 30 03:38:49.185380 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1520/3080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:48 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:49.424767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20f8ac3a-3205-4400-889a-3e7d64dec5d9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-201291871", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20f8ac3a-3205-4400-889a-3e7d64dec5d9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 237 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-201291871", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-201291871', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.447027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20f8ac3a-3205-4400-889a-3e7d64dec5d9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:49.453529 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20f8ac3a-3205-4400-889a-3e7d64dec5d9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032325 Aug 30 03:38:49.457393 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1521/3081] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:49.462288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:49.462873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:49.470322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:49.470810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:49.471429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:49.472300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:49.472756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:49.473174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:49.962948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:49.978424 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c80e7dec-4f74-44ce-9b69-7c7e77556d38 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.519795 Aug 30 03:38:49.979654 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1522/3082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:49 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:49.984710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:49.986514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:49.993394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:49.994399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:49.996887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:49.998001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:49.998688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:49.999333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:50.363659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:38:50.366413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:38:50.368855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:38:50.369509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:38:50.370846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:38:50.412061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:50.413208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:50.413853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:50.414918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:50.415629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:50.416844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:50.463485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:50.478871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:50.506062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Going to run 2 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:38:50.523875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:38:50.601214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122168) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 03:38:50.635073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:50.644463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:50.664551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:50.693842 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b401cc3-a38b-4296-8909-d7897fe4e0c2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1657 microversion: 2.1 time: 0.712085 Aug 30 03:38:50.695349 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1523/3083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:49 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1657 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:50.713978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:50.715332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:50.731406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:50.731794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:50.732795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:50.734801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:50.735554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:50.736530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:50.785687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:50.799631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:50.872813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=6b87b4f3-b583-42ce-a94f-139ccdf72d2f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:38:51.006584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:51.012910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:51.027439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:51.066404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:51.076647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:51.131488 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f41d4b06-adec-41ff-b33d-af8da24cad79 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.205230 Aug 30 03:38:51.135585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1561/3084] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 2211 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 30 03:38:51.154087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cadac4ed-9187-40ca-bffa-d2a0a7af9096 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:51.164177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cadac4ed-9187-40ca-bffa-d2a0a7af9096 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:51.164978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cadac4ed-9187-40ca-bffa-d2a0a7af9096 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:51.165748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cadac4ed-9187-40ca-bffa-d2a0a7af9096 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:51.196065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cadac4ed-9187-40ca-bffa-d2a0a7af9096 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 03:38:51.260009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cadac4ed-9187-40ca-bffa-d2a0a7af9096 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.122521 Aug 30 03:38:51.279583 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1562/3085] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:51 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:51.289113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:51.293958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:51.294772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Searching by: {'deleted': False, 'project_id': 'e432c15ade254bae971801b45521fe7a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:38:51.324102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:51.325707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:51.326155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:51.326903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:51.327379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:51.330353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:51.362907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:38:51.401157 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59b48293-2d5c-4289-b5ce-ebb7ba052cc8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.120087 Aug 30 03:38:51.401882 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1563/3086] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:38:51 2022] GET /compute/v2.1/servers => generated 1004 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:51.414852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:51.415607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:51.427495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:51.428333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:51.429431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:51.433586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:51.434239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:51.434822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:51.800377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:51.813962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd069631-ec25-417a-95ce-1096e2116e6c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.115314 Aug 30 03:38:51.814714 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1524/3087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:50 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:51.824308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ba09795-0301-4858-b98b-ec553a889af2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:51.826019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ba09795-0301-4858-b98b-ec553a889af2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:52.054686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ba09795-0301-4858-b98b-ec553a889af2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:52.065216 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ba09795-0301-4858-b98b-ec553a889af2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1219 microversion: 2.1 time: 0.249012 Aug 30 03:38:52.068311 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1525/3088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:51 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1219 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:52.080947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3d2b34e-2323-4660-a792-3fa5438cdbaa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1764691031", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3d2b34e-2323-4660-a792-3fa5438cdbaa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 235 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1764691031", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1764691031', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.115828 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 03:38:52.120300 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:38:52.124646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3d2b34e-2323-4660-a792-3fa5438cdbaa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:52.126183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3d2b34e-2323-4660-a792-3fa5438cdbaa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.054943 Aug 30 03:38:52.127299 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1526/3089] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:52 2022] POST /compute/v2.1/servers => generated 133 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:38:52.141662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:52.142677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:52.167304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:52.168021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:52.168714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:52.170022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:52.170717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:52.171308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:52.836220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:52.845489 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da1334ad-c7d5-4e06-9528-fdece759d589 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1666 microversion: 2.1 time: 1.442541 Aug 30 03:38:52.847061 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1564/3090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:51 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1666 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:53.134475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1830110668", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "32865e95-c904-480c-88c1-9ae4d6c18820"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:53.260917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] validate_networks() for [('32865e95-c904-480c-88c1-9ae4d6c18820', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:38:53.394262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:53.406604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce2098d9-ad45-44f3-a180-cccd92742779 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.271701 Aug 30 03:38:53.407895 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1527/3091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:52 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:53.425216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:53.431131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:53.444354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:53.445778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:53.446643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:53.448273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:53.450071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:53.452202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:53.619412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:53.633994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-43d99017-f5f9-4238-ab70-958ee6f76651 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1271 microversion: 2.1 time: 0.224664 Aug 30 03:38:53.634610 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1528/3092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:53 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:53.644901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:53.653691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:53.667449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:53.668387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:53.669541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:53.672650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:53.674425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:53.675123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:54.117176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:54.620187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:54.657904 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba11b4cd-f01b-4a80-9e5c-e7a795bbdd7d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 1.018037 Aug 30 03:38:54.672630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1529/3093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:53 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:54.686945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:54.687575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:54.711352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:54.711868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:54.712314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:54.713028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:54.713516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:54.713938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:55.514371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:38:55.515028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:38:55.515991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:38:55.516868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:38:55.517411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:38:55.531453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:55.532315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:55.533072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:55.533973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:55.534559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:55.535291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:55.601096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Getting quotas for project 82e3bf387c854106890134cfd995707b. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:38:55.609711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Getting quotas for user 46867e818a6c49f1910e372a625dc4c2 and project 82e3bf387c854106890134cfd995707b. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:38:55.640902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:38:55.643677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:38:55.751070 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eb00ec18-f81b-4beb-9614-f8bfdc18417a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.901742 Aug 30 03:38:55.751750 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1565/3094] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:38:55.765920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:55.771419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:55.813299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:55.818913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:55.821299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:55.837439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:55.838282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:55.838747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:56.498890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:56.512644 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-947c57e2-bb3f-4574-8953-88c60f8be716 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1277 microversion: 2.1 time: 0.758019 Aug 30 03:38:56.515709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1566/3095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:55 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1277 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:56.533435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5f4a9ab-07dd-4218-9182-c5fcf4d7aa29 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:56.534200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5f4a9ab-07dd-4218-9182-c5fcf4d7aa29 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 287833b5-d978-4919-8be3-aca87fa8e65c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:56.549440 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f5f4a9ab-07dd-4218-9182-c5fcf4d7aa29 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 287833b5-d978-4919-8be3-aca87fa8e65c could not be found. Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5f4a9ab-07dd-4218-9182-c5fcf4d7aa29 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/287833b5-d978-4919-8be3-aca87fa8e65c/action HTTP/1.1 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 13 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: {"pause": {}} Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 287833b5-d978-4919-8be3-aca87fa8e65c could not be found. Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '287833b5-d978-4919-8be3-aca87fa8e65c', 'body': {'pause': {}}} Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287833b5-d978-4919-8be3-aca87fa8e65c could not be found. Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287833b5-d978-4919-8be3-aca87fa8e65c could not be found. Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:38:56.559759 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:38:56.564927 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:38:56.564927 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:38:56.564927 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287833b5-d978-4919-8be3-aca87fa8e65c could not be found. Aug 30 03:38:56.564927 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:38:56.566441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5f4a9ab-07dd-4218-9182-c5fcf4d7aa29 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 287833b5-d978-4919-8be3-aca87fa8e65c could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:38:56.567521 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5f4a9ab-07dd-4218-9182-c5fcf4d7aa29 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/287833b5-d978-4919-8be3-aca87fa8e65c/action" status: 404 len: 111 microversion: 2.1 time: 0.048622 Aug 30 03:38:56.568507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:56.569125 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1567/3096] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:56 2022] POST /compute/v2.1/servers/287833b5-d978-4919-8be3-aca87fa8e65c/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:38:56.575411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f894d3ba-6207-471a-8ef2-6c63d6feea5e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:56.580635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f894d3ba-6207-471a-8ef2-6c63d6feea5e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:56.584772 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f964dce8-2fff-489a-9848-25a2bc186d35 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1666 microversion: 2.1 time: 1.910946 Aug 30 03:38:56.599940 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1530/3097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:54 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1666 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:56.616800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:56.619922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:56.650621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:56.652008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:56.655101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:56.656219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:56.657135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:56.657750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:56.930272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f894d3ba-6207-471a-8ef2-6c63d6feea5e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:56.937781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f894d3ba-6207-471a-8ef2-6c63d6feea5e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1228 microversion: 2.1 time: 0.368005 Aug 30 03:38:56.954326 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1568/3098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:56 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1228 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:57.530288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:57.535346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:57.536512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:57.546903 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-47472b64-3759-4fef-a9bc-4f589ab22089 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.945044 Aug 30 03:38:57.549814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:57.550512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:57.551295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:57.552768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:57.556985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:57.557679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:57.562626 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1531/3099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:56 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:57.571598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:57.573267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:57.579496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:57.580207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:57.583127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:57.584067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:57.584972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:57.585618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:57.590609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:57.730438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:57.747033 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f765a870-3cb3-41cd-83a6-10d45914a86a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1277 microversion: 2.1 time: 0.215537 Aug 30 03:38:57.747645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1569/3100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:57 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:57.763866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:57.775465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:57.788504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:57.790206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:57.790981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:57.795396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:57.796689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:57.797389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.282515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:58.303307 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dbb03be9-088b-4b6f-bf3a-60f8af9e575a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.735484 Aug 30 03:38:58.324938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1532/3101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:57 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:58.331187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:58.333637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:58.349024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.350002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.351179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.352276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.354111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.355512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.479148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:58.487833 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e40bec7-2fe2-42c2-a3d8-22b3ebd72cf1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.738564 Aug 30 03:38:58.505671 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1570/3102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:57 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:58.511452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:58.512365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:58.519153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.520776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.522282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.523709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.524751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.525840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.610379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:58.622096 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-770b93c0-ad47-40f3-bec1-68c14daf0c7a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1286 microversion: 2.1 time: 0.295588 Aug 30 03:38:58.626029 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba179ba1-a286-483f-aaa8-fe2a60d48f62 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 202 len: 0 microversion: 2.1 time: 0.118866 Aug 30 03:38:58.627381 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1571/3104] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:58 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:38:58.627639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1533/3104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:58 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1286 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:58.632927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:58.634077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:58.646364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.646870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.647306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.647687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:58.648319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:58.648628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.649292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.650123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.656598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.657237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.657804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:58.658588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:58.659310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:58.660123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:59.542334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:59.545235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:38:59.556064 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89b08838-91d1-4ae9-86d2-5444520cb463 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.928044 Aug 30 03:38:59.559863 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1572/3105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:58 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:38:59.560710 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac1750a2-2a1c-48e2-80e7-96db911e9b52 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1510 microversion: 2.1 time: 0.919000 Aug 30 03:38:59.570409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:59.571366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:59.574416 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1534/3106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:58 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1510 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:38:59.585529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:38:59.586421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:59.588532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:59.592351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:59.595388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:59.597574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:59.597733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:59.598986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:59.599628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:59.600350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:59.604439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:59.605505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:59.606199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:59.606880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:59.609494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:38:59.705635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Unlocking {{(pid=122167) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 03:38:59.790411 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4aa3de71-149f-45ed-8ae8-d068191e836d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.208005 Aug 30 03:38:59.802596 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1535/3107] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:38:59 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:38:59.814435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:38:59.815071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:38:59.822230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:59.822912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:59.823351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:38:59.824070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:38:59.824631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:38:59.825059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.007923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:00.024490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf15d182-8c6f-4203-a0f5-2a0889af50ca tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1286 microversion: 2.1 time: 0.220604 Aug 30 03:39:00.025279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1536/3108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:59 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:00.045552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:00.046193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:00.053455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:00.053455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:00.053837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.054544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:00.055000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:00.055421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.182402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:00.191760 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bc15779-1986-44db-9371-9345d023a881 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.630157 Aug 30 03:39:00.208422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1573/3109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:38:59 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:00.471879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:00.479999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de70c035-795d-45af-abf1-3171bd64f581 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.439828 Aug 30 03:39:00.480989 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1537/3110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:00 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:00.500707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:00.501333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:00.516687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:00.517194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:00.517654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.518599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:00.519238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:00.519838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.586009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:00.586919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:00.598154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:00.603768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:00.604428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.605321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:00.605957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:00.606631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:00.993469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:01.004931 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2237c25-64ab-4849-997d-12be007d57ca tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.508078 Aug 30 03:39:01.013551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1574/3111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:00 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:01.034729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:01.035552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:01.045393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.046020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.046660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.047644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.048436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.049157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.074947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:01.088792 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5227c94e-11fa-49b7-a88a-829d20f796af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1490 microversion: 2.1 time: 0.505962 Aug 30 03:39:01.091545 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1538/3112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:00 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1490 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:01.098047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:01.099566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:01.121893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.123277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.125192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.127214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.129475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.130348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.622525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:01.642799 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ae04ed5-e229-42f2-bb88-5daeb57d6dfa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.609966 Aug 30 03:39:01.644050 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1575/3113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:01 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:01.656135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:01.657312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:01.672651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.673167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.673673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.674779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.675650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.677501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.733440 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'pause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state paused Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 13 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: {"pause": {}} Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'pause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state paused Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'pause': {}}} Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state paused. Cannot pause while the instance is in this state. Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state paused Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:01.735473 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state paused Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'pause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state paused {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d3650743-1a34-45d8-9e81-defd072eeba9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 143 microversion: 2.1 time: 0.093594 Aug 30 03:39:01.742148 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1576/3114] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:01 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 143 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:39:01.743497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:01.746215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:01.747310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:01.754464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.755668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.756105 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-401cb7eb-0727-4472-aa19-e1e44d5f71a2 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.660830 Aug 30 03:39:01.756494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.756726 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1539/3115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:01 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:01.758112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.758610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.759041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.764995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:01.766110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:01.772495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.773217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.773898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.774783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.775227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.775646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.876432 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0f760bf6-8efc-4d5f-8824-bfd6e0b1b71c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.115411 Aug 30 03:39:01.883259 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1540/3116] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:01 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:39:01.892593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:01.893773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:01.904434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.905238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.906071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:01.907578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:01.908501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:01.909280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.010520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be8a1827-fb8d-4035-8355-1a7d14c0b3f2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 202 len: 0 microversion: 2.1 time: 0.125345 Aug 30 03:39:02.011408 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1541/3117] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:01 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:39:02.025084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:02.026274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:02.033568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.034308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.036571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.043458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.044327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.045303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.087258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:02.209966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:02.221529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-04052026-9f37-47a6-abee-4b1d78b174df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.478880 Aug 30 03:39:02.246694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1577/3118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:01 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:02.252663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:02.253327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:02.260251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.260998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.261639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.262520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.263137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.263707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.610608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:02.623270 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-079c1830-941b-40b7-ba89-d1d6b088ee8a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1675 microversion: 2.1 time: 0.609903 Aug 30 03:39:02.624446 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1542/3119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:02 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1675 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:02.630837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-66c24a43-27db-4805-8bde-fcf2af83ec10 req-9d7303e9-1d06-4c1c-a75e-88ff00b55bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19296f5-70f5-4402-8f62-b2ac7154e52b", "tag": "08e221fc-f914-4a0f-8215-c91031adb366"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:02.647512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-66c24a43-27db-4805-8bde-fcf2af83ec10 req-9d7303e9-1d06-4c1c-a75e-88ff00b55bfb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.648296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-66c24a43-27db-4805-8bde-fcf2af83ec10 req-9d7303e9-1d06-4c1c-a75e-88ff00b55bfb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.649077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-66c24a43-27db-4805-8bde-fcf2af83ec10 req-9d7303e9-1d06-4c1c-a75e-88ff00b55bfb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.665073 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-66c24a43-27db-4805-8bde-fcf2af83ec10 req-9d7303e9-1d06-4c1c-a75e-88ff00b55bfb service nova] Creating event network-changed:08e221fc-f914-4a0f-8215-c91031adb366 for instance a19296f5-70f5-4402-8f62-b2ac7154e52b on n-h2-854924-5 Aug 30 03:39:02.672035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-66c24a43-27db-4805-8bde-fcf2af83ec10 req-9d7303e9-1d06-4c1c-a75e-88ff00b55bfb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046213 Aug 30 03:39:02.673152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1543/3120] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:02.695447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:02.715940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0eb1c314-dd19-4b30-8e28-ffda67efb6e6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1497 microversion: 2.1 time: 0.467756 Aug 30 03:39:02.717501 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1578/3121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:02 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1497 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:02.781831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:02.783927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:02.791991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.793022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.793684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:02.794728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:02.795403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:02.795994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.207922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:03.215385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:03.226944 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc6eaaca-9c20-4e2a-bba4-c059f44e4d2b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.450130 Aug 30 03:39:03.241208 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1544/3122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:02 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:03.249519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:03.250239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:03.265307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.268417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.268906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.270927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.271292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.271857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.297484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5b13a64a-c769-49f6-badf-177ac36bce14 req-16746313-eb43-4923-9976-5e5d18102e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da0eaad-32e6-4960-9396-8ae4e91cc62a", "tag": "8e715ba3-e6b7-41bd-8dca-f3b49730fa72"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:03.335540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5b13a64a-c769-49f6-badf-177ac36bce14 req-16746313-eb43-4923-9976-5e5d18102e6d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.336046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5b13a64a-c769-49f6-badf-177ac36bce14 req-16746313-eb43-4923-9976-5e5d18102e6d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.343278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5b13a64a-c769-49f6-badf-177ac36bce14 req-16746313-eb43-4923-9976-5e5d18102e6d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.403597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5b13a64a-c769-49f6-badf-177ac36bce14 req-16746313-eb43-4923-9976-5e5d18102e6d service nova] Creating event network-changed:8e715ba3-e6b7-41bd-8dca-f3b49730fa72 for instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a on n-h1-854924-5 Aug 30 03:39:03.421450 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5b13a64a-c769-49f6-badf-177ac36bce14 req-16746313-eb43-4923-9976-5e5d18102e6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130322 Aug 30 03:39:03.424892 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1545/3123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:39:03.648810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:03.649947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:03.657059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.657948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.658647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.659903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.660605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.661845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.663081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:03.675427 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76c7e152-2717-4905-94f6-9ca6ce061599 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.431368 Aug 30 03:39:03.688431 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1579/3124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:03 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:03.742808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:03.749461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:03.756285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.756798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.757236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:03.758444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:03.758904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:03.759335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.309977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:04.318336 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1477d91b-be95-4099-ba0f-148b069c8195 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1655 microversion: 2.1 time: 0.673813 Aug 30 03:39:04.319013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1546/3125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:03 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1655 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:04.336609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:04.337402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:04.345724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.346345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.346916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.347889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.350616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.350616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.388414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:04.399389 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39365063-6676-4c6d-bc1e-c655a1a09282 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.664390 Aug 30 03:39:04.417357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1580/3126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:03 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:04.424046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:04.424591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:04.431661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.432395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.433073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.434080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.435157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.435604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.565008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96f7cb20-54a2-4c1e-871e-a7fe6445f12e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.145103 Aug 30 03:39:04.565923 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1581/3127] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:04 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:39:04.582941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:04.583670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:04.589008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:04.590204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.590897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.593377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.594266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.594894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.597490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.603819 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd82352c-872c-4fdf-bfac-a37895cac69d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.271365 Aug 30 03:39:04.619985 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1547/3128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:04 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:04.625246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:04.627119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:04.636195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.637022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.639460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.640457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.641139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.641822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.929429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:04.946211 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f0f2283-5f58-4ff8-a295-ad1b4cd4d83d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.378068 Aug 30 03:39:04.947875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1582/3129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:04 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:04.953028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:04.959429 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc5a9c9f-5bfd-44db-9c16-035d94d96495 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1662 microversion: 2.1 time: 0.338106 Aug 30 03:39:04.968655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:04.969946 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1548/3130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:04 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1662 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:04.970185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:04.986298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6cfde44b-453a-4aea-b0ea-ed838b67e2a7 req-97f482df-ecf1-476e-8a5f-16d0abe599c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b87b4f3-b583-42ce-a94f-139ccdf72d2f", "tag": "ed8d07e0-0322-4ad6-a061-f0203a7edb31"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:04.992735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.993776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.994808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:04.995971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:04.997147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:04.997848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.050693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6cfde44b-453a-4aea-b0ea-ed838b67e2a7 req-97f482df-ecf1-476e-8a5f-16d0abe599c4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.053033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6cfde44b-453a-4aea-b0ea-ed838b67e2a7 req-97f482df-ecf1-476e-8a5f-16d0abe599c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.057502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6cfde44b-453a-4aea-b0ea-ed838b67e2a7 req-97f482df-ecf1-476e-8a5f-16d0abe599c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.075471 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6cfde44b-453a-4aea-b0ea-ed838b67e2a7 req-97f482df-ecf1-476e-8a5f-16d0abe599c4 service nova] Creating event network-changed:ed8d07e0-0322-4ad6-a061-f0203a7edb31 for instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f on n-h2-854924-5 Aug 30 03:39:05.102116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6cfde44b-453a-4aea-b0ea-ed838b67e2a7 req-97f482df-ecf1-476e-8a5f-16d0abe599c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128790 Aug 30 03:39:05.106775 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1549/3131] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:05.131682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:05.139937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:05.161856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.162594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.176225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.177492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.178239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.179011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.214885 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515/action HTTP/1.1 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 28 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: {"reboot": {"type": "SOFT"}} Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '99e74adc-c2ac-414c-a28f-8988acf80515', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:05.217643 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:05.222799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:05.224889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:05.225951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-819ce893-ce9a-4d72-879d-e38c404e0a71 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515/action" status: 404 len: 111 microversion: 2.1 time: 0.118038 Aug 30 03:39:05.230990 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1550/3132] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:05 2022] POST /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515/action => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:05.239328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:05.240120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:05.252197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.252632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.253519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.254410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.256822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.257123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.408838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:05.417125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1229869-b254-443e-8e58-30f5b43de8d8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.461590 Aug 30 03:39:05.417763 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1583/3133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:04 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:05.635212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:05.636105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:05.638374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:05.647741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.651106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.654984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.655999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.656646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.657244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.714853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:05.728260 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30236f97-4e5e-4407-8a23-c8062b2500f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.494867 Aug 30 03:39:05.733271 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1551/3134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:05 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:05.761444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:05.762355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:05.778226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.779462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.780117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:05.780955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:05.781570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:05.784790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.104174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:06.112978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7dd36683-9588-40eb-80e3-fd372a0b6576 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.358762 Aug 30 03:39:06.115004 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1552/3135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:05 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:06.125385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:06.126316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:06.141155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:06.142337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:06.143723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.147148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:06.162182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:06.162668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.367488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:06.387812 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b391c769-2ea6-400c-8c1a-ccb1638b779d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.753797 Aug 30 03:39:06.388636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1584/3136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:05 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:06.394675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33adad05-7e44-471b-bfe9-4fc9c527e77f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:06.397832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33adad05-7e44-471b-bfe9-4fc9c527e77f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:06.406317 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-33adad05-7e44-471b-bfe9-4fc9c527e77f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96 could not be found. Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33adad05-7e44-471b-bfe9-4fc9c527e77f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96/action HTTP/1.1 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 28 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: {"reboot": {"type": "SOFT"}} Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96 could not be found. Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96 could not be found. Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96 could not be found. Aug 30 03:39:06.408012 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96 could not be found. Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33adad05-7e44-471b-bfe9-4fc9c527e77f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:06.413309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33adad05-7e44-471b-bfe9-4fc9c527e77f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96/action" status: 404 len: 111 microversion: 2.1 time: 0.019357 Aug 30 03:39:06.415003 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1585/3137] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:06 2022] POST /compute/v2.1/servers/c5f70a8f-e4d6-4b5d-8b63-c82c0c6faa96/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:06.419896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:06.420896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:06.428297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:06.428772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:06.429203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.430183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:06.430580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:06.430999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.506251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:06.516916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce361408-5d42-4075-8d4a-7e8aa3516ec8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1662 microversion: 2.1 time: 0.398895 Aug 30 03:39:06.527009 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1553/3138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:06 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1662 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:06.534249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:06.535002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:06.542350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:06.542968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:06.543514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.544445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:06.545001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:06.545666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:06.937552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=38 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:06.959591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:06.975397 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f684130b-60bd-4a1a-9790-aa85bef44170 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.559099 Aug 30 03:39:06.976825 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1586/3139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:06 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:06.999790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:07.001284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:07.012521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:07.013568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:07.014264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:07.015205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:07.016093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:07.017193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:07.025429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:07.038210 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c4932f7-2339-41c9-b864-e75848cc9423 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.509594 Aug 30 03:39:07.039151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1554/3140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:06 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:07.413737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:07.414494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:07.430993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:07.431494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:07.431932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:07.440780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:07.441699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:07.445273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:07.634129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:07.648151 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8708d507-b807-4c16-beb6-5ac8812714ee tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.654387 Aug 30 03:39:07.655034 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1587/3141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:06 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:07.665315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:07.668261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:07.682765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:07.683556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:07.684142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:07.685028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:07.685665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:07.686244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:07.909252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:07.917946 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d22311d-4b3f-41fc-a244-e32eeba8afc0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.512455 Aug 30 03:39:07.918530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1555/3142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:07 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:08.222349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1879358268", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "bb35cdd9-92eb-43df-ac7e-c5869f6415af"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:08.308070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:08.324945 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c5b55c8-6ef4-42e9-ac77-c26aee1f2602 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1662 microversion: 2.1 time: 0.666789 Aug 30 03:39:08.329249 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1588/3143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:07 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1662 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:08.342570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] validate_networks() for [('bb35cdd9-92eb-43df-ac7e-c5869f6415af', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:39:08.344121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:08.354990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:08.372009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:08.372574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:08.373226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:08.374314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:08.376250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:08.376985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:08.399776 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515/action HTTP/1.1 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 65 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '99e74adc-c2ac-414c-a28f-8988acf80515', 'body': {'rebuild': {'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c'}}} Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 03:39:08.402737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:39:08.409477 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:08.413656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:08.414780 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-125c414d-991c-4759-8ed3-62c9b5f30fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515/action" status: 404 len: 111 microversion: 2.1 time: 0.084083 Aug 30 03:39:08.416001 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1589/3144] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:08 2022] POST /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:08.427966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:08.428333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:08.436755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:08.437433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:08.437972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:08.438780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:08.439566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:08.440167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:09.396379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:09.403033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:09.413901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f57e2de-fd5d-443a-bedb-a5fa6d184cd4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.996584 Aug 30 03:39:09.416509 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1590/3145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:08 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:09.434616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:09.437744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:09.455144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:09.455954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:09.456564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:09.458292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:09.459590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:09.460845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.071380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:39:10.072734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:39:10.073229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:39:10.073718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:39:10.074446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:39:10.098698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.100386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.100837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.104013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.104432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.107205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.131985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:10.141500 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7e0e976-66d3-4bcd-9fcb-8bf06a5b9276 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.723644 Aug 30 03:39:10.142085 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1591/3146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:09 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:10.162182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Getting quotas for project bd729db31b104e28a6ce9997802c55a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:10.163441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:10.164066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:10.171531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.172246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.173039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.174037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.175007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.175783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.177641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Getting quotas for user 25f09accc2c64314b7a83cac46bb3b2b and project bd729db31b104e28a6ce9997802c55a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:10.216003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:39:10.219250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:39:10.295354 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c357eaa9-cb2e-48d2-8e00-257cae7502c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.352526 Aug 30 03:39:10.296603 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1556/3147] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:39:10.301992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:10.302860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:10.315764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.318057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.318664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.321253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.321960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.322571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.871259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:10.893381 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8328bdc-b7e2-43eb-84a5-4146e9e11b8e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.594599 Aug 30 03:39:10.899323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:10.917764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc14cca9-1086-4401-ac3a-807d7d58e0e6 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.750385 Aug 30 03:39:10.917764 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1592/3149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:10 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:10.918133 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1557/3149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:10 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:10.918314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:10.918314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:10.922690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5b161af-4c3d-4beb-97de-a68e8fbbdf95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:10.923594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5b161af-4c3d-4beb-97de-a68e8fbbdf95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:10.937080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.938225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.938697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:10.939425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:10.939889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:10.940321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.263986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5b161af-4c3d-4beb-97de-a68e8fbbdf95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:11.273120 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5b161af-4c3d-4beb-97de-a68e8fbbdf95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1218 microversion: 2.1 time: 0.358545 Aug 30 03:39:11.273747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1558/3150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:10 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:11.491942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-91391998-aa3f-4362-a73d-4c2ae21f98d4 req-de0d816f-47e9-42c1-bf39-0b0443a077e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19296f5-70f5-4402-8f62-b2ac7154e52b", "name": "network-vif-plugged", "status": "completed", "tag": "08e221fc-f914-4a0f-8215-c91031adb366"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:11.515953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-91391998-aa3f-4362-a73d-4c2ae21f98d4 req-de0d816f-47e9-42c1-bf39-0b0443a077e9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.516447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-91391998-aa3f-4362-a73d-4c2ae21f98d4 req-de0d816f-47e9-42c1-bf39-0b0443a077e9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.516936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-91391998-aa3f-4362-a73d-4c2ae21f98d4 req-de0d816f-47e9-42c1-bf39-0b0443a077e9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.561569 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-91391998-aa3f-4362-a73d-4c2ae21f98d4 req-de0d816f-47e9-42c1-bf39-0b0443a077e9 service nova] Creating event network-vif-plugged:08e221fc-f914-4a0f-8215-c91031adb366 for instance a19296f5-70f5-4402-8f62-b2ac7154e52b on n-h2-854924-5 Aug 30 03:39:11.576897 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-91391998-aa3f-4362-a73d-4c2ae21f98d4 req-de0d816f-47e9-42c1-bf39-0b0443a077e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301269 Aug 30 03:39:11.578129 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1559/3151] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:11.592444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:11.593216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:11.600894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:11.602909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.603656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.604344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.608793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.609664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.610766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.665432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:11.677965 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43f90a6f-1b64-4677-9a68-346a6a64a4df tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.767048 Aug 30 03:39:11.678562 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1593/3152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:10 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:11.711146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:11.712201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:11.731991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.732603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.733058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.736793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.738526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.739343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.823735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:11.838623 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4a118e5-a429-417e-9309-54a21b1d7a97 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1319 microversion: 2.1 time: 0.259046 Aug 30 03:39:11.844582 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1560/3153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:11 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:11.853179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f8ae574-0979-4c54-85a3-40f02cbb9602 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:11.857567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f8ae574-0979-4c54-85a3-40f02cbb9602 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 9dde27cd-056c-488f-984d-8cb25cfbf0f3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:11.870142 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-8f8ae574-0979-4c54-85a3-40f02cbb9602 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 9dde27cd-056c-488f-984d-8cb25cfbf0f3 could not be found. Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f8ae574-0979-4c54-85a3-40f02cbb9602 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/9dde27cd-056c-488f-984d-8cb25cfbf0f3/action HTTP/1.1 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 65 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 9dde27cd-056c-488f-984d-8cb25cfbf0f3 could not be found. Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '9dde27cd-056c-488f-984d-8cb25cfbf0f3', 'body': {'rebuild': {'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c'}}} Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dde27cd-056c-488f-984d-8cb25cfbf0f3 could not be found. Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:39:11.872032 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dde27cd-056c-488f-984d-8cb25cfbf0f3 could not be found. Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dde27cd-056c-488f-984d-8cb25cfbf0f3 could not be found. Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f8ae574-0979-4c54-85a3-40f02cbb9602 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 9dde27cd-056c-488f-984d-8cb25cfbf0f3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:11.876575 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f8ae574-0979-4c54-85a3-40f02cbb9602 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/9dde27cd-056c-488f-984d-8cb25cfbf0f3/action" status: 404 len: 111 microversion: 2.1 time: 0.030043 Aug 30 03:39:11.878635 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1561/3154] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:11 2022] POST /compute/v2.1/servers/9dde27cd-056c-488f-984d-8cb25cfbf0f3/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:11.887755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:11.888434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:11.900280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.900787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.901232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:11.902459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:11.902459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:11.902862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:12.235261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:12.243769 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b5a3a6a-745f-49d2-aa64-b6b101fb55b0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.564070 Aug 30 03:39:12.247495 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1594/3155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:11 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:12.261604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:12.262232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:12.276419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:12.277152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:12.278640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:12.280411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:12.284784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:12.285462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:12.421763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:12.434236 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-19ff5ea8-03cf-450f-a419-0a2215af091d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.551569 Aug 30 03:39:12.435141 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1562/3156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:11 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:12.448094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:12.453163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:12.467652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:12.468557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:12.469175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:12.472208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:12.472854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:12.474323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.219585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:13.243208 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b7bfa8b-4cfa-4392-a433-6aa516d4544a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.994556 Aug 30 03:39:13.257094 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1595/3157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:12 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:13.263903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:13.264532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:13.273691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:13.275408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:13.276244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:13.276860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.277904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:13.278611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:13.279229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.491669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:13.499343 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5142849-90bb-44f0-9ecd-fa51f4ceeee9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1276 microversion: 2.1 time: 0.240766 Aug 30 03:39:13.515592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1596/3158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:13 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:13.530724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:13.531358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:13.538289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:13.538839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:13.539280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.539985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:13.540438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:13.540861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.660454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:13.670303 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-745fbfc0-9fa7-47ab-a560-56a547a62a26 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.233944 Aug 30 03:39:13.671004 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1563/3159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:12 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:13.677863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:13.678698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:13.685703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:13.686392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:13.687556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.688494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:13.688958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:13.689478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:13.973651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:13.983581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08b9f48d-a806-46b8-891f-912532819a33 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.465681 Aug 30 03:39:14.002151 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1597/3160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:13 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:14.009488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da0eaad-32e6-4960-9396-8ae4e91cc62a", "name": "network-vif-plugged", "status": "completed", "tag": "8e715ba3-e6b7-41bd-8dca-f3b49730fa72"}, {"server_uuid": "6b87b4f3-b583-42ce-a94f-139ccdf72d2f", "name": "network-vif-plugged", "status": "completed", "tag": "ed8d07e0-0322-4ad6-a061-f0203a7edb31"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:14.020601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.021104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.021820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.041048 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] Creating event network-vif-plugged:8e715ba3-e6b7-41bd-8dca-f3b49730fa72 for instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a on n-h1-854924-5 Aug 30 03:39:14.041598 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] Creating event network-vif-plugged:ed8d07e0-0322-4ad6-a061-f0203a7edb31 for instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f on n-h2-854924-5 Aug 30 03:39:14.050144 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6d08fb55-d2a0-421d-9036-c0ab152d01c4 req-e7bf5099-eab9-4300-b81e-bdb273aea689 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046041 Aug 30 03:39:14.050976 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1598/3161] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:14.058561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:14.059296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:14.067160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.067813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.068242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.069307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.070119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.070704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.108690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:14.119154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e61bdec-c32b-4f79-a34f-36a10d890ebf tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1469 microversion: 2.1 time: 0.446743 Aug 30 03:39:14.119750 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1564/3162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:13 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:14.128397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d39bda01-3c6f-4096-bb81-5c2dfa4cf0ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:14.128941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d39bda01-3c6f-4096-bb81-5c2dfa4cf0ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 2db8adfe-2b93-4f09-9923-1aa131b047cf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:14.140407 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d39bda01-3c6f-4096-bb81-5c2dfa4cf0ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 2db8adfe-2b93-4f09-9923-1aa131b047cf could not be found. Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d39bda01-3c6f-4096-bb81-5c2dfa4cf0ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/2db8adfe-2b93-4f09-9923-1aa131b047cf/action HTTP/1.1 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 15 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: {"restore": {}} Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 2db8adfe-2b93-4f09-9923-1aa131b047cf could not be found. Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2db8adfe-2b93-4f09-9923-1aa131b047cf', 'body': {'restore': {}}} Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db8adfe-2b93-4f09-9923-1aa131b047cf could not be found. Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db8adfe-2b93-4f09-9923-1aa131b047cf could not be found. Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:14.147706 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:14.153107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:14.153107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:14.153107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db8adfe-2b93-4f09-9923-1aa131b047cf could not be found. Aug 30 03:39:14.153107 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:14.157547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d39bda01-3c6f-4096-bb81-5c2dfa4cf0ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 2db8adfe-2b93-4f09-9923-1aa131b047cf could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:14.158639 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d39bda01-3c6f-4096-bb81-5c2dfa4cf0ce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/2db8adfe-2b93-4f09-9923-1aa131b047cf/action" status: 404 len: 111 microversion: 2.1 time: 0.036390 Aug 30 03:39:14.166329 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1565/3163] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:14 2022] POST /compute/v2.1/servers/2db8adfe-2b93-4f09-9923-1aa131b047cf/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:14.171240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:14.171847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:14.183424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.184194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.184806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.185715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.186332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.186940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.702670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:14.714545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-769aab45-7039-4798-bf96-7a948ee2be04 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1319 microversion: 2.1 time: 0.547023 Aug 30 03:39:14.729395 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1566/3164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:14 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:14.734592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:14.735826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:14.743269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.744047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.744661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.745543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.746151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.746744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.771525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:14.782885 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9e94d4e4-72f4-48ce-853c-fa1dd71c20ac tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.729910 Aug 30 03:39:14.784226 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1599/3165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:14 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:14.789097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:14.789991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:14.798739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.799557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.800368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:14.801336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:14.802191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:14.802824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.149632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:15.158666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:15.163383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba953f07-dea1-44b0-b47b-84eb131cdaa3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.432526 Aug 30 03:39:15.165418 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1567/3166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:14 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:15.170443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:15.172158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:15.180618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.181512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.182196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.183143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.183819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.184593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.206547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:15.217939 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c318f30-c356-474b-a8b0-0f4649e2d64d tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1328 microversion: 2.1 time: 0.432359 Aug 30 03:39:15.222000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1600/3167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:14 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1328 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:15.238319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:15.239479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:15.246554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.247055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.247501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.248820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.249436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.249870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.289879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:15.299250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-73c18543-fb27-4c29-bed3-e39b0e190472 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1276 microversion: 2.1 time: 0.132352 Aug 30 03:39:15.299929 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1568/3168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:15 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:15.320203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:15.320868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:15.338815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.339134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.339579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.340283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.340740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.343177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.834037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:15.851433 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c78cf5b7-8225-4eb0-92fe-83a0e59020bb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.628064 Aug 30 03:39:15.852833 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1601/3169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:15 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:15.857794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:15.858612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:15.873460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.874351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.874954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.875841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.880727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.881365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.919440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:15.932205 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30c76e4e-e75a-44ee-ba80-bdff572e4587 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.629950 Aug 30 03:39:15.947074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1569/3170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:15 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:15.948734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:15.949500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:15.968574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.969103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.969683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:15.970419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:15.976601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:15.977110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.278259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:16.295152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:16.307656 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a8dce63-bb0f-46da-bcf5-6e12e000e96a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.368046 Aug 30 03:39:16.308517 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1570/3171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:15 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:16.309311 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cef181c8-025a-4dd9-9677-847e62a70437 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1319 microversion: 2.1 time: 0.451680 Aug 30 03:39:16.321774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:16.324178 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1602/3172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:15 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:16.324539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:16.331094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.331929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.333196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.334670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.335290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.335963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.351134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:16.355811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:16.370060 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'restore' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 15 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: {"restore": {}} Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'restore' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'restore': {}}} Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state active. Cannot restore while the instance is in this state. Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:16.373190 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:16.378456 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:16.378456 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:16.378456 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:16.378456 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:16.378456 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:16.378908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.378908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.378908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.378908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.378908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.378908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.384923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'restore' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:16.389069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-153a6e90-819e-4d74-af0f-98cc9930967a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 145 microversion: 2.1 time: 0.077636 Aug 30 03:39:16.390111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1571/3173] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:16 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:39:16.400224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:16.402626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:16.411638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.412554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.413437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.414428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.416181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.417029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.787105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:16.790590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:16.804131 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3be7f9b5-ee7a-405b-b8c0-f5a8dcd4dd45 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.409768 Aug 30 03:39:16.806190 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b56045f-9bb3-4ca7-a5fd-c072f96f199e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1527 microversion: 2.1 time: 0.479923 Aug 30 03:39:16.807908 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1603/3174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:16 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1527 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:16.816354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:16.817291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:16.825470 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1572/3175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:16 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:16.839706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:16.844583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:16.846509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.847109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.854822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.855742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.858455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.859188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.859674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.860085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.860228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:16.861135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:16.861902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:16.862542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:17.384386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:17.399602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-423cd44f-e1b3-4ccf-9173-9b50897bec9b tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1527 microversion: 2.1 time: 0.563585 Aug 30 03:39:17.415568 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1573/3176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:16 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1527 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:17.420197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:17.435737 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eaf6d731-351c-41a4-b041-573909f690f7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.625568 Aug 30 03:39:17.437461 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1604/3177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:16 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:17.444524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:17.446268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:17.452894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:17.453964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:17.461232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:17.462488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:17.463189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:17.464717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:17.608455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-506024ec-514f-463d-b78d-19ba06d2eb67 tempest-FloatingIPDetailsNegativeTestJSON-991985005 tempest-FloatingIPDetailsNegativeTestJSON-991985005-project] Calling method '.version_select at 0x7f897b8b89d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:17.730968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-506024ec-514f-463d-b78d-19ba06d2eb67 tempest-FloatingIPDetailsNegativeTestJSON-991985005 tempest-FloatingIPDetailsNegativeTestJSON-991985005-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 89661dd9-83d2-48c4-a11e-fb430a3c2bfe could not be found", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:39:17.731886 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-506024ec-514f-463d-b78d-19ba06d2eb67 tempest-FloatingIPDetailsNegativeTestJSON-991985005 tempest-FloatingIPDetailsNegativeTestJSON-991985005-project] HTTP exception thrown: Floating IP not found for ID 89661dd9-83d2-48c4-a11e-fb430a3c2bfe Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-506024ec-514f-463d-b78d-19ba06d2eb67 tempest-FloatingIPDetailsNegativeTestJSON-991985005 tempest-FloatingIPDetailsNegativeTestJSON-991985005-project] Request method failure captured: Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-floating-ips/89661dd9-83d2-48c4-a11e-fb430a3c2bfe HTTP/1.1 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYZlvgmGgK8JDmKDVo91S_O9fKIuzEmk3JvpV6HTlGv2usNWUdffit8RmpTnyNi_xaa6ntKhXnfmej95BTKmTmC_QhcSRjD16jOdIPYUJRNRnLMxtVa6jAzDx_gcD0av6tdgz5yd1JJFDFvo7hmbKi8ZWwYnUvKE4vJPYrBAzkpEBlA Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 44c618cbea8a4c369f3f37186149caaa Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-991985005 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44c618cbea8a4c369f3f37186149caaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44c618cbea8a4c369f3f37186149caaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44c618cbea8a4c369f3f37186149caaa", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44c618cbea8a4c369f3f37186149caaa"}]}] Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-991985005 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 44c618cbea8a4c369f3f37186149caaa Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-991985005 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-991985005-project Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 2d0069d708984c93bdb5c8441c3e34dd Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-991985005-project Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: exception: Floating IP not found for ID 89661dd9-83d2-48c4-a11e-fb430a3c2bfe Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '89661dd9-83d2-48c4-a11e-fb430a3c2bfe'} Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 89661dd9-83d2-48c4-a11e-fb430a3c2bfe could not be found Aug 30 03:39:17.733770 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a5ab6e8-6c4a-4c13-b046-e49a514304af'] Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 89661dd9-83d2-48c4-a11e-fb430a3c2bfe. Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 89661dd9-83d2-48c4-a11e-fb430a3c2bfe Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 89661dd9-83d2-48c4-a11e-fb430a3c2bfe Aug 30 03:39:17.740445 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:17.744236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-506024ec-514f-463d-b78d-19ba06d2eb67 tempest-FloatingIPDetailsNegativeTestJSON-991985005 tempest-FloatingIPDetailsNegativeTestJSON-991985005-project] Returning 404 to user: Floating IP not found for ID 89661dd9-83d2-48c4-a11e-fb430a3c2bfe {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:17.745283 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-506024ec-514f-463d-b78d-19ba06d2eb67 tempest-FloatingIPDetailsNegativeTestJSON-991985005 tempest-FloatingIPDetailsNegativeTestJSON-991985005-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/89661dd9-83d2-48c4-a11e-fb430a3c2bfe" status: 404 len: 111 microversion: 2.1 time: 0.328285 Aug 30 03:39:17.746351 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1574/3178] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:39:17 2022] GET /compute/v2.1/os-floating-ips/89661dd9-83d2-48c4-a11e-fb430a3c2bfe => generated 111 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:17.808611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:17.826356 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5ed482fd-c15a-495c-b83e-d89b45b213f0 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1469 microversion: 2.1 time: 0.386726 Aug 30 03:39:17.826943 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1605/3179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:17 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:17.848885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:17.849562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:17.868421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:17.870348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:17.870960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:17.872245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:17.875141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:17.876646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.061749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:18.062405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:18.071953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.072457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.072901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.073639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.096708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.099578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.178199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] HTTP exception thrown: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Request method failure captured: Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a HTTP/1.1 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYZM8pKBLlCd6qR6C5ArQgEJuCfhLjKP_vGPiq_4cqhRP4yVfcqHGK_AyuQQJsYqlEzRgA9-mR5jW1o61pTPiuV7WIkfRM2PszT5lit2dHjLsbtWegNUlPrJ5LxikAwaFadbvWpwxTM1J1iYlu8AJn0KWHxZGodG4vbp3i7sXPLHrn4 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 729cae0ff8a848209a88714d15c34ea4 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-486047718 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/729cae0ff8a848209a88714d15c34ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/729cae0ff8a848209a88714d15c34ea4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_729cae0ff8a848209a88714d15c34ea4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/729cae0ff8a848209a88714d15c34ea4"}]}] Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-486047718 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 729cae0ff8a848209a88714d15c34ea4 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-486047718 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestMultiTenantJSON-486047718-project Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 76e72a5944cc4533be1435564ec38846 Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-486047718-project Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7da0eaad-32e6-4960-9396-8ae4e91cc62a'} Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:18.186539 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:18.191675 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:39:18.194611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:18.197204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Returning 404 to user: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:18.198593 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eff7c953-138d-469f-b6e0-20d5d395e904 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 404 len: 111 microversion: 2.1 time: 0.450550 Aug 30 03:39:18.199674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1575/3180] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:39:17 2022] DELETE /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 111 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:18.204565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:18.205905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:18.209325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f090a6d8-7aba-419e-93eb-e97f9c178a47 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.377612 Aug 30 03:39:18.209966 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1606/3181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:17 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:18.213299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.213843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.214271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.215024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.215868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.216294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.230070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:18.235291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:18.236181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Searching by: {'reservation_id': 'r-x96k7gnl', 'deleted': False, 'project_id': 'e432c15ade254bae971801b45521fe7a'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:39:18.241839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.242348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.242830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.243739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.244379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.244819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.368565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:39:18.442345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:18.476220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:18.485714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.486615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.487404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.531143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:18.546849 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b50a59f0-da9b-4a61-b55e-957ac3a0ef31 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.345842 Aug 30 03:39:18.547453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1576/3182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:18 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:18.552497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f1b067a6-fb90-4f5d-b8d0-0019b8a8cd23 req-c40e54ff-60ae-4b89-8f71-89a75ec78ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c4cdbf-8780-41d1-a533-2648886fca54", "tag": "cabeb00d-2105-4617-8ed2-7f688acfbef8"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:18.563474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f1b067a6-fb90-4f5d-b8d0-0019b8a8cd23 req-c40e54ff-60ae-4b89-8f71-89a75ec78ccc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.563963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f1b067a6-fb90-4f5d-b8d0-0019b8a8cd23 req-c40e54ff-60ae-4b89-8f71-89a75ec78ccc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.564396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f1b067a6-fb90-4f5d-b8d0-0019b8a8cd23 req-c40e54ff-60ae-4b89-8f71-89a75ec78ccc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.578327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f1b067a6-fb90-4f5d-b8d0-0019b8a8cd23 req-c40e54ff-60ae-4b89-8f71-89a75ec78ccc service nova] Creating event network-changed:cabeb00d-2105-4617-8ed2-7f688acfbef8 for instance f7c4cdbf-8780-41d1-a533-2648886fca54 on n-h1-854924-5 Aug 30 03:39:18.585201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f1b067a6-fb90-4f5d-b8d0-0019b8a8cd23 req-c40e54ff-60ae-4b89-8f71-89a75ec78ccc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036341 Aug 30 03:39:18.586190 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1577/3183] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:18.592482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:18.593207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:18.599766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.600272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.600849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:18.602006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:18.602810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:18.603628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.364528 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-964cf5eb-d024-4666-8904-a8dea1b375a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-x96k7gnl" status: 200 len: 2931 microversion: 2.1 time: 1.140992 Aug 30 03:39:19.378770 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1607/3184] 10.222.0.30 () {58 vars in 1197 bytes} [Tue Aug 30 03:39:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-x96k7gnl => generated 2931 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:19.395557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13597684-f4ac-4010-b6b8-96ce00bfa6ac tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:19.400690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:19.408779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13597684-f4ac-4010-b6b8-96ce00bfa6ac tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: b6e8db1e-e8c8-437b-9607-c4362ff5cdc6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:19.411505 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-95a93f55-8860-4aab-84de-37f232d3914a tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1527 microversion: 2.1 time: 0.820327 Aug 30 03:39:19.412554 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1578/3185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:18 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1527 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:19.421337 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-13597684-f4ac-4010-b6b8-96ce00bfa6ac tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance b6e8db1e-e8c8-437b-9607-c4362ff5cdc6 could not be found. Aug 30 03:39:19.426808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb6e156a-f637-47e5-aaa9-c3b71ed47444 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13597684-f4ac-4010-b6b8-96ce00bfa6ac tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/b6e8db1e-e8c8-437b-9607-c4362ff5cdc6/action HTTP/1.1 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 14 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: {"resume": {}} Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance b6e8db1e-e8c8-437b-9607-c4362ff5cdc6 could not be found. Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'b6e8db1e-e8c8-437b-9607-c4362ff5cdc6', 'body': {'resume': {}}} Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e8db1e-e8c8-437b-9607-c4362ff5cdc6 could not be found. Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e8db1e-e8c8-437b-9607-c4362ff5cdc6 could not be found. Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:19.432835 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:19.438775 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:19.438775 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:19.438775 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e8db1e-e8c8-437b-9607-c4362ff5cdc6 could not be found. Aug 30 03:39:19.438775 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.439948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13597684-f4ac-4010-b6b8-96ce00bfa6ac tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance b6e8db1e-e8c8-437b-9607-c4362ff5cdc6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:19.440986 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13597684-f4ac-4010-b6b8-96ce00bfa6ac tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/b6e8db1e-e8c8-437b-9607-c4362ff5cdc6/action" status: 404 len: 111 microversion: 2.1 time: 0.060969 Aug 30 03:39:19.447471 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1608/3186] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:19 2022] POST /compute/v2.1/servers/b6e8db1e-e8c8-437b-9607-c4362ff5cdc6/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:19.453308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Action: 'update', calling method: >, body: {"server": {"name": "7da0eaad-32e6-4960-9396-8ae4e91cc62a_new"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:19.462713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:19.468235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.server_groups [None req-cb6e156a-f637-47e5-aaa9-c3b71ed47444 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Querying cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) for 2 instances {{(pid=122167) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 03:39:19.468971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6e156a-f637-47e5-aaa9-c3b71ed47444 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.469487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6e156a-f637-47e5-aaa9-c3b71ed47444 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.469934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6e156a-f637-47e5-aaa9-c3b71ed47444 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.476582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.479125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.481657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.482655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.486194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.486913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.524801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] HTTP exception thrown: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Request method failure captured: Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a HTTP/1.1 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 64 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYZM8pKBLlCd6qR6C5ArQgEJuCfhLjKP_vGPiq_4cqhRP4yVfcqHGK_AyuQQJsYqlEzRgA9-mR5jW1o61pTPiuV7WIkfRM2PszT5lit2dHjLsbtWegNUlPrJ5LxikAwaFadbvWpwxTM1J1iYlu8AJn0KWHxZGodG4vbp3i7sXPLHrn4 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 729cae0ff8a848209a88714d15c34ea4 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-486047718 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/729cae0ff8a848209a88714d15c34ea4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/729cae0ff8a848209a88714d15c34ea4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_729cae0ff8a848209a88714d15c34ea4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/729cae0ff8a848209a88714d15c34ea4"}]}] Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-486047718 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 729cae0ff8a848209a88714d15c34ea4 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-486047718 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestMultiTenantJSON-486047718-project Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 76e72a5944cc4533be1435564ec38846 Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-486047718-project Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "7da0eaad-32e6-4960-9396-8ae4e91cc62a_new"}} Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7da0eaad-32e6-4960-9396-8ae4e91cc62a', 'body': {'server': {'name': '7da0eaad-32e6-4960-9396-8ae4e91cc62a_new'}}} Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:19.528155 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] Returning 404 to user: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:19.533254 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-288688d1-bef0-45a1-a2bc-1f422f0c5a96 tempest-ServersNegativeTestMultiTenantJSON-486047718 tempest-ServersNegativeTestMultiTenantJSON-486047718-project] 10.222.0.30 "PUT /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 404 len: 111 microversion: 2.1 time: 0.082805 Aug 30 03:39:19.538624 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1609/3187] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:39:19 2022] PUT /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:19.548067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb6e156a-f637-47e5-aaa9-c3b71ed47444 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/178ab86e-4bf2-4f52-892f-22c7f39eea16" status: 200 len: 264 microversion: 2.1 time: 0.132335 Aug 30 03:39:19.550300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:19.554148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:19.554345 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1579/3188] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:39:19 2022] GET /compute/v2.1/os-server-groups/178ab86e-4bf2-4f52-892f-22c7f39eea16 => generated 264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:19.569301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:19.571894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.572846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:19.573733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.576028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.576910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.578853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.580556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.589027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.589829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.590566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.591425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.592032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.592634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.646130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:39:19.786269 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e660b468-be00-4a64-bd9a-73639c0e88c0 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 204 len: 0 microversion: 2.1 time: 0.229808 Aug 30 03:39:19.787655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1580/3189] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:39:19 2022] DELETE /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:39:19.794687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:19.796420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:19.802985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.803907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.804621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.805462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.806187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.806736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.905019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:19.915417 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-422e53a0-6a62-4720-81fd-eff9789112f6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.375702 Aug 30 03:39:19.916764 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1610/3190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:19 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:19.922336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:19.923074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:19.931641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.932281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.932846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:19.933684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:19.934409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:19.935058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.077512 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-44079a9c-44ef-4cec-a218-8197e983a93f tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1620 microversion: 2.1 time: 0.287864 Aug 30 03:39:20.080563 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1581/3191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:19 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1620 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:20.101378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:20.101661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:20.109484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.109986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.110488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.111178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.111637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.112068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.142366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:20.166907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:20.175910 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a596ad12-9a38-4321-8785-4bbaaa834a4d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.257665 Aug 30 03:39:20.177847 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1611/3192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:19 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:20.184694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:20.186355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:20.201332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.202117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.202890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.204614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.205401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.206269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.422888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:20.441777 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1944d566-6f97-417e-92a2-56bd9302f6df tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1533 microversion: 2.1 time: 0.344988 Aug 30 03:39:20.442954 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1582/3193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:20 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1533 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:20.450289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:20.451331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:20.458734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.460649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.461426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.462407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.463129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.463783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.469233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:20.478457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3892770-0e51-4462-b369-bf7500bae772 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.299167 Aug 30 03:39:20.493327 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1612/3194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:20 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:20.498858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:20.499583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:20.506368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.507008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.507568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.508648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.509201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.509747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.543651 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'resume' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 14 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: {"resume": {}} Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'resume' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'resume': {}}} Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state active. Cannot resume while the instance is in this state. Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:20.545743 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:39:20.550064 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:20.552779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'resume' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:20.554079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94b81777-48db-43fd-a2e6-f52d834ab061 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 144 microversion: 2.1 time: 0.059216 Aug 30 03:39:20.555329 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1613/3195] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:20 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 144 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:39:20.565033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:20.566234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:20.575074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.575936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.577110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.578088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.578778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.579569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.698910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78c52d53-c7b5-4d7b-9475-65ddc56fe88e tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 200 len: 1620 microversion: 2.1 time: 0.254151 Aug 30 03:39:20.720184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1583/3196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:20 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 1620 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:20.732960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef4a95af-0c85-494c-a7f8-82496fe7a88c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: .version_select at 0x7f89803bbaf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1679713142", "policies": ["anti-affinity"]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:20.749794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:20.759860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42933394-4523-49fe-b52c-c2158a52e7ef tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.200498 Aug 30 03:39:20.761263 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1614/3197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:20 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:20.770041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ef4a95af-0c85-494c-a7f8-82496fe7a88c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:20.782150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ef4a95af-0c85-494c-a7f8-82496fe7a88c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:20.786947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:20.787833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:20.795878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.796460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.796898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.797838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:20.798596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:20.799464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:20.884137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ef4a95af-0c85-494c-a7f8-82496fe7a88c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:20.894348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ef4a95af-0c85-494c-a7f8-82496fe7a88c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:20.915846 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef4a95af-0c85-494c-a7f8-82496fe7a88c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.188527 Aug 30 03:39:20.928175 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1584/3198] 10.222.0.30 () {60 vars in 1174 bytes} [Tue Aug 30 03:39:20 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:21.058759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2133744734", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "27952158-6c27-4bcb-8519-cc0fa8cde8bf"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:21.090345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:21.104765 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a99542e-f411-4672-acce-b012aa18721f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.324470 Aug 30 03:39:21.110107 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1615/3199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:20 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:21.154297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:39:21.198164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:21.198942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:21.210671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.211190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.211633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.212343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.212795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.213214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.543615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:21.553701 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6a6e1a1-8e70-4587-8d95-6ceb8cc70a9d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.359116 Aug 30 03:39:21.554704 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1616/3200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:21 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:21.559829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3fd6651-16b7-4692-9a72-2d987bcaae65 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3fd6651-16b7-4692-9a72-2d987bcaae65 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 160 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9674f167-e88d-4709-95e1-1809c91932c0"}]}} Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'networks': [{'uuid': '9674f167-e88d-4709-95e1-1809c91932c0'}]}}} Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi '' Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:39:21.564536 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3fd6651-16b7-4692-9a72-2d987bcaae65 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:21.571297 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3fd6651-16b7-4692-9a72-2d987bcaae65 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010063 Aug 30 03:39:21.573182 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1617/3201] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:39:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:39:21.580427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:21.581433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:21.592936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.593557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.594004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.595016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.595688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.596128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.631766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:39:21.632577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:39:21.633599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:39:21.634306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:39:21.634964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:39:21.653236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.654063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.654704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.655675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.656539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.657176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.678976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:21.685534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:21.702806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Going to run 2 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:39:21.705393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:39:21.752832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122167) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 03:39:21.760721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:21.781935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:21.784201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:21.790944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:21.793529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b365000-bd6a-490e-af36-ce08170bcc63 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1533 microversion: 2.1 time: 0.219886 Aug 30 03:39:21.794434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1618/3202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:21 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1533 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:21.806288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:21.807922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:21.819049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.820138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.820916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.822309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:21.823090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:21.823797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:21.840602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:21.846621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:21.865807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=633bd185-d6d9-422f-bc37-b3bc3e1a7662,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:39:21.958243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:21.973487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:22.010798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:22.020949 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbb11090-5cc6-4007-b6ba-d84f3910a157 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.225243 Aug 30 03:39:22.022344 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1619/3203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:21 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:22.045649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:22.045960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:22.047088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:22.053372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:22.078755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.081966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.084457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.087372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.088105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.089387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.117645 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1070b828-a3d1-453b-9900-9b6fb94f9e78 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.065469 Aug 30 03:39:22.121402 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1585/3204] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:39:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1068 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 30 03:39:22.130894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:22.136953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:22.139045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Searching by: {'deleted': False, 'project_id': 'e432c15ade254bae971801b45521fe7a'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:39:22.177058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.177937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.178901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.179968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.180733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.181295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.224513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:39:22.268836 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a27f97be-41f8-41fd-b019-7a608e00e779 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.141716 Aug 30 03:39:22.268836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1586/3205] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:39:22 2022] GET /compute/v2.1/servers => generated 1666 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:22.279977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-73330dd9-418f-44ce-9dd8-7e1db69b732f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:22.280605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-73330dd9-418f-44ce-9dd8-7e1db69b732f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:22.448095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-73330dd9-418f-44ce-9dd8-7e1db69b732f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:22.459114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-73330dd9-418f-44ce-9dd8-7e1db69b732f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1219 microversion: 2.1 time: 0.183199 Aug 30 03:39:22.460577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1587/3206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:22 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:22.533423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:22.560051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dfef30fe-38f2-484c-8c3f-0cf4fcc3aab6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.517071 Aug 30 03:39:22.563198 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1620/3207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:22 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:22.583236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:22.584127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:22.588784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-88f98ade-a554-4d42-8cc8-b8ea07a0c9cd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:22.589775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-88f98ade-a554-4d42-8cc8-b8ea07a0c9cd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: f1507064-ccca-4078-a7e6-ea3993aef9fc] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:22.596195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.596865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.598582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.600504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-88f98ade-a554-4d42-8cc8-b8ea07a0c9cd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance f1507064-ccca-4078-a7e6-ea3993aef9fc could not be found. Aug 30 03:39:22.602377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.603169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.603695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-88f98ade-a554-4d42-8cc8-b8ea07a0c9cd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/f1507064-ccca-4078-a7e6-ea3993aef9fc/action HTTP/1.1 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 14 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: {"shelve": {}} Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f1507064-ccca-4078-a7e6-ea3993aef9fc could not be found. Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f1507064-ccca-4078-a7e6-ea3993aef9fc', 'body': {'shelve': {}}} Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1507064-ccca-4078-a7e6-ea3993aef9fc could not be found. Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1507064-ccca-4078-a7e6-ea3993aef9fc could not be found. Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:22.604887 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:22.612807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:22.612807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:22.612807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1507064-ccca-4078-a7e6-ea3993aef9fc could not be found. Aug 30 03:39:22.612807 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:22.618379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-88f98ade-a554-4d42-8cc8-b8ea07a0c9cd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance f1507064-ccca-4078-a7e6-ea3993aef9fc could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:22.621178 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-88f98ade-a554-4d42-8cc8-b8ea07a0c9cd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/f1507064-ccca-4078-a7e6-ea3993aef9fc/action" status: 404 len: 111 microversion: 2.1 time: 0.038085 Aug 30 03:39:22.623909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:22.627738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1621/3208] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:22 2022] POST /compute/v2.1/servers/f1507064-ccca-4078-a7e6-ea3993aef9fc/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:22.636500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:22.640141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:22.650716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.651221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.651882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:22.652802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:22.654053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:22.654740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.007609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:23.021546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2da1b586-4617-4816-b396-a306e62f2f89 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.442416 Aug 30 03:39:23.022818 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1588/3209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:22 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:23.028750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:23.029521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:23.036580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.037498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.038200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.039158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.039949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.040924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.042711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:23.056753 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7edbb682-c2b6-4155-a994-c783a2fc2ca2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.427038 Aug 30 03:39:23.057640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1622/3210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:22 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:23.096364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:23.102620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:23.121035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.121556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.121988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.123036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.123568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.124129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.386405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:23.393849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:23.395861 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52026e9e-ae65-4909-adaf-80660b24dce8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.311969 Aug 30 03:39:23.407847 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ce130d6-103b-4524-a92b-170ae9a4b92e tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1533 microversion: 2.1 time: 0.382908 Aug 30 03:39:23.412010 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1623/3211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:23 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:23.413210 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1589/3212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:23 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1533 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:23.418049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:23.418812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:23.425249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.426041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.426478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.427364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.427811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.428395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.458401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lazy-loading 'flavor' on Instance uuid bf7df40a-028a-4b8d-ac8d-bae43dd4f7db {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:39:23.491344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:23.492840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:23.503435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.506274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.506764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.510270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.510773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.512806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.768210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:23.798804 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c38ef83a-79e3-469a-9a51-64901d4f12e3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1223 microversion: 2.1 time: 0.313271 Aug 30 03:39:23.799785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1590/3213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:23 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1223 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:23.853145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2923e19a-9232-4016-ad2d-2f6392ca4975 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 202 len: 0 microversion: 2.1 time: 0.439100 Aug 30 03:39:23.854828 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1624/3214] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:23 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:39:23.867454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:23.869500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:23.883527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.885142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.885969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:23.887214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:23.888179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:23.888988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.047158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:24.047973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:24.060389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:24.061005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:24.061540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.062519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:24.063916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:24.067653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:24.070302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.072670 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9d7e800-eabe-414f-a300-34b417dfd08b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.213673 Aug 30 03:39:24.091502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1591/3215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:23 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:24.393610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:24.402818 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0acb545b-9bac-4906-8d03-da1b94be649f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.361364 Aug 30 03:39:24.403948 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1625/3216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:24 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:24.436791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:24.438414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:24.449819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:24.450806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:24.451507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.452487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:24.453178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:24.453879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.831466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:24.832608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:24.840807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:24.841516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:24.842114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.843056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:24.843674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:24.844591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:24.910442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:24.919945 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9044e2c0-b413-475a-8c89-e0b784b28a13 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1533 microversion: 2.1 time: 0.487862 Aug 30 03:39:24.923584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:24.943814 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1592/3217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:24 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1533 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:25.040070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:25.056456 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d5399d9-5aaa-487a-b6cb-59c1f97b17f7 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1271 microversion: 2.1 time: 0.231127 Aug 30 03:39:25.057433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1626/3218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:24 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:25.103091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:25.103091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:25.111422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.121246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.121788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:25.123257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.124146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.124599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:25.424487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:25.425393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:25.432189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.432942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.433647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:25.434521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.435132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.435721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:25.649547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:25.666710 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6441f3f-008c-4f85-9b9d-a94a7625b9cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.571602 Aug 30 03:39:25.689540 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1593/3219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:25 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:25.876599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:25.886551 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9bb81d24-22e0-44a2-b6e2-010e148d730c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.465846 Aug 30 03:39:25.888157 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1627/3220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:25 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:25.944531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:25.945818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:25.955459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.956035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.957754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:25.963130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a5cf5945-b78b-4460-9cb7-8647824a6d73 req-cb65be99-62a7-4cef-be11-bd9d720fe8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da0eaad-32e6-4960-9396-8ae4e91cc62a", "name": "network-vif-deleted", "tag": "8e715ba3-e6b7-41bd-8dca-f3b49730fa72"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:25.969745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.970561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.972601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:25.981396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a5cf5945-b78b-4460-9cb7-8647824a6d73 req-cb65be99-62a7-4cef-be11-bd9d720fe8c7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:25.983242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a5cf5945-b78b-4460-9cb7-8647824a6d73 req-cb65be99-62a7-4cef-be11-bd9d720fe8c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:25.983944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a5cf5945-b78b-4460-9cb7-8647824a6d73 req-cb65be99-62a7-4cef-be11-bd9d720fe8c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.031630 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a5cf5945-b78b-4460-9cb7-8647824a6d73 req-cb65be99-62a7-4cef-be11-bd9d720fe8c7 service nova] Creating event network-vif-deleted:8e715ba3-e6b7-41bd-8dca-f3b49730fa72 for instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a on n-h1-854924-5 Aug 30 03:39:26.041067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a5cf5945-b78b-4460-9cb7-8647824a6d73 req-cb65be99-62a7-4cef-be11-bd9d720fe8c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349781 Aug 30 03:39:26.050809 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1594/3221] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:26.053971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.054479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.055050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.055517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lazy-loading 'fault' on Instance uuid 7da0eaad-32e6-4960-9396-8ae4e91cc62a {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:39:26.082439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:26.083203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:26.116766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.118596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.120947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.123558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.124746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.125436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.159742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46867e818a6c49f1910e372a625dc4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e3bf387c854106890134cfd995707b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:26.177333 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c0805cd-634a-405d-b9a5-47f216cd3374 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 200 len: 1318 microversion: 2.1 time: 0.232348 Aug 30 03:39:26.189383 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1628/3222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:25 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:26.283361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:26.308069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f0a694c-ac61-433d-a052-30671d91f0bc tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1277 microversion: 2.1 time: 0.230323 Aug 30 03:39:26.308683 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1595/3223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:26 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:26.701634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:26.703550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:26.715273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.717132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.717799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.728700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.729405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.731154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.731746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-35ede36a-64db-4778-88db-0e450eb37b61 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d32af0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:26.795250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35ede36a-64db-4778-88db-0e450eb37b61 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/aa30fb23-b17f-4de4-9735-aed4e833bc26" status: 200 len: 662 microversion: 2.1 time: 0.068224 Aug 30 03:39:26.803890 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1596/3224] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:39:26 2022] GET /compute/v2.1/images/aa30fb23-b17f-4de4-9735-aed4e833bc26 => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:26.809423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3c842e1b-d667-4a37-b530-83049549c363 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d09b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:26.865224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3c842e1b-d667-4a37-b530-83049549c363 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/aa30fb23-b17f-4de4-9735-aed4e833bc26" status: 200 len: 662 microversion: 2.1 time: 0.059953 Aug 30 03:39:26.865855 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1597/3225] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:39:26 2022] GET /compute/v2.1/images/aa30fb23-b17f-4de4-9735-aed4e833bc26 => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:39:26.909336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:26.910243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:26.919367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.923210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.925930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.926882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:26.928533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:26.929141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:26.963750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:26.977404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13b26e6a-63ef-4707-a84f-708b870fb9ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.282704 Aug 30 03:39:26.978669 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1629/3226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:26 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:27.113109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-95f8490f-2886-444f-805d-1d75e7937707 req-71b321ce-2b86-49bb-960a-4c98584bc383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633bd185-d6d9-422f-bc37-b3bc3e1a7662", "tag": "30a46c2c-315c-419e-8696-c59fdaf1ed94"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:27.126537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-95f8490f-2886-444f-805d-1d75e7937707 req-71b321ce-2b86-49bb-960a-4c98584bc383 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:27.127937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-95f8490f-2886-444f-805d-1d75e7937707 req-71b321ce-2b86-49bb-960a-4c98584bc383 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:27.129088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-95f8490f-2886-444f-805d-1d75e7937707 req-71b321ce-2b86-49bb-960a-4c98584bc383 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:27.148709 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-95f8490f-2886-444f-805d-1d75e7937707 req-71b321ce-2b86-49bb-960a-4c98584bc383 service nova] Creating event network-changed:30a46c2c-315c-419e-8696-c59fdaf1ed94 for instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 on n-h2-854924-5 Aug 30 03:39:27.154504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-95f8490f-2886-444f-805d-1d75e7937707 req-71b321ce-2b86-49bb-960a-4c98584bc383 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055537 Aug 30 03:39:27.155484 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1630/3227] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:27.180936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:27.201022 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3016504a-5c13-4096-871c-a37d720ea822 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.296274 Aug 30 03:39:27.201163 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1598/3228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:26 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:27.237984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:27.239579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] [instance: 7da0eaad-32e6-4960-9396-8ae4e91cc62a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:27.264279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:27.265571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:27.266928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:27.269035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:27.271383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:27.272156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:27.304184 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] HTTP exception thrown: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Request method failure captured: Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a HTTP/1.1 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYY9URvMTznFkUr2lZkJiItljTm_oN5XlwuDKOh_ocvyJOzAEt53SBb6XPnPfmaUVLiUm7WNFqyJsomoozS9gwBqIiHKmL7_guBLf8uGM_H6Az52HvkZHcUwRaXID6TTr6n56aOT8sZZCmP8MY6Fm9N2lgafgkZajIy0yAA_VbyeL-M Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 82e3bf387c854106890134cfd995707b Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2106835536 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/82e3bf387c854106890134cfd995707b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/82e3bf387c854106890134cfd995707b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_82e3bf387c854106890134cfd995707b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/82e3bf387c854106890134cfd995707b"}]}] Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2106835536 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 82e3bf387c854106890134cfd995707b Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2106835536 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2106835536-project Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 46867e818a6c49f1910e372a625dc4c2 Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2106835536-project Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7da0eaad-32e6-4960-9396-8ae4e91cc62a'} Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:27.306333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. Aug 30 03:39:27.310702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:39:27.313475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] Returning 404 to user: Instance 7da0eaad-32e6-4960-9396-8ae4e91cc62a could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:39:27.314797 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba792498-8d6a-403f-b675-7a891839e295 tempest-ServersNegativeTestMultiTenantJSON-2106835536 tempest-ServersNegativeTestMultiTenantJSON-2106835536-project] 10.222.0.30 "GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a" status: 404 len: 111 microversion: 2.1 time: 0.089605 Aug 30 03:39:27.316163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1631/3229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:27 2022] GET /compute/v2.1/servers/7da0eaad-32e6-4960-9396-8ae4e91cc62a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:39:27.333575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:27.334354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:27.343635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:27.344192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:27.344864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:27.348676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:27.349913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:27.350739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:28.002876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:28.005978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:28.016986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:28.018005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:28.019591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:28.020555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:28.021890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:28.022741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:28.213095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:28.230470 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-659a9b08-33ef-45bf-a582-c95a587c3445 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.905179 Aug 30 03:39:28.233200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1599/3230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:27 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:28.238168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-dfb28af9-8b80-4adc-8b8f-2e1ea65bb941 req-daa9d88f-60b1-4069-8305-bd235570b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c4cdbf-8780-41d1-a533-2648886fca54", "name": "network-vif-plugged", "status": "completed", "tag": "cabeb00d-2105-4617-8ed2-7f688acfbef8"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:28.265303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dfb28af9-8b80-4adc-8b8f-2e1ea65bb941 req-daa9d88f-60b1-4069-8305-bd235570b0d0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:28.265810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dfb28af9-8b80-4adc-8b8f-2e1ea65bb941 req-daa9d88f-60b1-4069-8305-bd235570b0d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:28.266238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dfb28af9-8b80-4adc-8b8f-2e1ea65bb941 req-daa9d88f-60b1-4069-8305-bd235570b0d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:28.279183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-dfb28af9-8b80-4adc-8b8f-2e1ea65bb941 req-daa9d88f-60b1-4069-8305-bd235570b0d0 service nova] Creating event network-vif-plugged:cabeb00d-2105-4617-8ed2-7f688acfbef8 for instance f7c4cdbf-8780-41d1-a533-2648886fca54 on n-h1-854924-5 Aug 30 03:39:28.302507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:28.303461 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-dfb28af9-8b80-4adc-8b8f-2e1ea65bb941 req-daa9d88f-60b1-4069-8305-bd235570b0d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068798 Aug 30 03:39:28.305005 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1600/3231] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:28.310211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:28.310931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:28.318308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:28.319004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:28.319634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:28.320561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:28.321215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:28.321903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:28.470824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:28.690113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:28.699901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b69fb9d-ff20-4951-adec-b7c816f453c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.701524 Aug 30 03:39:28.701000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1632/3232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:27 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:28.714205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e2da3b5-6d8c-4412-bc0c-9631015171c9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b554550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:28.794989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e2da3b5-6d8c-4412-bc0c-9631015171c9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/64ba40b8-9a97-4749-ac89-88ff44a5917c" status: 200 len: 661 microversion: 2.1 time: 0.092382 Aug 30 03:39:28.795993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1633/3233] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:39:28 2022] GET /compute/v2.1/images/64ba40b8-9a97-4749-ac89-88ff44a5917c => generated 661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:28.809660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9c0581a-fa99-4374-87cd-67e4430a0e7c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b600550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:28.857368 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9c0581a-fa99-4374-87cd-67e4430a0e7c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/64ba40b8-9a97-4749-ac89-88ff44a5917c" status: 200 len: 661 microversion: 2.1 time: 0.051672 Aug 30 03:39:28.858161 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1634/3234] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:39:28 2022] GET /compute/v2.1/images/64ba40b8-9a97-4749-ac89-88ff44a5917c => generated 661 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:39:28.871790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:28.885332 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce9aae35-0193-4d8a-a315-a9f853257656 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.579052 Aug 30 03:39:28.890232 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1601/3235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:28 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:29.259453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:29.260054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:29.266638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.267295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.267677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:29.268619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.269248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.270019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:29.622016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:29.634255 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8cf03c15-98a8-4d2f-9ddc-f5edea5ba6f2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.380816 Aug 30 03:39:29.635440 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1635/3236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:29 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:29.697244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-277adf06-c1b9-4255-9681-63ca3d4b60bf req-11d2814c-0d7d-4e85-9bfd-e47b9777a072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b419c0a6-ed2f-4f91-929c-bf9f97d48ac0", "tag": "0f21bdd9-39a7-47d3-a549-8e43e4563d1a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:29.706653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-277adf06-c1b9-4255-9681-63ca3d4b60bf req-11d2814c-0d7d-4e85-9bfd-e47b9777a072 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.707151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-277adf06-c1b9-4255-9681-63ca3d4b60bf req-11d2814c-0d7d-4e85-9bfd-e47b9777a072 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.707591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-277adf06-c1b9-4255-9681-63ca3d4b60bf req-11d2814c-0d7d-4e85-9bfd-e47b9777a072 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:29.718730 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-277adf06-c1b9-4255-9681-63ca3d4b60bf req-11d2814c-0d7d-4e85-9bfd-e47b9777a072 service nova] Creating event network-changed:0f21bdd9-39a7-47d3-a549-8e43e4563d1a for instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 on n-h1-854924-5 Aug 30 03:39:29.723196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:29.723355 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-277adf06-c1b9-4255-9681-63ca3d4b60bf req-11d2814c-0d7d-4e85-9bfd-e47b9777a072 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029721 Aug 30 03:39:29.723918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:29.724096 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1602/3237] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:29.730598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.731073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.731499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:29.732181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.732623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.733036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:29.908373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:29.909293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:29.917149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.920261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.920488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:29.921030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:29.924228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:29.928218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:30.115774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:30.127209 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-136b4d62-52fa-4a4a-8106-7daaf7ca0ab1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.409528 Aug 30 03:39:30.149202 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1636/3238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:30.271467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2555171b-ee30-4d0d-a692-60988a18af09 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b600700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:30.314910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:30.315807 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2555171b-ee30-4d0d-a692-60988a18af09 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/6c7ca36d-0693-454d-aecc-cba0c64aa82e" status: 200 len: 661 microversion: 2.1 time: 0.048679 Aug 30 03:39:30.318131 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1637/3239] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:39:30 2022] GET /compute/v2.1/images/6c7ca36d-0693-454d-aecc-cba0c64aa82e => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:39:30.333572 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a9b70458-54ce-43f0-ad2f-4a5546a082e6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1318 microversion: 2.1 time: 0.430143 Aug 30 03:39:30.334807 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1603/3240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:29 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:30.339269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d475636-519d-4729-89d2-944385d7e33d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b683af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:30.401313 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d475636-519d-4729-89d2-944385d7e33d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/6c7ca36d-0693-454d-aecc-cba0c64aa82e" status: 200 len: 661 microversion: 2.1 time: 0.070615 Aug 30 03:39:30.402231 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1638/3241] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:39:30 2022] GET /compute/v2.1/images/6c7ca36d-0693-454d-aecc-cba0c64aa82e => generated 661 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:30.463266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-659219203", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:30.537484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:39:30.664917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:30.665609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:30.672770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:30.673510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:30.674395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:30.675362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:30.676011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:30.676599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:31.123211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:31.128225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:39:31.130070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:39:31.130788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:39:31.131190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:39:31.131810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:39:31.136089 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aaa204f8-a4ee-4086-8a9d-4936e00b3ee4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.475763 Aug 30 03:39:31.136946 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1639/3242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:30 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:31.143941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:31.144776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:31.145454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:31.146534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:31.147177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:31.147844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:31.155897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:31.157148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:31.163775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:31.164525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:31.165122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:31.166159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:31.166953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:31.167604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:31.168085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Getting quotas for project 501102e4417a4fcb924b783e47e6fa6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:31.174802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Getting quotas for user a3b3482cb50a43c48b483ccb24923cdb and project 501102e4417a4fcb924b783e47e6fa6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:31.193144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:39:31.195838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:39:31.208862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:31.257077 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aea9652d-40b3-40d8-b42e-44816d1aa9c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797835 Aug 30 03:39:31.258031 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1604/3243] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:39:31.328818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1114948256", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:31.403974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:39:31.956229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:31.964098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bef5d6da-67a3-4234-8cda-48944728ca40 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.811973 Aug 30 03:39:31.977709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1640/3244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:31 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:31.982865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:31.983478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:31.990044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:31.990535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:31.990969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:31.991666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:31.992113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:31.992535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.361434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:39:32.362636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:39:32.364135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:39:32.364135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:39:32.364555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:39:32.380556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=47 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:32.394425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.395388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.395844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.396629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.403646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.404737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:32.405887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.414851 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7887dee1-319e-4089-a2be-0d2268f836f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1507 microversion: 2.1 time: 0.435709 Aug 30 03:39:32.431683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1641/3245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:31 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:32.436967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:32.437651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:32.438570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Getting quotas for project 501102e4417a4fcb924b783e47e6fa6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:32.445011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.446039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.446510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.447396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.448011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.448595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.449502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Getting quotas for user a3b3482cb50a43c48b483ccb24923cdb and project 501102e4417a4fcb924b783e47e6fa6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:32.467041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:39:32.469941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:39:32.532894 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-924dec01-9c32-411d-8016-ee95d969198c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207739 Aug 30 03:39:32.534215 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1605/3246] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:39:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:39:32.544938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:32.546168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:32.555233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.556342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.558890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.560358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.561101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.561778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.713016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:32.731745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5ffdefe-de87-46ba-b341-9002276ee805 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.298761 Aug 30 03:39:32.733038 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1642/3247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:32 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:32.739284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c1d7539-481d-4f4c-990f-e3f5970e35bf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:32.747134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c1d7539-481d-4f4c-990f-e3f5970e35bf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:32.784101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:32.805383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38ed85db-c17e-4a1b-9cd5-5982eada6a4f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1507 microversion: 2.1 time: 0.259535 Aug 30 03:39:32.807627 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1606/3248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:32 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:32.826086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:32.829126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:32.840577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.841082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.841553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.842268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:32.842727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:32.843153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:32.858889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c1d7539-481d-4f4c-990f-e3f5970e35bf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:32.867046 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c1d7539-481d-4f4c-990f-e3f5970e35bf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1218 microversion: 2.1 time: 0.131815 Aug 30 03:39:32.876311 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1643/3249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:32 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:32.988052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:32.990828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:32.999644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.001911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.002817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.004109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.004600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.005253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.008215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:39:33.008698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:39:33.011435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:39:33.012687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:39:33.013664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:39:33.140803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:33.162049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.163783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.166391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.168743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.170796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.172001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.235474 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1693aeea-a963-412e-9e4d-3245460c0515 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "POST /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54/action" status: 202 len: 1109 microversion: 2.1 time: 0.413313 Aug 30 03:39:33.239567 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1607/3250] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:39:32 2022] POST /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54/action => generated 1109 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 30 03:39:33.256125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:33.257224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:33.275459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.276331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.277550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.280693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.281467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.282097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.296842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:33.297827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:33.308958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2578fd6a-bab9-4413-b277-072eeaa96fdf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.325709 Aug 30 03:39:33.323069 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1644/3251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:32 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:33.503252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:33.511974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4c67ca3f-9e59-4fc1-9b54-f1b883e2b5d9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.261052 Aug 30 03:39:33.513386 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1608/3252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:33 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:33.556407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-88e66a5e-e53c-4f53-92f6-9f6631ada2c7 req-e3a02c58-5793-488c-bd7f-1b60301afcaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633bd185-d6d9-422f-bc37-b3bc3e1a7662", "name": "network-vif-plugged", "status": "completed", "tag": "30a46c2c-315c-419e-8696-c59fdaf1ed94"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:33.570811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88e66a5e-e53c-4f53-92f6-9f6631ada2c7 req-e3a02c58-5793-488c-bd7f-1b60301afcaa service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.572157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88e66a5e-e53c-4f53-92f6-9f6631ada2c7 req-e3a02c58-5793-488c-bd7f-1b60301afcaa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.572810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88e66a5e-e53c-4f53-92f6-9f6631ada2c7 req-e3a02c58-5793-488c-bd7f-1b60301afcaa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.588784 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-88e66a5e-e53c-4f53-92f6-9f6631ada2c7 req-e3a02c58-5793-488c-bd7f-1b60301afcaa service nova] Creating event network-vif-plugged:30a46c2c-315c-419e-8696-c59fdaf1ed94 for instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 on n-h2-854924-5 Aug 30 03:39:33.596389 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-88e66a5e-e53c-4f53-92f6-9f6631ada2c7 req-e3a02c58-5793-488c-bd7f-1b60301afcaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046626 Aug 30 03:39:33.597290 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1645/3253] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:33.752932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:33.753736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:33.772099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.773648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.780258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.782126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.783331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.784033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.897886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:33.899584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:33.906768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.907440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.907972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.908779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:33.909533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:33.910219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:33.955274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:33.964273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee6616f2-8491-45ef-a6d2-da2b0246fd45 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.215080 Aug 30 03:39:33.964885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1609/3254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:33 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:33.985798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:33.994614 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee8cf113-02e0-4499-aaed-7e2f24b9e83d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1222 microversion: 2.1 time: 0.104088 Aug 30 03:39:33.997471 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1646/3255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:33 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:34.332692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:34.333673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:34.339812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:34.340308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:34.340905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:34.341700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:34.342217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:34.342674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:34.534040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:34.537295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:34.546353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:34.547105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:34.547548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:34.548448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:34.549508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:34.550610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:34.579732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:34.591449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16fcc150-d914-41e2-802a-24c4889414aa tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.262928 Aug 30 03:39:34.599225 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1610/3256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:34 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:34.796721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:34.806186 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8bf010b3-0db1-4c78-bcc9-1c9f47915b0a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.276462 Aug 30 03:39:34.806782 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1647/3257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:34 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:34.988345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:34.989186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:35.000314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.001088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.001566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.002324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.002954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.003381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.020938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:35.021755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:35.031783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:35.033909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.036450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.038912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.039659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.040127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.041978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.227638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:35.238876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3ea8771-cf7e-474f-b882-7959034adc4b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1222 microversion: 2.1 time: 0.222585 Aug 30 03:39:35.240409 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1648/3258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:35 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:35.442533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:35.452451 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e17f01c7-2b7a-4189-8c30-aeb05446975f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.470128 Aug 30 03:39:35.454471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1611/3259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:34 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:35.621973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:35.621973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:35.627560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.628243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.628837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.630321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.631309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.632042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.659542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:35.828154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:35.830202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:35.837517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.839804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.841088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:35.843165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:35.844203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:35.850748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:36.000303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:36.018384 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76878fe3-2ad7-4173-bd9a-3789967533a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.402212 Aug 30 03:39:36.019389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1649/3260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:35 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:36.227890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:36.241463 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df7f69a3-6502-4626-a834-237c79a6d17c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.417260 Aug 30 03:39:36.256492 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1612/3261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:35 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:36.266522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:36.267405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:36.275026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:36.275669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:36.276526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:36.277369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:36.278079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:36.279004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:36.397128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:36.405600 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4003854b-e4cc-49d2-8d0f-cf4d8b9d43b6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1270 microversion: 2.1 time: 0.146042 Aug 30 03:39:36.406334 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1650/3262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:36 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:36.475236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:36.476035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:36.482322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:36.482814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:36.483252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:36.483955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:36.484414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:36.485042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:36.837524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:36.848247 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-afa3897c-61a5-4b8d-96f7-331af9da8542 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.377084 Aug 30 03:39:36.849274 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1613/3263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:36 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:37.044904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:37.045674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:37.056281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.056909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.057453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.058295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.058927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.059531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.268305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:37.268925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:37.285763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.288757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.289847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.290621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.291277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.291862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.578608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:37.593712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49036236-9afe-48c0-b150-3081497df7a3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.557833 Aug 30 03:39:37.594420 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1651/3264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:37 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:37.599717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:37.600336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:37.606710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.607207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.607647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.608360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.608818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.609244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.750632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:37.761725 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-73553992-7a3e-4e4d-a908-026bb98c07fe tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1276 microversion: 2.1 time: 0.165568 Aug 30 03:39:37.762519 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1652/3265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:37 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:37.869100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:37.870045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:37.876313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.877110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.877589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:37.878419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:37.879596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:37.880020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:38.261903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:38.277624 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08b80a63-b145-4aa4-bf99-ba0fd15b19cc tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 1.014310 Aug 30 03:39:38.279427 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1614/3266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:37 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:38.293883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-76d99d93-2f3b-40e1-b4c2-60e8b80db118 req-fc3b7576-41d7-4581-a85c-77b5f0915540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b419c0a6-ed2f-4f91-929c-bf9f97d48ac0", "name": "network-vif-plugged", "status": "completed", "tag": "0f21bdd9-39a7-47d3-a549-8e43e4563d1a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:38.329747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-76d99d93-2f3b-40e1-b4c2-60e8b80db118 req-fc3b7576-41d7-4581-a85c-77b5f0915540 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:38.331487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-76d99d93-2f3b-40e1-b4c2-60e8b80db118 req-fc3b7576-41d7-4581-a85c-77b5f0915540 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:38.333196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-76d99d93-2f3b-40e1-b4c2-60e8b80db118 req-fc3b7576-41d7-4581-a85c-77b5f0915540 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:38.351047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-76d99d93-2f3b-40e1-b4c2-60e8b80db118 req-fc3b7576-41d7-4581-a85c-77b5f0915540 service nova] Creating event network-vif-plugged:0f21bdd9-39a7-47d3-a549-8e43e4563d1a for instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 on n-h1-854924-5 Aug 30 03:39:38.358651 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-76d99d93-2f3b-40e1-b4c2-60e8b80db118 req-fc3b7576-41d7-4581-a85c-77b5f0915540 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076584 Aug 30 03:39:38.361840 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1615/3267] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:38.624238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:38.624899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:38.638534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:38.640079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:38.641214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:38.642924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:38.643270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:38.644396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:38.680289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:38.691935 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a030704c-17f9-4023-bc23-93c1816dc118 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.826961 Aug 30 03:39:38.693686 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1653/3268] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:37 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:38.782699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:38.783538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:38.792283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:38.794235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:38.795340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:38.796652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:38.797317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:38.798565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:39.077329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:39.088472 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29f9cbbc-d3fa-4acb-aa45-ea8d536b1652 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1276 microversion: 2.1 time: 0.309945 Aug 30 03:39:39.090560 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1654/3269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:38 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:39.250172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:39.262326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3ed2381-34ae-428e-9f77-23ab70e37335 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.651335 Aug 30 03:39:39.263249 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1616/3270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:38 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:39.300057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:39.301211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:39.309988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:39.310494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:39.310936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:39.317400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:39.317893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:39.318346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:39.714492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:39.715104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:39.723694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:39.724467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:39.724899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:39.725840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:39.726295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:39.726715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:39.746254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:39.755813 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-15ca07ec-c287-4b88-9a6b-ecc52999ec24 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.459627 Aug 30 03:39:39.756733 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1655/3271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:39 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:40.111443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:40.112350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:40.119517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:40.120002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:40.120795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:40.121736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:40.122361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:40.122980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:40.267449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:40.280017 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77104f75-02bf-4ed9-962c-6f9d12c500cb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1319 microversion: 2.1 time: 0.569236 Aug 30 03:39:40.284548 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1617/3272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:39 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:40.301428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:40.304488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:40.312745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:40.319474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:40.320253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:40.321442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:40.330266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:40.331164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:40.631371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:40.648399 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-995641c2-a342-4639-9e21-472a6ff070a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.540691 Aug 30 03:39:40.649306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1656/3273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:40 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:40.774975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:40.780391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:40.780391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:40.785865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:40.790991 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5108f437-4a87-439b-a41d-4b52cee1c68f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.503843 Aug 30 03:39:40.791886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:40.792332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:40.793068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:40.793544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:40.794365 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1618/3274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:40 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:40.795119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:41.309842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:41.310639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:41.321622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:41.322135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:41.322585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:41.323341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:41.326886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:41.327729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:41.755197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:41.795766 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a58b49e-e5f0-4537-8068-c25a8f834045 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 1.018186 Aug 30 03:39:41.797955 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1657/3275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:40 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:41.804442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:41.806494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:41.829065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:41.830885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:41.831773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:41.834248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:41.835033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:41.835881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.019138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:42.036895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0d8ae6f-2515-416f-a177-f81b889df6b8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1467 microversion: 2.1 time: 0.726635 Aug 30 03:39:42.045519 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1619/3276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:41 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1467 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:42.067482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:42.068891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:42.101056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.103489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.104237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.106767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.107527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.109658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.240071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:42.256269 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0dbda80-de4c-4b82-b1fe-a3bc946bc9a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.456375 Aug 30 03:39:42.271238 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1658/3277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:41 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:42.281847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:42.283971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:42.294856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.295373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.295827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.296565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.297148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.298092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.428475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:42.459394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=5 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:42.627507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:42.638225 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccd56e3c-198d-442a-9e5d-ef01fe9db3d5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.590514 Aug 30 03:39:42.643449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1620/3278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:42 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:42.661462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a2f3bf5e-9f5c-401c-9c6a-e1598c257070 req-be7084e1-983e-41ec-90c6-fcd0a33e9268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:42.695172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a2f3bf5e-9f5c-401c-9c6a-e1598c257070 req-be7084e1-983e-41ec-90c6-fcd0a33e9268 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.697879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a2f3bf5e-9f5c-401c-9c6a-e1598c257070 req-be7084e1-983e-41ec-90c6-fcd0a33e9268 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.699517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a2f3bf5e-9f5c-401c-9c6a-e1598c257070 req-be7084e1-983e-41ec-90c6-fcd0a33e9268 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.737328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:42.740288 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a2f3bf5e-9f5c-401c-9c6a-e1598c257070 req-be7084e1-983e-41ec-90c6-fcd0a33e9268 service nova] Creating event network-changed:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:39:42.748099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-610c05a9-1c7e-4e11-87b8-87a4b5124d3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662" status: 200 len: 1469 microversion: 2.1 time: 0.475365 Aug 30 03:39:42.760402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a2f3bf5e-9f5c-401c-9c6a-e1598c257070 req-be7084e1-983e-41ec-90c6-fcd0a33e9268 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113659 Aug 30 03:39:42.762536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1621/3279] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:42.762863 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1659/3280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:42 2022] GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:42.780172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:42.792091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:42.797522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Searching by: {'reservation_id': 'r-1daghy7j', 'deleted': False, 'project_id': 'e432c15ade254bae971801b45521fe7a'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:39:42.814573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.815305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.815932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.816736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:42.817609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:42.818645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.819416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.820108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.827312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.828600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.829050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.831831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:42.832618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:42.838274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:42.867302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:42.964524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:39:43.127941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:43.141832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:43.144309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:43.147608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:43.501869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:43.512147 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58f8aa6e-6cb5-4b41-be7f-36254347fae3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.699558 Aug 30 03:39:43.526583 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1660/3281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:42 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:43.532786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:43.533430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:43.539701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:43.540192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:43.540627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:43.541398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:43.541837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:43.542250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:43.875708 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57111050-3ae9-4d41-9ce5-fabc248f595c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-1daghy7j" status: 200 len: 2929 microversion: 2.1 time: 1.106818 Aug 30 03:39:43.877687 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1622/3282] 10.222.0.30 () {58 vars in 1197 bytes} [Tue Aug 30 03:39:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1daghy7j => generated 2929 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:43.883773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:43.885063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:43.892328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:43.893682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:43.894404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:43.895413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:43.896987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:43.897632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.056396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:44.064588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d07892c3-9fd5-4b50-8d79-268348943c23 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.536652 Aug 30 03:39:44.065172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1661/3283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:43 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:44.083623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50cdcfd0-f289-47ba-9f6d-b9d86f27b537 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:44.115209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.server_groups [None req-50cdcfd0-f289-47ba-9f6d-b9d86f27b537 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Querying cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) for 2 instances {{(pid=122168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 03:39:44.117088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50cdcfd0-f289-47ba-9f6d-b9d86f27b537 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.118182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50cdcfd0-f289-47ba-9f6d-b9d86f27b537 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.118892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50cdcfd0-f289-47ba-9f6d-b9d86f27b537 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.200421 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50cdcfd0-f289-47ba-9f6d-b9d86f27b537 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/27952158-6c27-4bcb-8519-cc0fa8cde8bf" status: 200 len: 271 microversion: 2.1 time: 0.133912 Aug 30 03:39:44.215788 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1662/3284] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:39:44 2022] GET /compute/v2.1/os-server-groups/27952158-6c27-4bcb-8519-cc0fa8cde8bf => generated 271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:44.237691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:44.240616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:44.259502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.261276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.263468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.265835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.266307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.266750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.287127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:44.295543 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-757643c7-24c9-4635-8b84-1173688eface tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.416618 Aug 30 03:39:44.309370 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1623/3285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:43 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:44.370181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2c28d1ed-488e-4b98-b97e-01ca5191849f req-1e73dcbb-b6e6-497a-922e-3d6e4cea6923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "name": "network-vif-plugged", "status": "completed", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:44.390150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2c28d1ed-488e-4b98-b97e-01ca5191849f req-1e73dcbb-b6e6-497a-922e-3d6e4cea6923 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.390936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2c28d1ed-488e-4b98-b97e-01ca5191849f req-1e73dcbb-b6e6-497a-922e-3d6e4cea6923 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.392787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2c28d1ed-488e-4b98-b97e-01ca5191849f req-1e73dcbb-b6e6-497a-922e-3d6e4cea6923 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.420185 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2c28d1ed-488e-4b98-b97e-01ca5191849f req-1e73dcbb-b6e6-497a-922e-3d6e4cea6923 service nova] Creating event network-vif-plugged:1d231e72-c1f2-4b64-96eb-d5a4fa229659 for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db on n-h1-854924-5 Aug 30 03:39:44.425509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2c28d1ed-488e-4b98-b97e-01ca5191849f req-1e73dcbb-b6e6-497a-922e-3d6e4cea6923 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059500 Aug 30 03:39:44.426515 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1624/3286] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:39:44.500759 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dfd8e208-1e14-4b9d-a695-32d4a0f03820 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662" status: 200 len: 1620 microversion: 2.1 time: 0.278650 Aug 30 03:39:44.509816 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1663/3287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:44 2022] GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 => generated 1620 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:44.538067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:44.538888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:44.544388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:44.546573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:44.552467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.553904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.556307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.557763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.560602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.561259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.561672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.562363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.563990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.569856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.570776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.571215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.819716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:44.835242 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a91e522f-8d21-491a-b25f-662e72425b75 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 200 len: 1618 microversion: 2.1 time: 0.305529 Aug 30 03:39:44.836111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1625/3288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:44 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 1618 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:44.842126 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69e354f8-93ec-4b27-8a42-125c2f9426e9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.302671 Aug 30 03:39:44.861980 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1664/3289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:44 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:44.968531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9081295b-d380-4e64-b7d6-ac0b4c6e2e4c req-0c2afa06-5a52-41eb-a069-7479d77d61ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ba30af-e8e3-4817-ab13-46a4b5e8325e", "tag": "cde12ff6-56bc-4b7f-8e16-1d13f9e6079f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:44.979566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9081295b-d380-4e64-b7d6-ac0b4c6e2e4c req-0c2afa06-5a52-41eb-a069-7479d77d61ff service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:44.980268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9081295b-d380-4e64-b7d6-ac0b4c6e2e4c req-0c2afa06-5a52-41eb-a069-7479d77d61ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:44.980902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9081295b-d380-4e64-b7d6-ac0b4c6e2e4c req-0c2afa06-5a52-41eb-a069-7479d77d61ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:44.986903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:44.995795 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9081295b-d380-4e64-b7d6-ac0b4c6e2e4c req-0c2afa06-5a52-41eb-a069-7479d77d61ff service nova] Creating event network-changed:cde12ff6-56bc-4b7f-8e16-1d13f9e6079f for instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e on n-h1-854924-5 Aug 30 03:39:45.001564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9081295b-d380-4e64-b7d6-ac0b4c6e2e4c req-0c2afa06-5a52-41eb-a069-7479d77d61ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036770 Aug 30 03:39:45.002971 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1626/3290] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:45.087140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:45.088170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:45.095590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.096667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.097372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.098384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.099094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.099748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.132431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1519782836", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "18f198dc-8871-4dff-bb85-142b689c1f0d"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:45.228230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] validate_networks() for None {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:39:45.281729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:45.290113 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e55f3652-da6e-41bb-9e50-5f7cd59e93fa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.208267 Aug 30 03:39:45.290792 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1665/3291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:45 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:45.321426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:45.322428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:45.330547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.331200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.331922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.332716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.333268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.333905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.354747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:45.591754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:45.605910 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee087a52-b1d0-471a-8caf-3cfa6d9de930 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.288007 Aug 30 03:39:45.617937 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1666/3292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:45 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:45.618045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:39:45.618045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:39:45.618045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:39:45.618045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:39:45.618045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:39:45.622810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.623298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.623736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.624458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.624916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.625366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.655763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:39:45.662674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:39:45.681566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:39:45.684318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:39:45.746539 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-63c39b2e-d50f-443e-8b8b-d1401167842b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620373 Aug 30 03:39:45.748116 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1627/3293] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:39:45.760972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c384b16-39bc-4f15-a7d4-52ead066567e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:45.761685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c384b16-39bc-4f15-a7d4-52ead066567e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:45.830102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c384b16-39bc-4f15-a7d4-52ead066567e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:45.840948 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c384b16-39bc-4f15-a7d4-52ead066567e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1217 microversion: 2.1 time: 0.085162 Aug 30 03:39:45.842517 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1667/3294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:45 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:45.863924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:45.864824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:45.877759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.878399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.878961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:45.881224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:45.881716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:45.882378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.046752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:46.056878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77db2172-d293-444a-a542-d1789d2cf0fd tempest-ExtensionsTest-408087880 tempest-ExtensionsTest-408087880-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:46.058519 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77db2172-d293-444a-a542-d1789d2cf0fd tempest-ExtensionsTest-408087880 tempest-ExtensionsTest-408087880-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.146286 Aug 30 03:39:46.059319 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1668/3295] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:39:45 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:39:46.066255 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f7abd7c-394d-4665-ae35-e8510d542508 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.207812 Aug 30 03:39:46.067001 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1628/3296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:45 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:46.070350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1ce9afe-77d6-4c8a-9017-526693ed5eeb tempest-ExtensionsTest-408087880 tempest-ExtensionsTest-408087880-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:46.072549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1ce9afe-77d6-4c8a-9017-526693ed5eeb tempest-ExtensionsTest-408087880 tempest-ExtensionsTest-408087880-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008519 Aug 30 03:39:46.073189 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1669/3297] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 30 03:39:46 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:39:46.310788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:46.311404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:46.318803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:46.319296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:46.319731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.320428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:46.320882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:46.321301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.481846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:46.491537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4f05d4f-ee24-4d90-bedb-1ee952d3419a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.184465 Aug 30 03:39:46.492095 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1629/3298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:46 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:46.630738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:46.632886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:46.641464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:46.642387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:46.642958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.645609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:46.646072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:46.646501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.791378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:46.799780 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6433a1e-2b19-4af8-b407-187c1b3ef609 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.175071 Aug 30 03:39:46.800417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1670/3299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:46 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:46.872280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:46.873156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:46.886562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:46.887101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:46.887580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.888455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:46.888945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:46.889392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:46.967144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:46.975706 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2444ab5-3e3f-476c-9d53-0f641b477c8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1269 microversion: 2.1 time: 0.110436 Aug 30 03:39:46.976467 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1630/3300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:46 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:47.108603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:47.109765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:47.117989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:47.118771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:47.119600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:47.120547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:47.121169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:47.121979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:47.385752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:47.415806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0a03d62-b460-4abf-9809-808f6fbdc617 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.329974 Aug 30 03:39:47.416846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1671/3301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:47 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:47.520445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:47.522063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:47.531440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:47.531937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:47.532369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:47.533077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:47.533559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:47.533978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:47.737012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:47.749169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d2e1240-28da-42b4-b73f-8227d339203d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.235227 Aug 30 03:39:47.759819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1631/3302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:47 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:47.831369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:47.832912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:47.847826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:47.849315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:47.851541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:47.853255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:47.855128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:47.856485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.009471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:48.010537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:48.028663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:48.032775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:48.034025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.037112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:48.037916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:48.041496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.590499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:48.611709 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23d61e89-ec6d-411d-9223-96903501d81f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.787957 Aug 30 03:39:48.612539 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1672/3303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:47 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:48.627955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:48.635321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:48.649698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:48.651406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:48.653407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.655023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:48.655755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:48.656456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.678641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:48.689947 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf951510-bc93-418b-a310-fd2078412d06 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 0.693545 Aug 30 03:39:48.691048 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1632/3304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:47 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:48.772642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:48.773273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:48.787970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:48.788542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:48.788988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.789742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:48.790201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:48.790628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:48.857318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:48.872212 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-35b52192-b6c7-4710-a213-24f6ad5bcba6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.255694 Aug 30 03:39:48.878253 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1673/3305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:48 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:49.031903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:49.042755 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-74494c5b-6fc5-42db-8b1f-cd944593e2a1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.274383 Aug 30 03:39:49.044244 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1633/3306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:48 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:49.635227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:49.636389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:49.654009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.654820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.655336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:49.664593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.665491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.668885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:49.742225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-117ccb0e-0fe4-44e6-b453-dc4579bdd32d req-9915acae-7364-4ea3-aee5-ab19f04e4297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3692df6c-bf9e-4c69-8c80-3ff0c20fe661", "tag": "48f237ea-7f82-40d7-9514-f2c81fe08f2b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:49.760622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-117ccb0e-0fe4-44e6-b453-dc4579bdd32d req-9915acae-7364-4ea3-aee5-ab19f04e4297 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.761104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-117ccb0e-0fe4-44e6-b453-dc4579bdd32d req-9915acae-7364-4ea3-aee5-ab19f04e4297 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.761571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-117ccb0e-0fe4-44e6-b453-dc4579bdd32d req-9915acae-7364-4ea3-aee5-ab19f04e4297 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:49.781307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-117ccb0e-0fe4-44e6-b453-dc4579bdd32d req-9915acae-7364-4ea3-aee5-ab19f04e4297 service nova] Creating event network-changed:48f237ea-7f82-40d7-9514-f2c81fe08f2b for instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 on n-h2-854924-5 Aug 30 03:39:49.799110 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-117ccb0e-0fe4-44e6-b453-dc4579bdd32d req-9915acae-7364-4ea3-aee5-ab19f04e4297 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432236 Aug 30 03:39:49.800743 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1674/3307] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:49.806936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:49.807680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:49.815297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.815863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.816448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:49.817156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.817634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.818960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:49.906426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:49.918916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c7d3a922-a3ee-45fb-8f9a-3aece64ce8b9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.288920 Aug 30 03:39:49.921117 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1634/3308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:49 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:49.927906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:49.928917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:49.936837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.937765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.939062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:49.940137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:49.940827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:49.941874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:50.145507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:50.156956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb6e21f7-72d4-43d2-934d-68b7c90ac2c6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 0.354850 Aug 30 03:39:50.157877 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1675/3309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:49 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:50.164521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:50.165720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:50.173779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:50.174768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:50.175841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:50.177101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:50.178352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:50.178881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:50.179504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:50.182678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38058781-36c8-4f40-b660-d5d6cac5c20b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.260153 Aug 30 03:39:50.183450 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1635/3310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:49 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:50.350875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:50.359010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e345b3f5-dcff-48be-90e1-cfc40d4be191 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.199671 Aug 30 03:39:50.359693 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1676/3311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:50 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:50.951622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:50.954265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:50.965732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:50.969258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:50.970289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:50.971142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:50.973100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:50.974311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:50.975292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.183027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:51.183845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:51.188000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:51.197004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:51.197769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:51.198683 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-50192453-ee0d-4767-9c73-972a5eec9f69 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.254072 Aug 30 03:39:51.199480 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1636/3312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:50 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:51.202200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.203055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:51.203534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:51.203973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.221033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:51.221708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:51.228601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:51.229094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:51.229750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.230883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:51.231661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:51.232377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.476354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:51.485477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-119c1a6c-07e1-4046-a3af-97810f2ab440 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 0.310256 Aug 30 03:39:51.488987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:51.498202 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1677/3313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:51 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:51.499754 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-19c6b3e8-c68b-4fc5-a9e4-2bc21f901e46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.283727 Aug 30 03:39:51.500514 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1637/3314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:51 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:51.504995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:51.505671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:51.514198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:51.514697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:51.515345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.516276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:51.516860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:51.517301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:51.737419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:51.750844 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cdfd6d5d-a176-4054-832d-b0a9b43e1fa4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.251253 Aug 30 03:39:51.758363 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1678/3315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:51 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:52.223786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:52.225214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:52.235340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:52.236036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:52.236889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:52.237871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:52.239143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:52.239793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:52.509373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:52.510218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:52.527711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:52.528194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:52.528636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:52.529369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:52.529838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:52.530264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:52.543731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:52.564130 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1357e01-8127-46e0-be24-448b2683e99e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1532 microversion: 2.1 time: 0.344661 Aug 30 03:39:52.566281 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1638/3316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:52 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1532 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:52.576070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:52.577183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:52.592409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:52.593443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:52.595808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:52.598116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:52.603673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:52.607312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:53.647896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:53.663619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:53.670278 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d1ad69b-26ce-497a-a5ee-26686901f11f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 1.102006 Aug 30 03:39:53.673471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1639/3317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:52 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:53.691704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-15a619f6-c6b8-40ed-8592-1a1436f2e0af tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 1.185731 Aug 30 03:39:53.692307 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1679/3318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:52 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:53.695042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:53.696036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:53.703743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:53.704521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:53.705135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:53.706048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:53.707190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:53.707809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:53.719392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-49d0dc0f-9bc1-4ae1-8be4-303ef1953eb7 req-27ed9168-505c-4fd8-8b20-73d28ce0a8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "name": "network-vif-plugged", "status": "completed", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:53.752034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-49d0dc0f-9bc1-4ae1-8be4-303ef1953eb7 req-27ed9168-505c-4fd8-8b20-73d28ce0a8d3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:53.755145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-49d0dc0f-9bc1-4ae1-8be4-303ef1953eb7 req-27ed9168-505c-4fd8-8b20-73d28ce0a8d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:53.755816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-49d0dc0f-9bc1-4ae1-8be4-303ef1953eb7 req-27ed9168-505c-4fd8-8b20-73d28ce0a8d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:53.829970 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-49d0dc0f-9bc1-4ae1-8be4-303ef1953eb7 req-27ed9168-505c-4fd8-8b20-73d28ce0a8d3 service nova] Creating event network-vif-plugged:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:39:53.872309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-49d0dc0f-9bc1-4ae1-8be4-303ef1953eb7 req-27ed9168-505c-4fd8-8b20-73d28ce0a8d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175296 Aug 30 03:39:53.876092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1680/3319] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:53.894312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:53.900404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:53.925724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:53.927076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:53.927827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:53.929023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:53.929817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:53.930584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:54.110889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:54.124245 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0a397621-171b-49f2-b57b-a5f0d2a10936 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.448939 Aug 30 03:39:54.130594 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1640/3320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:53 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:54.370357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:54.380135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43cac3d1-cbdb-4f02-becd-ff8083df3785 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.502005 Aug 30 03:39:54.394811 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1681/3321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:53 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:54.695378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:54.696084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:54.712050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:54.712563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:54.712997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:54.713771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:54.714215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:54.714749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:54.736314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:54.736933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:54.769045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:54.770862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:54.773221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:54.774226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:54.778599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:54.780818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:55.635386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:55.636245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:55.649811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:55.654275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ceb13f8-68ed-49fb-99a2-c6b454ca5b84 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 0.921774 Aug 30 03:39:55.654875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1682/3322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:54 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:55.668287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:55.668287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:55.675316 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-81a32149-5b61-4e5a-af1b-1168f6b19250 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.982113 Aug 30 03:39:55.679837 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1641/3323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:54 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:55.683436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:55.683937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:55.684377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:55.685093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:55.685580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:55.686000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:55.690430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:55.691972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:55.719260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:55.726935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:55.727741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:55.730853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:55.735504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:55.736333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:55.736963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:55.837014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:56.122399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:56.143123 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cab23123-3d13-4350-a3a6-242ccd3a1c06 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.456330 Aug 30 03:39:56.143823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1642/3324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:55 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:56.294065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:56.307975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff0459be-a7bb-488d-b36d-b88c9da63658 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.651879 Aug 30 03:39:56.309274 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1683/3325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:55 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:56.608992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-832dc184-e910-40d2-ab9e-9eb42ce20021 req-8590b5f8-6665-4885-b701-890ab1c1972e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3692df6c-bf9e-4c69-8c80-3ff0c20fe661", "name": "network-vif-plugged", "status": "completed", "tag": "48f237ea-7f82-40d7-9514-f2c81fe08f2b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:56.648498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-832dc184-e910-40d2-ab9e-9eb42ce20021 req-8590b5f8-6665-4885-b701-890ab1c1972e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:56.651186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-832dc184-e910-40d2-ab9e-9eb42ce20021 req-8590b5f8-6665-4885-b701-890ab1c1972e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:56.652030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-832dc184-e910-40d2-ab9e-9eb42ce20021 req-8590b5f8-6665-4885-b701-890ab1c1972e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:56.677012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:56.678177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:56.689006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:56.693835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:56.694685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:56.695924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:56.700433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:56.701551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:56.717219 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-832dc184-e910-40d2-ab9e-9eb42ce20021 req-8590b5f8-6665-4885-b701-890ab1c1972e service nova] Creating event network-vif-plugged:48f237ea-7f82-40d7-9514-f2c81fe08f2b for instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 on n-h2-854924-5 Aug 30 03:39:56.730092 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-832dc184-e910-40d2-ab9e-9eb42ce20021 req-8590b5f8-6665-4885-b701-890ab1c1972e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134630 Aug 30 03:39:56.735004 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1643/3326] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:56.748953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:56.752162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:56.773678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:56.779429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:56.783302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:56.786522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:56.788709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:56.790716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:57.400118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:57.425445 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d5d2aad-c3a2-4f02-b448-c0cb189cdfc5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 0.752826 Aug 30 03:39:57.426059 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1684/3327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:56 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:57.430940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:57.431561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:57.450366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:57.451095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:57.451307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:57.455204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:57.455986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:57.463501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:57.603465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:57.608566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:57.617073 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfba55e5-a127-43a3-9a9c-8a5b094e7793 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.880621 Aug 30 03:39:57.622058 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1644/3328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:56 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:57.632137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:57.640160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:57.662486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:57.663357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:57.664094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:57.665096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:57.665817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:57.666475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:57.930258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:57.939647 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d1be2bcb-9443-4156-af83-fd0ee2325ed0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.511805 Aug 30 03:39:57.939647 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1685/3329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:57 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:58.054146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:58.132498 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c0dbb4a-5be4-4007-b038-0888ea8330af tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.508724 Aug 30 03:39:58.133096 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1645/3330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:57 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:58.450940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:58.451580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:58.459308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:58.460040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:58.460658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:58.461721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:58.462425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:58.463136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:58.645987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:58.647020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:58.663009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:58.663891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:58.667351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:58.669084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:58.670359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:58.674844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:58.943748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:58.958523 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b79c65a5-2bd0-4642-a86f-c03b48ef3650 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1317 microversion: 2.1 time: 0.511051 Aug 30 03:39:58.979046 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1686/3331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:58 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:58.989989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-429ad32d-2536-4894-ac73-b8591d76fb6c req-cb5fb4e0-8923-4a83-bda7-b323bcfe8a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ba30af-e8e3-4817-ab13-46a4b5e8325e", "name": "network-vif-plugged", "status": "completed", "tag": "cde12ff6-56bc-4b7f-8e16-1d13f9e6079f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:39:59.000877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:59.011575 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f63c871e-8209-466c-840e-c27d1893a1fd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.371836 Aug 30 03:39:59.012569 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1646/3332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:58 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:39:59.012870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-429ad32d-2536-4894-ac73-b8591d76fb6c req-cb5fb4e0-8923-4a83-bda7-b323bcfe8a3c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:59.014089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-429ad32d-2536-4894-ac73-b8591d76fb6c req-cb5fb4e0-8923-4a83-bda7-b323bcfe8a3c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:59.014695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-429ad32d-2536-4894-ac73-b8591d76fb6c req-cb5fb4e0-8923-4a83-bda7-b323bcfe8a3c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:59.031218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:59.032274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:59.042313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:59.043201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:59.043879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:59.044879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-429ad32d-2536-4894-ac73-b8591d76fb6c req-cb5fb4e0-8923-4a83-bda7-b323bcfe8a3c service nova] Creating event network-vif-plugged:cde12ff6-56bc-4b7f-8e16-1d13f9e6079f for instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e on n-h1-854924-5 Aug 30 03:39:59.045019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:59.045759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:59.046423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:59.055161 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-429ad32d-2536-4894-ac73-b8591d76fb6c req-cb5fb4e0-8923-4a83-bda7-b323bcfe8a3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074992 Aug 30 03:39:59.056361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1687/3333] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:39:59.169315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:59.170166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:39:59.188369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:59.190814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:59.191540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:59.194589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:39:59.196082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:39:59.196771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:39:59.206810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:39:59.481867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:59.494201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2370fb0c-6a4a-4e21-af89-afe25f3b8242 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.467577 Aug 30 03:39:59.495187 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1647/3334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:59 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:59.626598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:39:59.644092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a4652c5-ab74-40ba-81e4-11b10e42fbb2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.481055 Aug 30 03:39:59.658090 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1688/3335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:59 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:39:59.985541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:39:59.986724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:00.005883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.011664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.013036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.017800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.018563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.019324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.038087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:00.039226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:00.056063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.059710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.060476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.061677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.062369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.063128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.399542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:00.423313 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ebaa7a43-3650-497d-846c-d01624f4367b tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1466 microversion: 2.1 time: 0.439944 Aug 30 03:40:00.425031 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1648/3336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:39:59 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:00.453594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:00.455025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:00.457278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:00.463988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.465600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.466730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.467696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.468855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.469915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.472730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01b73afe-7747-4c62-93bd-a96970687b8a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.438841 Aug 30 03:40:00.480540 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1689/3337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:00 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:00.521195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:00.521912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:00.552039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.557786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.560592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.570727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:00.574603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:00.579416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:00.947317 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bf853ae-fa6a-4861-9483-dd992c00f827 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1617 microversion: 2.1 time: 0.498918 Aug 30 03:40:00.969585 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1649/3338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:00 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1617 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:00.990195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:01.026556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-034ec9d0-bc82-48e1-8cc7-cbd8dcb823f5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.509661 Aug 30 03:40:01.028567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:01.031796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:01.039832 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1690/3339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:00 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:01.052269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:01.054537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:01.056800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:01.059811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:01.060678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:01.061706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:01.291140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-623870220", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["18f198dc-8871-4dff-bb85-142b689c1f0d"]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:01.410847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:40:01.436031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:01.456408 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df948500-e21b-464d-976a-3d368f69bc2f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1318 microversion: 2.1 time: 0.453229 Aug 30 03:40:01.473368 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1650/3340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:01 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:01.502647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:01.503159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:01.520583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:01.521075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:01.521569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:01.523703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:01.523703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:01.523703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:01.952531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:01.970130 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c544e196-fd5f-46bc-b996-a928ba7e4d52 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.476048 Aug 30 03:40:01.972378 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1651/3341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:01 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:02.120147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:02.121309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:02.131690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.132646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.133838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.134835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.135388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.135913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.153231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:40:02.154391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:40:02.155111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:40:02.155764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:40:02.157184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:40:02.168587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.169402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.170038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.171073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.171767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.174036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.217086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:40:02.229112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:40:02.255740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:40:02.260927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:40:02.345751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:02.389875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a93c1e2e-2dfa-4402-8d57-a7ace4bc035d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102514 Aug 30 03:40:02.398091 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1691/3342] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:40:02.403426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c5d93c8-4f04-479e-9ac4-499169bce2cd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:02.404059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c5d93c8-4f04-479e-9ac4-499169bce2cd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:02.516211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c5d93c8-4f04-479e-9ac4-499169bce2cd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:02.526003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c5d93c8-4f04-479e-9ac4-499169bce2cd tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1216 microversion: 2.1 time: 0.126649 Aug 30 03:40:02.543400 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1692/3343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:02 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:02.560602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:02.568846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:02.584486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:02.594072 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98dd4e68-4a47-4d8b-992b-f9ec2ef38b3e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.498636 Aug 30 03:40:02.596071 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1652/3344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:02 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:02.599639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.600891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.601955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.603471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.604552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.605587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.922598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:02.935401 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d30db2f9-4e40-4563-ac48-02e79d731400 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1468 microversion: 2.1 time: 0.390229 Aug 30 03:40:02.936205 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1693/3345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:02 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:02.968653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:02.970522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:02.981919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.983333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.984354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.988065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:02.989178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:02.990336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:02.997942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:02.998913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:03.011894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.013770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.014793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.016278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.017834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.018806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.548208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:03.557265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:03.572584 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8dec8707-3b15-4df0-b495-dcffcfe7d0a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1467 microversion: 2.1 time: 0.611051 Aug 30 03:40:03.588021 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1653/3346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:02 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1467 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:03.588751 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f20274e-4bc8-48b4-a997-b610bd0a35bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.599113 Aug 30 03:40:03.590582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1694/3347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:02 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:03.593324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:03.594158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:03.606658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1842726756"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:03.610275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:03.613552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.614097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.616852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.618814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.619444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.620037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.636516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.642902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.644074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.648157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.649789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.650490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.803930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:03.816540 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-24fa9cdb-f326-449f-adf2-b65d61812b77 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1220 microversion: 2.1 time: 0.226835 Aug 30 03:40:03.817735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1654/3348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:03 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:03.823572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:03.824841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:03.833865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.835338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.836121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:03.839434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:03.840971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:03.841705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:04.139964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:04.206199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-429a7fc0-8d73-4ba3-a5b2-b924c0ef7556 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.384624 Aug 30 03:40:04.206856 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1655/3349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:03 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:04.529016 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f6e124c-a885-4cf1-b8f6-e076abcd75df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "POST /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b/action" status: 202 len: 0 microversion: 2.1 time: 0.936479 Aug 30 03:40:04.530647 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1695/3350] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:40:03 2022] POST /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b/action => generated 0 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:40:04.547735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94fd1c11-c43b-41ba-84e6-1a155808cf08 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897affe820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:04.627763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:04.638825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:04.648085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:04.648842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:04.649573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:04.650812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:04.651574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:04.652228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:04.804878 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94fd1c11-c43b-41ba-84e6-1a155808cf08 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.261338 Aug 30 03:40:04.811807 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1656/3351] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:04 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:04.840465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:04.845773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:04.865742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:04.867408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:04.869868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:04.871202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:04.872989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:04.875062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:05.123722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:05.135415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:05.148109 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2d2b4c2c-8947-4719-826d-13f6f16fb75d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1276 microversion: 2.1 time: 0.309170 Aug 30 03:40:05.151524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1657/3352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:04 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:05.154878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-57526c56-6c84-42e4-8cea-dc1aa4a3ca6e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.546038 Aug 30 03:40:05.160469 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1696/3353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:04 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:05.233622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:05.236431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:05.253196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:05.254584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:05.255584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:05.257385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:05.258017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:05.262165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:05.529148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:05.546201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7c46deb-42df-4d3e-9779-75fb04a336c5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.318905 Aug 30 03:40:05.551096 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1658/3354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:05 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:05.820211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e7045ec-2410-4406-b370-baf88615e68b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983cfa700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:05.924836 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e7045ec-2410-4406-b370-baf88615e68b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.108647 Aug 30 03:40:05.933410 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1697/3355] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:05 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:06.179378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:06.182185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:06.182345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:06.182833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:06.203286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:06.203803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:06.204150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:06.204304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:06.204736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:06.204873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:06.205486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:06.205942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:06.206877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:06.213162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:06.216680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:06.217894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:06.704281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:06.719769 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0fb5e9fd-f90d-46af-a215-8be0eeb1e597 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.541238 Aug 30 03:40:06.739871 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1698/3356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:06 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:06.747585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:06.749655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:06.758841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:06.759694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:06.760378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:06.761478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:06.762297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:06.762970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:06.944257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:06.959530 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d341492d-c9c5-4310-bc26-7c3bcf74b890 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.782981 Aug 30 03:40:06.960789 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1659/3357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:06 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:06.971894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e423ce21-1492-4c14-a9da-be9e0df3a7a2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b4e790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:07.047084 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e423ce21-1492-4c14-a9da-be9e0df3a7a2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.084868 Aug 30 03:40:07.048064 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1660/3358] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:06 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:07.252018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:07.303383 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edb26995-baa2-4811-9446-13fa3fafee78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.559068 Aug 30 03:40:07.305263 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1699/3359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:06 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:07.538336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-60bf1efe-7719-4e4a-9647-3f743f1a99f1 req-5b8e6dbe-1240-4a1d-b992-e01770329e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f12a0d-edb1-41ac-a54f-95be0d3eb71e", "tag": "0311e04a-ee66-4b08-a748-c320b6b37684"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:07.562128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-60bf1efe-7719-4e4a-9647-3f743f1a99f1 req-5b8e6dbe-1240-4a1d-b992-e01770329e6b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:07.562610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-60bf1efe-7719-4e4a-9647-3f743f1a99f1 req-5b8e6dbe-1240-4a1d-b992-e01770329e6b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:07.563033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-60bf1efe-7719-4e4a-9647-3f743f1a99f1 req-5b8e6dbe-1240-4a1d-b992-e01770329e6b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:07.581752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-60bf1efe-7719-4e4a-9647-3f743f1a99f1 req-5b8e6dbe-1240-4a1d-b992-e01770329e6b service nova] Creating event network-changed:0311e04a-ee66-4b08-a748-c320b6b37684 for instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e on n-h2-854924-5 Aug 30 03:40:07.609010 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-60bf1efe-7719-4e4a-9647-3f743f1a99f1 req-5b8e6dbe-1240-4a1d-b992-e01770329e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075979 Aug 30 03:40:07.610290 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1661/3360] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:07.748972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:07.750054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:07.760947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:07.766801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:07.769719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:07.770744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:07.772580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:07.773225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:07.985094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:07.986265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:08.005315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:08.005847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:08.006292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:08.007319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:08.008003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:08.008902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:08.028803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:08.039875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-340b854c-f3dc-472e-aec0-481f6885b5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.298765 Aug 30 03:40:08.040511 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1700/3361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:07 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:08.065168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d709e5f-f950-4c83-91bf-ac3a7002637a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f89801eaca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:08.186499 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d709e5f-f950-4c83-91bf-ac3a7002637a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.126173 Aug 30 03:40:08.190185 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1701/3362] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:08 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:08.309601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:08.328214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:08.329615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:08.332169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-58cb671d-7b0c-4037-8202-d207a49ee527 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.351009 Aug 30 03:40:08.332765 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1662/3363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:07 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:08.349607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:08.350290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:08.350780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:08.351607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:08.352133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:08.352627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:08.541015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:08.551252 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-524d9f49-ae0d-4199-87a0-91ea19752029 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.225905 Aug 30 03:40:08.571166 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1702/3364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:08 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:09.062498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:09.063298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:09.074801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:09.075245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:09.075682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:09.076379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:09.076847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:09.077240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:09.204594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e0c3455-3cf9-405b-919c-3400225c8235 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b530550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:09.276546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:09.288467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd049901-2aa5-41d7-96a9-086e1a0b91f2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1514 microversion: 2.1 time: 0.230012 Aug 30 03:40:09.289614 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1663/3365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:09 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:09.330683 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e0c3455-3cf9-405b-919c-3400225c8235 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.130723 Aug 30 03:40:09.332504 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1703/3366] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:09 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:09.355309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:09.356522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:09.365966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:09.366735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:09.367615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:09.369246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:09.370568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:09.371306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:09.412355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:09.577580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:09.578646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:09.586984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:09.587640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:09.588307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:09.589419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:09.590095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:09.590600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:09.605902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:09.633162 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe2c641e-217d-45e7-8c65-d481daf05bec tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.283863 Aug 30 03:40:09.647634 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1664/3367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:09 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:09.858191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:09.868991 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-511191a5-4739-41cd-bf2b-52464684219e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.295462 Aug 30 03:40:09.892469 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1704/3368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:09 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:10.314640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:10.315269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:10.329362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:10.329949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:10.330554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:10.334098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:10.334568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:10.336345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:10.348575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-304d7c6e-d4e4-46d1-a1c0-97dfa96f8e02 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b5628b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:10.550625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:10.566595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6f561d4-60de-4f9f-b55b-5ddd4a07e894 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.257264 Aug 30 03:40:10.567198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1665/3369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:10 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:10.668401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:10.669585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:10.685882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:10.686390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:10.686833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:10.692785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:10.692785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:10.692785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:11.019502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:11.031120 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca7ac316-4962-4d89-993b-f8a7e62b4656 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.366845 Aug 30 03:40:11.032387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1666/3370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:10 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:11.039367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:11.040181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:11.048531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:11.049327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:11.049822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:11.051191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:11.051851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:11.052729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:11.329089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:11.341919 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90ba610c-68b4-4ec6-90a0-418d704d023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.307748 Aug 30 03:40:11.342975 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1667/3371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:11 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:11.516365 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-304d7c6e-d4e4-46d1-a1c0-97dfa96f8e02 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 1.172189 Aug 30 03:40:11.516945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1705/3372] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:10 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:11.594501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:11.595246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:11.603699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:11.604296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:11.604944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:11.605928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:11.606907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:11.608065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:11.855380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:11.871771 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c97eee7f-f5b9-4926-9168-46d1a051161d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.285605 Aug 30 03:40:11.890111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1668/3373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:11 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:12.056526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:12.057820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:12.078478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.079363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.080177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:12.081049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.082003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.082658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:12.183578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:12.296588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:12.314626 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e206b306-0d75-4de5-9d67-0a066192dc3f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.262435 Aug 30 03:40:12.330438 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1706/3374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:12 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:12.366987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:12.369185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:12.385484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.387587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.388263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:12.389282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.390177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.390866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:12.531528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:12.538193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-510d0bd2-6e78-4d5b-9de1-5ed1c6542acb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b530550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:12.627960 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-510d0bd2-6e78-4d5b-9de1-5ed1c6542acb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.098016 Aug 30 03:40:12.629798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1707/3375] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:12 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:12.763029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:12.780902 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-82d9e464-09a2-468e-8883-4df96605f272 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.420343 Aug 30 03:40:12.783942 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1669/3376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:12 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:12.897271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:12.899245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:12.924559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.926001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.929852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:12.932010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.935414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.935971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:12.968880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1beea35c-4ef4-4b0b-a972-9d1d0772e31e req-673e663b-b094-48d7-bb00-96d718b3cae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "name": "network-vif-plugged", "status": "completed", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:12.992249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1beea35c-4ef4-4b0b-a972-9d1d0772e31e req-673e663b-b094-48d7-bb00-96d718b3cae9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:12.993206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1beea35c-4ef4-4b0b-a972-9d1d0772e31e req-673e663b-b094-48d7-bb00-96d718b3cae9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:12.993901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1beea35c-4ef4-4b0b-a972-9d1d0772e31e req-673e663b-b094-48d7-bb00-96d718b3cae9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:13.025775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1beea35c-4ef4-4b0b-a972-9d1d0772e31e req-673e663b-b094-48d7-bb00-96d718b3cae9 service nova] Creating event network-vif-plugged:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:40:13.039287 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1beea35c-4ef4-4b0b-a972-9d1d0772e31e req-673e663b-b094-48d7-bb00-96d718b3cae9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072581 Aug 30 03:40:13.041676 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1670/3377] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:40:13.250139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:13.261987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9baa5389-f973-4db9-9470-4bf5729d614b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.369691 Aug 30 03:40:13.280455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1708/3378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:12 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:13.353081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:13.354229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:13.369925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:13.371403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:13.372106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:13.372974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:13.373924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:13.374508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:13.645485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1459e27-87bd-45f0-86a5-915f06ec03f2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b3188b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:13.733749 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1459e27-87bd-45f0-86a5-915f06ec03f2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.092603 Aug 30 03:40:13.739398 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1709/3379] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:13 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:13.753325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:13.768270 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e91e7984-982d-4a1b-945c-39b1e812db86 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.419220 Aug 30 03:40:13.770047 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1671/3380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:13 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:13.803940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:13.804543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:13.814575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:13.814928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:13.822899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:13.824924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:13.826942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:13.827792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:14.192151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:14.203009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3307220b-f100-41f3-8f07-c7e10a3590cc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.403840 Aug 30 03:40:14.203738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1710/3381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:13 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:14.288282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:14.289653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:14.298746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:14.299630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:14.300334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:14.301436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:14.303283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:14.303981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:14.518713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:14.526595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e21ce7f5-fdbb-46ab-ba71-c32814b518c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.243641 Aug 30 03:40:14.527169 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1672/3382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:14 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:14.748519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb4158ec-4c4a-475f-9644-7b053f20a268 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8980255dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:14.792673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:14.793617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:14.803144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:14.805952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:14.809501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:14.811267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:14.812119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:14.812785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:14.820802 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb4158ec-4c4a-475f-9644-7b053f20a268 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.076140 Aug 30 03:40:14.821561 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1711/3383] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:14 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:15.023173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:15.032013 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-99f814d5-32fc-4f6f-b72c-b85812eba983 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.244067 Aug 30 03:40:15.033026 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1673/3384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:14 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:15.083491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c4cdbf-8780-41d1-a533-2648886fca54", "name": "network-vif-unplugged", "status": "completed", "tag": "cabeb00d-2105-4617-8ed2-7f688acfbef8"}, {"server_uuid": "70f12a0d-edb1-41ac-a54f-95be0d3eb71e", "name": "network-vif-plugged", "status": "completed", "tag": "0311e04a-ee66-4b08-a748-c320b6b37684"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:15.103363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:15.108657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:15.109691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:15.117847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:15.141457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] Creating event network-vif-unplugged:cabeb00d-2105-4617-8ed2-7f688acfbef8 for instance f7c4cdbf-8780-41d1-a533-2648886fca54 on n-h1-854924-5 Aug 30 03:40:15.142304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] Creating event network-vif-plugged:0311e04a-ee66-4b08-a748-c320b6b37684 for instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e on n-h2-854924-5 Aug 30 03:40:15.162639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-515801b7-ad80-4574-baf6-fb4c86353cc6 req-d806b23d-c79c-4cff-9e4d-612d9599e2ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.089686 Aug 30 03:40:15.169002 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1712/3385] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:15.236956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:15.238723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:15.252671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:15.253972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:15.254795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:15.255697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:15.256325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:15.256922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:15.494694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:15.503400 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-29948481-98bf-48eb-81ef-ddf17c979163 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.280797 Aug 30 03:40:15.513388 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1674/3386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:15 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:15.548287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:15.549168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:15.560154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:15.560643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:15.561071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:15.562020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:15.562471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:15.563087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:15.748074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:15.757358 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f9b176a-6eac-4115-9f50-3ef3480f050f tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.212241 Aug 30 03:40:15.757358 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1713/3387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:15 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:15.838087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7908e33-f82a-44e6-adf0-8f49ef191e0b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b578b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:15.903607 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7908e33-f82a-44e6-adf0-8f49ef191e0b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.069568 Aug 30 03:40:15.913443 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1675/3388] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:15 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:16.060121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:16.061250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:16.070239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:16.071184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:16.071828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:16.073052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:16.073809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:16.074447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:16.246157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:16.256406 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8def2f01-d1cb-41ae-b804-fe48bd194858 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1316 microversion: 2.1 time: 0.204481 Aug 30 03:40:16.257167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1714/3389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:16 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:16.527395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:16.528017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:16.537972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:16.538478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:16.538924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:16.539637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:16.540100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:16.540530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:16.728661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:16.747232 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4ab42808-9a1b-4662-bec8-b59d04303f24 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1527 microversion: 2.1 time: 0.224499 Aug 30 03:40:16.749562 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1676/3390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:16 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1527 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:16.780201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:16.780895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:16.788851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:16.789439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:16.790112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:16.792971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:16.793850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:16.794477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:16.926012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69b680be-b211-4bd0-8aa5-5206db4df512 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b57a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:16.957564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:16.966958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61d7c5f8-a4f9-41ad-bf88-a821a7142e06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.192255 Aug 30 03:40:16.967430 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1715/3391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:16 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:16.997561 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69b680be-b211-4bd0-8aa5-5206db4df512 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.078411 Aug 30 03:40:17.000013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1677/3392] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:16 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:17.277103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:17.277892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:17.286378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:17.287296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:17.288169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:17.288953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:17.289806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:17.290741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:17.547109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:17.573604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-beaa8cf2-540d-498c-8e8e-4f22de921b85 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1466 microversion: 2.1 time: 0.299433 Aug 30 03:40:17.575593 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1716/3393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:17 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1466 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:17.597628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:17.598632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:17.606175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:17.607043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:17.608479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:17.609520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:17.610257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:17.610927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:17.774230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:17.775762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:17.788286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:17.789841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:17.790502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:17.805279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:17.805945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:17.806390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:17.961078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-452a5fc3-0f5f-4958-8bfd-8d043508e499 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1617 microversion: 2.1 time: 0.367036 Aug 30 03:40:17.966348 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1678/3394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:17 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1617 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:17.997684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:17.999025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:18.012665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:18.013581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:18.014189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:18.015226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:18.016167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:18.016949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:18.091452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:18.106781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f4b6c19-ee19-4cd0-a044-07bdfb51b177 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1509 microversion: 2.1 time: 0.338983 Aug 30 03:40:18.122217 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1717/3395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:17 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:18.128968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b26c942-d4dc-4e1f-bf13-419166a08d33 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b240d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:18.185523 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b26c942-d4dc-4e1f-bf13-419166a08d33 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.061318 Aug 30 03:40:18.188874 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1718/3396] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:18 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:18.198365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1745774958", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "18f198dc-8871-4dff-bb85-142b689c1f0d"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:18.288370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:40:18.309318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:18.319706 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cdd21b0b-1d4a-41a5-909d-0a3927f5ec7e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.334360 Aug 30 03:40:18.321246 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1679/3397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:17 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:19.133335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:19.134560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:19.150800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:19.151293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:19.151805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:19.152517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:19.152989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:19.153449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:19.176180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:40:19.177035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:40:19.177777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:40:19.178274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:40:19.179143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:40:19.201405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:19.202556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:19.203229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:19.204282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:19.205530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:19.206690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:19.234574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:40:19.244644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Getting quotas for user ca360cee4c844a5d91cdf6d1bb0879c4 and project e432c15ade254bae971801b45521fe7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:40:19.268611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:40:19.272880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:40:19.426174 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e11b69f-3c4d-4d28-b557-486a00081e21 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.222282 Aug 30 03:40:19.426828 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1719/3398] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:40:19.440982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f13e168-bdfb-4c87-b3b1-ff9ffcb6cbda tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b2404c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:19.448644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:19.460355 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba3b4dfa-d507-40e7-baed-1ac552d6ec8e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1509 microversion: 2.1 time: 0.330771 Aug 30 03:40:19.468040 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1680/3399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:19 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:19.483760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:19.484850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:19.494748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:19.495722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:19.496399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:19.497476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:19.498202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:19.498921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:19.536855 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f13e168-bdfb-4c87-b3b1-ff9ffcb6cbda tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.108721 Aug 30 03:40:19.537466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1720/3400] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:19 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:19.557749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-575fdf6d-8df9-428a-b952-80caab7ec5e9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:19.569660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-575fdf6d-8df9-428a-b952-80caab7ec5e9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:19.673426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-575fdf6d-8df9-428a-b952-80caab7ec5e9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:19.683188 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-575fdf6d-8df9-428a-b952-80caab7ec5e9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1217 microversion: 2.1 time: 0.144444 Aug 30 03:40:19.685322 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1721/3401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:19 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:19.733103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:19.743379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0da696e-ff17-49da-8489-98fd3b530138 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.274038 Aug 30 03:40:19.744503 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1681/3402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:19 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:20.492524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:20.493974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:20.514413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:20.518181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:20.519532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:20.522701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:20.524590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:20.525484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:20.552728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1b232fd-7dad-4d53-8268-4d2677e33792 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c33ee0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:20.604928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1b232fd-7dad-4d53-8268-4d2677e33792 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.057307 Aug 30 03:40:20.606231 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1682/3403] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:20 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:20.712124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:20.713078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:20.722758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:20.723586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:20.724252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:20.725667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:20.726316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:20.726919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:20.830841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:20.843913 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d568dc7c-af22-4f8b-8706-841262acb74b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1509 microversion: 2.1 time: 0.359545 Aug 30 03:40:20.844719 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1722/3404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:20 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:20.850713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:20.851649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:20.859212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:20.861657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:20.869103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:20.870829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:20.872541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:20.873280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:20.874856 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-314dee0d-4d1d-417f-aefd-02786e2e678f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1221 microversion: 2.1 time: 0.168708 Aug 30 03:40:20.876486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:20.877015 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1683/3405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:20 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:21.172325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:21.181172 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8423d1b4-7232-4aa1-a662-2cc3ca84ec6b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.335607 Aug 30 03:40:21.181802 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1723/3406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:20 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:21.620564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b4f7981-eab4-4272-9dfe-cf22ff825d04 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c2ab80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:21.762121 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b4f7981-eab4-4272-9dfe-cf22ff825d04 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.145837 Aug 30 03:40:21.762717 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1684/3407] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:21 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:21.774101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-894c8b5b-8e25-4274-b48d-1eb5941f3e25 req-ef600bd1-0a2e-464c-a755-0750d0e728ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c4cdbf-8780-41d1-a533-2648886fca54", "name": "network-vif-plugged", "status": "completed", "tag": "cabeb00d-2105-4617-8ed2-7f688acfbef8"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:21.811421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-894c8b5b-8e25-4274-b48d-1eb5941f3e25 req-ef600bd1-0a2e-464c-a755-0750d0e728ca service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:21.813914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-894c8b5b-8e25-4274-b48d-1eb5941f3e25 req-ef600bd1-0a2e-464c-a755-0750d0e728ca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:21.814366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-894c8b5b-8e25-4274-b48d-1eb5941f3e25 req-ef600bd1-0a2e-464c-a755-0750d0e728ca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:21.829380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:21.833154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:21.851000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=85 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:21.876691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:21.881650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:21.887735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:21.890369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-894c8b5b-8e25-4274-b48d-1eb5941f3e25 req-ef600bd1-0a2e-464c-a755-0750d0e728ca service nova] Creating event network-vif-plugged:cabeb00d-2105-4617-8ed2-7f688acfbef8 for instance f7c4cdbf-8780-41d1-a533-2648886fca54 on n-h1-854924-5 Aug 30 03:40:21.891415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:21.896686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:21.898728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:21.910756 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-894c8b5b-8e25-4274-b48d-1eb5941f3e25 req-ef600bd1-0a2e-464c-a755-0750d0e728ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140256 Aug 30 03:40:21.914924 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1724/3408] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:40:21.947728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:21.948789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:21.960924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:21.968753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:21.969250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:21.969708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:21.984379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:21.985931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:21.989746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:22.159997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-83ca1a94-6d67-4cbc-b8d4-6f976d4ed9cf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.336636 Aug 30 03:40:22.166616 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1685/3409] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:40:21 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:40:22.187457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:22.189825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:22.212320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:22.216506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:22.217888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:22.219034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:22.221379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:22.223498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:22.624677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:22.647528 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1c55d3e-2d2a-4606-bc53-81a7e2639715 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1269 microversion: 2.1 time: 0.473055 Aug 30 03:40:22.648671 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1686/3410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:22 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1269 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:22.664265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:22.667760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:22.686237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:22.687379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:22.688144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:22.689717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:22.690012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:22.691475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:22.692105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:22.707075 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62e48034-85a0-4ba7-8088-23b9e360d5ec tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1512 microversion: 2.1 time: 0.782256 Aug 30 03:40:22.707875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1725/3411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:21 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1512 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:22.720017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:22.725752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:22.741555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:22.742443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:22.743158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:22.744164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:22.745955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:22.746667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:23.810134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:23.825376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:23.832874 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a22c7a11-80a6-4ce0-972c-e91a381c7fa7 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 1.120105 Aug 30 03:40:23.837605 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1726/3412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:22 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:23.855235 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-efcb970e-b982-454e-9233-a8e6834ad731 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1672 microversion: 2.1 time: 1.205393 Aug 30 03:40:23.857632 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1687/3413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:22 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1672 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:23.863909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8227640e-7082-42c7-a504-259866ede2b0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b4e670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:23.864117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:23.864847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:23.889170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:23.906217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:23.906727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:23.907626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:23.907949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:23.920950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:23.997998 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8227640e-7082-42c7-a504-259866ede2b0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.138400 Aug 30 03:40:23.998610 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1688/3414] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:23 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:24.015463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:24.016103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:24.031786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.032195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.032634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.033372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.033833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.046190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.250025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:24.260020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b49dd993-1d2f-4c02-81cc-86b64090ce94 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1275 microversion: 2.1 time: 0.260096 Aug 30 03:40:24.265830 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1689/3415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:23 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:24.274550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-64891e05-8e84-4725-8ceb-8b040b41559e req-f2487f65-5120-42dd-a7b0-a43401e93da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "name": "network-vif-unplugged", "status": "completed", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:24.300915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64891e05-8e84-4725-8ceb-8b040b41559e req-f2487f65-5120-42dd-a7b0-a43401e93da9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.302659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64891e05-8e84-4725-8ceb-8b040b41559e req-f2487f65-5120-42dd-a7b0-a43401e93da9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.303500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-64891e05-8e84-4725-8ceb-8b040b41559e req-f2487f65-5120-42dd-a7b0-a43401e93da9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.334002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.server_external_events [req-64891e05-8e84-4725-8ceb-8b040b41559e req-f2487f65-5120-42dd-a7b0-a43401e93da9 service nova] Unable to find a host for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db. Dropping event network-vif-unplugged {{(pid=122167) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 03:40:24.335241 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-64891e05-8e84-4725-8ceb-8b040b41559e req-f2487f65-5120-42dd-a7b0-a43401e93da9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.068234 Aug 30 03:40:24.336019 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1690/3416] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 03:40:24.474786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:24.489111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7c5ef23d-c5b8-4641-9be9-04eb956816c0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1452 microversion: 2.1 time: 0.647289 Aug 30 03:40:24.493424 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1727/3417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:23 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1452 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:24.652544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:24.653763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:24.690234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.691261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.691928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.692928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.693637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.694288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.754551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lazy-loading 'flavor' on Instance uuid bf7df40a-028a-4b8d-ac8d-bae43dd4f7db {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:40:24.827178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'shelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state shelved_offloaded Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 14 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: {"shelve": {}} Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'shelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state shelved_offloaded Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'shelve': {}}} Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:40:24.832065 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state shelved_offloaded Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state shelved_offloaded Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:40:24.837180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'shelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state shelved_offloaded {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:40:24.839413 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e321eb21-b9bd-4f98-9272-9bf0512fe396 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 155 microversion: 2.1 time: 0.188712 Aug 30 03:40:24.840077 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1691/3418] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:40:24 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 155 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:40:24.853660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:24.860713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:24.882705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:24.889282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:24.895328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.896960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.900155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.905017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.906131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.907081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.922335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.923912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.924659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:24.932514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:24.939630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:24.943624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:25.514306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122168) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 03:40:25.587564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:25.596391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7273b5e3-2557-4919-b93f-9a4eeb8ba5c8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1520 microversion: 2.1 time: 0.739766 Aug 30 03:40:25.622760 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1692/3419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:24 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1520 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:25.652245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:25.652885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:25.679822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:25.702345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:25.702809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:25.703548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:25.704011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:25.704441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:25.721226 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b7435f4f-8bfd-4802-a558-393cb2e663b6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 202 len: 0 microversion: 2.1 time: 0.876034 Aug 30 03:40:25.723087 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1728/3420] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:40:24 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:40:25.736708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f836d5c4-b9e3-4690-b5d8-70029ee722cd tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b279670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:26.110381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:26.122321 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-525dba3c-4ea2-4fa8-a07e-be76770376a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1672 microversion: 2.1 time: 0.498337 Aug 30 03:40:26.140867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1693/3421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:25 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1672 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:26.149265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:26.153985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:26.168086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:26.168985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:26.171430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:26.177686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:26.178728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:26.179425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:26.360434 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f836d5c4-b9e3-4690-b5d8-70029ee722cd tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.636087 Aug 30 03:40:26.361029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1729/3422] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:25 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:26.386740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:26.390215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:26.413524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:26.415460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:26.417507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:26.418464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:26.418921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:26.421591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:26.480654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:26.489379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3331925f-ed4b-462a-8303-dddfee2439c1 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.347029 Aug 30 03:40:26.489969 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1694/3423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:26 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:26.634563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:26.635420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:26.651802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:26.652373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:26.652818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:26.653585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:26.654022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:26.658491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:26.885446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:26.900602 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01188f5c-9d58-4ce9-8c0c-527f4d8433e8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1460 microversion: 2.1 time: 0.533913 Aug 30 03:40:26.901536 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1730/3424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:26 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1460 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:27.145189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:27.145975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:27.163606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.174259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.176022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.177177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.184086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.184839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.196764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:27.210276 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7e621cb-39f2-4ef4-8c31-b465715dd017 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1505 microversion: 2.1 time: 0.579670 Aug 30 03:40:27.222745 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1695/3425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:26 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:27.245467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:27.246534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:27.259072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.260913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.261577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.263834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.267066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.272215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.528014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:27.542947 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1392742e-c73e-42c0-b9ee-9446bd551902 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.403085 Aug 30 03:40:27.550401 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1731/3426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:27 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:27.571205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe1150c4-cd85-4eee-bfe4-4b4887fb3bc2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b847940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:27.595028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:27.604733 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ffa17d31-876e-42df-b7d4-81d4d216c165 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 200 len: 1505 microversion: 2.1 time: 0.363307 Aug 30 03:40:27.605678 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1696/3427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:27 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:27.613308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:27.614250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:27.622252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.623023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.624623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.625574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.626201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.626842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.657758 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe1150c4-cd85-4eee-bfe4-4b4887fb3bc2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.105271 Aug 30 03:40:27.658659 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1732/3428] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:27 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:27.669845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:27.673993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:27.688848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.689643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.690337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.692916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.693663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.695374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.733202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:40:27.813048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:27.932261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1e6c7d19-a44e-4774-ba7b-f2c1997d1aa8 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 204 len: 0 microversion: 2.1 time: 0.271019 Aug 30 03:40:27.933274 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1733/3429] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:40:27 2022] DELETE /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:40:27.946366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:27.947750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:27.961764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.963017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.963627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:27.964536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:27.965156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:27.965765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:28.040152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:28.049536 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0e17a17-884d-423f-906c-58d02a6c1a82 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.440519 Aug 30 03:40:28.050471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1697/3430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:27 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:28.303947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-521916942", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "bb35cdd9-92eb-43df-ac7e-c5869f6415af"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:28.379815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:28.398119 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb888ead-21c8-4d4e-8469-08112545b439 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1460 microversion: 2.1 time: 0.462960 Aug 30 03:40:28.399170 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1734/3431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:27 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1460 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:28.498028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] validate_networks() for [('bb35cdd9-92eb-43df-ac7e-c5869f6415af', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:40:28.675353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eaf95584-048b-4a0c-9c61-190bc165f303 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897baa5e50>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:28.771507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eaf95584-048b-4a0c-9c61-190bc165f303 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.100337 Aug 30 03:40:28.775213 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1735/3432] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:28 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:29.079659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:29.080812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:29.117565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.118067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.127282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:29.133697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.135483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.136470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:29.222799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:29.626067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:29.649988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5dc6fedf-5de9-46c9-b524-bbaa4f0c3ca5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.570061 Aug 30 03:40:29.649988 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1736/3433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:29 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:29.665310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:29.668626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:29.689149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:29.704827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.705683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.706902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:29.707838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.709067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.709849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:29.756351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:40:29.756925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:40:29.757458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:40:29.758647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:40:29.759501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:40:29.774567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.778639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.779156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:29.779966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.780513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.780944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:29.815268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Getting quotas for project bd729db31b104e28a6ce9997802c55a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:40:29.826783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Getting quotas for user 25f09accc2c64314b7a83cac46bb3b2b and project bd729db31b104e28a6ce9997802c55a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:40:29.851416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:40:29.854627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:40:29.968868 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-74d2473f-7eb8-4eea-9e2e-ee36419ee845 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.668332 Aug 30 03:40:29.970566 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1698/3434] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:40:29.976867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:29.982388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0e3cc25f-0a68-4813-b1a3-13d33c3c4890 req-0fe050a6-480a-42a7-afde-5aade6d7c02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae5ece24-1de4-43b1-aa6d-18286bbc666f", "tag": "45afd486-aa87-4b99-ab58-c694e41af1a3"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:29.987488 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b733cdaa-ab5d-4521-8ddb-ed507c5b9d4b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.336341 Aug 30 03:40:29.988113 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1737/3435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:29.994238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1119d64-5e10-4336-863a-c6b826a6fe4d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b847d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:29.995040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e3cc25f-0a68-4813-b1a3-13d33c3c4890 req-0fe050a6-480a-42a7-afde-5aade6d7c02a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:29.996267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e3cc25f-0a68-4813-b1a3-13d33c3c4890 req-0fe050a6-480a-42a7-afde-5aade6d7c02a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:29.996931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e3cc25f-0a68-4813-b1a3-13d33c3c4890 req-0fe050a6-480a-42a7-afde-5aade6d7c02a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:30.026518 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0e3cc25f-0a68-4813-b1a3-13d33c3c4890 req-0fe050a6-480a-42a7-afde-5aade6d7c02a service nova] Creating event network-changed:45afd486-aa87-4b99-ab58-c694e41af1a3 for instance ae5ece24-1de4-43b1-aa6d-18286bbc666f on n-h1-854924-5 Aug 30 03:40:30.046222 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0e3cc25f-0a68-4813-b1a3-13d33c3c4890 req-0fe050a6-480a-42a7-afde-5aade6d7c02a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070139 Aug 30 03:40:30.048074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1699/3436] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:30.072017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c97ad81-a9b2-47da-a043-dc9c8c74c2a1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:30.072935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c97ad81-a9b2-47da-a043-dc9c8c74c2a1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:30.103312 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1119d64-5e10-4336-863a-c6b826a6fe4d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.114003 Aug 30 03:40:30.106362 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1738/3437] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:29 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:30.198795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c97ad81-a9b2-47da-a043-dc9c8c74c2a1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:30.215879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c97ad81-a9b2-47da-a043-dc9c8c74c2a1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1217 microversion: 2.1 time: 0.164368 Aug 30 03:40:30.230546 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1700/3438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:30 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:30.671512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:30.672134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:30.685621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:30.692253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:30.694457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:30.698376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:30.698921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:30.699967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:30.976283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:30.990095 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b3921ac-d95b-49e4-b63b-ea4ff175dc40 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.322129 Aug 30 03:40:30.992196 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1739/3439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:30 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:31.014357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:31.015762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:31.040288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:31.042262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:31.045092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:31.046201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:31.048439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:31.049414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:31.122513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94c3a17d-0bce-405a-af59-27421e33acda tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b562940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:31.252576 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94c3a17d-0bce-405a-af59-27421e33acda tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.135473 Aug 30 03:40:31.253933 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1740/3440] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:31 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:31.264187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:31.270794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:31.276966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:31.298545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:31.300513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:31.301009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:31.301989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:31.302661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:31.303576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:31.464411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:31.483623 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d710a6d-cec5-461c-a5c0-49b06ce39b70 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1269 microversion: 2.1 time: 0.227554 Aug 30 03:40:31.484579 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1741/3441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:31 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:31.540115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f6b8d923-d662-4de1-90ca-abcbc9e5aef3 req-0616541e-c84a-4bdd-8eb2-26d94b41b8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c4cdbf-8780-41d1-a533-2648886fca54", "name": "network-vif-deleted", "tag": "cabeb00d-2105-4617-8ed2-7f688acfbef8"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:31.565047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6b8d923-d662-4de1-90ca-abcbc9e5aef3 req-0616541e-c84a-4bdd-8eb2-26d94b41b8ad service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:31.570191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6b8d923-d662-4de1-90ca-abcbc9e5aef3 req-0616541e-c84a-4bdd-8eb2-26d94b41b8ad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:31.571105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f6b8d923-d662-4de1-90ca-abcbc9e5aef3 req-0616541e-c84a-4bdd-8eb2-26d94b41b8ad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:31.591073 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f6b8d923-d662-4de1-90ca-abcbc9e5aef3 req-0616541e-c84a-4bdd-8eb2-26d94b41b8ad service nova] Creating event network-vif-deleted:cabeb00d-2105-4617-8ed2-7f688acfbef8 for instance f7c4cdbf-8780-41d1-a533-2648886fca54 on n-h1-854924-5 Aug 30 03:40:31.601427 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f6b8d923-d662-4de1-90ca-abcbc9e5aef3 req-0616541e-c84a-4bdd-8eb2-26d94b41b8ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064467 Aug 30 03:40:31.602389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1742/3442] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:40:31.689296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:31.700078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e7e2902-d8f0-4278-8466-70d5e5b9c495 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.689764 Aug 30 03:40:31.703590 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1701/3443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:31 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:32.026984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:32.028073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:32.055329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:32.056355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:32.057798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:32.059267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:32.060074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:32.060705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:32.268437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-01debdb0-188c-4927-960e-a9bda5c15734 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c84790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:32.352848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-01debdb0-188c-4927-960e-a9bda5c15734 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.088105 Aug 30 03:40:32.358988 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1702/3444] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:32 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:32.423082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:32.436457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b35f6cbe-29df-4967-af15-08ffebbb5da4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.426120 Aug 30 03:40:32.438041 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1743/3445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:32 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:32.512804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:32.525598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:32.548429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:32.549267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:32.550078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:32.551263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:32.551995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:32.552682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:32.726142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:32.727098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:32.743114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:32.743933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:32.747241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:32.751940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:32.758704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:32.759682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:32.760334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:32.793154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-506ef34e-7d6e-4c0c-9ceb-1c19f9b5375a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1275 microversion: 2.1 time: 0.287338 Aug 30 03:40:32.809988 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1703/3446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:32 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:33.075878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:33.084778 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d47912b0-004b-44a6-8198-39dbec7d62c6 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.363377 Aug 30 03:40:33.089626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1744/3447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:32 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:33.374755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77e3c58f-a239-4756-8a7d-dd5fb54c9f39 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b4eb80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:33.474036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:33.474683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:33.480606 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77e3c58f-a239-4756-8a7d-dd5fb54c9f39 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.110572 Aug 30 03:40:33.481888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1704/3448] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:33 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:33.495522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:33.496035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:33.496485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:33.497247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:33.497744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:33.503939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:33.840491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:33.845207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:33.871059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:33.872043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:33.875070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:33.889659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:33.890606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:33.891266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:34.007277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:34.020659 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0a273966-aac6-4377-8e5d-a89a7a426bcb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.546627 Aug 30 03:40:34.040311 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1745/3449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:33 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:34.103871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:34.111724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:34.112892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:34.119651 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-36ea47c3-5cd8-477e-a4f9-a54ec31abbb4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1275 microversion: 2.1 time: 0.290812 Aug 30 03:40:34.121591 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1705/3450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:33 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:34.140311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:34.140820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:34.144818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:34.146026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:34.146455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:34.149953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:34.275027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e82bf5ce-e342-437a-9cde-38d8330ef912 req-1056c55a-d9ba-478c-8831-ddc3da7b306f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:34.303315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e82bf5ce-e342-437a-9cde-38d8330ef912 req-1056c55a-d9ba-478c-8831-ddc3da7b306f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:34.304282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e82bf5ce-e342-437a-9cde-38d8330ef912 req-1056c55a-d9ba-478c-8831-ddc3da7b306f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:34.304932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e82bf5ce-e342-437a-9cde-38d8330ef912 req-1056c55a-d9ba-478c-8831-ddc3da7b306f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:34.323764 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e82bf5ce-e342-437a-9cde-38d8330ef912 req-1056c55a-d9ba-478c-8831-ddc3da7b306f service nova] Creating event network-changed:1d231e72-c1f2-4b64-96eb-d5a4fa229659 for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db on n-h2-854924-5 Aug 30 03:40:34.332845 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e82bf5ce-e342-437a-9cde-38d8330ef912 req-1056c55a-d9ba-478c-8831-ddc3da7b306f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063765 Aug 30 03:40:34.335000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1706/3451] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:34.354609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:34.367690 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6da7de7b-ff90-462c-94fc-c8790fdc88a5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.258649 Aug 30 03:40:34.368915 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1746/3452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:34 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:34.496950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64a30790-6dba-4407-bcb2-7291d7f506c9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b982040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:34.561407 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64a30790-6dba-4407-bcb2-7291d7f506c9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 0.067889 Aug 30 03:40:34.572798 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1707/3453] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:34 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:35.044014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:35.044648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:35.057088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:35.057609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:35.058472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:35.058991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:35.069604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:35.071917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:35.148755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:35.149530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:35.170290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:35.171068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:35.171910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:35.172809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:35.173468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:35.174310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:35.670170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:35.686145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-059e8cc6-a139-46fb-b445-ae7c7ae37d8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.642884 Aug 30 03:40:35.688138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1747/3454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:35 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:35.702053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:35.712375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:35.721631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:35.722418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:35.723025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:35.723920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:35.728735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:35.734293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:35.741145 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f248c717-d177-44d1-8960-e53fecfa55d2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.596202 Aug 30 03:40:35.743177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:35.744821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:35.756975 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1708/3455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:35 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:35.774330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6dcb3284-f874-40af-96ef-ae8a9640c7e8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab3fb80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:36.037385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:36.048536 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05ed8490-89fb-49d3-acbb-ef3f777bdd09 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.359086 Aug 30 03:40:36.066480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1748/3456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:35 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:36.712549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:36.714698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:36.736916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:36.737750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:36.738371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:36.739279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:36.739902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:36.740497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:37.339468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:37.347922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58d8dafc-c20e-4dcc-bde5-77fdf7351a8f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.641713 Aug 30 03:40:37.353474 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1749/3457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:36 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:37.360666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:37.361768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:37.383681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:37.384680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:37.385286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:37.387287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:37.387950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:37.390631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:37.774139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:37.787045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76e2c48d-ac0f-4108-9739-92b9a95740ce tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.431345 Aug 30 03:40:37.789003 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1750/3458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:37 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:37.797072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:37.800261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:37.813450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:37.816761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:37.819339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:37.820427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:37.821142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:37.821845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:39.703847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:39.718082 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eea608e9-9571-4825-a8e9-500eea1628af tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 1.927560 Aug 30 03:40:39.735388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1751/3459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:37 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:39.756958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:39.757611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:39.788454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:39.790996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:39.791698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:39.792854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:39.794256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:39.795503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:39.799714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:40.206427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:40.341078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:40.352002 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8f3ee066-a228-425f-821d-49851773def6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.614576 Aug 30 03:40:40.373826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1752/3460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:39 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:40.387984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:40.391126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:40.405200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:40.406109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:40.407885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:40.410189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:40.410928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:40.413882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:40.456708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:40.792973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:40.802712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca2ffbd8-953e-4543-a151-835ddc2db08b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.427351 Aug 30 03:40:40.806042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1753/3461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:40 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:40.817598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e7bfccb9-9fc8-4a36-b00b-2c71022895b4 req-4cca78e3-02ed-4276-a633-3c0fb8161a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5bc8eb0-5c19-419d-9213-3b8b9d973ccf", "tag": "1d8b172e-eb09-40eb-ae27-f9b24cc004cb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:40.857135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e7bfccb9-9fc8-4a36-b00b-2c71022895b4 req-4cca78e3-02ed-4276-a633-3c0fb8161a82 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:40.857871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e7bfccb9-9fc8-4a36-b00b-2c71022895b4 req-4cca78e3-02ed-4276-a633-3c0fb8161a82 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:40.860148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e7bfccb9-9fc8-4a36-b00b-2c71022895b4 req-4cca78e3-02ed-4276-a633-3c0fb8161a82 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:40.922261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e7bfccb9-9fc8-4a36-b00b-2c71022895b4 req-4cca78e3-02ed-4276-a633-3c0fb8161a82 service nova] Creating event network-changed:1d8b172e-eb09-40eb-ae27-f9b24cc004cb for instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf on n-h2-854924-5 Aug 30 03:40:40.936473 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e7bfccb9-9fc8-4a36-b00b-2c71022895b4 req-4cca78e3-02ed-4276-a633-3c0fb8161a82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122061 Aug 30 03:40:40.937526 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1754/3462] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:40.956674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:40.957651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:40.969761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6dcb3284-f874-40af-96ef-ae8a9640c7e8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1455 microversion: 2.1 time: 5.210441 Aug 30 03:40:40.970365 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1709/3463] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:35 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1455 bytes in 5213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:40.992419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-43590ae8-6bb2-44e2-9eea-303724a08ac0 req-b55104fd-2b4e-43d5-8b6a-2d8cedc4a082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5ece24-1de4-43b1-aa6d-18286bbc666f", "name": "network-vif-plugged", "status": "completed", "tag": "45afd486-aa87-4b99-ab58-c694e41af1a3"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:41.003817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.004328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.004920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.011628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.012288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.012737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.013630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-43590ae8-6bb2-44e2-9eea-303724a08ac0 req-b55104fd-2b4e-43d5-8b6a-2d8cedc4a082 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.014117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-43590ae8-6bb2-44e2-9eea-303724a08ac0 req-b55104fd-2b4e-43d5-8b6a-2d8cedc4a082 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.014655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-43590ae8-6bb2-44e2-9eea-303724a08ac0 req-b55104fd-2b4e-43d5-8b6a-2d8cedc4a082 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.052144 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-43590ae8-6bb2-44e2-9eea-303724a08ac0 req-b55104fd-2b4e-43d5-8b6a-2d8cedc4a082 service nova] Creating event network-vif-plugged:45afd486-aa87-4b99-ab58-c694e41af1a3 for instance ae5ece24-1de4-43b1-aa6d-18286bbc666f on n-h1-854924-5 Aug 30 03:40:41.058370 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-43590ae8-6bb2-44e2-9eea-303724a08ac0 req-b55104fd-2b4e-43d5-8b6a-2d8cedc4a082 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075700 Aug 30 03:40:41.059338 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1710/3464] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:40:41.324450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:41.333680 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65d3ab9b-f2dc-4b45-89e1-a24f06587d90 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.392495 Aug 30 03:40:41.334373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1755/3465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:40 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:41.380557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:41.381316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:41.389374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.390180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.390923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.391348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.391814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.392240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.680181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:41.698439 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c38d9600-04dd-469a-9923-ad52f206abee tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.322815 Aug 30 03:40:41.720729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1711/3466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:41 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:41.826521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:41.827171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:41.838200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.839049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.839819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.841703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:41.842336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:41.842934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:41.985423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-24db6ea9-5747-413d-8c5f-d97bf36423c9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b573a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:42.059557 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-24db6ea9-5747-413d-8c5f-d97bf36423c9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1464 microversion: 2.1 time: 0.077921 Aug 30 03:40:42.070676 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1712/3467] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:41 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1464 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:42.077371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-97c176f1-a203-446c-9acc-c265f85e72df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab3f160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:42.145140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:42.155446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37315a06-15f0-4150-8318-93e887685f27 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.333114 Aug 30 03:40:42.161431 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1756/3468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:41 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:42.180292 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-97c176f1-a203-446c-9acc-c265f85e72df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 200 len: 1464 microversion: 2.1 time: 0.107352 Aug 30 03:40:42.182107 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1713/3469] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:42 2022] GET /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 1464 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:42.196154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:42.196862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:42.204209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.204775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.205248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.206639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.207201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.207819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.357926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:42.358588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:42.372241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.372787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.377392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.378494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.378994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.379441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.552943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:42.564764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee252ac3-ebec-4e08-9a43-efaf6a80c551 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1467 microversion: 2.1 time: 0.371565 Aug 30 03:40:42.582836 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1757/3470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:42 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:42.588818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-762993153"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:42.592277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:42.599326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.600082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.600713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.602439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.603251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.603964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.661198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:42.676891 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca2766fc-d98a-4daf-ad5c-30ace6bd00de tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.316748 Aug 30 03:40:42.677593 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1714/3471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:42 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:42.724049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:42.725025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:42.735726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.736512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.737190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:42.738143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:42.742525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:42.743189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:43.005497 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63bb6982-9cc2-42bc-a85b-ecbb20a319e1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "POST /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e/action" status: 202 len: 0 microversion: 2.1 time: 0.420778 Aug 30 03:40:43.006569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1758/3472] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:40:42 2022] POST /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:40:43.028557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9fa1611-65fa-43ce-831b-b4c794034e3e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b279ca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:43.028973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:43.043449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e2570e6-9640-4c52-baf2-a7f5abb38def tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1317 microversion: 2.1 time: 0.323175 Aug 30 03:40:43.061837 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1715/3473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:42 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:43.115923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9fa1611-65fa-43ce-831b-b4c794034e3e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.100444 Aug 30 03:40:43.117842 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1759/3474] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:43 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:43.186316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:43.193511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:43.214535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:43.217451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:43.218137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:43.218895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:43.224625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:43.227122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:43.449700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:43.463263 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ad0953f-2a9a-40b9-a4db-c8ab4004481b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.289267 Aug 30 03:40:43.479872 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1716/3475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:43 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:43.704788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:43.707039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:43.732601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:43.733770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:43.734582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:43.735583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:43.736305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:43.737988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.031228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:44.069618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:44.070943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:44.087756 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07c19f7e-fb82-42f0-b055-49864c96a079 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.391456 Aug 30 03:40:44.104382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:44.105147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:44.107184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.110041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:44.113674 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1760/3476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:43 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:44.114620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:44.115272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.136820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3ecc703-98d5-4c74-a14a-9f8560d40c41 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b276550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:44.229820 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3ecc703-98d5-4c74-a14a-9f8560d40c41 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.094869 Aug 30 03:40:44.242579 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1761/3477] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:44 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:44.363801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:44.381112 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9d953e0c-4d68-48bd-9707-5bb3f47c4ef9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1466 microversion: 2.1 time: 0.315997 Aug 30 03:40:44.386710 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1717/3478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:44 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1466 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:44.437805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:44.439096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:44.493253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:44.494367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:44.506795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:44.510636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:44.511538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:44.512434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:44.513870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.514699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.516952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:44.519103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:44.520803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:44.521529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:44.523259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.524201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:44.893300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:44.904564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4b1e0815-d4e8-4675-924c-636b270be1c0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.416192 Aug 30 03:40:44.905600 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1718/3479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:44 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:44.923892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2d2df47b-8806-47ae-9e29-935e81548d72 tempest-ServersOnMultiNodesTest-1642147035 tempest-ServersOnMultiNodesTest-1642147035-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1617 microversion: 2.1 time: 0.500216 Aug 30 03:40:44.926718 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1762/3480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:44 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1617 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:44.983378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:44.984638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:45.005045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.005814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.006522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.007464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.008240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.008900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.075288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:40:45.117650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:45.118270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:45.158273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.158820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.159288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.161870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.162341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.162778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.264330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d4489f36-ce4d-4414-b693-297e5cbb69f3 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 204 len: 0 microversion: 2.1 time: 0.300732 Aug 30 03:40:45.277077 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1719/3481] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:40:44 2022] DELETE /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:40:45.296155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-825bb16e-dc03-4426-8e21-7afad3104751 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b02c310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:45.414453 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-825bb16e-dc03-4426-8e21-7afad3104751 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.134979 Aug 30 03:40:45.415569 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1720/3482] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:45 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:45.426920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:45.427687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:45.434367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.434988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.435607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.436402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.436854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.437277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.440292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:45.454539 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-806068ca-46bd-4c2c-8c83-cdd17133aea3 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.341180 Aug 30 03:40:45.456610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1763/3483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:45 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:45.730118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:45.742942 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-842a35a5-9241-4495-9fb9-8f47217d67f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1472 microversion: 2.1 time: 0.319982 Aug 30 03:40:45.744963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1721/3484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:45 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:45.931359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:45.931987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:45.959370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.959927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.960373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:45.961122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:45.963916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:45.965973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:46.085095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d889809f-b9d8-4e67-a845-6aaf28299cac req-68bc7967-7e72-42db-a813-f2e05a332f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bc8eb0-5c19-419d-9213-3b8b9d973ccf", "name": "network-vif-plugged", "status": "completed", "tag": "1d8b172e-eb09-40eb-ae27-f9b24cc004cb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:46.116271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d889809f-b9d8-4e67-a845-6aaf28299cac req-68bc7967-7e72-42db-a813-f2e05a332f64 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:46.117324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d889809f-b9d8-4e67-a845-6aaf28299cac req-68bc7967-7e72-42db-a813-f2e05a332f64 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:46.118087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d889809f-b9d8-4e67-a845-6aaf28299cac req-68bc7967-7e72-42db-a813-f2e05a332f64 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:46.155091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d889809f-b9d8-4e67-a845-6aaf28299cac req-68bc7967-7e72-42db-a813-f2e05a332f64 service nova] Creating event network-vif-plugged:1d8b172e-eb09-40eb-ae27-f9b24cc004cb for instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf on n-h2-854924-5 Aug 30 03:40:46.167125 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d889809f-b9d8-4e67-a845-6aaf28299cac req-68bc7967-7e72-42db-a813-f2e05a332f64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090261 Aug 30 03:40:46.170323 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1722/3485] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:40:46.432786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1696aa40-9bb6-42ab-8cd9-d6756e682d3c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b02c280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:46.537603 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1696aa40-9bb6-42ab-8cd9-d6756e682d3c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.111060 Aug 30 03:40:46.542050 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1723/3486] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:46 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:46.556615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:46.557720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:46.583382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:46.584055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:46.584493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:46.594863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:46.595570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:46.596029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:46.683829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:46.697390 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1cb0947b-517f-40f7-829e-cbe56e7f7a46 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.770048 Aug 30 03:40:46.702496 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1764/3487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:45 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:46.772554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:46.773851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:46.786319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:46.790119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:46.790884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:46.798392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:46.806161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:46.806979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:47.088450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:47.107005 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-869a66c3-a747-45a7-90ac-62ca952462dc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.555814 Aug 30 03:40:47.122250 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1724/3488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:46 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:47.151247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:47.168615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f836399-71f0-46bb-8dce-02d459a88a08 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1472 microversion: 2.1 time: 0.400237 Aug 30 03:40:47.178008 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1765/3489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:46 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:47.555312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c858ef3-42e1-4446-97ca-85c0c988af7e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b006f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:47.644372 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c858ef3-42e1-4446-97ca-85c0c988af7e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.093857 Aug 30 03:40:47.652388 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1725/3490] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:47 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:47.747917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:47.748527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:47.764710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:47.765087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:47.765613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:47.768786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:47.769303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:47.771655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.113137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:48.124163 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da7b06e4-f789-4158-904a-c2003729235a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 0.381281 Aug 30 03:40:48.128251 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1766/3491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:47 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:48.129710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:48.130335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:48.147635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:48.151788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:48.152240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.152983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:48.158986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:48.178879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.202495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:48.203383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:48.219586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:48.220076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:48.220541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.227834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:48.228555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:48.229027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.517264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:48.536602 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-897bdb06-5787-4960-8a98-94b2d05a95df tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1430 microversion: 2.1 time: 0.338532 Aug 30 03:40:48.537191 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1767/3492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:48 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1430 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:48.557966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2a9e1220-f1d9-456c-bc86-4091b4d64e3f req-ffafb7e8-3ac1-45fd-97c8-c9006c40927c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5ece24-1de4-43b1-aa6d-18286bbc666f", "name": "network-vif-deleted", "tag": "45afd486-aa87-4b99-ab58-c694e41af1a3"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:48.603136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2a9e1220-f1d9-456c-bc86-4091b4d64e3f req-ffafb7e8-3ac1-45fd-97c8-c9006c40927c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:48.603540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2a9e1220-f1d9-456c-bc86-4091b4d64e3f req-ffafb7e8-3ac1-45fd-97c8-c9006c40927c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:48.603977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2a9e1220-f1d9-456c-bc86-4091b4d64e3f req-ffafb7e8-3ac1-45fd-97c8-c9006c40927c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.637798 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2a9e1220-f1d9-456c-bc86-4091b4d64e3f req-ffafb7e8-3ac1-45fd-97c8-c9006c40927c service nova] Creating event network-vif-deleted:45afd486-aa87-4b99-ab58-c694e41af1a3 for instance ae5ece24-1de4-43b1-aa6d-18286bbc666f on n-h1-854924-5 Aug 30 03:40:48.655002 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2a9e1220-f1d9-456c-bc86-4091b4d64e3f req-ffafb7e8-3ac1-45fd-97c8-c9006c40927c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114777 Aug 30 03:40:48.662006 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1768/3493] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:48.695566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-da6e33e4-315f-4ab2-b549-ef8ddb0e80c0 req-bb5fb201-4c90-43d9-9de1-39d53f393f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "name": "network-vif-unplugged", "status": "completed", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:48.724246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da6e33e4-315f-4ab2-b549-ef8ddb0e80c0 req-bb5fb201-4c90-43d9-9de1-39d53f393f0f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:48.728181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da6e33e4-315f-4ab2-b549-ef8ddb0e80c0 req-bb5fb201-4c90-43d9-9de1-39d53f393f0f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:48.728691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da6e33e4-315f-4ab2-b549-ef8ddb0e80c0 req-bb5fb201-4c90-43d9-9de1-39d53f393f0f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:48.767642 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-da6e33e4-315f-4ab2-b549-ef8ddb0e80c0 req-bb5fb201-4c90-43d9-9de1-39d53f393f0f service nova] Creating event network-vif-unplugged:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:40:48.789021 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-da6e33e4-315f-4ab2-b549-ef8ddb0e80c0 req-bb5fb201-4c90-43d9-9de1-39d53f393f0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122889 Aug 30 03:40:48.794233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1769/3494] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:48.809463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddb4cc04-981e-4893-a964-f7ea803c67c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bccf790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:48.907301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:48.918139 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f7d9c37-8a40-43a6-8ac8-9c5c98f1e9c1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.792851 Aug 30 03:40:48.925871 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1726/3495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:48 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:48.937870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddb4cc04-981e-4893-a964-f7ea803c67c8 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.141158 Aug 30 03:40:48.940521 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1770/3496] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:48 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:49.162532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:49.164264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:49.208668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:49.209600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:49.210300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:49.211799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:49.212500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:49.213197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:49.563503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:49.564384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:49.591118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:49.592478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:49.594847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:49.597881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:49.600014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:49.601577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:49.667543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:49.668921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:49.669884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:49.670546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lazy-loading 'fault' on Instance uuid ae5ece24-1de4-43b1-aa6d-18286bbc666f {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:40:50.338617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:50.348915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-156bc708-40f6-4315-87c2-1872c8368801 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 200 len: 1307 microversion: 2.1 time: 0.794036 Aug 30 03:40:50.364280 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1771/3497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:49 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 1307 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:50.369199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b53acb42-568d-4967-a6c2-f0540d8eaf09 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b32ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:50.431089 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b53acb42-568d-4967-a6c2-f0540d8eaf09 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.065645 Aug 30 03:40:50.431779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1772/3498] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:50 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:50.438331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:50.445798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:50.447590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:50.449137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba551c42-ba08-4e2f-9b53-71d592e6c935 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1317 microversion: 2.1 time: 1.292825 Aug 30 03:40:50.450488 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1727/3499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:49 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1317 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:50.455555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:50.456087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:50.456548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:50.458061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:50.458536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:50.460749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:50.641506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:50.642011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:50.648952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:50.649485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:50.649924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:50.650626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:50.651079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:50.651500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:50.695033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:40:50.707225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:50.716443 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dce42b6d-db11-4ecd-b8b3-44bc125b865c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.283337 Aug 30 03:40:50.729438 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1773/3500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:50 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:50.809856 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8fcb2a9-b2d0-4d74-9a6c-35d9f1e9e484 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 204 len: 0 microversion: 2.42 time: 0.332664 Aug 30 03:40:50.811970 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1728/3501] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:40:50 2022] DELETE /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 03:40:50.824118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:50.826369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:50.833851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:50.834791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:50.835309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:50.836236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:50.836875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:50.837497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:50.858722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:51.147308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:51.161279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:51.162767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:51.169784 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e5fdc53-cd6e-4811-841f-57e0bf6296f7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2957 microversion: 2.42 time: 0.344850 Aug 30 03:40:51.171506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1774/3502] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:40:50 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2957 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:40:51.241553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0e848e16-5b5f-4ce1-8f3b-409901f3e3a4 req-dea57e45-6526-45df-bda1-6ef9dcfebfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ba30af-e8e3-4817-ab13-46a4b5e8325e", "name": "network-vif-plugged", "status": "completed", "tag": "cde12ff6-56bc-4b7f-8e16-1d13f9e6079f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:51.266272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e848e16-5b5f-4ce1-8f3b-409901f3e3a4 req-dea57e45-6526-45df-bda1-6ef9dcfebfa0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.267061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e848e16-5b5f-4ce1-8f3b-409901f3e3a4 req-dea57e45-6526-45df-bda1-6ef9dcfebfa0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.268093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0e848e16-5b5f-4ce1-8f3b-409901f3e3a4 req-dea57e45-6526-45df-bda1-6ef9dcfebfa0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.295538 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0e848e16-5b5f-4ce1-8f3b-409901f3e3a4 req-dea57e45-6526-45df-bda1-6ef9dcfebfa0 service nova] Creating event network-vif-plugged:cde12ff6-56bc-4b7f-8e16-1d13f9e6079f for instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e on n-h1-854924-5 Aug 30 03:40:51.307620 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0e848e16-5b5f-4ce1-8f3b-409901f3e3a4 req-dea57e45-6526-45df-bda1-6ef9dcfebfa0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073953 Aug 30 03:40:51.309664 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1729/3503] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:51.370694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.371316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: ae5ece24-1de4-43b1-aa6d-18286bbc666f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:51.378445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.379012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.379378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.380355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.380548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.380969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.396637 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance ae5ece24-1de4-43b1-aa6d-18286bbc666f could not be found. Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f HTTP/1.1 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance ae5ece24-1de4-43b1-aa6d-18286bbc666f could not be found. Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'ae5ece24-1de4-43b1-aa6d-18286bbc666f'} Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5ece24-1de4-43b1-aa6d-18286bbc666f could not be found. Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5ece24-1de4-43b1-aa6d-18286bbc666f could not be found. Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:40:51.398256 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5ece24-1de4-43b1-aa6d-18286bbc666f could not be found. Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance ae5ece24-1de4-43b1-aa6d-18286bbc666f could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba81f685-20e6-4c46-89ba-97a95a562676 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f" status: 404 len: 111 microversion: 2.1 time: 0.032936 Aug 30 03:40:51.407253 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1775/3504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:51 2022] GET /compute/v2.1/servers/ae5ece24-1de4-43b1-aa6d-18286bbc666f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:40:51.410892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.411483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:51.418546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.419036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.419466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.420415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.420869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.421293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.426540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:51.449361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fdcef2e-1ec0-4615-87a0-d6b25e8048c7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b1b3790>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.453380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:40:51.511516 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fdcef2e-1ec0-4615-87a0-d6b25e8048c7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.067264 Aug 30 03:40:51.513599 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1776/3505] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:51 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:51.521513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.522678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:51.530391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.531252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.531911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.532881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.534419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.535492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.559827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:51.599723 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b97c345f-07c2-4956-b3dd-eaf0a8f5429d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 204 len: 0 microversion: 2.1 time: 0.188415 Aug 30 03:40:51.603860 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1730/3506] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:40:51 2022] DELETE /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:40:51.611596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.613505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:51.622495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.623134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.623720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.624524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.625098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.625679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.733376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:51.744498 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e4533c64-9254-40fc-adde-2da4ee042392 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1507 microversion: 2.1 time: 0.226189 Aug 30 03:40:51.760879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1777/3507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:51 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:51.766069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.767175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:51.775782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.776584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.777302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.778982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.779656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.780830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.852089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:51.864125 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-644786e5-3111-4ef0-9ec6-cbd428da8967 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1472 microversion: 2.1 time: 0.257582 Aug 30 03:40:51.865564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1731/3508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:51 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:51.884064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:51.886525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:51.902072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.902948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.903648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:51.904481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:51.905074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:51.905551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.063174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.075021 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1cadc79f-215a-4df4-9e2e-eede805f3b88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.312998 Aug 30 03:40:52.075605 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1778/3509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:51 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:52.147883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.165778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e87048c-9677-4003-8047-2193a5d8b368 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1507 microversion: 2.1 time: 0.289525 Aug 30 03:40:52.167997 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1732/3510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:51 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:52.188411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:52.191385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.196472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:52.197084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.198766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.199454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.200517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.201474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.202376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.203018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.203219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.203895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.204340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.205039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.206014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.206435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.312956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cddb13fb-220c-439c-86cf-fdd4f5842ce6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "PUT /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1079 microversion: 2.1 time: 0.128420 Aug 30 03:40:52.316100 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1779/3511] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:40:52 2022] PUT /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1079 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:52.340267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:52.341028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.349948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.350590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.351082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.352005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.352562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.353057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.434499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.450324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.452332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.454270 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d456d3c0-b88f-4443-b3a6-6f800c3c4908 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2957 microversion: 2.42 time: 0.262090 Aug 30 03:40:52.456621 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1733/3512] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:40:52 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2957 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:40:52.530508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3fecfad2-5488-46d4-9deb-701c9479124f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab55e50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:52.549033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.558534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58c8f2ed-19ac-484a-b88a-d4d0cbd60f59 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1505 microversion: 2.1 time: 0.222583 Aug 30 03:40:52.559127 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1780/3513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:52 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:52.579295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:52.580015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.588583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.589152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.589673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.590430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.590946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.591460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.592205 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3fecfad2-5488-46d4-9deb-701c9479124f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.065697 Aug 30 03:40:52.593117 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1734/3514] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:52 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:52.748758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:52.762631 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6291f1b5-b312-4cba-b380-f12768d70986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1505 microversion: 2.1 time: 0.187294 Aug 30 03:40:52.764720 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1781/3515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:52 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:52.785696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:52.788985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.797009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.797860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.798413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.799773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.800329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.801008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.890199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:52.891020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.894318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:40:52.894742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:40:52.895216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:40:52.895624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:40:52.896034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:40:52.898489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.899123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.899653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.900916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.901629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.902285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.978617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:52.985090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.985765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.986434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:52.987446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:52.987895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:52.988338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.029941 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12e6f5f6-cbac-4455-ba7b-da1bf8d842a9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "POST /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf/action" status: 202 len: 1111 microversion: 2.1 time: 0.248629 Aug 30 03:40:53.031179 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1735/3516] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:40:52 2022] POST /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf/action => generated 1111 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 03:40:53.058102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:53.058716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:53.074075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:53.075011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:53.075701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.076906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:53.077739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:53.078482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.111220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:53.120615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b806f43c-ebbb-4ec3-9b7a-6229f9b1b819 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1472 microversion: 2.1 time: 0.235947 Aug 30 03:40:53.125123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1782/3517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:52 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:53.130344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:53.131186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:53.138905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:53.139709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:53.140541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.141470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:53.142124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:53.142715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.434230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:53.448902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:53.454412 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-17b1a2ea-0522-42e7-ad7d-26554682999a tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.402355 Aug 30 03:40:53.456298 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1736/3518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:53 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:53.465029 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6cf9f66e-4a85-4ba5-829d-161cad5766bb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.338603 Aug 30 03:40:53.469621 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1783/3519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:53 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:53.484740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:53.485681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:53.505057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:53.506368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:53.509859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.511032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:53.512682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:53.513656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:53.607218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b542640-3d4e-4b3e-a4b3-9a9b1dc85b07 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b1b3ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:53.672467 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b542640-3d4e-4b3e-a4b3-9a9b1dc85b07 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.069137 Aug 30 03:40:53.680764 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1784/3520] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:53 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:53.772046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:53.782694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:53.785010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:53.786662 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1079a65d-dfb0-4349-a6d3-97784f8703a3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2957 microversion: 2.42 time: 0.306190 Aug 30 03:40:53.806140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1737/3521] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:40:53 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2957 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:40:54.147053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:54.147921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:54.154814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:54.155305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:54.155742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:54.156443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:54.156926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:54.157403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:54.307746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:54.317960 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b82b926e-aebd-44a1-bd05-ab36e9e78a6c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1472 microversion: 2.1 time: 0.175524 Aug 30 03:40:54.319504 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1785/3522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:54 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:54.489718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:54.490424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:54.491336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:54.495208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:54.501701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:54.503082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:54.503822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:54.504714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:54.505502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:54.505759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:54.506687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:54.506903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:54.508804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:54.518346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:54.518346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:54.524913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:55.141260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:55.152372 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6b9267d-c17c-4c36-9656-bd705f9653c9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.673094 Aug 30 03:40:55.155338 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1738/3523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:54 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:55.169525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c58ee8db-c7f0-4bfc-b89d-23dd8c91ed11 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab55b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:55.182683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:55.206630 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed28f626-239f-4c89-8d67-6b9defd982f0 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.713574 Aug 30 03:40:55.207628 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1786/3524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:54 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:40:55.222806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:55.224397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:55.237416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:55.238661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:55.239670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:55.241155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:55.242206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:55.243782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:55.350189 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c58ee8db-c7f0-4bfc-b89d-23dd8c91ed11 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.193398 Aug 30 03:40:55.355573 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1739/3525] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:55 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:55.360749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:55.368648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:55.376763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:55.377175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:55.378208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:55.385970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:55.386462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:55.386901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:55.674749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:55.691021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:55.693006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:55.697105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ef8e9481-4a5a-43e5-bc96-f83f3b3aba92 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2957 microversion: 2.42 time: 0.487467 Aug 30 03:40:55.699105 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1787/3526] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:40:55 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2957 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:40:55.706877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:55.716215 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0d98b2d-2b5d-4476-8ec2-e701f9fa7152 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1472 microversion: 2.1 time: 0.359345 Aug 30 03:40:55.731141 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1740/3527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:55 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:56.189430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:56.190904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:56.197683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.198535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.199239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.200189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.200876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.201653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.231212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:56.232189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:56.240809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.243913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.244678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.247533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.248011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.248442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.640986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:56.649380 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd5588f7-2db2-48e3-bba8-79995eabf759 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.422082 Aug 30 03:40:56.665385 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1741/3528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:56 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:56.673123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:56.703635 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-842dfa99-ba4c-4af9-b90b-3d48216887ae tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.517338 Aug 30 03:40:56.704253 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1788/3529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:56 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:56.709925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-038ccc73-9c7c-4fcf-9681-a8efcad07173 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab59310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:56.740846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:56.741610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:56.750036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.755664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.756563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.757579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.759694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.761741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.796566 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-038ccc73-9c7c-4fcf-9681-a8efcad07173 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.141264 Aug 30 03:40:56.800008 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1742/3530] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:56 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:56.806056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:56.809422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:56.821059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.821959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.823277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:56.824467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:56.825740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:56.826379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:57.090912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:57.100434 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5292f6b7-eee2-4849-8e7f-d744a07aa560 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1472 microversion: 2.1 time: 0.365462 Aug 30 03:40:57.104427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1789/3531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:56 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1472 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:57.216011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:57.230265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:57.232406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:57.234024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-91ceb253-2c02-4f41-9ea5-9f920fe7933f tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2957 microversion: 2.42 time: 0.432831 Aug 30 03:40:57.235153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1743/3532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:40:56 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2957 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:40:57.676090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:57.676955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:57.685377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:57.685870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:57.686309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:57.687021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:57.692200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:57.692658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:57.730615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:57.731208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:57.756037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:57.756649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:57.757099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:57.757865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:57.758320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:57.765545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:58.179788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:58.192224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8ff5932-a139-4516-bc59-48cbc84d6dbd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.465368 Aug 30 03:40:58.196450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:58.207351 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1744/3533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:57 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:58.217855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1aa3007-ebfb-4ef7-8872-1a6250fcb495 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab44040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:58.274242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-168ef565-8a2c-4480-b1f4-a72f3ae1ea59 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.599271 Aug 30 03:40:58.278000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1790/3534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:57 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:58.290114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1aa3007-ebfb-4ef7-8872-1a6250fcb495 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.080829 Aug 30 03:40:58.290922 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1745/3535] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:40:58 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:58.301647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2b264a53-5510-4ff2-bab1-e601151b0463 req-8bba9974-e4ab-43b0-bc43-b742b5717e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f12a0d-edb1-41ac-a54f-95be0d3eb71e", "name": "network-vif-deleted", "tag": "0311e04a-ee66-4b08-a748-c320b6b37684"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:58.311750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:58.312405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:58.319720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2b264a53-5510-4ff2-bab1-e601151b0463 req-8bba9974-e4ab-43b0-bc43-b742b5717e64 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:58.320642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2b264a53-5510-4ff2-bab1-e601151b0463 req-8bba9974-e4ab-43b0-bc43-b742b5717e64 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:58.321641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2b264a53-5510-4ff2-bab1-e601151b0463 req-8bba9974-e4ab-43b0-bc43-b742b5717e64 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:58.335638 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2b264a53-5510-4ff2-bab1-e601151b0463 req-8bba9974-e4ab-43b0-bc43-b742b5717e64 service nova] Creating event network-vif-deleted:0311e04a-ee66-4b08-a748-c320b6b37684 for instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e on n-h2-854924-5 Aug 30 03:40:58.335896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:58.336344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:58.336775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:58.337493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:58.338018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:58.338439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:58.342169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2b264a53-5510-4ff2-bab1-e601151b0463 req-8bba9974-e4ab-43b0-bc43-b742b5717e64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049289 Aug 30 03:40:58.344178 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1746/3536] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:40:58.350992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:58.352162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:58.359074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:58.360488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:58.361155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:58.362228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:58.363044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:58.364548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:58.666407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:58.708231 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98aefab0-68f5-4478-ad4a-35d19384e89d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 200 len: 1301 microversion: 2.1 time: 0.426947 Aug 30 03:40:58.713452 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1791/3537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:58 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 1301 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:40:58.930035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-58b55636-e9b7-4e24-8a7d-6cc077f2aa70 req-abd83fd4-63fa-48fd-a676-808022dd87f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-unplugged", "status": "completed", "tag": "d49ca1e1-d171-473d-86f2-efabad830021"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:40:59.034697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-58b55636-e9b7-4e24-8a7d-6cc077f2aa70 req-abd83fd4-63fa-48fd-a676-808022dd87f6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:59.036156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-58b55636-e9b7-4e24-8a7d-6cc077f2aa70 req-abd83fd4-63fa-48fd-a676-808022dd87f6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:59.041565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-58b55636-e9b7-4e24-8a7d-6cc077f2aa70 req-abd83fd4-63fa-48fd-a676-808022dd87f6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:59.115459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:59.120616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:40:59.132870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:59.143605 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-58b55636-e9b7-4e24-8a7d-6cc077f2aa70 req-abd83fd4-63fa-48fd-a676-808022dd87f6 service nova] Creating event network-vif-unplugged:d49ca1e1-d171-473d-86f2-efabad830021 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:40:59.146608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:40:59.147942 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a04581d-77b6-48d8-ae17-e08976394324 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2957 microversion: 2.42 time: 0.802387 Aug 30 03:40:59.170332 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1747/3538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:40:58 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2957 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:40:59.179872 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-58b55636-e9b7-4e24-8a7d-6cc077f2aa70 req-abd83fd4-63fa-48fd-a676-808022dd87f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.255479 Aug 30 03:40:59.180616 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1792/3539] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:40:59.220582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:59.222590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:59.236121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:59.243292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:59.245674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:59.248607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:59.251060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:59.253324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:59.303695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:40:59.304579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:40:59.320248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:59.321123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:59.322367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:40:59.324890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:40:59.325406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:40:59.327484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.115690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:00.119590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:00.129097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7eed22d-27cd-4ee1-974e-a5ab9ddacbb5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.832339 Aug 30 03:41:00.134161 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1793/3540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:59 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:00.167332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45bb26d5-779f-4cfa-a72f-1992d68a8cac tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b276550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:00.264304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45bb26d5-779f-4cfa-a72f-1992d68a8cac tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.128410 Aug 30 03:41:00.264918 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1794/3541] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:00 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:00.296851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:00.298582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:00.299253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 70f12a0d-edb1-41ac-a54f-95be0d3eb71e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:00.309782 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb597822-464b-4c7d-8b86-af1d7ac00847 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 1.092755 Aug 30 03:41:00.327790 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1748/3542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:40:59 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:00.344313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:00.344949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.345696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.345979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:00.346740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.347495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.347956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.348385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.363595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.364385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.366254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.370810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.371519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.372477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.418005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e could not be found. Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e HTTP/1.1 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e could not be found. Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '70f12a0d-edb1-41ac-a54f-95be0d3eb71e'} Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e could not be found. Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e could not be found. Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:00.423337 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e could not be found. Aug 30 03:41:00.428237 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:00.438570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance 70f12a0d-edb1-41ac-a54f-95be0d3eb71e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:00.441010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-442bdbae-1ba8-4a3b-b2bb-74ac0b5f78eb tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e" status: 404 len: 111 microversion: 2.1 time: 0.165485 Aug 30 03:41:00.442114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1795/3543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:00 2022] GET /compute/v2.1/servers/70f12a0d-edb1-41ac-a54f-95be0d3eb71e => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:00.459919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:00.466091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:00.490620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.492513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.493799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.495171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.495914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.496552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.666561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:00.804593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:00.844210 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1dfeca5-2256-4714-9d32-7e8015b85942 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 204 len: 0 microversion: 2.1 time: 0.397101 Aug 30 03:41:00.845389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1796/3544] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:00 2022] DELETE /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:00.866209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:00.872462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:00.914687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.918031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.920011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.925818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:00.928974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:00.929640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:00.952153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:00.966886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:00.968360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:00.969649 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-83b687eb-2f39-4ba0-af13-932295204df1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2936 microversion: 2.42 time: 0.640526 Aug 30 03:41:00.970231 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1749/3545] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:00 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2936 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:01.163341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:01.163965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:01.181062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:01.181629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:01.182081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:01.182807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:01.183271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:01.183705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:01.247521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:01.264172 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-44ab7995-cdc9-40ea-b68a-cfefcb52ff8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1472 microversion: 2.1 time: 0.413336 Aug 30 03:41:01.265124 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1797/3546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:00 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:01.281448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b367c2-c520-4f6e-b251-798e702ebbe1"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-unplugged", "status": "completed", "tag": "57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:01.308727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:01.309075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:01.309531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:01.349455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] Creating event network-vif-unplugged:f0b367c2-c520-4f6e-b251-798e702ebbe1 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:01.350670 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] Creating event network-vif-unplugged:57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:01.357254 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f2487185-87c7-4e0a-a486-6afb62726028 req-759e83ff-811c-4cbe-9209-fd08ee31e9b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.090780 Aug 30 03:41:01.363513 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1798/3547] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:01.369105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-667ef2d9-0c2e-482a-8291-6bbeff953346 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b9705e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:01.452208 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-667ef2d9-0c2e-482a-8291-6bbeff953346 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.087098 Aug 30 03:41:01.453181 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1799/3548] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:01 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:01.464759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:01.465831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:01.481543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:01.482662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:01.483344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:01.484298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:01.494063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:01.502820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:01.573211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:01.585899 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-868d2575-6f0d-49c0-8d82-309457a92625 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.426358 Aug 30 03:41:01.594072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1750/3549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:01 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:01.760438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:01.771420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-739621c3-2da7-43f4-99fd-0b5f045cd4fb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.316873 Aug 30 03:41:01.772638 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1800/3550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:01 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:02.015288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:02.016396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:02.028268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.029205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.029937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.030859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.031630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.032799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.289243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:02.290897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:02.302543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.303385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.305089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.307957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.308679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.310614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.576489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:02.589835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:02.591940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:02.593727 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d8ef54d-932b-4ccf-a1f1-911970a11bb9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2915 microversion: 2.42 time: 0.586504 Aug 30 03:41:02.595537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1751/3551] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:01 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2915 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:02.600810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53b29f01-caf5-4f32-9685-77ab38887ace tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab19790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:02.659047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-53b29f01-caf5-4f32-9685-77ab38887ace tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.061943 Aug 30 03:41:02.660017 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1752/3552] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:02 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:02.666457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:02.667566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:02.677681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.678747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.679423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.681059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.682048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.682757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.814244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:02.830203 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d574785-2a1a-41cb-967b-d2c3105cd5f8 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1472 microversion: 2.1 time: 0.544941 Aug 30 03:41:02.847936 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1801/3553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:02 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1472 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:02.854253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:02.855863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:02.870991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.871875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.874381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:02.876838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:02.883237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:02.884937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:03.066488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:03.075537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5625285a-72c2-4c6d-a6f2-99714db1d09d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.414261 Aug 30 03:41:03.109529 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1753/3554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:02 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:03.324846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:03.338458 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02d86aaa-2adb-4d71-abcd-2da787e3d1b3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.488931 Aug 30 03:41:03.339160 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1802/3555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:02 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:03.539509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-unplugged", "status": "completed", "tag": "03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-unplugged", "status": "completed", "tag": "848a0abf-622c-49ee-b610-7c1c4641e0ef"}, {"server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "name": "network-vif-plugged", "status": "completed", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:03.557862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:03.561291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:03.563316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:03.595251 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Creating event network-vif-unplugged:03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:03.596771 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Creating event network-vif-unplugged:848a0abf-622c-49ee-b610-7c1c4641e0ef for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:03.597392 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] Creating event network-vif-plugged:1d231e72-c1f2-4b64-96eb-d5a4fa229659 for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db on n-h2-854924-5 Aug 30 03:41:03.606336 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-09ce1cfb-f521-4908-b18b-42e6a3c2f346 req-c6dfeadf-0406-4fb3-8e91-38f14e2e063f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.070260 Aug 30 03:41:03.607536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1754/3556] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:03.625226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:03.626315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:03.634283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:03.635418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:03.636088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:03.637064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:03.637811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:03.638467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:03.675490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c11f9c2-a42a-4788-816e-978554f46ab4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab555e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:03.776604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c11f9c2-a42a-4788-816e-978554f46ab4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.105744 Aug 30 03:41:03.791735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1755/3557] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:03 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:03.855985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:03.857366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:03.866539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:03.867530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:03.868401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:03.869837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:03.870642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:03.871293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:04.586926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:04.596986 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-691326e0-e8ae-4088-b988-811476e90173 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1472 microversion: 2.1 time: 0.746067 Aug 30 03:41:04.609685 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1756/3558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:03 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1472 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:04.629457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:04.631095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:04.649885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:04.650747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:04.651523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:04.652542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:04.653208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:04.654144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:04.817814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:04.892600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:04.903338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:04.926164 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8db40807-c84e-411c-892a-35ca7883299b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2915 microversion: 2.42 time: 1.304615 Aug 30 03:41:04.933880 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1803/3559] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:03 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2915 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:04.963649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:04.974342 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4628e9b7-c98e-409c-957f-48bbe8811acf tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.355679 Aug 30 03:41:04.977751 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1757/3560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:04 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:04.986378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:04.998437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:05.011807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-73132aea-e8a8-49b0-8eaa-ebcaceb3099e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab59c10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:05.052532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:05.053170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:05.056777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:05.058968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:05.061748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:05.067208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:05.636205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:05.645623 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76939dee-fef6-4fca-bb7a-cb6f30598c76 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.707761 Aug 30 03:41:05.651280 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1804/3561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:04 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:05.664446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-205ccae0-03ea-48a5-ab9a-85dffa009036 req-64a9d368-1c1a-43fd-b57a-dbd1ceacd911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3692df6c-bf9e-4c69-8c80-3ff0c20fe661", "name": "network-vif-deleted", "tag": "48f237ea-7f82-40d7-9514-f2c81fe08f2b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:05.707734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-205ccae0-03ea-48a5-ab9a-85dffa009036 req-64a9d368-1c1a-43fd-b57a-dbd1ceacd911 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:05.716759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-205ccae0-03ea-48a5-ab9a-85dffa009036 req-64a9d368-1c1a-43fd-b57a-dbd1ceacd911 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:05.717965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-205ccae0-03ea-48a5-ab9a-85dffa009036 req-64a9d368-1c1a-43fd-b57a-dbd1ceacd911 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:05.743234 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-205ccae0-03ea-48a5-ab9a-85dffa009036 req-64a9d368-1c1a-43fd-b57a-dbd1ceacd911 service nova] Creating event network-vif-deleted:48f237ea-7f82-40d7-9514-f2c81fe08f2b for instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 on n-h2-854924-5 Aug 30 03:41:05.761457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-205ccae0-03ea-48a5-ab9a-85dffa009036 req-64a9d368-1c1a-43fd-b57a-dbd1ceacd911 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106199 Aug 30 03:41:05.762627 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1805/3562] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:05.769140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:05.771954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:05.787065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:05.787978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:05.788648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:05.789612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:05.802188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:05.803001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:05.877432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:05.878736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:05.879376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:05.880035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lazy-loading 'fault' on Instance uuid 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:05.985879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:06.001903 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0949e3e9-1a7d-42c0-945e-721c6041b32d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 200 len: 1307 microversion: 2.1 time: 0.237810 Aug 30 03:41:06.002942 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1806/3563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:05 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:06.021431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-153695cd-e29c-430d-aa9c-a3b406ba66b7 req-7d01a679-71bb-4516-b86e-7f8e6efcf28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-deleted", "tag": "848a0abf-622c-49ee-b610-7c1c4641e0ef"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:06.039081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-153695cd-e29c-430d-aa9c-a3b406ba66b7 req-7d01a679-71bb-4516-b86e-7f8e6efcf28f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.040950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-153695cd-e29c-430d-aa9c-a3b406ba66b7 req-7d01a679-71bb-4516-b86e-7f8e6efcf28f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.049969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-153695cd-e29c-430d-aa9c-a3b406ba66b7 req-7d01a679-71bb-4516-b86e-7f8e6efcf28f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:06.109275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-153695cd-e29c-430d-aa9c-a3b406ba66b7 req-7d01a679-71bb-4516-b86e-7f8e6efcf28f service nova] Creating event network-vif-deleted:848a0abf-622c-49ee-b610-7c1c4641e0ef for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:06.134078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-153695cd-e29c-430d-aa9c-a3b406ba66b7 req-7d01a679-71bb-4516-b86e-7f8e6efcf28f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124803 Aug 30 03:41:06.135616 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1807/3564] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:06.159215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:06.160125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:06.181172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.183666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.186625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:06.194302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.196612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.197177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:06.789512 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-73132aea-e8a8-49b0-8eaa-ebcaceb3099e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 1.809556 Aug 30 03:41:06.793832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1758/3565] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:04 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:06.808417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:06.809114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:06.854569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.855072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.859739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:06.860583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.861061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.863350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:06.900012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:06.931486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:06.933783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:06.935420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08ff4a96-a3fc-49d4-bc71-c0ff2aac38b9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2531 microversion: 2.42 time: 0.796473 Aug 30 03:41:06.941017 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1808/3566] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:06 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2531 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:06.958380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:06.960657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:06.972295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.973203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.973895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:06.974866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:06.978051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:06.978788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:07.531074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:07.546029 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b711872-9da3-42b0-bc7d-33a9ebdf530c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.603408 Aug 30 03:41:07.563304 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1809/3567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:06 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:07.578992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:07.579610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 3692df6c-bf9e-4c69-8c80-3ff0c20fe661] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:07.592895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:07.593629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:07.594238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:07.595152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:07.596305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:07.596932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:07.631519 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 could not be found. Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 HTTP/1.1 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 could not be found. Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3692df6c-bf9e-4c69-8c80-3ff0c20fe661'} Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 could not be found. Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 could not be found. Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:07.633133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 could not be found. Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance 3692df6c-bf9e-4c69-8c80-3ff0c20fe661 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:07.638949 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0a44f18-328d-4dff-838c-a43d477a58a6 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661" status: 404 len: 111 microversion: 2.1 time: 0.070222 Aug 30 03:41:07.644747 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1810/3568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:07 2022] GET /compute/v2.1/servers/3692df6c-bf9e-4c69-8c80-3ff0c20fe661 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:07.656971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:07.660084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:07.671602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:07.677256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:07.678088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:07.679217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:07.680670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:07.683303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:07.715241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:07.729832 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3124466d-a502-4f63-9ab2-46ad9ad20f61 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1518 microversion: 2.1 time: 0.934393 Aug 30 03:41:07.730456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1759/3569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:06 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1518 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:07.789292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:07.807971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05c4e657-09d3-4cfb-937d-955069a77f61 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b4e9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:07.989756 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-557b16b6-4eac-4821-a8e2-7775ea96f2e5 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662" status: 204 len: 0 microversion: 2.1 time: 0.339089 Aug 30 03:41:07.993132 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1811/3570] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:07 2022] DELETE /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:08.007682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:08.010669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:08.027770 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05c4e657-09d3-4cfb-937d-955069a77f61 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.226440 Aug 30 03:41:08.028788 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1760/3571] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:07 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:08.039755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.040437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.043225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.045674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.046165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:08.046671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:08.049769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.050366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.057781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.058527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.059278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.060191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.060806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.061465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.139595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:08.545952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:08.558834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:08.583680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:08.591588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:08.595752 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51a10460-0ccd-446e-98ba-e3bb81c68748 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2531 microversion: 2.42 time: 0.600242 Aug 30 03:41:08.617876 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1812/3572] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:07 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2531 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:08.624342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e1521ed9-2067-4845-bad8-fb0e3aabc27c req-5ac1eb7b-e0ce-4a7d-8743-5bb3ac926d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-deleted", "tag": "f0b367c2-c520-4f6e-b251-798e702ebbe1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:08.651449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e1521ed9-2067-4845-bad8-fb0e3aabc27c req-5ac1eb7b-e0ce-4a7d-8743-5bb3ac926d77 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.655103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e1521ed9-2067-4845-bad8-fb0e3aabc27c req-5ac1eb7b-e0ce-4a7d-8743-5bb3ac926d77 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.657204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e1521ed9-2067-4845-bad8-fb0e3aabc27c req-5ac1eb7b-e0ce-4a7d-8743-5bb3ac926d77 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.693748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e1521ed9-2067-4845-bad8-fb0e3aabc27c req-5ac1eb7b-e0ce-4a7d-8743-5bb3ac926d77 service nova] Creating event network-vif-deleted:f0b367c2-c520-4f6e-b251-798e702ebbe1 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:08.708386 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e1521ed9-2067-4845-bad8-fb0e3aabc27c req-5ac1eb7b-e0ce-4a7d-8743-5bb3ac926d77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087196 Aug 30 03:41:08.709699 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1813/3573] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:08.728063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:08.733487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:08.749409 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-944d7e00-67d9-407e-a3ab-9b70ad926d54 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 204 len: 0 microversion: 2.1 time: 0.711540 Aug 30 03:41:08.750046 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1761/3574] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:08 2022] DELETE /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:08.758868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:08.760206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:08.785875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.786484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.786936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.787672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.788123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.788544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.792341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.793678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.796464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:08.798387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:08.801893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:08.802491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:09.214743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:09.234812 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05f3cb10-0280-40b8-a03b-f17ed86d078b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.521490 Aug 30 03:41:09.237694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1814/3575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:08 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:09.251155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:09.253387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:09.271785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:09.272325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:09.272737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:09.273494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:09.273942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:09.277859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:09.342615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:09.368981 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b7ff955-e16c-4059-b113-7b79e0860197 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.617621 Aug 30 03:41:09.377487 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1762/3576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:08 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:09.389093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8dd68f95-f6dc-4e4a-ad0d-5bbee58677ea tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b57310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:09.501076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8dd68f95-f6dc-4e4a-ad0d-5bbee58677ea tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.122005 Aug 30 03:41:09.501882 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1763/3577] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:09 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:09.515621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:09.516812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:09.540847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:09.545240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:09.546151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:09.547527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:09.548263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:09.548900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:10.202898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:10.217382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:10.243344 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d9a659e-0c55-4394-ba7b-f17cdd130982 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662" status: 200 len: 1475 microversion: 2.1 time: 1.003357 Aug 30 03:41:10.256363 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c5a582e-de36-4439-b3e7-ed7065bcb9ba tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.749850 Aug 30 03:41:10.259092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1815/3578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:09 2022] GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 => generated 1475 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:10.283028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:10.283028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:10.341019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:10.341019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:10.341019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:10.341019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:10.341019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:10.341019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:10.379839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1764/3579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:09 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:10.403908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:10.405841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:10.438490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:10.440897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:10.442313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:10.444585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:10.445861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:10.446918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:10.960858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:10.998446 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a11b8a5a-9d97-4a29-9d9e-68ce85ba1986 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.613997 Aug 30 03:41:11.004813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1765/3580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:10 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:11.023112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:11.026646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:11.067145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.071003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.073323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.075423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.076192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.079227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.179611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:11.209844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:11.222254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:11.223945 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bd4a2bf4-43cf-4eba-8359-bb6255c44af4 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 2325 microversion: 2.42 time: 0.964673 Aug 30 03:41:11.261856 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1816/3581] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:10 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 2325 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:11.290833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2109c39-b9e1-4b06-8a6c-319be52496bd tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b970c10>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:11.432330 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f2109c39-b9e1-4b06-8a6c-319be52496bd tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.168208 Aug 30 03:41:11.433209 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1817/3582] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:11 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:11.464109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-deleted", "tag": "57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-deleted", "tag": "d49ca1e1-d171-473d-86f2-efabad830021"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:11.526380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.527153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.527295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.590659 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] Creating event network-vif-deleted:57f2301e-1d12-45c6-8aa1-ea4fbfa7bd2e for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:11.591373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] Creating event network-vif-deleted:d49ca1e1-d171-473d-86f2-efabad830021 for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:11.598615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e04bcabd-8e31-4ffd-bdaf-642d5a44b113 req-5cbbbccc-aa52-4917-8d39-485110122c8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.159722 Aug 30 03:41:11.600188 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1818/3583] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:11.610935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2f7b6129-959b-4197-900d-8bcab4fb8b60 req-e3a25710-25a7-4062-be9a-9503e2b370c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633bd185-d6d9-422f-bc37-b3bc3e1a7662", "name": "network-vif-deleted", "tag": "30a46c2c-315c-419e-8696-c59fdaf1ed94"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:11.703951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f7b6129-959b-4197-900d-8bcab4fb8b60 req-e3a25710-25a7-4062-be9a-9503e2b370c4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.705524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f7b6129-959b-4197-900d-8bcab4fb8b60 req-e3a25710-25a7-4062-be9a-9503e2b370c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.707035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:11.707713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f7b6129-959b-4197-900d-8bcab4fb8b60 req-e3a25710-25a7-4062-be9a-9503e2b370c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.737734 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6eac6940-bf95-4580-9d60-25c414674746 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.729825 Aug 30 03:41:11.743553 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1766/3584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:11 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:11.757220 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2f7b6129-959b-4197-900d-8bcab4fb8b60 req-e3a25710-25a7-4062-be9a-9503e2b370c4 service nova] Creating event network-vif-deleted:30a46c2c-315c-419e-8696-c59fdaf1ed94 for instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 on n-h2-854924-5 Aug 30 03:41:11.772041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:11.781442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:11.782254 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2f7b6129-959b-4197-900d-8bcab4fb8b60 req-e3a25710-25a7-4062-be9a-9503e2b370c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180568 Aug 30 03:41:11.782900 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1819/3585] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:11.801108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.806863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4eeaf5e0-90b7-4eb7-9b3c-e195d63c973b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:11.807617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.809858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.819262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.820416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.825799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.850211 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4eeaf5e0-90b7-4eb7-9b3c-e195d63c973b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 2486e356-e1f5-44fc-8f19-029314a0c40c has no mapping to a cell. Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4eeaf5e0-90b7-4eb7-9b3c-e195d63c973b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/2486e356-e1f5-44fc-8f19-029314a0c40c/action HTTP/1.1 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 15 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: {"os-stop": {}} Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 2486e356-e1f5-44fc-8f19-029314a0c40c has no mapping to a cell. Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2486e356-e1f5-44fc-8f19-029314a0c40c', 'body': {'os-stop': {}}} Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2486e356-e1f5-44fc-8f19-029314a0c40c has no mapping to a cell. Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:11.863485 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2486e356-e1f5-44fc-8f19-029314a0c40c has no mapping to a cell. Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2486e356-e1f5-44fc-8f19-029314a0c40c has no mapping to a cell. Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4eeaf5e0-90b7-4eb7-9b3c-e195d63c973b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 2486e356-e1f5-44fc-8f19-029314a0c40c has no mapping to a cell. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:11.869520 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4eeaf5e0-90b7-4eb7-9b3c-e195d63c973b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/2486e356-e1f5-44fc-8f19-029314a0c40c/action" status: 404 len: 117 microversion: 2.1 time: 0.073985 Aug 30 03:41:11.871844 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1820/3586] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:11 2022] POST /compute/v2.1/servers/2486e356-e1f5-44fc-8f19-029314a0c40c/action => generated 117 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:11.897690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:11.904849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:11.928904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.929313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.929793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.930254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lazy-loading 'fault' on Instance uuid 633bd185-d6d9-422f-bc37-b3bc3e1a7662 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:11.935249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.935881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.936320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:11.943159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:11.943905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:11.944512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:12.126371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:12.171671 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ed8485bb-9b1e-48a2-b377-0d6c6373d21e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662" status: 200 len: 1309 microversion: 2.1 time: 0.422601 Aug 30 03:41:12.176415 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1767/3587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:11 2022] GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 => generated 1309 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:12.227509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:12.232474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:12.272933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:12.274093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:12.278287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:12.284590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:12.290601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:12.295217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:12.341258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:12.688639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:12.700140 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31792383-0d7f-49ba-9bf7-f47e222be132 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.827816 Aug 30 03:41:12.700769 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1821/3588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:11 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:12.732647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:12.743056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:12.743681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:12.744060 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6e1d5e6a-8057-486e-abd7-699fbc60f917 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.548093 Aug 30 03:41:12.745361 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1768/3589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:12 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:12.763284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b79b3d15-9529-495a-acbb-34ea83ea16ad tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897ab448b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:12.791762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:12.797782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:12.798447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:12.802545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:12.805450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:12.805909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:12.862626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b79b3d15-9529-495a-acbb-34ea83ea16ad tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.115800 Aug 30 03:41:12.871304 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1769/3590] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:12 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:12.876528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:12.878039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:12.886343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:12.887364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:12.888045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:12.889084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:12.889836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:12.890515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.144795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:13.162624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:13.165247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:13.171715 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c26ba0d7-b8b5-48e9-8807-07256a771839 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.440700 Aug 30 03:41:13.175138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1822/3591] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:12 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:13.199776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.201040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 633bd185-d6d9-422f-bc37-b3bc3e1a7662] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.210138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.213034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.213401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.217072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.217804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.218433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.250637 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 could not be found. Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 HTTP/1.1 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 could not be found. Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '633bd185-d6d9-422f-bc37-b3bc3e1a7662'} Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 could not be found. Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 could not be found. Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:13.253410 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 could not be found. Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance 633bd185-d6d9-422f-bc37-b3bc3e1a7662 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae7fc689-1f7d-46d1-8f55-bd9c79e0f1f4 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662" status: 404 len: 111 microversion: 2.1 time: 0.061293 Aug 30 03:41:13.260828 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1823/3592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:13 2022] GET /compute/v2.1/servers/633bd185-d6d9-422f-bc37-b3bc3e1a7662 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:41:13.269366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.270200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: b419c0a6-ed2f-4f91-929c-bf9f97d48ac0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.277174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.277987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.278807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.280206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.280679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.281116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.304373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 could not be found. Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 HTTP/1.1 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 could not be found. Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'b419c0a6-ed2f-4f91-929c-bf9f97d48ac0'} Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 could not be found. Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 could not be found. Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:13.322725 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 could not be found. Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81e3a30c-c748-4af3-96be-503a2dea9e9c tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0" status: 404 len: 111 microversion: 2.1 time: 0.060480 Aug 30 03:41:13.329524 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1824/3593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:13 2022] GET /compute/v2.1/servers/b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:13.335452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fbc873c6-3bba-4df4-858a-8ab94c550de2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.389838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:13.400953 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2951cef-e0e1-4369-a8c0-7f9eea95d5ae tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.525767 Aug 30 03:41:13.401740 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1770/3594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:12 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:13.420122 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fbc873c6-3bba-4df4-858a-8ab94c550de2 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/27952158-6c27-4bcb-8519-cc0fa8cde8bf" status: 204 len: 0 microversion: 2.1 time: 0.088062 Aug 30 03:41:13.424228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1825/3595] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:41:13 2022] DELETE /compute/v2.1/os-server-groups/27952158-6c27-4bcb-8519-cc0fa8cde8bf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:13.428796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c047c11-c391-4658-9f42-d7e870341691 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:13.431118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.433067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.435510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c047c11-c391-4658-9f42-d7e870341691 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.442969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.444144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.445030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.445941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.446712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.447292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.452040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4c047c11-c391-4658-9f42-d7e870341691 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3 could not be found. Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c047c11-c391-4658-9f42-d7e870341691 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3/action HTTP/1.1 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 15 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: {"suspend": {}} Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3 could not be found. Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3', 'body': {'suspend': {}}} Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3 could not be found. Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3 could not be found. Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:13.454277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:13.460576 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:13.460576 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:13.460576 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3 could not be found. Aug 30 03:41:13.460576 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:13.463744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c047c11-c391-4658-9f42-d7e870341691 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:13.464366 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4c047c11-c391-4658-9f42-d7e870341691 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3/action" status: 404 len: 111 microversion: 2.1 time: 0.042408 Aug 30 03:41:13.465157 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1771/3596] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:13 2022] POST /compute/v2.1/servers/1a4c0b3c-f93a-4e2f-b3b8-a54714a98ff3/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:41:13.473625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.474394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.483993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.484625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.485286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.486166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.486844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.487389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.490112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:13.656866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:13.685149 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-43bbf41d-d69b-40ab-8404-7c6693582ad5 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.215437 Aug 30 03:41:13.694925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5301aef-fca5-4f6f-b6e7-80870ae67ae9 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 204 len: 0 microversion: 2.1 time: 0.269063 Aug 30 03:41:13.698664 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1772/3598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:13 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:13.701223 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1826/3598] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:13 2022] DELETE /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:13.711031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b419c0a6-ed2f-4f91-929c-bf9f97d48ac0", "name": "network-vif-deleted", "tag": "0f21bdd9-39a7-47d3-a549-8e43e4563d1a"}, {"server_uuid": "19ec1e87-eb98-432c-a1ce-945ad67a0983", "name": "network-vif-deleted", "tag": "03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:13.718585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.719190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.729993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.730956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.731788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.742019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.743197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.743890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.744787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.745331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.747953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.757996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] Creating event network-vif-deleted:0f21bdd9-39a7-47d3-a549-8e43e4563d1a for instance b419c0a6-ed2f-4f91-929c-bf9f97d48ac0 on n-h1-854924-5 Aug 30 03:41:13.774893 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] Creating event network-vif-deleted:03e2bf2a-f0e5-4a98-9eab-4e9efb8eb62f for instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 on n-h2-854924-5 Aug 30 03:41:13.790263 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9eeb8597-3a14-47bc-9b72-c3b6e95c1f6e req-e11769be-b14c-437d-968a-ce3b7ce9cd93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089772 Aug 30 03:41:13.791706 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1773/3599] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:13.815007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.816624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:13.821198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.832733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.833646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.834309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.835576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.836726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.837924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.971486 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-931255d0-2056-4dff-ba7c-d107fae586ad tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 204 len: 0 microversion: 2.1 time: 0.260843 Aug 30 03:41:13.972531 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1827/3600] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:13 2022] DELETE /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:13.982700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:13.983599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:13.995163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.997870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:13.998410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:13.999225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:13.999795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.002157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.190101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:14.202021 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-55f34511-8799-40aa-9560-3017eecae21a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.391811 Aug 30 03:41:14.224414 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1774/3601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:13 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:14.233296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1ca01c89-347c-4a96-97db-87d37c1781b0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897affe3a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:14.316108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:14.334239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1ca01c89-347c-4a96-97db-87d37c1781b0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.107562 Aug 30 03:41:14.344041 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1775/3602] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:14 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:14.348467 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9116dcfd-31e0-4809-aac1-f1378ae4facd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.366774 Aug 30 03:41:14.349377 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1828/3603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:13 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:14.354254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:14.356129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:14.356757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:14.360602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:14.367535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.369951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.370578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.371697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.373772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.375796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.375942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.376606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.379904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.380860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.381530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.383506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.574694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:14.585831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:14.592467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:14.595099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-19658657-bfad-42ca-83f3-176aa376fd49 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.244569 Aug 30 03:41:14.599428 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1829/3604] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:14 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:14.604967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:14.608568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:14.625039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:14.638011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.638831 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68bef1f2-0dbf-4b51-8d7b-dfe133918950 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1475 microversion: 2.1 time: 0.288860 Aug 30 03:41:14.639764 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1776/3605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:14 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1475 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:14.640414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.641195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.642959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.643718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.644306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.698748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lazy-loading 'flavor' on Instance uuid bf7df40a-028a-4b8d-ac8d-bae43dd4f7db {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:14.795509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:14.852247 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca740056-24bc-424c-8e07-930dd137bc66 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 202 len: 0 microversion: 2.1 time: 0.250547 Aug 30 03:41:14.854999 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1830/3606] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:14 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:41:14.862730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:14.863936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:14.874041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.874759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.875416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:14.876573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:14.877855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:14.878742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:15.202147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:15.210971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-491a81b7-a49e-435a-a720-85c2768111c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1513 microversion: 2.1 time: 0.353406 Aug 30 03:41:15.214971 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1777/3607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:14 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:15.352162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0e05991d-ec9c-4124-8e2f-e8b3337ebc0f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897baa5e50>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:15.376546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:15.378405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:15.386812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:15.388280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:15.390039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:15.391009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:15.391710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:15.392645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:15.441111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0e05991d-ec9c-4124-8e2f-e8b3337ebc0f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.096238 Aug 30 03:41:15.449873 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1831/3608] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:15 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:15.626006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:15.627291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:15.635553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:15.636474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:15.637491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:15.638447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:15.639129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:15.639806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:15.905765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:15.911821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:15.919857 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b72c2b9e-bab0-4820-97de-1100dd561e6c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.550672 Aug 30 03:41:15.920449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1778/3609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:15 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:15.922676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:15.928308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:15.933005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-415ffc5f-50b0-4f5e-ab28-9731439e4007 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.311063 Aug 30 03:41:15.934130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:15.936685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:15.937273 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1832/3610] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:15 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:41:15.955726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:15.960498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:15.961260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:15.964045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:15.964707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:15.967222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:16.234976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:16.235923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:16.247590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:16.253198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:16.255237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:16.263437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:16.264168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:16.264863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:16.265898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:16.278895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-87b13be1-56f8-4bcb-9c2e-b80e2512de9f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1475 microversion: 2.1 time: 0.351687 Aug 30 03:41:16.280857 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1779/3611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:15 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1475 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:16.464692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-754f441c-d55c-4dae-b717-dc39ec6fba71 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b57940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:16.552064 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-754f441c-d55c-4dae-b717-dc39ec6fba71 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.091625 Aug 30 03:41:16.558994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1780/3612] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:16 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:16.945594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:16.946396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:16.957566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:16.962512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:16.964008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:16.966066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:16.967856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:16.968636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:17.171917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:17.182191 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc87bff2-5b73-4525-96ad-e510925aa775 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1513 microversion: 2.1 time: 0.950955 Aug 30 03:41:17.194465 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1833/3613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:16 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1513 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:17.213286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:17.214334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:17.216652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:17.228839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:17.229965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:17.230714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:17.232040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:17.232957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:17.234290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:17.527191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:17.565511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:17.582157 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f14ad4b-66c4-4823-af0c-0d9c26b0389d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.641155 Aug 30 03:41:17.603403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:17.604885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:17.606185 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fbfa3b2e-deee-4876-aa31-f5caba28f945 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.410288 Aug 30 03:41:17.607000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1834/3614] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:17 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:17.613832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1781/3615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:16 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:17.618919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e507a1f-f6b5-4d6b-a552-842186bf1966 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897afc3310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:17.628989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:17.629677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:17.657083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:17.657613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:17.666459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:17.667293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:17.667706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:17.668141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:17.717111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e507a1f-f6b5-4d6b-a552-842186bf1966 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1454 microversion: 2.1 time: 0.102031 Aug 30 03:41:17.719567 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1782/3616] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:17 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:18.032627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f9ac3082-408f-41b0-a334-09681d9f701a req-e12e90d5-2f5f-46b8-ae30-39eb91f2a86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b87b4f3-b583-42ce-a94f-139ccdf72d2f", "name": "network-vif-deleted", "tag": "ed8d07e0-0322-4ad6-a061-f0203a7edb31"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:18.052951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f9ac3082-408f-41b0-a334-09681d9f701a req-e12e90d5-2f5f-46b8-ae30-39eb91f2a86e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:18.057586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f9ac3082-408f-41b0-a334-09681d9f701a req-e12e90d5-2f5f-46b8-ae30-39eb91f2a86e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:18.058304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f9ac3082-408f-41b0-a334-09681d9f701a req-e12e90d5-2f5f-46b8-ae30-39eb91f2a86e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:18.086692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f9ac3082-408f-41b0-a334-09681d9f701a req-e12e90d5-2f5f-46b8-ae30-39eb91f2a86e service nova] Creating event network-vif-deleted:ed8d07e0-0322-4ad6-a061-f0203a7edb31 for instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f on n-h2-854924-5 Aug 30 03:41:18.125930 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f9ac3082-408f-41b0-a334-09681d9f701a req-e12e90d5-2f5f-46b8-ae30-39eb91f2a86e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099857 Aug 30 03:41:18.127685 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1783/3617] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:18.214674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:18.215759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:18.246157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:18.246612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:18.247625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:18.250192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:18.252273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:18.256340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.191391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:19.213772 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bbfa841d-7e46-4923-81f6-d2937f83e301 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 200 len: 1475 microversion: 2.1 time: 1.605903 Aug 30 03:41:19.226294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1835/3618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:17 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 1475 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:19.237111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:19.237794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:19.245115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.245707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.246141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.246949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.247566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.248006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.617256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:19.633386 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cadddddc-62ec-4a11-9e64-d4d8f85e3ff8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1496 microversion: 2.1 time: 1.422272 Aug 30 03:41:19.635333 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1784/3619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:18 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1496 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:19.645673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:19.646529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:19.650051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:19.654737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:19.660126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.661258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.661902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.663139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.663934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.664591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.668030 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8912e839-6dd0-4947-b47c-963e1ccc72ba tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.439765 Aug 30 03:41:19.668624 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1836/3620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:19 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:19.679726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-310bfecf-a938-4b2c-9a47-c45a28f35ff6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d4a940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:19.752709 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-310bfecf-a938-4b2c-9a47-c45a28f35ff6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1463 microversion: 2.1 time: 0.082906 Aug 30 03:41:19.766873 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1837/3621] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:19 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1463 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:19.768565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-16836054-1975-4ba3-93d4-fbc1bb33d61b req-74fec48b-ce6e-49cf-bb72-e97969d66fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19296f5-70f5-4402-8f62-b2ac7154e52b", "name": "network-vif-deleted", "tag": "08e221fc-f914-4a0f-8215-c91031adb366"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:19.781942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-16836054-1975-4ba3-93d4-fbc1bb33d61b req-74fec48b-ce6e-49cf-bb72-e97969d66fd8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.782425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-16836054-1975-4ba3-93d4-fbc1bb33d61b req-74fec48b-ce6e-49cf-bb72-e97969d66fd8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.784065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-16836054-1975-4ba3-93d4-fbc1bb33d61b req-74fec48b-ce6e-49cf-bb72-e97969d66fd8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.801368 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-16836054-1975-4ba3-93d4-fbc1bb33d61b req-74fec48b-ce6e-49cf-bb72-e97969d66fd8 service nova] Creating event network-vif-deleted:08e221fc-f914-4a0f-8215-c91031adb366 for instance a19296f5-70f5-4402-8f62-b2ac7154e52b on n-h2-854924-5 Aug 30 03:41:19.808612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-16836054-1975-4ba3-93d4-fbc1bb33d61b req-74fec48b-ce6e-49cf-bb72-e97969d66fd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048400 Aug 30 03:41:19.810000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1838/3622] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:19.810527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:19.816526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:19.817821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:19.826300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.826962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.827401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.827874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:19.828370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.829175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.829629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.832342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:19.834324 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f100571c-10e5-44f9-909e-c8908ee006fb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.197328 Aug 30 03:41:19.846057 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1785/3623] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:19 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:19.870453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6372e6ae-5ee6-4251-9453-34859c957d1f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c96820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:19.891129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lazy-loading 'flavor' on Instance uuid bf7df40a-028a-4b8d-ac8d-bae43dd4f7db {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:19.917966 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'suspend' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state suspended Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 15 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: {"suspend": {}} Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'suspend' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state suspended Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'suspend': {}}} Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state suspended. Cannot suspend while the instance is in this state. Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 30 03:41:19.922274 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state suspended Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state suspended Aug 30 03:41:19.927874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:19.937634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'suspend' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state suspended {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:19.938844 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6c995d56-0e60-40d2-9ede-6f0bba5ef421 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 148 microversion: 2.1 time: 0.127011 Aug 30 03:41:19.949744 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1839/3624] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:19 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 148 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:41:19.958773 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6372e6ae-5ee6-4251-9453-34859c957d1f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 200 len: 1463 microversion: 2.1 time: 0.099737 Aug 30 03:41:19.959630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:19.959933 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1786/3625] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:19 2022] GET /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:19.960220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:19.978551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.978813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:19.979281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.979777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:19.980367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:19.981166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:19.981751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:19.983343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.004009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.004935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.007309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.011047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.011749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.013072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.186224 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee01958b-1d74-44a0-981a-e1d50568173d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 202 len: 0 microversion: 2.1 time: 0.233442 Aug 30 03:41:20.187508 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1840/3626] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:19 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:41:20.197606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.199674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:20.209293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.210110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.210964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.211966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.212655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.213249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.265790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:20.279178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46eb286d-5b62-4f12-a9a1-6a0b60818ed7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1468 microversion: 2.1 time: 0.309720 Aug 30 03:41:20.280022 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1787/3627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:19 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1468 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:20.295851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.298181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 6b87b4f3-b583-42ce-a94f-139ccdf72d2f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:20.305953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.306723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.307892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.308917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.309764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.310443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.341087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f could not be found. Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f HTTP/1.1 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f could not be found. Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '6b87b4f3-b583-42ce-a94f-139ccdf72d2f'} Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f could not be found. Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f could not be found. Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:20.350589 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f could not be found. Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance 6b87b4f3-b583-42ce-a94f-139ccdf72d2f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:20.357246 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8959c5db-be0b-4827-b7a3-7a36cbcf8135 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f" status: 404 len: 111 microversion: 2.1 time: 0.071355 Aug 30 03:41:20.358671 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1788/3628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:20 2022] GET /compute/v2.1/servers/6b87b4f3-b583-42ce-a94f-139ccdf72d2f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:20.364861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-895648369"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:20.367673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:20.376638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.378465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.379246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.380677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.381385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.382182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.665584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:20.676455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e63e9a4f-e85d-4a18-a7b9-5d33a0e140f1 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1502 microversion: 2.1 time: 0.484384 Aug 30 03:41:20.681264 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1841/3629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:20 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1502 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:20.696588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.698717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: a19296f5-70f5-4402-8f62-b2ac7154e52b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:20.704547 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d88ffa18-a268-4912-8c67-942c72115e0e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "POST /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b/action" status: 202 len: 0 microversion: 2.1 time: 0.344344 Aug 30 03:41:20.712073 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1789/3630] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:20 2022] POST /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 03:41:20.714228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.714735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.715167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.715876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.722419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.723201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.727708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.730223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:20.738102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.738919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.739534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.740540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.741171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.741790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.753376 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance a19296f5-70f5-4402-8f62-b2ac7154e52b could not be found. Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b HTTP/1.1 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a19296f5-70f5-4402-8f62-b2ac7154e52b could not be found. Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a19296f5-70f5-4402-8f62-b2ac7154e52b'} Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19296f5-70f5-4402-8f62-b2ac7154e52b could not be found. Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19296f5-70f5-4402-8f62-b2ac7154e52b could not be found. Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:20.755070 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19296f5-70f5-4402-8f62-b2ac7154e52b could not be found. Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance a19296f5-70f5-4402-8f62-b2ac7154e52b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b01ea06-2506-44e5-87a0-bbdaffd28b8e tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b" status: 404 len: 111 microversion: 2.1 time: 0.073718 Aug 30 03:41:20.764657 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1842/3631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:20 2022] GET /compute/v2.1/servers/a19296f5-70f5-4402-8f62-b2ac7154e52b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:20.770544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a22add6-a045-420c-8116-857babb7d319 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bcd9ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.846236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a22add6-a045-420c-8116-857babb7d319 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.087573 Aug 30 03:41:20.847524 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1843/3632] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:20 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:20.852454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0111eb30-1f45-4383-8292-31eab2f0cb24 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.890293 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0111eb30-1f45-4383-8292-31eab2f0cb24 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/178ab86e-4bf2-4f52-892f-22c7f39eea16" status: 204 len: 0 microversion: 2.1 time: 0.041245 Aug 30 03:41:20.891102 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1844/3633] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:41:20 2022] DELETE /compute/v2.1/os-server-groups/178ab86e-4bf2-4f52-892f-22c7f39eea16 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:20.903046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:20.903697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:20.915934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.916740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.918026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:20.919437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:20.920243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:20.921061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.139241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:21.159185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:21.161000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:21.162437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb2a3f03-9910-40fb-ac61-aa4b28d1d8bd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.270092 Aug 30 03:41:21.163190 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1845/3634] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:20 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:21.169514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:21.170157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:21.187343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:21.187870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:21.188772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.189124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:21.189715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:21.190142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.190973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:21.199616 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92b0e166-3369-4ee0-b934-1b3a468d8458 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.485908 Aug 30 03:41:21.200200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1790/3635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:20 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:21.223335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:21.336222 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9744aeb-8a46-4960-8b76-3b525865138d tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 204 len: 0 microversion: 2.1 time: 0.171231 Aug 30 03:41:21.338244 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1846/3636] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:21 2022] DELETE /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:21.349121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:21.349903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:21.362355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:21.363457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:21.364260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.365203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:21.365914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:21.366690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.394353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:21.539341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:21.549330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a85eba4-f3a7-42bd-8df9-1021b345d100 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1472 microversion: 2.1 time: 0.206080 Aug 30 03:41:21.550611 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1791/3637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:21 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:21.702237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:21.703354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:21.709873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:21.710370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:21.710807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.711505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:21.712268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:21.712407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:21.862120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce1a5e5d-c8e0-4a58-bafa-0da9f5972836 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b4e040>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:21.905664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:21.917146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3514c485-c694-46ec-936a-64770810cafd tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1502 microversion: 2.1 time: 0.219051 Aug 30 03:41:21.918383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce1a5e5d-c8e0-4a58-bafa-0da9f5972836 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.060493 Aug 30 03:41:21.925726 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1792/3638] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:21 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:21.927823 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1847/3639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:21 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:22.193655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:22.194624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:22.204553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.205258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.208440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.209393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.210131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.210993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.224396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:22.225892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:22.243957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.246225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.246773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.247698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.250796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.255284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.359563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:22.377067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:22.378810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:22.380189 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ca475f2-cf01-4c46-950d-cbab2518a005 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.197206 Aug 30 03:41:22.394513 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1793/3640] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:22 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:22.472451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:22.484956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a342442e-bf11-470b-891c-0d3a71aa1aa1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1516 microversion: 2.1 time: 0.267478 Aug 30 03:41:22.485582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1848/3641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:22 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:22.571591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:22.572655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:22.578800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.579284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.579824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.580502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.581181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.581942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.788583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:22.797029 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b57b935-8f38-4996-a434-49b46eb49879 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1472 microversion: 2.1 time: 0.230331 Aug 30 03:41:22.797963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1794/3642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:22 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:22.944703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b025297f-793e-44bf-ac97-4f1ebcecd868 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b1f7dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:22.948061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:22.949687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:22.973193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.974070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.975331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:22.977021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:22.978925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:22.979665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.079349 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b025297f-793e-44bf-ac97-4f1ebcecd868 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.149198 Aug 30 03:41:23.090395 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1849/3643] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:22 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:23.226826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:23.234806 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3178d59e-df66-4016-93fd-80c0870b50c7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1502 microversion: 2.1 time: 0.300161 Aug 30 03:41:23.235965 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1795/3644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:22 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1502 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:23.412136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:23.414842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:23.428915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:23.430266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:23.431348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.433219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:23.434399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:23.436423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.481922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:23.516060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:23.517115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:23.527864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:23.530432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:23.531211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.534586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:23.536710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:23.537566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.621533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:23.673183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:23.682259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:23.684327 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-14403767-526b-4584-87f9-bce3f812b1d9 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.281180 Aug 30 03:41:23.686366 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1850/3645] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:23 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:23.818587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:23.819211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:23.829865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:23.830364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:23.830801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.831503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:23.831950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:23.835459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:23.860161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:23.869173 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5157a6c6-20ca-4fc8-98df-65f7a06b0206 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1522 microversion: 2.1 time: 0.363541 Aug 30 03:41:23.870486 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1796/3646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:23 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:24.051048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:24.060476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cf04dc64-8013-477e-bfbb-3ab8c39dba53 tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1472 microversion: 2.1 time: 0.246061 Aug 30 03:41:24.061451 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1851/3647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:23 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:24.097470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a39faadf-b85e-4be3-820f-3216c215c177 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c96e50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:24.190641 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a39faadf-b85e-4be3-820f-3216c215c177 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.098112 Aug 30 03:41:24.191815 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1797/3648] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:24 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:24.262341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:24.262876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:24.274862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.275469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.275913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.276617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.277065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.277508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.309130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7684ad4c-46c9-4e12-acd8-c6e23ef16d29 req-fd2c55ff-8666-4e78-b995-7d98b37b98a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18f198dc-8871-4dff-bb85-142b689c1f0d", "name": "network-vif-deleted", "tag": "89158373-130d-4051-abe6-d370804390be"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:24.340814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7684ad4c-46c9-4e12-acd8-c6e23ef16d29 req-fd2c55ff-8666-4e78-b995-7d98b37b98a6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.346460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7684ad4c-46c9-4e12-acd8-c6e23ef16d29 req-fd2c55ff-8666-4e78-b995-7d98b37b98a6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.350316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7684ad4c-46c9-4e12-acd8-c6e23ef16d29 req-fd2c55ff-8666-4e78-b995-7d98b37b98a6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.417106 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7684ad4c-46c9-4e12-acd8-c6e23ef16d29 req-fd2c55ff-8666-4e78-b995-7d98b37b98a6 service nova] Creating event network-vif-deleted:89158373-130d-4051-abe6-d370804390be for instance 18f198dc-8871-4dff-bb85-142b689c1f0d on n-h1-854924-5 Aug 30 03:41:24.424405 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7684ad4c-46c9-4e12-acd8-c6e23ef16d29 req-fd2c55ff-8666-4e78-b995-7d98b37b98a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119407 Aug 30 03:41:24.425404 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1798/3649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:41:24.488848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:24.499841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8779c736-8269-43b0-a95e-f6612b35abd8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.242299 Aug 30 03:41:24.500422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1852/3650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:24 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:24.526101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:24.527155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:24.540183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.540885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.541574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.542505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.543906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.545494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.728988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:24.730305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:24.739289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.744192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.745037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.747399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.749667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.753776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.860225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:24.873739 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4f6ad74-6ca3-403a-b367-01ab711fe8e4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.350825 Aug 30 03:41:24.875095 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1799/3651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:24 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:24.893528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:24.898120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:24.906912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:24.916944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.917877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:24.918590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.919737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:24.920315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.921136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.921458 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9eea7dcc-fa2c-4c91-9093-de22cc1dc890 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.196915 Aug 30 03:41:24.922532 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1853/3652] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:24 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:41:24.923199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.924516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.932946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-454dd992-00f6-46d4-ba73-0922889fdc50 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:24.933817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-454dd992-00f6-46d4-ba73-0922889fdc50 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 219b000d-4671-410b-b2a1-442cfab3c489] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:24.941696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-454dd992-00f6-46d4-ba73-0922889fdc50 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 219b000d-4671-410b-b2a1-442cfab3c489 could not be found. Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-454dd992-00f6-46d4-ba73-0922889fdc50 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/219b000d-4671-410b-b2a1-442cfab3c489/action HTTP/1.1 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 15 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: {"unpause": {}} Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 219b000d-4671-410b-b2a1-442cfab3c489 could not be found. Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '219b000d-4671-410b-b2a1-442cfab3c489', 'body': {'unpause': {}}} Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 219b000d-4671-410b-b2a1-442cfab3c489 could not be found. Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 219b000d-4671-410b-b2a1-442cfab3c489 could not be found. Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:24.943831 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:24.949923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:24.949923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:24.949923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 219b000d-4671-410b-b2a1-442cfab3c489 could not be found. Aug 30 03:41:24.949923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:24.952263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-454dd992-00f6-46d4-ba73-0922889fdc50 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 219b000d-4671-410b-b2a1-442cfab3c489 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:24.953323 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-454dd992-00f6-46d4-ba73-0922889fdc50 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/219b000d-4671-410b-b2a1-442cfab3c489/action" status: 404 len: 111 microversion: 2.1 time: 0.029403 Aug 30 03:41:24.953939 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1854/3653] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:24 2022] POST /compute/v2.1/servers/219b000d-4671-410b-b2a1-442cfab3c489/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:24.962453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:24.963169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:24.971301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.972282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.972920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:24.974117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:24.975111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:24.975837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.162741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:25.176328 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-178e2fcd-4cf5-460b-af9e-202c53045cac tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1522 microversion: 2.1 time: 0.287848 Aug 30 03:41:25.177059 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1800/3654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:24 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:25.191127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:25.191996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:25.193556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:25.200560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.202458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.202677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.203874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.204677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.205389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.206235 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64b9b609-4b0e-4467-a740-9f3ecebd4c37 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.247588 Aug 30 03:41:25.207640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1855/3655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:24 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:25.215106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d69e33f7-1cb1-4aa7-b206-832232c261e4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b11aaf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:25.255827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.256597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.257300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.258021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lazy-loading 'fault' on Instance uuid 18f198dc-8871-4dff-bb85-142b689c1f0d {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:25.305954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d69e33f7-1cb1-4aa7-b206-832232c261e4 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.097096 Aug 30 03:41:25.306556 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1856/3656] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:25 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:25.321831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:25.322716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:25.335086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.335856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.337391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.337391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.337963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.338723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.343020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca360cee4c844a5d91cdf6d1bb0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e432c15ade254bae971801b45521fe7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:25.356039 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf15d097-7587-420e-ad84-55dd05d1e54f tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 200 len: 1307 microversion: 2.1 time: 0.170096 Aug 30 03:41:25.357326 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1801/3657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:25 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:25.473402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-562cab54-36e6-44ac-9c1e-4bdd4406691a req-679f74f0-661a-4f90-854f-da6549b8e750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ba30af-e8e3-4817-ab13-46a4b5e8325e", "name": "network-vif-unplugged", "status": "completed", "tag": "cde12ff6-56bc-4b7f-8e16-1d13f9e6079f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:25.498778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-562cab54-36e6-44ac-9c1e-4bdd4406691a req-679f74f0-661a-4f90-854f-da6549b8e750 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.499988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-562cab54-36e6-44ac-9c1e-4bdd4406691a req-679f74f0-661a-4f90-854f-da6549b8e750 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.501199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-562cab54-36e6-44ac-9c1e-4bdd4406691a req-679f74f0-661a-4f90-854f-da6549b8e750 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.538154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-562cab54-36e6-44ac-9c1e-4bdd4406691a req-679f74f0-661a-4f90-854f-da6549b8e750 service nova] Creating event network-vif-unplugged:cde12ff6-56bc-4b7f-8e16-1d13f9e6079f for instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e on n-h1-854924-5 Aug 30 03:41:25.557033 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-562cab54-36e6-44ac-9c1e-4bdd4406691a req-679f74f0-661a-4f90-854f-da6549b8e750 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086804 Aug 30 03:41:25.558264 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1802/3658] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:41:25.562700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:25.571828 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86625312-04fa-45b1-a638-1dcfae98b41d tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.264182 Aug 30 03:41:25.573063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1857/3659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:25 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:25.597185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:25.599378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:25.606767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.607832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.608535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.609690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.610382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.611658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.645774 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'unpause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 15 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: {"unpause": {}} Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'unpause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'unpause': {}}} Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state active. Cannot unpause while the instance is in this state. Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:25.648177 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'unpause' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5968d3cb-5caf-4e39-95a6-4ea9dee8b706 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 145 microversion: 2.1 time: 0.060987 Aug 30 03:41:25.654437 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1803/3660] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:25 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:41:25.669824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:25.670362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:25.677907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.678499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.679092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.680038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.680586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.681302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.848295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:25.856665 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffb0d3ff-dac6-4b2e-bcdb-c01effdf4432 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.199678 Aug 30 03:41:25.857739 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1858/3661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:25 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:25.880873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:25.882033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:25.890267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.891215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.892046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.893445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.894091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.894682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.953116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:25.957863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:25.969319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.971605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.972055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:25.972790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:25.973518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:25.973946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.113121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.115211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.124122 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8f97d42-4c86-403b-a550-2b0c34960c88 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.247477 Aug 30 03:41:26.124741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.125092 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1804/3662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:25 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:26.126502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.128282 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d95ca29-6f82-4dd3-a78f-648865c9e9ec tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.181150 Aug 30 03:41:26.128907 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1859/3663] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:25 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:26.159298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96984c5d-e4b7-4bca-9c1e-d9c8dd9acb78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:26.159629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96984c5d-e4b7-4bca-9c1e-d9c8dd9acb78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 39d6cd00-de1d-4685-a73d-d567023d67d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:26.170801 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-96984c5d-e4b7-4bca-9c1e-d9c8dd9acb78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 39d6cd00-de1d-4685-a73d-d567023d67d1 could not be found. Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96984c5d-e4b7-4bca-9c1e-d9c8dd9acb78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/39d6cd00-de1d-4685-a73d-d567023d67d1/action HTTP/1.1 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 18 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: {"unshelve": null} Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 39d6cd00-de1d-4685-a73d-d567023d67d1 could not be found. Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '39d6cd00-de1d-4685-a73d-d567023d67d1', 'body': {'unshelve': None}} Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d6cd00-de1d-4685-a73d-d567023d67d1 could not be found. Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d6cd00-de1d-4685-a73d-d567023d67d1 could not be found. Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.173022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d6cd00-de1d-4685-a73d-d567023d67d1 could not be found. Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96984c5d-e4b7-4bca-9c1e-d9c8dd9acb78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 39d6cd00-de1d-4685-a73d-d567023d67d1 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-96984c5d-e4b7-4bca-9c1e-d9c8dd9acb78 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/39d6cd00-de1d-4685-a73d-d567023d67d1/action" status: 404 len: 111 microversion: 2.1 time: 0.033723 Aug 30 03:41:26.179477 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1805/3664] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:26 2022] POST /compute/v2.1/servers/39d6cd00-de1d-4685-a73d-d567023d67d1/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:26.197557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:26.204744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:26.209089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:26.213993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:26.224413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.224914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.225571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.225873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.226617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.227159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.227295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.227833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.228461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.228819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.229472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.230018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.471568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.485878 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-862d4fd1-fb2c-41fc-b725-c6cf8e1b2d78 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1522 microversion: 2.1 time: 0.279392 Aug 30 03:41:26.486601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1806/3665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:26 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:26.494287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-636e1e0b-2502-406b-866d-aa76a57f0ffa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897afc3f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:26.534168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.543022 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bff5e18d-05c8-4177-98ac-e5324896721b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.362145 Aug 30 03:41:26.544393 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1860/3666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:26 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:26.557791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:26.558836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] [instance: 18f198dc-8871-4dff-bb85-142b689c1f0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:26.566355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.568238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.568993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.569943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.570909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.571908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.592181 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] HTTP exception thrown: Instance 18f198dc-8871-4dff-bb85-142b689c1f0d could not be found. Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Request method failure captured: Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d HTTP/1.1 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYYoZTyuuGE6lnJFjxFlPOSbVyLvNi7vH_UKJ7m8goTldYSdCySsDnznGgkrL76Ke2sEMRSjcj9vyH0V3x8WD1rdg6sjMn7gPR-_TMoyQ9MKOW77CscFkdEB6Bbnk88TQ39CqT0wj3kyPutvZ2Q7nLB8lbyoNVAGfaNjUdLxPkqry8w Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e432c15ade254bae971801b45521fe7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e432c15ade254bae971801b45521fe7a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e432c15ade254bae971801b45521fe7a"}]}] Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e432c15ade254bae971801b45521fe7a Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-96982572 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ca360cee4c844a5d91cdf6d1bb0879c4 Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersOnMultiNodesTest-96982572-project Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 18f198dc-8871-4dff-bb85-142b689c1f0d could not be found. Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '18f198dc-8871-4dff-bb85-142b689c1f0d'} Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18f198dc-8871-4dff-bb85-142b689c1f0d could not be found. Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18f198dc-8871-4dff-bb85-142b689c1f0d could not be found. Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:26.593821 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18f198dc-8871-4dff-bb85-142b689c1f0d could not be found. Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] Returning 404 to user: Instance 18f198dc-8871-4dff-bb85-142b689c1f0d could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b631cdd-086d-4ebd-9149-936c865d7d8a tempest-ServersOnMultiNodesTest-96982572 tempest-ServersOnMultiNodesTest-96982572-project] 10.222.0.30 "GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d" status: 404 len: 111 microversion: 2.1 time: 0.049722 Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1861/3667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:26 2022] GET /compute/v2.1/servers/18f198dc-8871-4dff-bb85-142b689c1f0d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:26.605851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:26.613405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.613952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.614505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.615270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.616144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.616477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.625809 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-636e1e0b-2502-406b-866d-aa76a57f0ffa tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.118899 Aug 30 03:41:26.626524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1807/3668] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:26 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:26.944788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:26.955838 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ff2f936-dd76-4911-a2b4-5e7c642d3fe9 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.355667 Aug 30 03:41:26.956741 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1862/3669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:26 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:26.978703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:26.979314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:26.995458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.995969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.996407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:26.997563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:26.998024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:26.998447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.076016 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Cannot 'unshelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action HTTP/1.1 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 18 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: {"unshelve": null} Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'unshelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'unshelve': None}} Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db in vm_state active. Cannot unshelve while the instance is in this state. Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:41:27.077671 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active Aug 30 03:41:27.083803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:27.085497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 409 to user: Cannot 'unshelve' instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db while it is in vm_state active {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:27.086543 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b0954e6-5aba-49c0-b402-78d7b70f9176 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action" status: 409 len: 146 microversion: 2.1 time: 0.112100 Aug 30 03:41:27.087656 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1808/3670] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:41:26 2022] POST /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db/action => generated 146 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:41:27.098637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:27.099342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:27.108059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.112458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.112978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.115415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.116168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.118202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.163174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:27.164244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:27.179732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.180976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.181443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.182158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.182612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.183044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.488805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:27.506333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:27.507805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:27.518183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c324acec-aa22-48ee-b4a6-2f852f77b783 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.349807 Aug 30 03:41:27.519771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1809/3671] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:27 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:41:27.526776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:27.534562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:27.536188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:27.538466 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d649a100-edc5-4c03-9950-ec1f755e47d8 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.446631 Aug 30 03:41:27.542578 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1863/3672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:27 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:27.560850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.561834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.562532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.563501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.566371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.567116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.571565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:27.573590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:27.598676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.600121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.601745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.603649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:27.604909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:27.605696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:27.944863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:27.959315 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5540bea2-19ec-4cef-bdd2-94d66c66730e tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.393199 Aug 30 03:41:27.973388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1864/3673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:27 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:27.978432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1d092666-b80a-4cdd-b251-2154abc57f12 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b279d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:28.037590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:28.059608 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8990a42-95a2-4e63-a3af-1df117a2be06 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1522 microversion: 2.1 time: 0.536255 Aug 30 03:41:28.060660 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1810/3674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:27 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:28.062325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1d092666-b80a-4cdd-b251-2154abc57f12 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.094229 Aug 30 03:41:28.072068 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1865/3675] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:27 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:28.077084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bec68983-a72c-4f40-84ca-065809e3cfeb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-789649500_updated"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:28.080283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bec68983-a72c-4f40-84ca-065809e3cfeb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 03ba992e-e2ee-433d-9b6b-b8f6acfa9171] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:28.118005 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-bec68983-a72c-4f40-84ca-065809e3cfeb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 03ba992e-e2ee-433d-9b6b-b8f6acfa9171 could not be found. Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bec68983-a72c-4f40-84ca-065809e3cfeb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/servers/03ba992e-e2ee-433d-9b6b-b8f6acfa9171 HTTP/1.1 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 80 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-789649500_updated"}} Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 03ba992e-e2ee-433d-9b6b-b8f6acfa9171 could not be found. Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '03ba992e-e2ee-433d-9b6b-b8f6acfa9171', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-789649500_updated'}}} Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ba992e-e2ee-433d-9b6b-b8f6acfa9171 could not be found. Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 03:41:28.119790 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ba992e-e2ee-433d-9b6b-b8f6acfa9171 could not be found. Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ba992e-e2ee-433d-9b6b-b8f6acfa9171 could not be found. Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bec68983-a72c-4f40-84ca-065809e3cfeb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 03ba992e-e2ee-433d-9b6b-b8f6acfa9171 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bec68983-a72c-4f40-84ca-065809e3cfeb tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "PUT /compute/v2.1/servers/03ba992e-e2ee-433d-9b6b-b8f6acfa9171" status: 404 len: 111 microversion: 2.1 time: 0.059579 Aug 30 03:41:28.126314 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1811/3676] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:41:28 2022] PUT /compute/v2.1/servers/03ba992e-e2ee-433d-9b6b-b8f6acfa9171 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:28.133794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:28.133794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:28.151538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:28.152180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:28.152695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:28.156443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:28.156937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:28.161432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:28.549996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:28.550551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:28.564904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:28.565998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:28.567111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:28.568107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:28.569725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:28.570554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:28.700481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:28.720465 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42cabd93-d352-469e-b050-87312511023f tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.592158 Aug 30 03:41:28.723382 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1866/3677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:28 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:28.746663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:28.747601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:28.750176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:28.755491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:28.756341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:28.756998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:28.758391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:28.759038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:28.759690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:28.764761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:28.771122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:28.779989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2724cea-76ca-4404-8925-0b851d581a04 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.237396 Aug 30 03:41:28.786163 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1812/3678] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:28 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:41:29.056800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:29.077692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b228b9e2-ab22-4b9f-b676-c22e0134a315 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c2ef70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:29.087851 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3e638da-e1cc-480a-abc0-40e783294159 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.345041 Aug 30 03:41:29.126478 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1867/3679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:28 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:29.153197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:29.157227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:29.191114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:29.191677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:29.192185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:29.192942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:29.193293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:29.193743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:29.202859 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b228b9e2-ab22-4b9f-b676-c22e0134a315 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.129509 Aug 30 03:41:29.210883 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1813/3680] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:29 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:29.221909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-391d31ef-8c0f-44e3-9d70-29cda3590294 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-391d31ef-8c0f-44e3-9d70-29cda3590294 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db HTTP/1.1 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 280 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.229392 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-391d31ef-8c0f-44e3-9d70-29cda3590294 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:29.235277 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-391d31ef-8c0f-44e3-9d70-29cda3590294 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "PUT /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 400 len: 619 microversion: 2.1 time: 0.021189 Aug 30 03:41:29.237875 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1814/3681] 10.222.0.30 () {60 vars in 1257 bytes} [Tue Aug 30 03:41:29 2022] PUT /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:41:29.247090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:29.248859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:29.260201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:29.260758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:29.261436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:29.262329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:29.263011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:29.263614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:29.626240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:29.648152 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8c1e724-cd01-4889-be27-37fdf04767b7 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.407373 Aug 30 03:41:29.650491 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1815/3682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:29.677524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:29.678480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:29.690278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:29.691054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:29.691688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:29.692788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:29.693484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:29.694111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:30.030741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:30.053122 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64491540-63e3-455a-b1a1-ada46c7e0830 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1522 microversion: 2.1 time: 0.922074 Aug 30 03:41:30.066285 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1868/3683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:29 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1522 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:30.072290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-07f60638-f351-4f27-be76-271ba7124481 req-b4300d9f-2c83-4300-8db8-dc7f0a17cdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bc8eb0-5c19-419d-9213-3b8b9d973ccf", "name": "network-vif-plugged", "status": "completed", "tag": "1d8b172e-eb09-40eb-ae27-f9b24cc004cb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:30.098739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-07f60638-f351-4f27-be76-271ba7124481 req-b4300d9f-2c83-4300-8db8-dc7f0a17cdc9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:30.099366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-07f60638-f351-4f27-be76-271ba7124481 req-b4300d9f-2c83-4300-8db8-dc7f0a17cdc9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:30.100134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-07f60638-f351-4f27-be76-271ba7124481 req-b4300d9f-2c83-4300-8db8-dc7f0a17cdc9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:30.119943 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-07f60638-f351-4f27-be76-271ba7124481 req-b4300d9f-2c83-4300-8db8-dc7f0a17cdc9 service nova] Creating event network-vif-plugged:1d8b172e-eb09-40eb-ae27-f9b24cc004cb for instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf on n-h2-854924-5 Aug 30 03:41:30.138202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-07f60638-f351-4f27-be76-271ba7124481 req-b4300d9f-2c83-4300-8db8-dc7f0a17cdc9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070356 Aug 30 03:41:30.139582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1869/3684] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:30.152807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:30.157571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:30.172298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:30.173198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:30.174711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:30.176101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:30.178840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:30.179775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:30.365094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:30.379210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:30.383350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:30.385808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74e0d6ce-3e4d-4a6b-a2a4-e041fda054cb tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.244803 Aug 30 03:41:30.386745 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1870/3685] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:30 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:30.409006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a27ac143-fd3a-4307-b5a8-a24836e47719 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c67dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:30.510153 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a27ac143-fd3a-4307-b5a8-a24836e47719 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.120864 Aug 30 03:41:30.512914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1871/3686] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:30 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:30.636706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:30.643167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:30.655614 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fee5e5a1-8734-4900-a7af-dd2196bc8333 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.983283 Aug 30 03:41:30.659822 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1816/3687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:29 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:30.683446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7eb3f723-2fa5-41cd-8062-7462c5036410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7eb3f723-2fa5-41cd-8062-7462c5036410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: request: PUT /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db HTTP/1.1 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 24 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": ""}} Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db', 'body': {'server': {'name': ''}}} Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi '' Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:41:30.692714 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7eb3f723-2fa5-41cd-8062-7462c5036410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7eb3f723-2fa5-41cd-8062-7462c5036410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "PUT /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 400 len: 108 microversion: 2.1 time: 0.016601 Aug 30 03:41:30.702011 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1872/3688] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:41:30 2022] PUT /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:41:30.705400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:30.706124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:30.720963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:30.721504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:30.722348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:30.723096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:30.723547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:30.724029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:31.042081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:31.054773 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b3e10fd-85fa-4bbb-9cb9-f994f1f338fc tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1505 microversion: 2.1 time: 0.354794 Aug 30 03:41:31.056244 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1817/3689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:30 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:31.081446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:31.083059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:31.101261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:31.102339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:31.105089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:31.106714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:31.112479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:31.113130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:31.155264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:31.417488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:31.418015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:31.442239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:31.459601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:31.462369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:31.464174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:31.465320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:31.466065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:32.461318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:32.487168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:32.489827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:32.499568 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb6af3b7-e493-4f59-a2ff-54f7f7273eb7 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 1.086055 Aug 30 03:41:32.501084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1818/3690] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:31 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:41:32.513754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea43ae49-312f-4e77-b47b-026f6cac9b6e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897affe790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:32.564750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:32.611541 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eaa63f2f-e4eb-43c9-9564-d38bb9b3ce29 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1522 microversion: 2.1 time: 1.538978 Aug 30 03:41:32.635080 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1873/3691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:31 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1522 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:32.645797 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea43ae49-312f-4e77-b47b-026f6cac9b6e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.140344 Aug 30 03:41:32.648663 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1819/3692] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:32 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:32.676370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6f3994c5-e6fd-4420-b7eb-bc2797633b07 req-accdc34c-6ac0-468b-9040-1c9ac1ce2c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "name": "network-vif-plugged", "status": "completed", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:32.712179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f3994c5-e6fd-4420-b7eb-bc2797633b07 req-accdc34c-6ac0-468b-9040-1c9ac1ce2c26 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:32.712666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f3994c5-e6fd-4420-b7eb-bc2797633b07 req-accdc34c-6ac0-468b-9040-1c9ac1ce2c26 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:32.713097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f3994c5-e6fd-4420-b7eb-bc2797633b07 req-accdc34c-6ac0-468b-9040-1c9ac1ce2c26 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:32.755559 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6f3994c5-e6fd-4420-b7eb-bc2797633b07 req-accdc34c-6ac0-468b-9040-1c9ac1ce2c26 service nova] Creating event network-vif-plugged:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:41:32.797202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6f3994c5-e6fd-4420-b7eb-bc2797633b07 req-accdc34c-6ac0-468b-9040-1c9ac1ce2c26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159448 Aug 30 03:41:32.799229 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1874/3693] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:33.532521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:33.535459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:33.591125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:33.592062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:33.594629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:33.601209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:33.605335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:33.607096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:33.638055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:33.639423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:33.664914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:33.674298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:33.675088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:33.676067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:33.676755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:33.680654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:33.921741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:33.965431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:33.968688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:33.976366 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-580186ef-7c45-4392-b702-8d50771f1004 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1605 microversion: 2.42 time: 0.452620 Aug 30 03:41:34.005274 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1820/3694] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:33 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1605 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:41:34.012759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46de54c4-019c-48a6-a061-8d96ee010095 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983cc44c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:34.127874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46de54c4-019c-48a6-a061-8d96ee010095 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.120028 Aug 30 03:41:34.136233 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1821/3695] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:34 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:34.357501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:34.368560 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-563058c4-4951-4e6b-af72-0b8f4a51b09b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1507 microversion: 2.1 time: 0.738656 Aug 30 03:41:34.373250 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1875/3696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:33 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1507 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:34.395266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:34.395893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:34.414915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:34.415437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:34.419692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:34.420452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:34.420922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:34.421370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:35.005769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:35.006591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:35.023662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:35.026354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:35.026931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:35.027941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:35.031163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:35.031915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:35.150525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:35.151187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:35.155029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:35.155847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lazy-loading 'fault' on Instance uuid 19ec1e87-eb98-432c-a1ce-945ad67a0983 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:35.335404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:35.351586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:35.362315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a42c27b343c949b7bc4fd507565f43f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4353d8911fc24ecab08fa31c69ed67f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:35.370616 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f336e9d-f37e-462d-9fa0-578a92c9211b tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 200 len: 1610 microversion: 2.42 time: 0.369322 Aug 30 03:41:35.377163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1876/3697] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:34 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 1610 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:41:35.418969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:35.419953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1828c01f-a4c7-4842-945a-f2ff0143fae0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa5ddc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:35.434400 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4152cc8-6159-4c90-a122-63d545d4cc00 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 200 len: 1507 microversion: 2.1 time: 1.044000 Aug 30 03:41:35.437198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1822/3698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:34 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 1507 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:35.458002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:35.458502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:35.465758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:35.466251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:35.466683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:35.467986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:35.468448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:35.468875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:35.512153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:35.602423 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1828c01f-a4c7-4842-945a-f2ff0143fae0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.213072 Aug 30 03:41:35.622145 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1877/3699] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:35 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:35.732509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb798c34-d01f-41c3-b553-21ae3cc2f47d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 204 len: 0 microversion: 2.1 time: 0.277110 Aug 30 03:41:35.749929 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1823/3700] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:35 2022] DELETE /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:36.015724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2041066095", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "bb35cdd9-92eb-43df-ac7e-c5869f6415af"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:36.134588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] validate_networks() for [('bb35cdd9-92eb-43df-ac7e-c5869f6415af', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:41:36.404612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:36.405318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:36.419382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:36.420042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:36.420306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:36.421025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:36.421494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:36.434214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:36.503407 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] HTTP exception thrown: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Request method failure captured: Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 HTTP/1.1 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUa7jfShl7tbcXM-2BZFP-DEUz_grJXZNn4IXlMUNQq6CDyEjXdFb3N02kiMr6SDWer7zzJTF3G6XmAbvUWoU_H185sBmfPeHx03JG7fP37fWYgbkKUiVoESSzcKrQRQ9jZ_fjOVy7CsgrE2y9bDh2iTdvVefPNI_fzFnfZYIeSuOk Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 4353d8911fc24ecab08fa31c69ed67f9 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4353d8911fc24ecab08fa31c69ed67f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4353d8911fc24ecab08fa31c69ed67f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4353d8911fc24ecab08fa31c69ed67f9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4353d8911fc24ecab08fa31c69ed67f9"}]}] Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 4353d8911fc24ecab08fa31c69ed67f9 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TaggedBootDevicesTest_v242-819363391-project Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a42c27b343c949b7bc4fd507565f43f4 Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TaggedBootDevicesTest_v242-819363391-project Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '19ec1e87-eb98-432c-a1ce-945ad67a0983'} Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:36.515437 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:36.522504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:36.525761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Returning 404 to user: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:36.527577 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ea9db0b-b537-431a-ad43-7fd342ccecb1 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 404 len: 111 microversion: 2.42 time: 0.127273 Aug 30 03:41:36.528359 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1824/3701] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:36 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:41:36.545038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb78719a-4727-46ea-9b88-f3093d63acfd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '.version_select at 0x7f897b7651f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:36.582322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb78719a-4727-46ea-9b88-f3093d63acfd tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188981609" status: 204 len: 0 microversion: 2.42 time: 0.045899 Aug 30 03:41:36.586885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1825/3702] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188981609 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:41:36.620058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f7b293d-3ce2-4419-93df-124c3e6596df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c96280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:36.730675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f7b293d-3ce2-4419-93df-124c3e6596df tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.116270 Aug 30 03:41:36.732003 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1826/3703] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:36 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:37.706681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:41:37.707163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:41:37.707572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:41:37.708778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:41:37.709202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:41:37.741571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:37.748867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e1f0fb4-f517-41ea-a75b-66f40b887b25 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983cf8b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:37.754043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:37.758448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:37.761324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:37.776438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:37.777947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:37.871361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e1f0fb4-f517-41ea-a75b-66f40b887b25 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.128021 Aug 30 03:41:37.872642 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1827/3704] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:37 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:37.878688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Getting quotas for project bd729db31b104e28a6ce9997802c55a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:41:37.913332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Getting quotas for user 25f09accc2c64314b7a83cac46bb3b2b and project bd729db31b104e28a6ce9997802c55a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:41:37.987510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:41:38.000645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:41:38.120557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:38.179127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c6c995f1-bd52-4e1f-8706-762f0b1dd23b tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166908 Aug 30 03:41:38.180322 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1878/3705] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:41:38.192139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99749856-cc6e-4fd0-8eac-5dda392fdc3d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:38.192763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-99749856-cc6e-4fd0-8eac-5dda392fdc3d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:38.476655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-99749856-cc6e-4fd0-8eac-5dda392fdc3d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:38.488801 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-99749856-cc6e-4fd0-8eac-5dda392fdc3d tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1218 microversion: 2.1 time: 0.298452 Aug 30 03:41:38.490238 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1828/3706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:38 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1218 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:38.887361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1af61083-e41a-405c-bb86-986b066dfa2e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa645e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:39.024815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1af61083-e41a-405c-bb86-986b066dfa2e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.141532 Aug 30 03:41:39.025689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1879/3707] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:38 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:39.515777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:39.517546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:39.542003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:39.564871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:39.569744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:39.573364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:39.586411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:39.592372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:39.922241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:39.940202 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79f42014-acf7-40e6-a289-026aacc00b02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1222 microversion: 2.1 time: 0.429830 Aug 30 03:41:39.940927 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1829/3708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:39 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1222 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:40.040074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85c5d3f8-9e97-4dc7-86aa-ef0eda83be21 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa5d4c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:40.162209 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85c5d3f8-9e97-4dc7-86aa-ef0eda83be21 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.125774 Aug 30 03:41:40.163131 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1880/3709] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:40 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:40.961698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:40.963592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:40.987357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:40.988290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:40.989000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:40.990064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:40.990744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:40.998139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:41.178498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7eff3885-9508-4d8f-be37-253b3dbd5f1e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897baa5670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:41.279251 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7eff3885-9508-4d8f-be37-253b3dbd5f1e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.104938 Aug 30 03:41:41.280459 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1881/3710] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:41 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:41.310896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:41.326937 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-87ef3bfd-41db-46bc-bc29-ba0082cabac1 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1278 microversion: 2.1 time: 0.368291 Aug 30 03:41:41.346634 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1830/3711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:40 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1278 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:41.563274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a41bbcb0-9103-4563-9216-c843c5624b4e req-35899f97-500e-4ebd-8925-a8d059230766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bc8eb0-5c19-419d-9213-3b8b9d973ccf", "name": "network-vif-deleted", "tag": "1d8b172e-eb09-40eb-ae27-f9b24cc004cb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:41.584082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a41bbcb0-9103-4563-9216-c843c5624b4e req-35899f97-500e-4ebd-8925-a8d059230766 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:41.589459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a41bbcb0-9103-4563-9216-c843c5624b4e req-35899f97-500e-4ebd-8925-a8d059230766 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:41.598019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a41bbcb0-9103-4563-9216-c843c5624b4e req-35899f97-500e-4ebd-8925-a8d059230766 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:41.636032 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a41bbcb0-9103-4563-9216-c843c5624b4e req-35899f97-500e-4ebd-8925-a8d059230766 service nova] Creating event network-vif-deleted:1d8b172e-eb09-40eb-ae27-f9b24cc004cb for instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf on n-h2-854924-5 Aug 30 03:41:41.651265 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a41bbcb0-9103-4563-9216-c843c5624b4e req-35899f97-500e-4ebd-8925-a8d059230766 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091408 Aug 30 03:41:41.662349 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1882/3712] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:42.310695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6a1dc90e-315e-4f31-b2b7-de792d5135fc tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c33670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:42.355694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:42.356633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:42.384896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:42.401692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:42.402400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:42.404127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:42.409407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:42.412082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:42.416746 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6a1dc90e-315e-4f31-b2b7-de792d5135fc tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.117491 Aug 30 03:41:42.427639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1831/3713] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:42 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:42.771420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:42.814819 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c052f5e-e4e1-4379-a210-61603065ac20 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1276 microversion: 2.1 time: 0.460788 Aug 30 03:41:42.830566 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1883/3714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:42 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1276 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:43.440194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-515b5cb4-7759-4e6d-bba8-017a6defb48e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c2ef70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:43.566159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-515b5cb4-7759-4e6d-bba8-017a6defb48e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.134197 Aug 30 03:41:43.574147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1832/3715] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:43 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:43.838430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:43.839102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:43.860223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:43.862656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:43.863352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:43.864163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:43.864571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:43.865143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.294867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:44.297053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:44.326481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:44.326993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:44.327440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.333423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:44.333939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:44.345818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.418133 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 HTTP/1.1 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '99e74adc-c2ac-414c-a28f-8988acf80515'} Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:44.421619 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.427722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.433110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:44.435342 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-88e367c7-501f-40cf-8795-30e2b3e2edce tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 404 len: 111 microversion: 2.1 time: 0.152834 Aug 30 03:41:44.450165 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1833/3716] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:44 2022] DELETE /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:44.456663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:44.460148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:44.460996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: 99e74adc-c2ac-414c-a28f-8988acf80515] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:44.465982 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ef6fdedb-fc27-4c1c-a98d-a83f00ef72f9 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 0.631512 Aug 30 03:41:44.466578 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1884/3717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:43 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:44.494120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:44.494910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:44.496127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.497164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:44.498166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:44.500918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.538658 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 HTTP/1.1 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '99e74adc-c2ac-414c-a28f-8988acf80515'} Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:44.540270 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance 99e74adc-c2ac-414c-a28f-8988acf80515 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-922192b3-8f1a-47ea-a0e8-f77e5f3ff20a tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515" status: 404 len: 111 microversion: 2.1 time: 0.091870 Aug 30 03:41:44.548018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1834/3718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:44 2022] GET /compute/v2.1/servers/99e74adc-c2ac-414c-a28f-8988acf80515 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:44.553649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:44.554219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:44.568429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:44.568929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:44.569449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.570140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:44.570941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:44.591408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c30b1549-9035-4dad-99d5-e625ca4ab22b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f898018e430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:44.606054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:44.702831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:41:44.739179 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c30b1549-9035-4dad-99d5-e625ca4ab22b tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.161434 Aug 30 03:41:44.739963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1835/3719] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:44 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:45.003016 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54345104-f752-42cb-bcb7-0c3266fd97d4 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 204 len: 0 microversion: 2.1 time: 0.452991 Aug 30 03:41:45.005102 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1885/3720] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:41:44 2022] DELETE /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:41:45.030118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:45.032662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:45.056286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:45.059944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:45.067607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:45.068562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:45.069125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:45.074211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:45.488564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:45.491072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:45.508142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:45.508941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:45.509653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:45.512338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:45.514023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:45.514824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:45.715604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:45.730121 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c903de2b-3380-4cd0-b03d-5d2c50d59d73 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.716928 Aug 30 03:41:45.737979 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1836/3721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:45 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:45.766571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc0ea3cb-47e9-41fd-ac5e-72dcd138647a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d32280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:45.879054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc0ea3cb-47e9-41fd-ac5e-72dcd138647a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.124206 Aug 30 03:41:45.882317 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1837/3722] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:45 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:46.317715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:46.332041 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1911db0-8b5e-45ce-bd82-82f4ba165d95 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 0.844452 Aug 30 03:41:46.336099 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1886/3723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:45 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:46.776042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:46.776669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:46.801397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:46.815713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:46.816186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:46.816994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:46.817565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:46.818009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:46.896207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-46b82688-10a1-4a2e-bc02-318a62fca2a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b11a550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:47.047784 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-46b82688-10a1-4a2e-bc02-318a62fca2a9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.155500 Aug 30 03:41:47.055572 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1887/3724] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:46 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:47.354098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:47.354761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:47.369230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:47.369230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:47.369566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:47.370484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:47.371326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:47.372124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:47.542487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:47.553672 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e15712e-729f-411c-8750-dbd923d9d17c tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.782707 Aug 30 03:41:47.554275 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1838/3725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:46 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:47.819606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:47.953059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:48.065280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e144f2d1-06bd-4966-8864-3730f09ffec0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c2ae50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:48.150326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e144f2d1-06bd-4966-8864-3730f09ffec0 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.090760 Aug 30 03:41:48.150923 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1839/3726] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:48 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:48.580101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:48.581691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:48.604243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:48.609024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:48.618834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:48.625446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:48.627926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:48.631344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:48.634496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:49.178449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:49.186619 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-83b1b9a6-d41d-4493-b2a3-85247ca45f02 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 1.836356 Aug 30 03:41:49.187208 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1888/3727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:47 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:49.209144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94ab902c-9d02-4cd4-86ea-79b791a2ff21 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b11adc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:49.317765 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94ab902c-9d02-4cd4-86ea-79b791a2ff21 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.124394 Aug 30 03:41:49.323929 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1889/3728] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:49 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:49.402946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:49.421910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-844979e4-dc75-48df-a985-9afde438c410 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1511 microversion: 2.1 time: 0.837323 Aug 30 03:41:49.436158 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1840/3729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:48 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1511 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:49.989881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f118b598-1d46-4f02-95b1-5a474d1f27d8 req-d74122c8-6f61-4f53-91a5-695fc1193962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7df40a-028a-4b8d-ac8d-bae43dd4f7db", "name": "network-vif-deleted", "tag": "1d231e72-c1f2-4b64-96eb-d5a4fa229659"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:50.043795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f118b598-1d46-4f02-95b1-5a474d1f27d8 req-d74122c8-6f61-4f53-91a5-695fc1193962 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.047489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f118b598-1d46-4f02-95b1-5a474d1f27d8 req-d74122c8-6f61-4f53-91a5-695fc1193962 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.048052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f118b598-1d46-4f02-95b1-5a474d1f27d8 req-d74122c8-6f61-4f53-91a5-695fc1193962 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.085657 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f118b598-1d46-4f02-95b1-5a474d1f27d8 req-d74122c8-6f61-4f53-91a5-695fc1193962 service nova] Creating event network-vif-deleted:1d231e72-c1f2-4b64-96eb-d5a4fa229659 for instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db on n-h2-854924-5 Aug 30 03:41:50.105521 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f118b598-1d46-4f02-95b1-5a474d1f27d8 req-d74122c8-6f61-4f53-91a5-695fc1193962 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126953 Aug 30 03:41:50.113708 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1890/3730] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:50.208623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:50.215625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:50.232200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:50.253587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.259475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.264033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.266198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.276137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.277361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.334233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b0561c1-2376-40fc-bc6d-e2ab148631ba tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b11a1f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:50.447429 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b0561c1-2376-40fc-bc6d-e2ab148631ba tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.118902 Aug 30 03:41:50.461664 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1891/3731] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:50 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:41:50.468870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:50.483790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:50.511793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.515738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.517532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.524743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.525883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.531641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.655475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.657539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.662030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.662513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lazy-loading 'fault' on Instance uuid bf7df40a-028a-4b8d-ac8d-bae43dd4f7db {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:41:50.782315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c031703afa842c3891785e086792cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b41bf3c5464c9b93a97afc7a00a708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:50.793563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:50.801754 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6a544b66-1ec0-4cc0-adfd-71444ab9aced tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 0.597450 Aug 30 03:41:50.808120 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d730bf5c-4274-46d7-be7c-0d2e6a1e8df2 tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 200 len: 1307 microversion: 2.1 time: 0.343088 Aug 30 03:41:50.815930 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1841/3732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:50 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:50.821886 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1892/3733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:50 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:50.838728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:50.841312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:50.849213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.849953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.850590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.851786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.852411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.853120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.872611 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] HTTP exception thrown: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Request method failure captured: Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 HTTP/1.1 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYUa7jfShl7tbcXM-2BZFP-DEUz_grJXZNn4IXlMUNQq6CDyEjXdFb3N02kiMr6SDWer7zzJTF3G6XmAbvUWoU_H185sBmfPeHx03JG7fP37fWYgbkKUiVoESSzcKrQRQ9jZ_fjOVy7CsgrE2y9bDh2iTdvVefPNI_fzFnfZYIeSuOk Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 4353d8911fc24ecab08fa31c69ed67f9 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4353d8911fc24ecab08fa31c69ed67f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4353d8911fc24ecab08fa31c69ed67f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4353d8911fc24ecab08fa31c69ed67f9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4353d8911fc24ecab08fa31c69ed67f9"}]}] Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 4353d8911fc24ecab08fa31c69ed67f9 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TaggedBootDevicesTest_v242-819363391-project Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a42c27b343c949b7bc4fd507565f43f4 Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TaggedBootDevicesTest_v242-819363391-project Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '19ec1e87-eb98-432c-a1ce-945ad67a0983'} Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:50.875557 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.881814 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.886961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Returning 404 to user: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:50.888280 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8f04c3c-7778-4184-b46c-01d1c9df24c3 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 404 len: 111 microversion: 2.42 time: 0.071218 Aug 30 03:41:50.890125 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1842/3734] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:41:50 2022] DELETE /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:41:50.899416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:50.899599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] [instance: 19ec1e87-eb98-432c-a1ce-945ad67a0983] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:50.912333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.912743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.916692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.917706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:50.918344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:50.918938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:50.954014 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] HTTP exception thrown: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Request method failure captured: Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 HTTP/1.1 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYUa7jfShl7tbcXM-2BZFP-DEUz_grJXZNn4IXlMUNQq6CDyEjXdFb3N02kiMr6SDWer7zzJTF3G6XmAbvUWoU_H185sBmfPeHx03JG7fP37fWYgbkKUiVoESSzcKrQRQ9jZ_fjOVy7CsgrE2y9bDh2iTdvVefPNI_fzFnfZYIeSuOk Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 4353d8911fc24ecab08fa31c69ed67f9 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4353d8911fc24ecab08fa31c69ed67f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4353d8911fc24ecab08fa31c69ed67f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4353d8911fc24ecab08fa31c69ed67f9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4353d8911fc24ecab08fa31c69ed67f9"}]}] Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 4353d8911fc24ecab08fa31c69ed67f9 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-819363391 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TaggedBootDevicesTest_v242-819363391-project Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a42c27b343c949b7bc4fd507565f43f4 Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TaggedBootDevicesTest_v242-819363391-project Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '19ec1e87-eb98-432c-a1ce-945ad67a0983'} Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.957000 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] Returning 404 to user: Instance 19ec1e87-eb98-432c-a1ce-945ad67a0983 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:50.964079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65b01924-785a-4c97-9077-e213c1c74202 tempest-TaggedBootDevicesTest_v242-819363391 tempest-TaggedBootDevicesTest_v242-819363391-project] 10.222.0.30 "GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983" status: 404 len: 111 microversion: 2.42 time: 0.063900 Aug 30 03:41:50.966925 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1893/3735] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:41:50 2022] GET /compute/v2.1/servers/19ec1e87-eb98-432c-a1ce-945ad67a0983 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:41:51.465962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-de32a8f9-afe1-4bad-991a-23e00aa5827f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b11a040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:51.570302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-de32a8f9-afe1-4bad-991a-23e00aa5827f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.108513 Aug 30 03:41:51.575230 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1894/3736] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:51 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:51.592817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:51.598224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:51.625854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:51.627452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:51.628188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:51.630403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:51.635476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:51.636279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:51.650101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20c68c64-6efa-4e66-8490-4785e16b96b0 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Calling method '.version_select at 0x7f8983d88550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:51.957966 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20c68c64-6efa-4e66-8490-4785e16b96b0 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.669125 Aug 30 03:41:51.966854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1843/3737] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:41:51 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:41:51.973130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-77e757af-d6e2-43dd-acbf-3e1664f7c8ba req-e6425642-9934-4558-b796-aa67a2e05ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba9c3d2-ca1d-4839-a437-1c15221962a6", "tag": "8f047c8a-071b-4665-8e45-ce7fa61b2441"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:52.005268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-77e757af-d6e2-43dd-acbf-3e1664f7c8ba req-e6425642-9934-4558-b796-aa67a2e05ecb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:52.007015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-77e757af-d6e2-43dd-acbf-3e1664f7c8ba req-e6425642-9934-4558-b796-aa67a2e05ecb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:52.007520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-77e757af-d6e2-43dd-acbf-3e1664f7c8ba req-e6425642-9934-4558-b796-aa67a2e05ecb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:52.039692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-77e757af-d6e2-43dd-acbf-3e1664f7c8ba req-e6425642-9934-4558-b796-aa67a2e05ecb service nova] Creating event network-changed:8f047c8a-071b-4665-8e45-ce7fa61b2441 for instance bba9c3d2-ca1d-4839-a437-1c15221962a6 on n-h1-854924-5 Aug 30 03:41:52.061419 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-77e757af-d6e2-43dd-acbf-3e1664f7c8ba req-e6425642-9934-4558-b796-aa67a2e05ecb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092938 Aug 30 03:41:52.062027 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1844/3738] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:41:52.081794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:52.090583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:52.105841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:52.116251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:52.116706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:52.117473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:52.117936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:52.118366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:52.385625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:52.397653 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0df9506-2312-44cd-91ba-2fff0b200631 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.820639 Aug 30 03:41:52.406640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1895/3739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:51 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:52.418140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:52.429074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] [instance: bf7df40a-028a-4b8d-ac8d-bae43dd4f7db] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:52.458149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:52.458641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:52.459073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:52.459767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:52.460212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:52.460629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:52.496071 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] HTTP exception thrown: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db could not be found. Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Request method failure captured: Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db HTTP/1.1 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYXkJB2O8H_UP4E4RTKPXVrcrxBMRerOyC4sKRbBJz_IguZQ_pLq-u26Nzz5-Picp0HVIhed1Lq2MGoTFJtB2NtAtMx1srv0XJyIR1y7BCIhzYPAkxaa96RFnzR6v_tnaakltT_lQOooPHJdtQuJEA_H3QTUfwYZwevxYiHGv22D4k0 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9b41bf3c5464c9b93a97afc7a00a708"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9b41bf3c5464c9b93a97afc7a00a708", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9b41bf3c5464c9b93a97afc7a00a708"}]}] Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b9b41bf3c5464c9b93a97afc7a00a708 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1793892338 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0c031703afa842c3891785e086792cb7 Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1793892338-project Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db could not be found. Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bf7df40a-028a-4b8d-ac8d-bae43dd4f7db'} Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db could not be found. Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db could not be found. Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:52.497653 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db could not be found. Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] Returning 404 to user: Instance bf7df40a-028a-4b8d-ac8d-bae43dd4f7db could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:52.503764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ad1f464-7c79-4f06-b6e7-6947b580ca5b tempest-ServersNegativeTestJSON-1793892338 tempest-ServersNegativeTestJSON-1793892338-project] 10.222.0.30 "GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db" status: 404 len: 111 microversion: 2.1 time: 0.090293 Aug 30 03:41:52.528583 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1896/3740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:52 2022] GET /compute/v2.1/servers/bf7df40a-028a-4b8d-ac8d-bae43dd4f7db => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:52.553766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41e3fd14-2861-434f-8777-b594975f6fc4 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Action: 'create', calling method: .version_select at 0x7f897b16aaf0>, body: {"pool": "non_exist_pool"} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:52.993940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-41e3fd14-2861-434f-8777-b594975f6fc4 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] HTTP exception thrown: Floating IP pool not found. Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41e3fd14-2861-434f-8777-b594975f6fc4 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Request method failure captured: Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 26 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYb_OQKMs1Hh0zC3s_nqFcgE43fthnM6nAIIpQAZkfQP6JTk7egvMJVsC7lMJ9-meTN830jhYuoTM64ppWFz--qWIvM-Y6NtUj3ddbKqvnRXa2A5H0oLyUzTJFD3jHpE-ELuaAE2CDvqtJpYWt75IqnptT0DIQ8iRP5prQNDRJh7tvE Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 60caa7ef62f34819ba0110a390a1d95d Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1384933066 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60caa7ef62f34819ba0110a390a1d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60caa7ef62f34819ba0110a390a1d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60caa7ef62f34819ba0110a390a1d95d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60caa7ef62f34819ba0110a390a1d95d"}]}] Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1384933066 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 60caa7ef62f34819ba0110a390a1d95d Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1384933066 Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-FloatingIPsNegativeTestJSON-1384933066-project Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 5be67170101f4351befdecccc2c714bd Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1384933066-project Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: {"pool": "non_exist_pool"} Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: exception: Floating IP pool not found. Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:52.995656 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:53.005282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 30 03:41:53.005282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.005282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41e3fd14-2861-434f-8777-b594975f6fc4 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Returning 404 to user: Floating IP pool not found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:53.005282 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-41e3fd14-2861-434f-8777-b594975f6fc4 tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.467385 Aug 30 03:41:53.005282 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1897/3741] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:41:52 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:41:53.285744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:53.315854 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b687058b-5278-4385-b224-aa0d6b9a908c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 1.244226 Aug 30 03:41:53.320326 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1845/3742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:52 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:53.344215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c856d9c3-749d-45eb-97c8-b3869d7e083e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c96430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:53.480732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:53.481589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:53.511658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:53.512900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:53.520508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:53.523906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:53.527061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:53.530198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:53.534343 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c856d9c3-749d-45eb-97c8-b3869d7e083e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.200218 Aug 30 03:41:53.535339 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1846/3743] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:53 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:53.550508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46d9f27e-d7cc-415a-bda0-0afcdbea5cba tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Calling method '.version_select at 0x7f897ab55670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:53.949021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-46d9f27e-d7cc-415a-bda0-0afcdbea5cba tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7361bcd8-000c-45d7-a595-a6f640cd0ee3 could not be found", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:41:53.949761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-46d9f27e-d7cc-415a-bda0-0afcdbea5cba tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] HTTP exception thrown: Floating IP not found for ID 7361bcd8-000c-45d7-a595-a6f640cd0ee3 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46d9f27e-d7cc-415a-bda0-0afcdbea5cba tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Request method failure captured: Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-floating-ips/7361bcd8-000c-45d7-a595-a6f640cd0ee3 HTTP/1.1 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYb_OQKMs1Hh0zC3s_nqFcgE43fthnM6nAIIpQAZkfQP6JTk7egvMJVsC7lMJ9-meTN830jhYuoTM64ppWFz--qWIvM-Y6NtUj3ddbKqvnRXa2A5H0oLyUzTJFD3jHpE-ELuaAE2CDvqtJpYWt75IqnptT0DIQ8iRP5prQNDRJh7tvE Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 60caa7ef62f34819ba0110a390a1d95d Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1384933066 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60caa7ef62f34819ba0110a390a1d95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60caa7ef62f34819ba0110a390a1d95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60caa7ef62f34819ba0110a390a1d95d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60caa7ef62f34819ba0110a390a1d95d"}]}] Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1384933066 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 60caa7ef62f34819ba0110a390a1d95d Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1384933066 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-FloatingIPsNegativeTestJSON-1384933066-project Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 5be67170101f4351befdecccc2c714bd Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1384933066-project Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: exception: Floating IP not found for ID 7361bcd8-000c-45d7-a595-a6f640cd0ee3 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7361bcd8-000c-45d7-a595-a6f640cd0ee3'} Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7361bcd8-000c-45d7-a595-a6f640cd0ee3 could not be found Aug 30 03:41:53.952316 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0697b7a2-b3a8-49a2-bcb3-504f5c71fb3c'] Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7361bcd8-000c-45d7-a595-a6f640cd0ee3. Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7361bcd8-000c-45d7-a595-a6f640cd0ee3 Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7361bcd8-000c-45d7-a595-a6f640cd0ee3 Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46d9f27e-d7cc-415a-bda0-0afcdbea5cba tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] Returning 404 to user: Floating IP not found for ID 7361bcd8-000c-45d7-a595-a6f640cd0ee3 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46d9f27e-d7cc-415a-bda0-0afcdbea5cba tempest-FloatingIPsNegativeTestJSON-1384933066 tempest-FloatingIPsNegativeTestJSON-1384933066-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/7361bcd8-000c-45d7-a595-a6f640cd0ee3" status: 404 len: 111 microversion: 2.1 time: 0.417258 Aug 30 03:41:53.960986 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1847/3744] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:41:53 2022] DELETE /compute/v2.1/os-floating-ips/7361bcd8-000c-45d7-a595-a6f640cd0ee3 => generated 111 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:41:54.315018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:54.323816 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ac74df1-a62e-4ca2-a40f-50e78fa75c89 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.318709 Aug 30 03:41:54.352812 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1898/3745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:53 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:54.360972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:54.364465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:54.365532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:54.368090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:54.384349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:54.385522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:54.386180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:54.389148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:54.389762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:54.392461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:54.394242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:54.395229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:54.397469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:54.401121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:54.406689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:54.408590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:55.273631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:55.292559 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff12e8f0-45dc-4d65-aeeb-39a99312a923 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.935837 Aug 30 03:41:55.293194 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1899/3746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:54 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:55.308111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-abf7e134-29eb-4448-845d-8d9ecd0bd7f9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa5e5e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:55.467685 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-abf7e134-29eb-4448-845d-8d9ecd0bd7f9 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.172711 Aug 30 03:41:55.475947 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1900/3747] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:55 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:55.487977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:55.490009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:55.512003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:55.512837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:55.514065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:55.518347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:55.520989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:55.521724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:55.525381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:55.549793 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ceaf65fc-1547-4b00-8763-976fdcddc154 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 1.185678 Aug 30 03:41:55.569463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1848/3748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:54 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:56.490178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3f1b8b34-c920-4115-b50a-66e1783959d6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c33e50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:56.555523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:56.559263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:41:56.573537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3f1b8b34-c920-4115-b50a-66e1783959d6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.087999 Aug 30 03:41:56.580253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e197953e-60dc-4358-bdde-ec1afc19e466 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.099393 Aug 30 03:41:56.581209 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1901/3749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:55 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:56.591441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:56.592063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:56.598697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1849/3750] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:56 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:56.635712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:56.636566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:56.637217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:56.638198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:56.638814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:56.639401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:56.776398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1106925703", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "e6a4f0d7-59ea-445f-abb0-b63795f79159"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:41:56.903602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] validate_networks() for [('e6a4f0d7-59ea-445f-abb0-b63795f79159', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:41:57.629530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:41:57.643595 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8079f0c5-b8c6-449f-9a5d-5d546f223b57 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 1.056667 Aug 30 03:41:57.647867 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1902/3751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:56 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:57.660054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52a8e33d-94cd-4697-b8e0-bc6503ac5c07 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa5d430>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:57.748591 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52a8e33d-94cd-4697-b8e0-bc6503ac5c07 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.099213 Aug 30 03:41:57.753781 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1903/3752] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:41:57 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:41:58.665321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:41:58.665976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:41:58.677753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:58.681902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:58.683080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:41:58.683996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:41:58.684787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:41:58.685437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:00.511463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:00.523449 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f8ac56d9-566c-4685-a24e-fe5f8dec99a4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 1.863014 Aug 30 03:42:00.542567 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1904/3753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:41:58 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:00.547503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c47d26f3-5e9a-46ef-bd12-3a3758ab7cd5 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d540d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:00.642707 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c47d26f3-5e9a-46ef-bd12-3a3758ab7cd5 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.098912 Aug 30 03:42:00.643296 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1905/3754] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:00 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:01.552387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:01.553115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:01.586793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:01.590672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:01.591436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:01.594961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:01.599133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:01.601292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:03.022835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:03.036056 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ea971bb-3836-4213-b773-4b7a23576f86 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 1.486121 Aug 30 03:42:03.052107 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1906/3755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:01 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:03.058405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62320a38-d337-4e5f-9f46-80d9a6251dd3 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa5dca0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:03.144848 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62320a38-d337-4e5f-9f46-80d9a6251dd3 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.090634 Aug 30 03:42:03.145958 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1907/3756] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:03 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:03.310108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:42:03.310877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:42:03.312703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:42:03.316107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:42:03.320739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:42:03.393464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:03.396973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:03.399433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:03.401025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:03.402217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:03.405239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:03.426714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:03.451251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:42:03.463916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for user a681b194cdb24b6fbb49eb39711ffa1c and project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:42:03.494310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:42:03.500157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:42:03.610171 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4db8c7ca-5195-4fd2-86e0-469079713550 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.839360 Aug 30 03:42:03.611439 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1850/3757] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:41:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 6842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:42:03.627257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-939c79cf-5c4b-4be3-902c-af0e47daa0e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:03.638042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-939c79cf-5c4b-4be3-902c-af0e47daa0e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:03.789412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2e4856bf-f99a-4cd9-9c82-2f0100d85047 req-d5ce090f-8bd3-459d-b409-6a821d636a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba9c3d2-ca1d-4839-a437-1c15221962a6", "name": "network-vif-plugged", "status": "completed", "tag": "8f047c8a-071b-4665-8e45-ce7fa61b2441"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:03.839818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2e4856bf-f99a-4cd9-9c82-2f0100d85047 req-d5ce090f-8bd3-459d-b409-6a821d636a9e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:03.844355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2e4856bf-f99a-4cd9-9c82-2f0100d85047 req-d5ce090f-8bd3-459d-b409-6a821d636a9e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:03.845118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2e4856bf-f99a-4cd9-9c82-2f0100d85047 req-d5ce090f-8bd3-459d-b409-6a821d636a9e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:03.871330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2e4856bf-f99a-4cd9-9c82-2f0100d85047 req-d5ce090f-8bd3-459d-b409-6a821d636a9e service nova] Creating event network-vif-plugged:8f047c8a-071b-4665-8e45-ce7fa61b2441 for instance bba9c3d2-ca1d-4839-a437-1c15221962a6 on n-h1-854924-5 Aug 30 03:42:03.883424 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2e4856bf-f99a-4cd9-9c82-2f0100d85047 req-d5ce090f-8bd3-459d-b409-6a821d636a9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098643 Aug 30 03:42:03.900465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1851/3758] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:42:03.993293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-939c79cf-5c4b-4be3-902c-af0e47daa0e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:04.012065 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-939c79cf-5c4b-4be3-902c-af0e47daa0e5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1215 microversion: 2.1 time: 0.392295 Aug 30 03:42:04.028480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1908/3759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:03 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:04.060753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:04.062922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:04.083433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:04.084124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:04.086711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:04.089414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:04.090310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:04.091139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:04.167478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3aad6c39-7890-4d5c-91b7-45fb2ec893fd tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b68c430>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:04.265393 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3aad6c39-7890-4d5c-91b7-45fb2ec893fd tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.101965 Aug 30 03:42:04.268913 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1909/3760] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:04 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:04.581951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:04.599289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-983b2da9-eb1e-4a04-91db-bc43e733daec tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 0.540583 Aug 30 03:42:04.601140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1852/3761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:04 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:05.041870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:05.043287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:05.059934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:05.066088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:05.066830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:05.067794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:05.068435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:05.070755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:05.284318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20cfeb8c-0b4e-43fe-995c-2e77c97dbb4e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983cf4ee0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:05.314644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:05.347999 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54cefd98-d210-4573-a8a9-bc6d722e9568 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1219 microversion: 2.1 time: 0.308072 Aug 30 03:42:05.348111 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1910/3762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:05 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1219 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:05.439652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20cfeb8c-0b4e-43fe-995c-2e77c97dbb4e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.161513 Aug 30 03:42:05.440248 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1853/3763] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:05 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:05.630286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:05.630923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:05.647216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:05.650085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:05.651356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:05.654759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:05.655436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:05.656792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:06.378549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:06.380833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:06.404157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:06.404329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:06.415252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:06.415697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:06.418216 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-991f609f-9a40-4058-91fc-7bfc26a605e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1318 microversion: 2.1 time: 0.798571 Aug 30 03:42:06.428690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:06.429184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:06.432548 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1911/3764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:05 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:06.434964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:06.464878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-90696b6e-c7f0-43e2-b8d2-18d8c6e79968 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa004c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:06.674293 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-90696b6e-c7f0-43e2-b8d2-18d8c6e79968 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1454 microversion: 2.1 time: 0.223982 Aug 30 03:42:06.682167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1912/3765] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:06 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1454 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:06.788311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:06.796366 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d942967e-4ab1-4df2-bd25-1f1264280cc1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1267 microversion: 2.1 time: 0.429542 Aug 30 03:42:06.796967 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1854/3766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:06 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1267 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:07.459053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:07.462292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:07.487595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:07.488310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:07.489090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:07.490238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:07.490964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:07.491447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:07.696975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-01a473b2-36d0-4723-b15a-220bbb92379a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d32160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:07.913004 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-01a473b2-36d0-4723-b15a-220bbb92379a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1463 microversion: 2.1 time: 0.225440 Aug 30 03:42:07.914234 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1855/3767] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:07 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:07.937009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:07.937735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:07.968165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:07.973978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:07.974598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:07.979811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:07.985661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:07.990795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:08.578733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:08.596683 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7d7dcb9-3045-4ab9-83c2-1da31e804287 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1273 microversion: 2.1 time: 0.680680 Aug 30 03:42:08.609592 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1856/3768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:07 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1273 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:08.643036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee0edc0c-113c-469b-ab3c-a490c081db04 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bb2d940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:08.693018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:08.704839 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0bf6972e-64ee-4f55-abc8-ff21d9019c36 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1507 microversion: 2.1 time: 1.253055 Aug 30 03:42:08.726191 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1913/3769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:07 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1507 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:08.741402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:08.742352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:08.781906 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee0edc0c-113c-469b-ab3c-a490c081db04 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 200 len: 1463 microversion: 2.1 time: 0.155731 Aug 30 03:42:08.783159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:08.792597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:08.794966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:08.798316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:08.801483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:08.803116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:08.804662 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1857/3770] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:08 2022] GET /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 1463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:08.820946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:08.832003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:08.848307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:08.849951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:08.850604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:08.854101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:08.855121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:08.865773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:09.549880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:09.559787 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-142aa66d-7a23-42e8-a36a-d84425646db7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1467 microversion: 2.1 time: 0.753655 Aug 30 03:42:09.569552 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1858/3771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:08 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1467 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:09.586188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c913811-7cf2-453b-995f-14cfa7594674 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bb2daf0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:09.823102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c913811-7cf2-453b-995f-14cfa7594674 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-08-30T03%3A39%3A29Z" status: 200 len: 1901 microversion: 2.1 time: 0.239084 Aug 30 03:42:09.825707 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1859/3772] 10.222.0.30 () {58 vars in 1199 bytes} [Tue Aug 30 03:42:09 2022] GET /compute/v2.1/images?changes-since=2022-08-30T03%3A39%3A29Z => generated 1901 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:09.839861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:09.852226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:09.853309 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-733d670b-87f0-4d9e-b450-8f0e045a4b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1507 microversion: 2.1 time: 1.116150 Aug 30 03:42:09.854009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:09.869656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1914/3773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:08 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1507 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:09.878520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba064a94-2dc1-4232-b726-b57a18dcfa49 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b12f670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:09.888773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:09.889297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:09.895217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:09.897188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:09.897816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:09.902480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:09.959025 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba064a94-2dc1-4232-b726-b57a18dcfa49 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1190114943" status: 200 len: 485 microversion: 2.1 time: 0.087894 Aug 30 03:42:09.965294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1915/3774] 10.222.0.30 () {58 vars in 1231 bytes} [Tue Aug 30 03:42:09 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1190114943 => generated 485 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:09.990477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:09.999857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:10.002825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:10.020511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:10.023814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:10.024498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:10.025482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:10.028054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:10.028807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:10.173276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30852682-6e56-4387-b7da-342b713052a5 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "PUT /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1079 microversion: 2.1 time: 0.196161 Aug 30 03:42:10.185685 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1916/3775] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:42:09 2022] PUT /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1079 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:10.191486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc68c73a-41c2-490f-b03d-ab13a2461b02 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa641f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:10.290426 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc68c73a-41c2-490f-b03d-ab13a2461b02 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?server=a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 957 microversion: 2.1 time: 0.103234 Aug 30 03:42:10.302160 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1917/3776] 10.222.0.30 () {58 vars in 1209 bytes} [Tue Aug 30 03:42:10 2022] GET /compute/v2.1/images?server=a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 957 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:10.307926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:10.308899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:10.316010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:10.316750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:10.317392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:10.318401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:10.319780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:10.320474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:10.350679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:10.359287 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eff529d8-2dd5-4139-9ab5-8227694e74ec tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1273 microversion: 2.1 time: 0.529668 Aug 30 03:42:10.361092 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1860/3777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:09 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1273 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:10.366598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad0444a2-f1df-4234-ae17-379e338a1743 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c969d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:10.590743 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad0444a2-f1df-4234-ae17-379e338a1743 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 484 microversion: 2.1 time: 0.227996 Aug 30 03:42:10.591985 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1861/3778] 10.222.0.30 () {58 vars in 1317 bytes} [Tue Aug 30 03:42:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 484 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:10.604475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-514c8ad8-d7d2-4434-9b4a-9c71713f9794 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bd79ee0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:10.765673 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-514c8ad8-d7d2-4434-9b4a-9c71713f9794 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 484 microversion: 2.1 time: 0.165340 Aug 30 03:42:10.777919 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1862/3779] 10.222.0.30 () {58 vars in 1303 bytes} [Tue Aug 30 03:42:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 484 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:10.809912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd56050c-78df-4fff-a1b7-78d146a08ce1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bb2d4c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:11.199648 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd56050c-78df-4fff-a1b7-78d146a08ce1 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.420498 Aug 30 03:42:11.220670 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1863/3780] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:42:10 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:11.232132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cda2004e-4fb1-4962-82b6-46d98515837c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c2e700>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:11.381097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cda2004e-4fb1-4962-82b6-46d98515837c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.158139 Aug 30 03:42:11.392808 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1864/3781] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:42:11 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:11.398402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:11.399044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:11.405944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:11.406664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:11.407153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:11.407888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:11.408353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:11.409589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:11.760742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:11.799193 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-393e5f91-ecce-4806-a561-7642fa0eb6e3 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1505 microversion: 2.1 time: 1.492304 Aug 30 03:42:11.801480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1918/3782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:10 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1505 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:11.828403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6b329e5-9712-4828-b736-cde7c6f0f83f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa5d940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:11.955256 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6b329e5-9712-4828-b736-cde7c6f0f83f tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.148225 Aug 30 03:42:11.956419 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1919/3783] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:42:11 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:11.966370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d4459bb4-2f18-4753-abcc-344608ec7633 req-7733d224-7895-48f5-8bea-562a250b284f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "name": "network-vif-unplugged", "status": "completed", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:11.996170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4459bb4-2f18-4753-abcc-344608ec7633 req-7733d224-7895-48f5-8bea-562a250b284f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:11.997450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4459bb4-2f18-4753-abcc-344608ec7633 req-7733d224-7895-48f5-8bea-562a250b284f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:12.002228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4459bb4-2f18-4753-abcc-344608ec7633 req-7733d224-7895-48f5-8bea-562a250b284f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:12.084436 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d4459bb4-2f18-4753-abcc-344608ec7633 req-7733d224-7895-48f5-8bea-562a250b284f service nova] Creating event network-vif-unplugged:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:42:12.106305 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d4459bb4-2f18-4753-abcc-344608ec7633 req-7733d224-7895-48f5-8bea-562a250b284f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148383 Aug 30 03:42:12.114285 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1920/3784] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:12.133724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:12.145113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:12.169616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:12.176829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:12.182141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:12.188761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:12.196984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:12.197984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:12.390998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:12.430517 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bbfaca8a-f81e-4190-9220-b31f8a7bd41c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 1.031567 Aug 30 03:42:12.431489 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1865/3785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:11 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:12.459446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8788622-bde4-4668-9dfc-4839cdf1620d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d885e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:12.805874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8788622-bde4-4668-9dfc-4839cdf1620d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-08-30T03%3A39%3A25Z" status: 200 len: 6332 microversion: 2.1 time: 0.371724 Aug 30 03:42:12.820141 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1866/3786] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Aug 30 03:42:12 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-30T03%3A39%3A25Z => generated 6332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:12.825831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-55393ca3-5e0d-4c9d-8ff9-d406cbc3318d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c2e820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:12.899905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-55393ca3-5e0d-4c9d-8ff9-d406cbc3318d tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1190114943" status: 200 len: 665 microversion: 2.1 time: 0.077651 Aug 30 03:42:12.911095 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1867/3787] 10.222.0.30 () {58 vars in 1252 bytes} [Tue Aug 30 03:42:12 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1190114943 => generated 665 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:12.916975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec882106-6ce6-4b29-9814-9474dd287bf7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897bd798b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:13.037200 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec882106-6ce6-4b29-9814-9474dd287bf7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1466 microversion: 2.1 time: 0.086837 Aug 30 03:42:13.057891 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1868/3788] 10.222.0.30 () {58 vars in 1338 bytes} [Tue Aug 30 03:42:12 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1466 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:13.078348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fdba0bbc-ff70-4b0f-9947-b8cee8b4c9ae tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d88940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:13.202354 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fdba0bbc-ff70-4b0f-9947-b8cee8b4c9ae tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1466 microversion: 2.1 time: 0.122293 Aug 30 03:42:13.208095 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1869/3789] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Aug 30 03:42:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2Fb9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1466 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:13.229106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4de461d-34a2-4e60-a152-c2a4e169f603 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983cbd9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:13.419500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4de461d-34a2-4e60-a152-c2a4e169f603 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.199469 Aug 30 03:42:13.424474 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1870/3790] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:42:13 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:13.442910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:13.451068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7a1d0c8-01b7-4ca5-a938-31139cf4b209 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d88af0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:13.479001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:13.578620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:13.590759 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7a1d0c8-01b7-4ca5-a938-31139cf4b209 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.148866 Aug 30 03:42:13.592273 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1871/3791] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 03:42:13 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:13.598745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:13.599833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:13.603558 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5eaef3af-0305-42f9-90f5-ccd5515cffa6 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1505 microversion: 2.1 time: 1.487367 Aug 30 03:42:13.606068 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1921/3792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:12 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1505 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:13.621263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:13.621263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:13.621263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:13.621263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:13.621263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:13.621263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:13.638094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28257b2a-6426-4167-aa94-638d6b60866c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b1b5550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:13.762730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28257b2a-6426-4167-aa94-638d6b60866c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/b40a5c3f-7379-4565-a6da-58a9aabde37c" status: 200 len: 784 microversion: 2.1 time: 0.136549 Aug 30 03:42:13.775911 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1922/3793] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Aug 30 03:42:13 2022] GET /compute/v2.1/images/b40a5c3f-7379-4565-a6da-58a9aabde37c => generated 784 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:13.782755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:13.798653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:13.820945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:13.821491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:13.821932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:13.822664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:13.823131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:13.823567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:14.006824 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dea5c199-b72c-4953-a86b-8c29ba3ce80c tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "PUT /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1081 microversion: 2.1 time: 0.229443 Aug 30 03:42:14.023658 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1923/3794] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:42:13 2022] PUT /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1081 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:14.029106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab350563-e514-46e2-93da-e7ad21a302e2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa77040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:14.063126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:14.259687 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab350563-e514-46e2-93da-e7ad21a302e2 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.234598 Aug 30 03:42:14.278348 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1924/3795] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:42:14 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:14.300811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:14.301476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:14.326501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:14.329616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:14.337571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:14.338762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:14.340284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:14.340920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:14.455391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:14.486933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84b75434-43e3-408d-90fb-bec2538eb0af tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 0.891493 Aug 30 03:42:14.488884 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1872/3796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:13 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:14.502090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1e4eeab-1921-4659-a3ab-72b4e3eefcfc tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983d88dc0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:15.330075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:15.367601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1aa2c8cd-65f4-499a-8c11-6aac93dd8975 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1507 microversion: 2.1 time: 1.085598 Aug 30 03:42:15.386822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1925/3797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:14 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1507 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:15.402522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-762b7ae4-d222-4ca7-90e2-94598be15176 req-4658e2d7-38b8-41d8-9ba9-1eba80ca261c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fc9719-d228-445b-a2cf-2290906c266d", "tag": "2de6fbbe-e94a-4897-99c8-73c2f47a451a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:15.418500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-762b7ae4-d222-4ca7-90e2-94598be15176 req-4658e2d7-38b8-41d8-9ba9-1eba80ca261c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:15.419403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-762b7ae4-d222-4ca7-90e2-94598be15176 req-4658e2d7-38b8-41d8-9ba9-1eba80ca261c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:15.420094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-762b7ae4-d222-4ca7-90e2-94598be15176 req-4658e2d7-38b8-41d8-9ba9-1eba80ca261c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:15.451057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-762b7ae4-d222-4ca7-90e2-94598be15176 req-4658e2d7-38b8-41d8-9ba9-1eba80ca261c service nova] Creating event network-changed:2de6fbbe-e94a-4897-99c8-73c2f47a451a for instance 60fc9719-d228-445b-a2cf-2290906c266d on n-h2-854924-5 Aug 30 03:42:15.463892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-762b7ae4-d222-4ca7-90e2-94598be15176 req-4658e2d7-38b8-41d8-9ba9-1eba80ca261c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070735 Aug 30 03:42:15.466694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1926/3798] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:15.474540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:15.481425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:15.520350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:15.521054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:15.521943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:15.522934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:15.524080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:15.524765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:16.024461 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1e4eeab-1921-4659-a3ab-72b4e3eefcfc tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2" status: 204 len: 0 microversion: 2.1 time: 1.533493 Aug 30 03:42:16.025688 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1873/3799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:14 2022] DELETE /compute/v2.1/images/9b292ad9-ff6b-4c37-8b2c-e2513ca953f2 => generated 0 bytes in 1536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:16.031700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:16.032883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:16.061773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:16.062283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:16.062741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:16.063525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:16.063995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:16.064430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:16.084355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:16.108142 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b88b4c90-4729-48fd-9ab6-4914bc72d4bd tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1507 microversion: 2.1 time: 0.637204 Aug 30 03:42:16.115120 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1927/3800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:15 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:16.131770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebf829c9-1bad-4011-8ebf-2d572dedb999 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b16ae50>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:16.695099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:16.705473 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-919542a8-9c4e-468f-ab79-a5eab0d5fdaf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 0.678509 Aug 30 03:42:16.712154 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1874/3801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:16 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:16.722439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:16.724646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:16.740567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:16.741402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:16.742244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:16.757824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:16.758600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:16.759222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:16.855599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:42:17.225733 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d0897c2-1eaf-4409-a4d4-a798985b6eb0 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 204 len: 0 microversion: 2.1 time: 0.500291 Aug 30 03:42:17.227885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1875/3802] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:42:16 2022] DELETE /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:17.248025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:17.249298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:17.271454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:17.271925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:17.272373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:17.273233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:17.273560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:17.284808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:17.357013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:42:17.527044 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Instance is already in deleting state, ignoring this request Aug 30 03:42:17.528116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d00a4b48-dd17-4d9e-9158-b5ce9bb69cdb tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 204 len: 0 microversion: 2.1 time: 0.284449 Aug 30 03:42:17.529197 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1876/3803] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:42:17 2022] DELETE /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:17.542119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:17.542753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:17.569287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ebf829c9-1bad-4011-8ebf-2d572dedb999 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac" status: 204 len: 0 microversion: 2.1 time: 1.452545 Aug 30 03:42:17.570203 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1928/3804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:16 2022] DELETE /compute/v2.1/images/e94081e8-204e-4a36-84a6-c43e571997ac => generated 0 bytes in 1454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:17.571988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:17.572496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:17.572942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:17.573689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:17.574150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:17.581302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9702481d-e69e-4aba-a8a9-c3ea4478126c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897b11aa60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:17.588882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:19.363820 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9702481d-e69e-4aba-a8a9-c3ea4478126c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c" status: 204 len: 0 microversion: 2.1 time: 1.785716 Aug 30 03:42:19.368366 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1929/3805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:17 2022] DELETE /compute/v2.1/images/e3ad2d2f-671b-4f9c-9659-d9032ce89e1c => generated 0 bytes in 1789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:19.380750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:19.386703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:19.418446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:19.420555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:19.422323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:19.442844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:19.443719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:19.454362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:19.488771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:19.534201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7d977ce0-54fd-4498-abc3-65fce28dc311 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1513 microversion: 2.1 time: 1.998117 Aug 30 03:42:19.554962 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1877/3806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:17 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1513 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:19.565437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:19.573416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:19.593972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:19.597706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:19.598357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:19.599275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:19.599879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:19.600432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:19.709732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:42:19.847951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:19.935129 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5db46fbc-c0b2-431a-8cbc-0ec628a19abf tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 204 len: 0 microversion: 2.1 time: 0.390651 Aug 30 03:42:19.937625 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1878/3807] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:42:19 2022] DELETE /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:19.948912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:19.949860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:19.960915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:19.962371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:19.963107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:19.963972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:19.964718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:19.965426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:21.476018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:21.491433 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c575c062-3202-49b7-bf2a-32ea1d8f1861 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1474 microversion: 2.1 time: 1.547042 Aug 30 03:42:21.492046 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1879/3808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:19 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1474 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:21.501005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:21.505722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:21.507947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:21.514767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:21.541749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:21.542274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:21.542735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:21.543460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:21.547987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:21.552613 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-84fc2827-b667-48b0-9c90-ffd54dde0f33 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 2.182881 Aug 30 03:42:21.556595 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1930/3809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:19 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:21.568971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:22.517011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:22.517677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:22.532414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:22.533320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:22.534245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:22.535179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:22.535958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:22.537472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:22.604589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:22.729845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:22.754095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f755289-3878-4c40-be2e-42e870cd5533 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1513 microversion: 2.1 time: 1.260115 Aug 30 03:42:22.774542 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1880/3810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:21 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1513 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:22.792358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:22.796530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:22.814044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:22.822227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:22.826176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:22.828299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:22.834218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:22.834961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:23.323584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:23.343906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f91a119a-00df-4015-85e6-ec1e82a86588 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1474 microversion: 2.1 time: 0.832753 Aug 30 03:42:23.344544 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1931/3811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:22 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1474 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:23.550110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:23.573306 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-782dc6ff-3152-4418-912a-b2409bec567d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 0.793531 Aug 30 03:42:23.575113 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1881/3812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:22 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:23.785718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:23.786460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:23.804961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:23.813354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:23.817605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:23.818394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:23.818882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:23.822048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:23.848636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-bcf6b4d0-b100-4a58-b10f-df2f044342a9 req-e0d3db47-cab2-4b3e-b1aa-127a45274ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba9c3d2-ca1d-4839-a437-1c15221962a6", "name": "network-vif-deleted", "tag": "8f047c8a-071b-4665-8e45-ce7fa61b2441"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:23.882543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bcf6b4d0-b100-4a58-b10f-df2f044342a9 req-e0d3db47-cab2-4b3e-b1aa-127a45274ae0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:23.885205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bcf6b4d0-b100-4a58-b10f-df2f044342a9 req-e0d3db47-cab2-4b3e-b1aa-127a45274ae0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:23.887058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bcf6b4d0-b100-4a58-b10f-df2f044342a9 req-e0d3db47-cab2-4b3e-b1aa-127a45274ae0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:23.948447 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-bcf6b4d0-b100-4a58-b10f-df2f044342a9 req-e0d3db47-cab2-4b3e-b1aa-127a45274ae0 service nova] Creating event network-vif-deleted:8f047c8a-071b-4665-8e45-ce7fa61b2441 for instance bba9c3d2-ca1d-4839-a437-1c15221962a6 on n-h1-854924-5 Aug 30 03:42:23.974361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-bcf6b4d0-b100-4a58-b10f-df2f044342a9 req-e0d3db47-cab2-4b3e-b1aa-127a45274ae0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130131 Aug 30 03:42:23.975756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1882/3813] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:42:24.036170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f09accc2c64314b7a83cac46bb3b2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd729db31b104e28a6ce9997802c55a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:24.063246 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c265740f-1199-4960-a075-7fb65122a25e tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 200 len: 1303 microversion: 2.1 time: 0.275146 Aug 30 03:42:24.064546 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1932/3814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:23 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 1303 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:24.202467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9351a42f-373d-4a03-b3ad-6f3ce675210f req-1cdcd565-114d-44b8-9827-00d66a7608c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ba30af-e8e3-4817-ab13-46a4b5e8325e", "name": "network-vif-deleted", "tag": "cde12ff6-56bc-4b7f-8e16-1d13f9e6079f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:24.239745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9351a42f-373d-4a03-b3ad-6f3ce675210f req-1cdcd565-114d-44b8-9827-00d66a7608c9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:24.240606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9351a42f-373d-4a03-b3ad-6f3ce675210f req-1cdcd565-114d-44b8-9827-00d66a7608c9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:24.241121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9351a42f-373d-4a03-b3ad-6f3ce675210f req-1cdcd565-114d-44b8-9827-00d66a7608c9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:24.295717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9351a42f-373d-4a03-b3ad-6f3ce675210f req-1cdcd565-114d-44b8-9827-00d66a7608c9 service nova] Creating event network-vif-deleted:cde12ff6-56bc-4b7f-8e16-1d13f9e6079f for instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e on n-h1-854924-5 Aug 30 03:42:24.316170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9351a42f-373d-4a03-b3ad-6f3ce675210f req-1cdcd565-114d-44b8-9827-00d66a7608c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118822 Aug 30 03:42:24.318872 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1883/3815] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:24.366601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:24.367441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:24.387541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:24.389373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:24.390034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:24.392099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:24.403696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:24.404248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:24.469937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:24.482138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:24.488601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:24.489254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lazy-loading 'fault' on Instance uuid b9ba30af-e8e3-4817-ab13-46a4b5e8325e {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:42:24.595327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:24.598702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:24.599820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:24.604950 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8422a478-63c5-45dd-b682-9435b3d9465a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 200 len: 1308 microversion: 2.1 time: 0.242390 Aug 30 03:42:24.609037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:24.609833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:24.610154 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1933/3816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:24 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:24.645024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:24.648584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:24.649153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:24.649637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.088912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.090128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: bba9c3d2-ca1d-4839-a437-1c15221962a6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.106763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.107460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.110910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.111983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.117679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.118516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.152461 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] HTTP exception thrown: Instance bba9c3d2-ca1d-4839-a437-1c15221962a6 could not be found. Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Request method failure captured: Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 HTTP/1.1 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYZbGssfPmNFOvuFfGQwmdIfxDnsv9fnG_vwe-tmffZ7y5Mw1ht03VIgQdUtNVMOaq9mXoFEKjp8iv9GjgKw1NH9j8fvP0pBwgm2EWuUgw86p8Bj-VmqbwBTx1Y--MYctdZGXlE7WQsgvLA9r8dBiAOLKCNuqlOmL6GsUt3hJFUemfI Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd729db31b104e28a6ce9997802c55a7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}] Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25f09accc2c64314b7a83cac46bb3b2b Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance bba9c3d2-ca1d-4839-a437-1c15221962a6 could not be found. Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bba9c3d2-ca1d-4839-a437-1c15221962a6'} Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba9c3d2-ca1d-4839-a437-1c15221962a6 could not be found. Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba9c3d2-ca1d-4839-a437-1c15221962a6 could not be found. Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.154547 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba9c3d2-ca1d-4839-a437-1c15221962a6 could not be found. Aug 30 03:42:25.158178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.159386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Returning 404 to user: Instance bba9c3d2-ca1d-4839-a437-1c15221962a6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:25.160396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a7a07f3c-4c28-4d3e-9ff4-bdc700df6b58 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6" status: 404 len: 111 microversion: 2.1 time: 0.075575 Aug 30 03:42:25.161465 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1934/3817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:25 2022] GET /compute/v2.1/servers/bba9c3d2-ca1d-4839-a437-1c15221962a6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:42:25.169463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.176755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.184706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.187949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.188574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.189521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.193885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.194535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.227743 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] HTTP exception thrown: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Request method failure captured: Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf HTTP/1.1 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYZbGssfPmNFOvuFfGQwmdIfxDnsv9fnG_vwe-tmffZ7y5Mw1ht03VIgQdUtNVMOaq9mXoFEKjp8iv9GjgKw1NH9j8fvP0pBwgm2EWuUgw86p8Bj-VmqbwBTx1Y--MYctdZGXlE7WQsgvLA9r8dBiAOLKCNuqlOmL6GsUt3hJFUemfI Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd729db31b104e28a6ce9997802c55a7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}] Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25f09accc2c64314b7a83cac46bb3b2b Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a5bc8eb0-5c19-419d-9213-3b8b9d973ccf'} Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:25.232005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.235813 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.241672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Returning 404 to user: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:25.242911 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81569776-73e1-4826-a67e-6a6f8551d7b2 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 404 len: 111 microversion: 2.1 time: 0.077430 Aug 30 03:42:25.243965 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1935/3818] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:42:25 2022] DELETE /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:42:25.253974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.259820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: a5bc8eb0-5c19-419d-9213-3b8b9d973ccf] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.271910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.274520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.275169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.276052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.277750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.279716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.317547 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] HTTP exception thrown: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Request method failure captured: Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf HTTP/1.1 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYZbGssfPmNFOvuFfGQwmdIfxDnsv9fnG_vwe-tmffZ7y5Mw1ht03VIgQdUtNVMOaq9mXoFEKjp8iv9GjgKw1NH9j8fvP0pBwgm2EWuUgw86p8Bj-VmqbwBTx1Y--MYctdZGXlE7WQsgvLA9r8dBiAOLKCNuqlOmL6GsUt3hJFUemfI Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd729db31b104e28a6ce9997802c55a7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}] Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25f09accc2c64314b7a83cac46bb3b2b Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a5bc8eb0-5c19-419d-9213-3b8b9d973ccf'} Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.319370 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. Aug 30 03:42:25.322874 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.324752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Returning 404 to user: Instance a5bc8eb0-5c19-419d-9213-3b8b9d973ccf could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:25.325843 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ad45c850-6d81-4fe2-8c17-891a11796cef tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf" status: 404 len: 111 microversion: 2.1 time: 0.077994 Aug 30 03:42:25.328645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1936/3819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:25 2022] GET /compute/v2.1/servers/a5bc8eb0-5c19-419d-9213-3b8b9d973ccf => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:42:25.337301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.341983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.354195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.355285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.360387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.361371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.361987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.362561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.376249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:25.404722 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] HTTP exception thrown: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Request method failure captured: Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 HTTP/1.1 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYZbGssfPmNFOvuFfGQwmdIfxDnsv9fnG_vwe-tmffZ7y5Mw1ht03VIgQdUtNVMOaq9mXoFEKjp8iv9GjgKw1NH9j8fvP0pBwgm2EWuUgw86p8Bj-VmqbwBTx1Y--MYctdZGXlE7WQsgvLA9r8dBiAOLKCNuqlOmL6GsUt3hJFUemfI Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd729db31b104e28a6ce9997802c55a7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}] Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25f09accc2c64314b7a83cac46bb3b2b Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f7c4cdbf-8780-41d1-a533-2648886fca54'} Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:25.406393 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Returning 404 to user: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:25.410097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6a7eacd-95f2-4c8e-a0b7-09f9bd5adb32 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 404 len: 111 microversion: 2.1 time: 0.075523 Aug 30 03:42:25.412887 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e94290dc-737c-4aa8-a276-020ba8b0e7fa tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 0.804253 Aug 30 03:42:25.417433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1937/3820] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:42:25 2022] DELETE /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:42:25.418712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1884/3821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:24 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:25.435213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.435852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] [instance: f7c4cdbf-8780-41d1-a533-2648886fca54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.452715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.455888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.460043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.461137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.462176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.462822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.511087 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] HTTP exception thrown: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Request method failure captured: Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 HTTP/1.1 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYZbGssfPmNFOvuFfGQwmdIfxDnsv9fnG_vwe-tmffZ7y5Mw1ht03VIgQdUtNVMOaq9mXoFEKjp8iv9GjgKw1NH9j8fvP0pBwgm2EWuUgw86p8Bj-VmqbwBTx1Y--MYctdZGXlE7WQsgvLA9r8dBiAOLKCNuqlOmL6GsUt3hJFUemfI Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd729db31b104e28a6ce9997802c55a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd729db31b104e28a6ce9997802c55a7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd729db31b104e28a6ce9997802c55a7"}]}] Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: bd729db31b104e28a6ce9997802c55a7 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1506427108 Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 25f09accc2c64314b7a83cac46bb3b2b Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiskConfigTestJSON-1506427108-project Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f7c4cdbf-8780-41d1-a533-2648886fca54'} Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.519282 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. Aug 30 03:42:25.522962 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.524184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] Returning 404 to user: Instance f7c4cdbf-8780-41d1-a533-2648886fca54 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:25.525236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64d31953-8f17-4398-af62-a837479686c4 tempest-ServerDiskConfigTestJSON-1506427108 tempest-ServerDiskConfigTestJSON-1506427108-project] 10.222.0.30 "GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54" status: 404 len: 111 microversion: 2.1 time: 0.106617 Aug 30 03:42:25.526331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1938/3822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:25 2022] GET /compute/v2.1/servers/f7c4cdbf-8780-41d1-a533-2648886fca54 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:42:25.647216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.648263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: b9ba30af-e8e3-4817-ab13-46a4b5e8325e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.668654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.669195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.669712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.671566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.672064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.672556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.735652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] HTTP exception thrown: Instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e could not be found. Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Request method failure captured: Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e HTTP/1.1 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYZsX8ySunBlZZI3dP9dpLid86XzmncgHsIUiWMMotUqGD-k08qTlIQkIPhxZiQp1-9yjDFGFKf8YyH4B1kmUuo151SueDKTyGzZW5_L1Ri3rmkC-2whmJQyPmA-RtIGJad2q56jc_FWCRp5_VDYOe_x6LccmOkaTw6ggpiQGLZMyDE Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 501102e4417a4fcb924b783e47e6fa6c Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListImageFiltersTestJSON-1826978895 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/501102e4417a4fcb924b783e47e6fa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/501102e4417a4fcb924b783e47e6fa6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_501102e4417a4fcb924b783e47e6fa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/501102e4417a4fcb924b783e47e6fa6c"}]}] Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListImageFiltersTestJSON-1826978895 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 501102e4417a4fcb924b783e47e6fa6c Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1826978895 Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListImageFiltersTestJSON-1826978895-project Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a3b3482cb50a43c48b483ccb24923cdb Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListImageFiltersTestJSON-1826978895-project Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e could not be found. Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'b9ba30af-e8e3-4817-ab13-46a4b5e8325e'} Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e could not be found. Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e could not be found. Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:25.744349 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e could not be found. Aug 30 03:42:25.747970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:25.749718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Returning 404 to user: Instance b9ba30af-e8e3-4817-ab13-46a4b5e8325e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:25.753000 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b9846fa-3185-4820-8daf-6bebbbbeb8ed tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e" status: 404 len: 111 microversion: 2.1 time: 0.121873 Aug 30 03:42:25.757303 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1885/3823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:25 2022] GET /compute/v2.1/servers/b9ba30af-e8e3-4817-ab13-46a4b5e8325e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:42:25.763306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:25.763818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:25.777847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.778357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.778867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.779588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:25.782500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:25.785781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:25.918062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:42:26.200426 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56c2e8c9-c89a-4270-ad56-0628ca51938c tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 204 len: 0 microversion: 2.1 time: 0.440793 Aug 30 03:42:26.210198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:26.210829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:26.211555 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1939/3824] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:42:25 2022] DELETE /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:26.226431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:26.244469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:26.245053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:26.247208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:26.250779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:26.251264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:26.452901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:26.455952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:26.479879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:26.480997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:26.481496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:26.483485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:26.484124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:26.484561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:27.381431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:27.411547 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dac58a79-e8f4-4e47-abd6-01df23e771a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 0.964924 Aug 30 03:42:27.429150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:27.431759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1940/3825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:26 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:27.442682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2e257514-e95c-43be-a028-0d2fed4e724f req-8ec49762-e058-412a-bf27-f5fd5180655c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fc9719-d228-445b-a2cf-2290906c266d", "name": "network-vif-plugged", "status": "completed", "tag": "2de6fbbe-e94a-4897-99c8-73c2f47a451a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:27.458637 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e0cb9ad-f92a-4d8e-b01f-d03d084ab1c6 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1473 microversion: 2.1 time: 1.252611 Aug 30 03:42:27.481481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1886/3826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:26 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1473 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:27.483763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2e257514-e95c-43be-a028-0d2fed4e724f req-8ec49762-e058-412a-bf27-f5fd5180655c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:27.484246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2e257514-e95c-43be-a028-0d2fed4e724f req-8ec49762-e058-412a-bf27-f5fd5180655c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:27.485268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2e257514-e95c-43be-a028-0d2fed4e724f req-8ec49762-e058-412a-bf27-f5fd5180655c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:27.527066 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2e257514-e95c-43be-a028-0d2fed4e724f req-8ec49762-e058-412a-bf27-f5fd5180655c service nova] Creating event network-vif-plugged:2de6fbbe-e94a-4897-99c8-73c2f47a451a for instance 60fc9719-d228-445b-a2cf-2290906c266d on n-h2-854924-5 Aug 30 03:42:27.558264 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2e257514-e95c-43be-a028-0d2fed4e724f req-8ec49762-e058-412a-bf27-f5fd5180655c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114838 Aug 30 03:42:27.559845 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1941/3827] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:28.432817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:28.434167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:28.456873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:28.457695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:28.458307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:28.459117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:28.459592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:28.460113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:28.484137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:28.485735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:28.513666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:28.514220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:28.514674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:28.515761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:28.520106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:28.520789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:29.051946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:29.077707 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8ed6af7-37f6-484b-9f6c-50cdba5f8477 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1315 microversion: 2.1 time: 0.648815 Aug 30 03:42:29.098101 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1887/3828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:28 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:29.244476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:29.273081 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c29baba3-f2b8-41fa-bf88-4c2dcda34adb tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1473 microversion: 2.1 time: 0.792232 Aug 30 03:42:29.274133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1942/3829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:28 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1473 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:30.102941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:30.104564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:30.122825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:30.123727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:30.124633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:30.126584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:30.127566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:30.128227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:30.301729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:30.302428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:30.321557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:30.322398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:30.323111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:30.324058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:30.324759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:30.326198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:30.874651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:30.893888 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c27c3bc-123f-49c5-903b-6877e62aa807 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1473 microversion: 2.1 time: 0.597715 Aug 30 03:42:30.894536 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1943/3830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:30 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1473 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:30.945007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:30.979057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0bd9e9b-3935-4f40-9c3d-1886f3dfe17a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1503 microversion: 2.1 time: 0.881779 Aug 30 03:42:30.979704 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1888/3831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:30 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1503 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:31.003875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:31.004417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:31.011319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:31.012762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:31.013929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:31.015398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:31.016959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:31.017781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:31.362778 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Removing security group 10201f91-f021-46c4-8cc1-f5f1a8c81061 from port 2de6fbbe-e94a-4897-99c8-73c2f47a451a Aug 30 03:42:31.610130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-84fe3e9e-5e1c-4a42-b7aa-053bf06e848f req-6682c0bc-20e9-4b4b-a811-9767f17b1f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b", "name": "network-vif-deleted", "tag": "60c44e11-666b-4510-8063-031a45b310bb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:31.631928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-84fe3e9e-5e1c-4a42-b7aa-053bf06e848f req-6682c0bc-20e9-4b4b-a811-9767f17b1f3d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:31.639232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-84fe3e9e-5e1c-4a42-b7aa-053bf06e848f req-6682c0bc-20e9-4b4b-a811-9767f17b1f3d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:31.650466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-84fe3e9e-5e1c-4a42-b7aa-053bf06e848f req-6682c0bc-20e9-4b4b-a811-9767f17b1f3d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:31.676589 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-84fe3e9e-5e1c-4a42-b7aa-053bf06e848f req-6682c0bc-20e9-4b4b-a811-9767f17b1f3d service nova] Creating event network-vif-deleted:60c44e11-666b-4510-8063-031a45b310bb for instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b on n-h1-854924-5 Aug 30 03:42:31.691902 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-84fe3e9e-5e1c-4a42-b7aa-053bf06e848f req-6682c0bc-20e9-4b4b-a811-9767f17b1f3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087610 Aug 30 03:42:31.699577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1889/3832] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:31.919762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:31.920794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:31.935725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:31.939973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:31.940428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:31.947291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:31.949808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:31.950534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:32.058962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:32.059869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:32.061663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:32.062418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lazy-loading 'fault' on Instance uuid a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:42:32.150876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b3482cb50a43c48b483ccb24923cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501102e4417a4fcb924b783e47e6fa6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:32.164811 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f47466de-3df1-4948-bcf3-72383602e872 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 200 len: 1307 microversion: 2.1 time: 0.249759 Aug 30 03:42:32.181579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1890/3833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:31 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:32.761992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6de5398-6916-4804-aaf4-fce885a8cd0a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d/action" status: 202 len: 0 microversion: 2.1 time: 1.763211 Aug 30 03:42:32.763527 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1944/3834] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:42:30 2022] POST /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d/action => generated 0 bytes in 1767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:42:32.775351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:32.775789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:32.780105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5b56cabf-23b7-40e5-9d60-58ea55324b59 req-8efade25-7bc9-4dc1-8a1b-74cd0ec2e12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fc9719-d228-445b-a2cf-2290906c266d", "tag": "2de6fbbe-e94a-4897-99c8-73c2f47a451a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:32.804026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:32.806454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:32.809926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:32.811865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:32.813588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:32.823497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:32.825909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5b56cabf-23b7-40e5-9d60-58ea55324b59 req-8efade25-7bc9-4dc1-8a1b-74cd0ec2e12d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:32.836445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5b56cabf-23b7-40e5-9d60-58ea55324b59 req-8efade25-7bc9-4dc1-8a1b-74cd0ec2e12d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:32.837116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5b56cabf-23b7-40e5-9d60-58ea55324b59 req-8efade25-7bc9-4dc1-8a1b-74cd0ec2e12d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:32.888079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5b56cabf-23b7-40e5-9d60-58ea55324b59 req-8efade25-7bc9-4dc1-8a1b-74cd0ec2e12d service nova] Creating event network-changed:2de6fbbe-e94a-4897-99c8-73c2f47a451a for instance 60fc9719-d228-445b-a2cf-2290906c266d on n-h2-854924-5 Aug 30 03:42:32.911498 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5b56cabf-23b7-40e5-9d60-58ea55324b59 req-8efade25-7bc9-4dc1-8a1b-74cd0ec2e12d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136085 Aug 30 03:42:32.923071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1945/3835] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:33.174650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:33.219772 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c99e50ee-c303-4103-80b4-42c4c0189ce6 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1461 microversion: 2.1 time: 0.451507 Aug 30 03:42:33.230564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1891/3836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:32 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1461 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:33.270752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:33.274088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] [instance: a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:33.317421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:33.321961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:33.324726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:33.326298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:33.329944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:33.333952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:33.395892 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] HTTP exception thrown: Instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b could not be found. Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Request method failure captured: Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b HTTP/1.1 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYZsX8ySunBlZZI3dP9dpLid86XzmncgHsIUiWMMotUqGD-k08qTlIQkIPhxZiQp1-9yjDFGFKf8YyH4B1kmUuo151SueDKTyGzZW5_L1Ri3rmkC-2whmJQyPmA-RtIGJad2q56jc_FWCRp5_VDYOe_x6LccmOkaTw6ggpiQGLZMyDE Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 501102e4417a4fcb924b783e47e6fa6c Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListImageFiltersTestJSON-1826978895 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/501102e4417a4fcb924b783e47e6fa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/501102e4417a4fcb924b783e47e6fa6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_501102e4417a4fcb924b783e47e6fa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/501102e4417a4fcb924b783e47e6fa6c"}]}] Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListImageFiltersTestJSON-1826978895 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 501102e4417a4fcb924b783e47e6fa6c Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1826978895 Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListImageFiltersTestJSON-1826978895-project Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a3b3482cb50a43c48b483ccb24923cdb Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListImageFiltersTestJSON-1826978895-project Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b could not be found. Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b'} Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b could not be found. Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b could not be found. Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:42:33.397788 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b could not be found. Aug 30 03:42:33.402181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:42:33.403464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Returning 404 to user: Instance a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:42:33.423757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c480ae4-ec2f-4c1a-a8a1-7ab27eca400a tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b" status: 404 len: 111 microversion: 2.1 time: 0.188632 Aug 30 03:42:33.429883 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1892/3837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:33 2022] GET /compute/v2.1/servers/a8a79bed-5ce4-4dde-a7eb-71bf7dc1f36b => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:42:33.440568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:33.454468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:33.468521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:33.476911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:33.478767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:33.481327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:33.482072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:33.482646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:34.039082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1075549322", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "37c4a243-7b90-42e0-b884-29d67fa0f2da"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:34.122283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:34.134838 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-684c4009-6581-4a52-9ff9-ed59332e16a4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.703551 Aug 30 03:42:34.139355 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1893/3838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:33 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:34.150170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d6c38c6-2bda-4e6b-8be0-c9b8cb69e3a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983c33670>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:34.193235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] validate_networks() for [('37c4a243-7b90-42e0-b884-29d67fa0f2da', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:42:34.998207 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d6c38c6-2bda-4e6b-8be0-c9b8cb69e3a7 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/images/6c7ca36d-0693-454d-aecc-cba0c64aa82e" status: 204 len: 0 microversion: 2.1 time: 0.856065 Aug 30 03:42:34.999088 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1894/3839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:34 2022] DELETE /compute/v2.1/images/6c7ca36d-0693-454d-aecc-cba0c64aa82e => generated 0 bytes in 859 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:35.009586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:35.011147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:35.026211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:35.033030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:35.034918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:35.038194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:35.039056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:35.041833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:35.745772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:35.785188 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6a81b43-8540-44b8-894c-af8fa09c2433 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.781171 Aug 30 03:42:35.807979 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1895/3840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:34 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:35.819387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-578d82f8-9609-4d86-a1bc-3623346f8f3e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f8983b57c10>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:36.450482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:42:36.451173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:42:36.452267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:42:36.453097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:42:36.454198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:42:36.492595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:36.496831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:36.501399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:36.502703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:36.507967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:36.509715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:36.570040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Getting quotas for project aff4b6ebd9ca4c7daa9bb107d3829b15. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:42:36.586219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Getting quotas for user 03f76179a5c34545a0a04b37090fd1cb and project aff4b6ebd9ca4c7daa9bb107d3829b15. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:42:36.619338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:42:36.624824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:42:36.682694 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-578d82f8-9609-4d86-a1bc-3623346f8f3e tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/images/64ba40b8-9a97-4749-ac89-88ff44a5917c" status: 204 len: 0 microversion: 2.1 time: 0.872324 Aug 30 03:42:36.683555 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1896/3841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:35 2022] DELETE /compute/v2.1/images/64ba40b8-9a97-4749-ac89-88ff44a5917c => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:36.690628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:36.691260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:36.700172 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d9d659e-f5b6-4d40-acf6-b61f1a76501d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.554655 Aug 30 03:42:36.701282 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1946/3842] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:42:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:42:36.706060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:36.711062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:36.712767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:36.714478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5eee1c1e-4e79-4c11-8263-e5f72e6db952 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] Calling method '.version_select at 0x7f897aa2eaf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:36.716598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:36.717533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:36.718560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:37.372583 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5eee1c1e-4e79-4c11-8263-e5f72e6db952 tempest-ListImageFiltersTestJSON-1826978895 tempest-ListImageFiltersTestJSON-1826978895-project] 10.222.0.30 "DELETE /compute/v2.1/images/aa30fb23-b17f-4de4-9735-aed4e833bc26" status: 204 len: 0 microversion: 2.1 time: 0.669816 Aug 30 03:42:37.373365 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1947/3843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:36 2022] DELETE /compute/v2.1/images/aa30fb23-b17f-4de4-9735-aed4e833bc26 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:42:37.403296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-789d6066-3575-4076-999c-cf2d2797623c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:37.404859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-789d6066-3575-4076-999c-cf2d2797623c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:38.600807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-789d6066-3575-4076-999c-cf2d2797623c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:38.608266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:38.614574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-789d6066-3575-4076-999c-cf2d2797623c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1216 microversion: 2.1 time: 1.234808 Aug 30 03:42:38.616574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1948/3844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:37 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1216 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:38.617593 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05f157f7-546e-4a1a-a188-c2c82f390307 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 1.932703 Aug 30 03:42:38.618211 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1897/3845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:36 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:38.640575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1143801138", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:38.649549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:38.650182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:38.657374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:38.657878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:38.658513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:38.659025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:38.664840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:38.666963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:38.753137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:42:39.437061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:39.445224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f863fc4f-f5f1-4fbc-a025-0747841f471d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.799758 Aug 30 03:42:39.467926 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1898/3846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:38 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:39.553635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:42:39.555375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:42:39.558931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:42:39.560141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:42:39.560811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:42:39.613702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:39.615867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:39.615867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:39.615867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:39.624923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:39.624923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:39.653804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:39.654771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:39.671274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:39.671789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:39.672306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:39.673109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:39.673605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:39.674035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:39.722832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Getting quotas for project b86282e199f940ef838aa5809d607b22. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:42:39.741770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Getting quotas for user d26c1c055c63453e9d8894a3455796c2 and project b86282e199f940ef838aa5809d607b22. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:42:39.810660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:42:39.816434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:39.818681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:42:39.825295 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f508c8c8-9f1f-49b3-91ca-8949cb75a34d tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1274 microversion: 2.1 time: 0.176809 Aug 30 03:42:39.833233 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1899/3847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:39 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:39.878918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-524583325", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "e6a4f0d7-59ea-445f-abb0-b63795f79159"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:40.032745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4547ffb8-377a-4d0e-8f65-9d2682b5664a tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414110 Aug 30 03:42:40.050547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] validate_networks() for [('e6a4f0d7-59ea-445f-abb0-b63795f79159', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:42:40.057005 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1949/3848] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:42:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:42:40.064853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea7123de-ccbc-42e8-b0e7-1b60727c8bb8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:40.072799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea7123de-ccbc-42e8-b0e7-1b60727c8bb8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:40.282420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea7123de-ccbc-42e8-b0e7-1b60727c8bb8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:40.291057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea7123de-ccbc-42e8-b0e7-1b60727c8bb8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1214 microversion: 2.1 time: 0.232159 Aug 30 03:42:40.304539 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1950/3849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:40 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:40.848955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:40.850440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:40.864203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:40.866097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:40.866683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:40.867185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:40.867973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:40.868462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:40.869067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:41.202123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:42:41.202757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:42:41.203231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:42:41.204329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:42:41.204890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:42:41.226959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:41.227444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:41.227882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:41.228611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:41.229065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:41.229614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:41.251641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:41.280567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:42:41.292567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Getting quotas for user a681b194cdb24b6fbb49eb39711ffa1c and project 34b80862ddfb408fb212f9bd047a292a. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:42:41.322895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:42:41.324617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:42:41.341913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:41.358134 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7c18baf7-f0b7-4e50-87a7-bb399c590d69 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1274 microversion: 2.1 time: 0.514593 Aug 30 03:42:41.358937 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1951/3850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:40 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1274 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:41.365632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:41.366247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:41.395176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:41.395673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:41.396110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:41.396814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:41.397264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:41.397706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:41.479116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-09ea4e69-3218-4ca0-9690-df70534e2bef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604361 Aug 30 03:42:41.488771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1900/3851] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:42:41.511674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5a9b644-ea5c-4567-878d-5c06f814b725 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:41.512172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5a9b644-ea5c-4567-878d-5c06f814b725 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:41.632733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:41.646529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-336864a3-6af6-4be0-a73b-db883ef38902 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1210 microversion: 2.1 time: 0.286425 Aug 30 03:42:41.652784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1952/3852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:41 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1210 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:41.722984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e5a9b644-ea5c-4567-878d-5c06f814b725 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:41.731611 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5a9b644-ea5c-4567-878d-5c06f814b725 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1214 microversion: 2.1 time: 0.240911 Aug 30 03:42:41.734998 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1901/3853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:41 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:42.396846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:42.397623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:42.412016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:42.413151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:42.414420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:42.416517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:42.421315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:42.422634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:42.673002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:42.673776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:42.695671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:42.697674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:42.698146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:42.701531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:42.702346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:42.704205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:42.925097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:42.935371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dbe24da0-dc7c-4a44-9a44-0f4f815ede6c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1274 microversion: 2.1 time: 0.543388 Aug 30 03:42:42.941954 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1953/3854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:42 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1274 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:42.954314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:42.955238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:42.969910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:42.970833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:42.974027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:42.975168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:42.978349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:42.979246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:43.060028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:43.076677 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98008563-4fd0-4fac-b66d-701233493ead tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1284 microversion: 2.1 time: 0.408211 Aug 30 03:42:43.077690 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1902/3855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:42 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1284 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:43.318983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:43.338377 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0fdc986-3f55-45c7-9c4c-02c4b0c7b873 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1218 microversion: 2.1 time: 0.389919 Aug 30 03:42:43.338377 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1954/3856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:42 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1218 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:43.962043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:43.962667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:43.977413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:43.977930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:43.978570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:43.979487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:43.979957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:43.980639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:44.103857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:44.106345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:44.127975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:44.128479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:44.128925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:44.129928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:44.130566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:44.131143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:44.171610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:44.498956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:44.523015 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c43973e6-1fa3-4550-a52d-e735752630c4 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1272 microversion: 2.1 time: 0.422617 Aug 30 03:42:44.533599 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1955/3857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:44 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:44.550236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:44.551127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:44.570464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:44.571174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:44.571779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:44.572582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:44.573092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:44.573572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:44.751130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:44.766742 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d883860b-a27d-40c4-be55-78dee666561c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1272 microversion: 2.1 time: 0.226414 Aug 30 03:42:44.767705 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1956/3858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:44 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:44.836129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:44.848596 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9104055d-d14a-4cae-8bf2-2407206c4595 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 0.890905 Aug 30 03:42:44.863138 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1903/3859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:43 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:45.575628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:45.577443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:45.591913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.592484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.592933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.593780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.594631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.595197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.643352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9a7fbfe1-68e1-4b6c-8fa8-8140bf6bbd5a req-7adc85b1-a80e-4522-940d-e08766be0bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8418183-c481-46fb-8198-2aa8f3db36e7", "tag": "6443e8c0-4dd8-4a2b-bc3e-a7e4d43c2f53"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:45.671541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9a7fbfe1-68e1-4b6c-8fa8-8140bf6bbd5a req-7adc85b1-a80e-4522-940d-e08766be0bad service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.672450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9a7fbfe1-68e1-4b6c-8fa8-8140bf6bbd5a req-7adc85b1-a80e-4522-940d-e08766be0bad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.674174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9a7fbfe1-68e1-4b6c-8fa8-8140bf6bbd5a req-7adc85b1-a80e-4522-940d-e08766be0bad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.698876 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9a7fbfe1-68e1-4b6c-8fa8-8140bf6bbd5a req-7adc85b1-a80e-4522-940d-e08766be0bad service nova] Creating event network-changed:6443e8c0-4dd8-4a2b-bc3e-a7e4d43c2f53 for instance a8418183-c481-46fb-8198-2aa8f3db36e7 on n-h1-854924-5 Aug 30 03:42:45.706188 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9a7fbfe1-68e1-4b6c-8fa8-8140bf6bbd5a req-7adc85b1-a80e-4522-940d-e08766be0bad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073008 Aug 30 03:42:45.708181 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1904/3860] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:42:45.769830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:45.781961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72138c43-360a-419f-91ba-93b4a35c3cc8 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1272 microversion: 2.1 time: 0.215091 Aug 30 03:42:45.783350 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1957/3861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:45 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:45.790209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:45.791280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:45.805337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.805963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.806657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.808235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.808980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.809685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.871139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:45.872204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:45.884593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.886326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.891162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.892572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:45.894019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:45.896471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:45.987724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:46.001436 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe552bc3-cdcf-4142-aeb9-f3bfa8d6f5fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1272 microversion: 2.1 time: 0.216726 Aug 30 03:42:46.017478 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1905/3862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:45 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:46.497273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:46.509090 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-44e043f7-296c-40d7-b507-e59b993e51ea tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 0.642082 Aug 30 03:42:46.534075 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1958/3863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:45 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:46.807297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:46.807959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:46.826962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:46.828621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:46.830119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:46.832970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:46.835235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:46.835945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:47.034830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:47.035514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:47.065452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:47.066506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:47.067330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:47.068655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:47.075905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:47.081679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:48.349238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:48.364100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12656eb7-b891-484f-8419-b2c4ce137b43 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 1.562172 Aug 30 03:42:48.367256 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1906/3864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:46 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:48.379448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:48.383235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:48.398780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:48.401209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:48.403142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:48.411052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:48.411546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:48.411989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:48.648752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:48.664853 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d9775955-1e17-4962-9659-3a68053e7b81 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 1.629850 Aug 30 03:42:48.667761 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1959/3865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:47 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:49.065659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:49.080656 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db6ecaba-894c-47a2-b517-ac64c8607550 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 0.707609 Aug 30 03:42:49.095308 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1907/3866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:48 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:49.407350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:49.408013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:49.445549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:49.446076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:49.446527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:49.447293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:49.447751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:49.448178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:49.655380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9259e552-5eb4-4439-b266-6f710034b726 req-ec09083a-fb38-49b6-8242-405e96f5cb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f", "tag": "3ac228a9-f1ed-491c-b85a-54fb04b449f1"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:49.670327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:49.697173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9259e552-5eb4-4439-b266-6f710034b726 req-ec09083a-fb38-49b6-8242-405e96f5cb90 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:49.702754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9259e552-5eb4-4439-b266-6f710034b726 req-ec09083a-fb38-49b6-8242-405e96f5cb90 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:49.704024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9259e552-5eb4-4439-b266-6f710034b726 req-ec09083a-fb38-49b6-8242-405e96f5cb90 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:49.728476 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9259e552-5eb4-4439-b266-6f710034b726 req-ec09083a-fb38-49b6-8242-405e96f5cb90 service nova] Creating event network-changed:3ac228a9-f1ed-491c-b85a-54fb04b449f1 for instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f on n-h2-854924-5 Aug 30 03:42:49.757586 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9259e552-5eb4-4439-b266-6f710034b726 req-ec09083a-fb38-49b6-8242-405e96f5cb90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105986 Aug 30 03:42:49.758304 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1908/3867] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:42:49.763868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:49.769192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:49.787886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:49.788635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:49.789216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:49.790136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:49.792493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:49.793154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:50.290561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=16 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:50.851882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:50.871769 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1387bbd7-dc28-4666-88dc-bf98e0763034 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 1.476002 Aug 30 03:42:50.896985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1960/3868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:49 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:50.912192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:50.916326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:50.918314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:50.949877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:50.952471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:50.960554 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66ae6794-3283-4b72-aad3-2bb69953bf9f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 1.194296 Aug 30 03:42:50.964275 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1909/3869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:49 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:50.972922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:50.974278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:50.974416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:50.974756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:51.447067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-275bbe08-578e-4a27-8570-010fbd24b339 req-3f4c0ef2-3910-44fb-894f-6cef6b009fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72b9fc7-5a88-4419-a22a-53f569b4d111", "tag": "4fd17ee9-6099-4c76-aedd-596dc6338fad"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:51.468681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:51.478175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-275bbe08-578e-4a27-8570-010fbd24b339 req-3f4c0ef2-3910-44fb-894f-6cef6b009fb3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:51.478772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-275bbe08-578e-4a27-8570-010fbd24b339 req-3f4c0ef2-3910-44fb-894f-6cef6b009fb3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:51.479661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-275bbe08-578e-4a27-8570-010fbd24b339 req-3f4c0ef2-3910-44fb-894f-6cef6b009fb3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:51.513388 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-275bbe08-578e-4a27-8570-010fbd24b339 req-3f4c0ef2-3910-44fb-894f-6cef6b009fb3 service nova] Creating event network-changed:4fd17ee9-6099-4c76-aedd-596dc6338fad for instance e72b9fc7-5a88-4419-a22a-53f569b4d111 on n-h2-854924-5 Aug 30 03:42:51.529049 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-275bbe08-578e-4a27-8570-010fbd24b339 req-3f4c0ef2-3910-44fb-894f-6cef6b009fb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084670 Aug 30 03:42:51.540053 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1910/3870] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:51.899840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:51.900958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:51.916113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:51.917390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:51.924653 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f20835e-d206-43d6-b2ff-91f49ca26444 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 1.023387 Aug 30 03:42:51.927086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:42:51.927690 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1961/3871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:50 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:51.929878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:51.930624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:51.931273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:51.932218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:51.933126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:51.933798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:51.991259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:51.992675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:52.009155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:52.018030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:52.021274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:52.025337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:52.029960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:52.029960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:52.922585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:52.923764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:52.969503 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ceaab966-749e-43d1-809c-681074bc02fc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 0.987811 Aug 30 03:42:52.970860 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1962/3872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:51 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:52.980467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cf6d9021-bd74-435c-a6ea-c1508a3769ea tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 1.085368 Aug 30 03:42:52.992022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:52.992644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:52.994901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1911/3873] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:51 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:53.003448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:53.004346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:53.004792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:53.005537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:53.005994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:53.006423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:53.542627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:53.553395 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-688b0d49-e56a-4625-b6d1-8e8ba3324a62 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 0.579608 Aug 30 03:42:53.569744 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1963/3874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:52 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:54.005182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:54.006818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:54.009560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:54.010234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:54.017986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:54.021396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:54.022074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:54.023025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:54.025279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:54.025988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:54.029113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:54.029680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:54.037394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:54.040959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:54.043036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:54.043515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:55.166545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:55.178116 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0544645-f8b7-4a15-b4d2-72c23cd1fdd6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 1.175014 Aug 30 03:42:55.181667 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1964/3875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:53 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:55.189901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-685bf546-1f0e-4fe7-9424-60700d4e511a req-70c643c8-c67e-48d1-9018-dc09ed515df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8418183-c481-46fb-8198-2aa8f3db36e7", "name": "network-vif-plugged", "status": "completed", "tag": "6443e8c0-4dd8-4a2b-bc3e-a7e4d43c2f53"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:55.220322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-685bf546-1f0e-4fe7-9424-60700d4e511a req-70c643c8-c67e-48d1-9018-dc09ed515df7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:55.223122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-685bf546-1f0e-4fe7-9424-60700d4e511a req-70c643c8-c67e-48d1-9018-dc09ed515df7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:55.225427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-685bf546-1f0e-4fe7-9424-60700d4e511a req-70c643c8-c67e-48d1-9018-dc09ed515df7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:55.245620 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-685bf546-1f0e-4fe7-9424-60700d4e511a req-70c643c8-c67e-48d1-9018-dc09ed515df7 service nova] Creating event network-vif-plugged:6443e8c0-4dd8-4a2b-bc3e-a7e4d43c2f53 for instance a8418183-c481-46fb-8198-2aa8f3db36e7 on n-h1-854924-5 Aug 30 03:42:55.260171 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-685bf546-1f0e-4fe7-9424-60700d4e511a req-70c643c8-c67e-48d1-9018-dc09ed515df7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074515 Aug 30 03:42:55.264929 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1965/3876] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:42:55.274973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:55.276543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:55.295239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:55.296063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:55.297422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:55.298370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:55.298988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:55.299570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:55.621000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:55.634114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38a74bfb-f5c3-4458-9436-e5b832505f11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 1.632273 Aug 30 03:42:55.638096 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1912/3877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:53 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:56.055183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:56.069210 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a507502-42ad-4c59-84bc-90cc321a92a0 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 0.801748 Aug 30 03:42:56.070245 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1966/3878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:55 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:56.204320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:56.205024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:56.223891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:56.227599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:56.228352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:56.235781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:56.236626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:56.238730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:56.658778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:56.659469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:56.680254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:56.680955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:56.681294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:56.687952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:56.688458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:56.688901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:56.716076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:56.730529 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9acee037-8d2f-4aa5-945a-938dea37b54f tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 0.528235 Aug 30 03:42:56.731489 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1913/3879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:56 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:57.094615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:57.095521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:57.113674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:57.114629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:57.115270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:57.116192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:57.116663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:57.117100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:57.682969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:57.698275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e85a4b8-b448-43ff-a34d-f8dcddd85d11 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 1.043418 Aug 30 03:42:57.698876 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1967/3880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:56 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:57.752356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:57.752986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:57.772987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:57.773557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:57.773998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:57.776073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:57.782115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:57.782773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:57.802562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:57.813027 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64149abc-3f8f-4d06-b3f5-87736eff0775 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1316 microversion: 2.1 time: 0.722409 Aug 30 03:42:57.832888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1914/3881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:57 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:58.535290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:58.547497 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc5b7057-7b8d-4a83-a119-4a5b5721afef tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 0.799471 Aug 30 03:42:58.557826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1968/3882] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:57 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:42:58.637579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1255685426", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "d228a048-1836-4fc1-8661-60ae0b2b9d51"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:42:58.719639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:58.721064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:58.733657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:58.736778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:58.737636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:58.741268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:58.741976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:58.743558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:58.773748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] validate_networks() for [('d228a048-1836-4fc1-8661-60ae0b2b9d51', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:42:59.705314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:42:59.715800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed3523b4-3c2e-4f09-adc5-aff3ea110e1d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 1.000618 Aug 30 03:42:59.716377 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1969/3883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:58 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:42:59.731406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:42:59.732101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:42:59.739610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:59.742991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:59.754061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:42:59.754818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:42:59.755297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:42:59.755723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.322041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:00.351346 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-04fd02a7-a85c-4771-bf9e-2d13634a71d8 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1504 microversion: 2.1 time: 0.633780 Aug 30 03:43:00.352527 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1970/3884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:42:59 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:00.365210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9b72623e-eef0-4c59-9268-f21bbb043bbd req-c221d781-3db5-4096-b9d0-411ce9bc2f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f", "name": "network-vif-plugged", "status": "completed", "tag": "3ac228a9-f1ed-491c-b85a-54fb04b449f1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:00.395378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b72623e-eef0-4c59-9268-f21bbb043bbd req-c221d781-3db5-4096-b9d0-411ce9bc2f89 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.395863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b72623e-eef0-4c59-9268-f21bbb043bbd req-c221d781-3db5-4096-b9d0-411ce9bc2f89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.396295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b72623e-eef0-4c59-9268-f21bbb043bbd req-c221d781-3db5-4096-b9d0-411ce9bc2f89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.451432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9b72623e-eef0-4c59-9268-f21bbb043bbd req-c221d781-3db5-4096-b9d0-411ce9bc2f89 service nova] Creating event network-vif-plugged:3ac228a9-f1ed-491c-b85a-54fb04b449f1 for instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f on n-h2-854924-5 Aug 30 03:43:00.480597 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9b72623e-eef0-4c59-9268-f21bbb043bbd req-c221d781-3db5-4096-b9d0-411ce9bc2f89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124801 Aug 30 03:43:00.488831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:43:00.489826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:43:00.490449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:43:00.491085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:43:00.491764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:43:00.505779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1971/3885] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:00.515802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:00.524545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.525694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.527646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:00.527971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.529664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.530459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.531721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.559764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.559764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.560699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Getting quotas for project 1b3cf8d76fba40b296de4f021faebd37. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:00.561157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.562024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.563120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.569724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Getting quotas for user e772fa68b30842b3b97fbc3796651bf2 and project 1b3cf8d76fba40b296de4f021faebd37. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:00.574102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.598857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:43:00.601870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:43:00.686839 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-945682bd-822a-4ab0-ac29-1207f4a1ed4d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359523 Aug 30 03:43:00.687926 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1915/3886] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:43:00.692765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:00.693660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:00.700402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.701153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.701804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.702677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:00.703325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:00.704068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:00.778876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:43:01.041053 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b336d8e6-1f87-45ff-8ee6-c176435a9182 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 204 len: 0 microversion: 2.1 time: 0.351627 Aug 30 03:43:01.042424 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1916/3887] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:43:00 2022] DELETE /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:43:01.049177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:01.050823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:01.060953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:01.061573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:01.062087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:01.062857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:01.063326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:01.063761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:01.071569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:01.087323 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e1b1f53-815d-439d-9b4c-ae18ae771462 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 0.579653 Aug 30 03:43:01.097554 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1972/3888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:00 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:01.121653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1357043707", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "d228a048-1836-4fc1-8661-60ae0b2b9d51"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:01.216467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] validate_networks() for [('d228a048-1836-4fc1-8661-60ae0b2b9d51', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:43:01.893337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:01.907855 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0fa08a8-1537-4206-9d00-d57af09697b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1314 microversion: 2.1 time: 0.857955 Aug 30 03:43:01.908628 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1917/3889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:01 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:01.932897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:01.933675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:01.952179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:01.953854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:01.954821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:01.955762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:01.958572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:01.959083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:02.850771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:02.859224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25936ae8-478a-423f-9cc8-807ad31fa936 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1510 microversion: 2.1 time: 0.948645 Aug 30 03:43:02.862099 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1918/3890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:01 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1510 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:02.869232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:02.881637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:02.903754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:02.904964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:02.906833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:02.907803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:02.917876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:02.918524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:02.973321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:03.583734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:03.593035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6ea4f64-2f37-4901-a55e-f6c1c4974cc5 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 0.727572 Aug 30 03:43:03.601758 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1919/3891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:02 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:03.626383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:03.631687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:03.646853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:03.666312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:03.666930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:03.667949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:03.668572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:03.669138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:03.844064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:43:03.844594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:43:03.845192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:43:03.846074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:43:03.846998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:43:03.891589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:03.892436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:03.892891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:03.896489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:03.896991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:03.898026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:03.990602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Getting quotas for project 1b3cf8d76fba40b296de4f021faebd37. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:04.015476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Getting quotas for user e772fa68b30842b3b97fbc3796651bf2 and project 1b3cf8d76fba40b296de4f021faebd37. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:04.055012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:43:04.060429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:43:04.303728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2d866abe-4139-4c80-a133-40d05e9556ae tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.204631 Aug 30 03:43:04.315977 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1973/3892] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:43:04.323420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:04.336386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:04.354334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:04.363432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:04.365948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:04.366999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:04.367717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:04.369263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:04.392212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:05.401033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:05.413312 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f2914446-34f4-40ac-9f98-36751c8bd3ef tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1501 microversion: 2.1 time: 1.805432 Aug 30 03:43:05.439690 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1920/3893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:03 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1501 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:05.469896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:05.470706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:05.472925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f76179a5c34545a0a04b37090fd1cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff4b6ebd9ca4c7daa9bb107d3829b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:05.485105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17fb4423-f868-4d19-832a-67508a6b7061 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 200 len: 1468 microversion: 2.1 time: 1.167438 Aug 30 03:43:05.485941 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1974/3894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:04 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 1468 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:05.498049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1665437108", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "451", "networks": [{"uuid": "d228a048-1836-4fc1-8661-60ae0b2b9d51"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:05.541738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:05.544634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:05.545097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:05.545905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:05.546382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:05.562479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:05.619134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] validate_networks() for [('d228a048-1836-4fc1-8661-60ae0b2b9d51', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:43:06.455505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:06.483527 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-39ade2d1-ad18-4bcc-bbe3-848dab1531f2 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 1.034689 Aug 30 03:43:06.485939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1921/3895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:05 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:06.511160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-cbb96f45-cb9e-4832-b51c-f85db6ce531a req-4253a07f-4f88-4d87-9c0d-753561017987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8418183-c481-46fb-8198-2aa8f3db36e7", "name": "network-vif-deleted", "tag": "6443e8c0-4dd8-4a2b-bc3e-a7e4d43c2f53"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:06.537739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-cbb96f45-cb9e-4832-b51c-f85db6ce531a req-4253a07f-4f88-4d87-9c0d-753561017987 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:06.538735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-cbb96f45-cb9e-4832-b51c-f85db6ce531a req-4253a07f-4f88-4d87-9c0d-753561017987 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:06.539403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-cbb96f45-cb9e-4832-b51c-f85db6ce531a req-4253a07f-4f88-4d87-9c0d-753561017987 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:06.569519 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-cbb96f45-cb9e-4832-b51c-f85db6ce531a req-4253a07f-4f88-4d87-9c0d-753561017987 service nova] Creating event network-vif-deleted:6443e8c0-4dd8-4a2b-bc3e-a7e4d43c2f53 for instance a8418183-c481-46fb-8198-2aa8f3db36e7 on n-h1-854924-5 Aug 30 03:43:06.589297 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-cbb96f45-cb9e-4832-b51c-f85db6ce531a req-4253a07f-4f88-4d87-9c0d-753561017987 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090082 Aug 30 03:43:06.594469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1922/3896] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:06.611118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:06.612558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:06.633980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:06.634572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:06.635058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:06.637611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:06.639461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:06.640041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:06.764383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c238cee-0749-4ae7-8efd-0213a628d405 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.165070 Aug 30 03:43:06.771960 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1923/3897] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:43:06 2022] POST /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:06.785384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8c90f6b8-9a99-4e5c-9813-309b3daa7a4a req-3551cd95-56e3-4135-9afa-07c090abea12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72b9fc7-5a88-4419-a22a-53f569b4d111", "name": "network-vif-plugged", "status": "completed", "tag": "4fd17ee9-6099-4c76-aedd-596dc6338fad"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:06.822726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8c90f6b8-9a99-4e5c-9813-309b3daa7a4a req-3551cd95-56e3-4135-9afa-07c090abea12 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:06.825758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8c90f6b8-9a99-4e5c-9813-309b3daa7a4a req-3551cd95-56e3-4135-9afa-07c090abea12 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:06.826310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8c90f6b8-9a99-4e5c-9813-309b3daa7a4a req-3551cd95-56e3-4135-9afa-07c090abea12 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:06.851242 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8c90f6b8-9a99-4e5c-9813-309b3daa7a4a req-3551cd95-56e3-4135-9afa-07c090abea12 service nova] Creating event network-vif-plugged:4fd17ee9-6099-4c76-aedd-596dc6338fad for instance e72b9fc7-5a88-4419-a22a-53f569b4d111 on n-h2-854924-5 Aug 30 03:43:06.867774 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8c90f6b8-9a99-4e5c-9813-309b3daa7a4a req-3551cd95-56e3-4135-9afa-07c090abea12 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093057 Aug 30 03:43:06.868486 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1924/3898] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:06.882212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:06.883242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:06.905371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:06.906181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:06.906746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:06.908257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:06.908721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:06.909173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:06.938665 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 HTTP/1.1 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a8418183-c481-46fb-8198-2aa8f3db36e7'} Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:06.940565 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0276fb9-78fd-41e1-ac29-29efb9fb04f9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 404 len: 111 microversion: 2.1 time: 0.072618 Aug 30 03:43:06.944579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1925/3899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:06 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:07.025194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:43:07.025806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:43:07.026109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:43:07.026521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:43:07.027098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:43:07.044513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:07.045026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:07.047243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:07.048127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:07.048609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:07.049599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:07.096569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Getting quotas for project 1b3cf8d76fba40b296de4f021faebd37. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:07.109047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Getting quotas for user e772fa68b30842b3b97fbc3796651bf2 and project 1b3cf8d76fba40b296de4f021faebd37. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:07.147869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:43:07.159452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:43:07.264802 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0c468b5-d870-4202-bac4-ba65894face2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.771649 Aug 30 03:43:07.273023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1975/3900] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:43:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:43:07.280315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:07.282460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:07.291299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:07.292187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:07.293802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:07.294897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:07.295845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:07.296696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:07.322824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6dcb7ede-fbe3-4f40-aee1-a9486c8d481b tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897b874a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1900192288", "description": "tempest-description-628361393"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:08.106380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:08.132335 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eaa5b729-8781-47e3-a36c-a5ab23b34ca5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1486 microversion: 2.1 time: 0.856884 Aug 30 03:43:08.150926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6dcb7ede-fbe3-4f40-aee1-a9486c8d481b tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.206754 Aug 30 03:43:08.152154 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1926/3901] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:43:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:08.163009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-63260541", "metadata": {"image_type": "test"}}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:08.165486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:08.169308 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1976/3902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:07 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1486 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:08.176295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0254f63-e0ba-4b2e-9b22-49bdcc5db668 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:08.184573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0254f63-e0ba-4b2e-9b22-49bdcc5db668 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:08.192897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:08.196077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:08.196592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:08.201018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:08.203842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:08.205109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:08.283200 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7/action HTTP/1.1 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 110 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-63260541", "metadata": {"image_type": "test"}}} Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a8418183-c481-46fb-8198-2aa8f3db36e7', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-63260541', 'metadata': {'image_type': 'test'}}}} Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:43:08.298146 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:08.306181 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20443e5e-9556-4cd3-b302-1c0e4644a0d9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "POST /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7/action" status: 404 len: 111 microversion: 2.1 time: 0.148526 Aug 30 03:43:08.307707 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1927/3903] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Aug 30 03:43:08 2022] POST /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7/action => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:08.332051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:08.332949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:08.362190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:08.370152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0254f63-e0ba-4b2e-9b22-49bdcc5db668 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:08.371156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:08.371868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:08.374244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:08.375706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:08.379242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:08.387981 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0254f63-e0ba-4b2e-9b22-49bdcc5db668 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1221 microversion: 2.1 time: 0.217026 Aug 30 03:43:08.392956 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1977/3904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:08 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:08.423775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:08.424326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:08.462781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:08.464089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:08.465243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:08.466907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:08.468922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:08.469860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:08.546886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lazy-loading 'flavor' on Instance uuid 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:43:08.918791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:08.931273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2f6f4d5-9dd5-47a3-b067-2df56ee251ec tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1314 microversion: 2.1 time: 0.608473 Aug 30 03:43:08.932748 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1928/3905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:08 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:08.964151 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-66d50890-cc68-4391-8bd2-8ed7039c7645 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.565349 Aug 30 03:43:08.964364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5095f14e-7296-45a6-b567-a6eef698e04b tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897b982af0>, body: {"security_group_rule": {"parent_group_id": "38047f2c-4202-40e7-a7e5-1b1f21eef82c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:08.965106 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1978/3906] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:43:08 2022] POST /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:08.975587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bbcd9cb-241d-46fd-9901-cec16cbcbe7c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2142963170", "metadata": {"image_type": "test"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:08.979504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bbcd9cb-241d-46fd-9901-cec16cbcbe7c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Failed to fetch instance by id tempest-invalid-1123336601 {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:43:08.980283 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8bbcd9cb-241d-46fd-9901-cec16cbcbe7c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance tempest-invalid-1123336601 could not be found. Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bbcd9cb-241d-46fd-9901-cec16cbcbe7c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/tempest-invalid-1123336601/action HTTP/1.1 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 112 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2142963170", "metadata": {"image_type": "test"}}} Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance tempest-invalid-1123336601 could not be found. Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'tempest-invalid-1123336601', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2142963170', 'metadata': {'image_type': 'test'}}}} Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1123336601 could not be found. Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:08.982147 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1123336601 could not be found. Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1123336601 could not be found. Aug 30 03:43:08.987654 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:08.990154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bbcd9cb-241d-46fd-9901-cec16cbcbe7c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance tempest-invalid-1123336601 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:08.994432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8bbcd9cb-241d-46fd-9901-cec16cbcbe7c tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-1123336601/action" status: 404 len: 101 microversion: 2.1 time: 0.027575 Aug 30 03:43:08.995811 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1979/3907] 10.222.0.30 () {60 vars in 1249 bytes} [Tue Aug 30 03:43:08 2022] POST /compute/v2.1/servers/tempest-invalid-1123336601/action => generated 101 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:09.008112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:09.014481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:09.037208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:09.037795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:09.039219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:09.040667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:09.042565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:09.045696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:09.753966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:09.768345 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ab96da2-dd8c-4814-98b2-cd3e64cc866f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1492 microversion: 2.1 time: 0.771057 Aug 30 03:43:09.771423 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1980/3908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:08 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1492 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:09.801630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71451bb0-5a8f-4f6c-a9ba-a23978a3cc83 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1894940370"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:09.820000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71451bb0-5a8f-4f6c-a9ba-a23978a3cc83 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:43:09.823801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-71451bb0-5a8f-4f6c-a9ba-a23978a3cc83 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71451bb0-5a8f-4f6c-a9ba-a23978a3cc83 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 57 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: {"createImage": {"name": "tempest-test-snap-1894940370"}} Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1894940370'}}} Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:09.825696 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:09.841558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:09.853726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71451bb0-5a8f-4f6c-a9ba-a23978a3cc83 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:09.856631 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71451bb0-5a8f-4f6c-a9ba-a23978a3cc83 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.067268 Aug 30 03:43:09.868941 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1981/3909] 10.222.0.30 () {60 vars in 1275 bytes} [Tue Aug 30 03:43:09 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:09.922024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:09.950654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:10.005916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.016790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.019272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.024928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.028112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.029301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.238136 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5095f14e-7296-45a6-b567-a6eef698e04b tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.296733 Aug 30 03:43:10.241842 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1929/3910] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:10.249065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f609d467-28c5-4e4b-bf4e-4e2b5be1e8a9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-127792602"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:10.287810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f609d467-28c5-4e4b-bf4e-4e2b5be1e8a9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:43:10.289309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:10.297497 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f609d467-28c5-4e4b-bf4e-4e2b5be1e8a9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f609d467-28c5-4e4b-bf4e-4e2b5be1e8a9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 56 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: {"createImage": {"name": "tempest-test-snap-127792602"}} Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-127792602'}}} Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:10.299584 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 03:43:10.303381 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.307735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f609d467-28c5-4e4b-bf4e-4e2b5be1e8a9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:10.308622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f609d467-28c5-4e4b-bf4e-4e2b5be1e8a9 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.065550 Aug 30 03:43:10.309210 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1930/3911] 10.222.0.30 () {60 vars in 1281 bytes} [Tue Aug 30 03:43:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:10.316101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be22d643-848d-4ab9-8a86-30fe0cc5dfab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1273 microversion: 2.1 time: 0.445928 Aug 30 03:43:10.329581 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1982/3912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:09 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1273 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:10.335295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:10.336256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:10.349680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4af9568b-3aee-443e-8922-d548a9e57166 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897a9d2670>, body: {"security_group_rule": {"parent_group_id": "38047f2c-4202-40e7-a7e5-1b1f21eef82c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:10.362332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.363178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.366224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.371597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.374342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.378603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.487728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4af9568b-3aee-443e-8922-d548a9e57166 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: This rule already exists in group 38047f2c-4202-40e7-a7e5-1b1f21eef82c Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4af9568b-3aee-443e-8922-d548a9e57166 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 138 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: {"security_group_rule": {"parent_group_id": "38047f2c-4202-40e7-a7e5-1b1f21eef82c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: exception: This rule already exists in group 38047f2c-4202-40e7-a7e5-1b1f21eef82c Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'security_group_rule': {'parent_group_id': '38047f2c-4202-40e7-a7e5-1b1f21eef82c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 38047f2c-4202-40e7-a7e5-1b1f21eef82c Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 38047f2c-4202-40e7-a7e5-1b1f21eef82c Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:10.489930 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:10.493718 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:10.493718 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:10.493718 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 38047f2c-4202-40e7-a7e5-1b1f21eef82c Aug 30 03:43:10.493718 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.493718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4af9568b-3aee-443e-8922-d548a9e57166 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 400 to user: This rule already exists in group 38047f2c-4202-40e7-a7e5-1b1f21eef82c {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:10.493718 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4af9568b-3aee-443e-8922-d548a9e57166 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.161095 Aug 30 03:43:10.495569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1983/3913] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:10 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:43:10.502369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:10.502875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:10.523889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.525832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.526564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.540874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.542560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.543015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.546086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:10.591680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:10.600745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 HTTP/1.1 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a8418183-c481-46fb-8198-2aa8f3db36e7'} Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:10.614686 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:10.619161 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:10.630688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:10.631890 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b637291-779e-418a-9c76-11f797b8dbf1 tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 404 len: 111 microversion: 2.1 time: 0.135287 Aug 30 03:43:10.636357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1984/3914] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:43:10 2022] DELETE /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:10.654670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-256461f2-4944-4aba-8375-ba5cec87e633 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897a9d2820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:10.889760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:10.901251 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1cafdaf6-a33b-4997-bbad-8f7e406ce104 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1463 microversion: 2.1 time: 0.585663 Aug 30 03:43:10.911325 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1931/3915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:10 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1463 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:10.928399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:10.928399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] [instance: a8418183-c481-46fb-8198-2aa8f3db36e7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:10.947701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.948604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.949429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.950393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:10.952733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:10.953699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:10.997774 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] HTTP exception thrown: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Request method failure captured: Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 HTTP/1.1 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYcoMQ3DOIcoidTqhuA1-GRG7bhlh3Nkg4Q3L-g_Y_31BkLixnJt25pjHWPT1go4Db6GLoWPfG6ptOOcXeBc6le_OyFuvTwSSzMiKFREYTgExM8avW4shRTjaBX4puu3sOzyEOYj_u6v3hWCblBiPdnsfUMjkakQLnjNvaEBBF129KA Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aff4b6ebd9ca4c7daa9bb107d3829b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aff4b6ebd9ca4c7daa9bb107d3829b15"}]}] Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: aff4b6ebd9ca4c7daa9bb107d3829b15 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-533720932 Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 03f76179a5c34545a0a04b37090fd1cb Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ImagesNegativeTestJSON-533720932-project Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a8418183-c481-46fb-8198-2aa8f3db36e7'} Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:11.000397 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. Aug 30 03:43:11.004403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:11.007147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] Returning 404 to user: Instance a8418183-c481-46fb-8198-2aa8f3db36e7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:11.010326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bacc1db4-299f-4406-ba66-68d0ac1cc51f tempest-ImagesNegativeTestJSON-533720932 tempest-ImagesNegativeTestJSON-533720932-project] 10.222.0.30 "GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7" status: 404 len: 111 microversion: 2.1 time: 0.097996 Aug 30 03:43:11.016102 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1932/3916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:10 2022] GET /compute/v2.1/servers/a8418183-c481-46fb-8198-2aa8f3db36e7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:11.023968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:11.027691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:11.044275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:11.045137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:11.046072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:11.054344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:11.055242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:11.056293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:11.739781 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-256461f2-4944-4aba-8375-ba5cec87e633 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/f3cfbd2c-8397-494e-b008-f9410fb974a6" status: 202 len: 0 microversion: 2.1 time: 1.092326 Aug 30 03:43:11.742453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1985/3917] 10.222.0.30 () {58 vars in 1287 bytes} [Tue Aug 30 03:43:10 2022] DELETE /compute/v2.1/os-security-group-rules/f3cfbd2c-8397-494e-b008-f9410fb974a6 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:11.756745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f01a6265-56f2-40e3-9ba0-7c1dd706455f", "device": "/dev/sdb"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:11.790855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:11.806494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:11.826579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:11.827495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:11.828717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:11.829718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:11.830473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:11.831129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:12.307577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:12.321545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea754846-45e9-4e16-a9ff-634a1de07c76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1513 microversion: 2.1 time: 1.303654 Aug 30 03:43:12.328863 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1933/3918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:11 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1513 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:12.346702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:12.353271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:12.399805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:12.404614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:12.407263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:12.408382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:12.409985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:12.411379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:12.552833 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2377e10d-4733-4a18-a9e5-9bf90e25d9a1 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "POST /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.808418 Aug 30 03:43:12.556408 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1986/3919] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:43:11 2022] POST /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:12.572003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf63b5d1-328f-4999-b81e-cd0645051e3c tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897aa77af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2102666157", "description": "tempest-description-680204071"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:12.944335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:12.952446 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04512e1e-e9c6-4d27-a34c-d44419e4bd3f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1279 microversion: 2.1 time: 0.623245 Aug 30 03:43:12.960000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1934/3920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:12 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1279 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:13.462949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-944795172", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "8804e3d2-234c-4294-bd19-91209b7ff25b"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:13.584672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] validate_networks() for [('8804e3d2-234c-4294-bd19-91209b7ff25b', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:43:14.474128 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf63b5d1-328f-4999-b81e-cd0645051e3c tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.911791 Aug 30 03:43:14.475433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1987/3921] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:43:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:14.481131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:14.482925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:14.505160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:14.512891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:14.513476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:14.514375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:14.515699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:14.515699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:15.706339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:15.733512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc8739f6-8608-4876-b8c7-a8acf55c0369 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 1.256368 Aug 30 03:43:15.735411 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1988/3922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:14 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:15.765849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:15.767010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:15.798767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:15.799684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:15.802109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:15.803182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:15.805025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:15.806996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:17.074639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:17.730163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:43:17.730769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:43:17.731142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:43:17.731708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:43:17.732232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:43:17.756791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:17.758101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:17.759406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:17.760474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:17.761189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:17.764883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:17.821628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Getting quotas for project f69bf4f4b2704bab8bee42616c8d7030. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:17.839669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:17.874763 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-112733b0-4023-43d1-862a-4f2c7a1c6a06 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 2.137211 Aug 30 03:43:17.880302 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1989/3923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:15 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:17.885477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Getting quotas for user c0e4e198274d4c9da6c0f4a598aee165 and project f69bf4f4b2704bab8bee42616c8d7030. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:17.908509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91dd1ec7-2637-465a-9724-a77a17aabffe tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897aa5e700>, body: {"security_group_rule": {"parent_group_id": "b4e8b79e-6ece-4113-9b00-b3cb30b628b1", "ip_protocol": "tcp", "from_port": 928426327, "to_port": 22}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:17.942923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:43:17.946047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:43:18.110049 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04f0bbc7-7177-4d20-9d89-c87a67e9ee87 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.039640 Aug 30 03:43:18.112485 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1935/3924] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 5043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:43:18.139225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-613f8336-3f17-42ae-a38b-b10e7fc4eb6f req-1ee1467b-ccf8-4ddc-825f-ebd37d5405d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad47ef0-3fc1-45bb-b291-46eeb9d55717", "tag": "58ededfe-7a19-45cd-8ce5-d8e76bcb9899"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:18.203667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-613f8336-3f17-42ae-a38b-b10e7fc4eb6f req-1ee1467b-ccf8-4ddc-825f-ebd37d5405d5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:18.206717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-613f8336-3f17-42ae-a38b-b10e7fc4eb6f req-1ee1467b-ccf8-4ddc-825f-ebd37d5405d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:18.210649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-613f8336-3f17-42ae-a38b-b10e7fc4eb6f req-1ee1467b-ccf8-4ddc-825f-ebd37d5405d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:18.236301 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-613f8336-3f17-42ae-a38b-b10e7fc4eb6f req-1ee1467b-ccf8-4ddc-825f-ebd37d5405d5 service nova] Creating event network-changed:58ededfe-7a19-45cd-8ce5-d8e76bcb9899 for instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 on n-h1-854924-5 Aug 30 03:43:18.250921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-613f8336-3f17-42ae-a38b-b10e7fc4eb6f req-1ee1467b-ccf8-4ddc-825f-ebd37d5405d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134331 Aug 30 03:43:18.251722 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1936/3925] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:18.264438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-17047948-b76e-448d-b6a5-4b8291b7839e req-d3859f7f-99a1-4980-8fd1-f96b4b4d7318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5bd277-41fb-4592-b55b-356bd04eb9c4", "tag": "dfbd7479-1472-40e5-a490-412db6b45e36"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:18.332701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-17047948-b76e-448d-b6a5-4b8291b7839e req-d3859f7f-99a1-4980-8fd1-f96b4b4d7318 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:18.333990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-17047948-b76e-448d-b6a5-4b8291b7839e req-d3859f7f-99a1-4980-8fd1-f96b4b4d7318 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:18.335307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-17047948-b76e-448d-b6a5-4b8291b7839e req-d3859f7f-99a1-4980-8fd1-f96b4b4d7318 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:18.368403 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-17047948-b76e-448d-b6a5-4b8291b7839e req-d3859f7f-99a1-4980-8fd1-f96b4b4d7318 service nova] Creating event network-changed:dfbd7479-1472-40e5-a490-412db6b45e36 for instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 on n-h2-854924-5 Aug 30 03:43:18.374679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=14 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:18.397113 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-17047948-b76e-448d-b6a5-4b8291b7839e req-d3859f7f-99a1-4980-8fd1-f96b4b4d7318 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143373 Aug 30 03:43:18.398336 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1937/3926] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:18.423137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:18.423990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:18.445433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:18.449623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:18.450431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:18.451330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:18.453798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:18.454442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:18.996315 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-91dd1ec7-2637-465a-9724-a77a17aabffe tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Invalid port range 928426327:22. Former value cannot be greater than the later Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91dd1ec7-2637-465a-9724-a77a17aabffe tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 145 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: {"security_group_rule": {"parent_group_id": "b4e8b79e-6ece-4113-9b00-b3cb30b628b1", "ip_protocol": "tcp", "from_port": 928426327, "to_port": 22}} Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid port range 928426327:22. Former value cannot be greater than the later Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b4e8b79e-6ece-4113-9b00-b3cb30b628b1', 'ip_protocol': 'tcp', 'from_port': 928426327, 'to_port': 22}}} Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 928426327:22. Former value cannot be greater than the later Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 928426327:22. Former value cannot be greater than the later Aug 30 03:43:18.998318 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 928426327:22. Former value cannot be greater than the later Aug 30 03:43:19.002202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.004423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91dd1ec7-2637-465a-9724-a77a17aabffe tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 400 to user: Invalid port range 928426327:22. Former value cannot be greater than the later {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:19.005521 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-91dd1ec7-2637-465a-9724-a77a17aabffe tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 1.123135 Aug 30 03:43:19.006657 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1990/3927] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:17 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 1125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:43:19.016450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-cb50c41d-5587-4dc3-a88e-9e1adc639e69 req-a0f5606d-3a88-4a36-ab17-5513b3150d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f", "name": "network-vif-plugged", "status": "completed", "tag": "3ac228a9-f1ed-491c-b85a-54fb04b449f1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:19.039552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cb50c41d-5587-4dc3-a88e-9e1adc639e69 req-a0f5606d-3a88-4a36-ab17-5513b3150d54 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:19.042310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cb50c41d-5587-4dc3-a88e-9e1adc639e69 req-a0f5606d-3a88-4a36-ab17-5513b3150d54 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:19.044386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cb50c41d-5587-4dc3-a88e-9e1adc639e69 req-a0f5606d-3a88-4a36-ab17-5513b3150d54 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:19.068957 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-cb50c41d-5587-4dc3-a88e-9e1adc639e69 req-a0f5606d-3a88-4a36-ab17-5513b3150d54 service nova] Creating event network-vif-plugged:3ac228a9-f1ed-491c-b85a-54fb04b449f1 for instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f on n-h2-854924-5 Aug 30 03:43:19.083062 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-cb50c41d-5587-4dc3-a88e-9e1adc639e69 req-a0f5606d-3a88-4a36-ab17-5513b3150d54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074842 Aug 30 03:43:19.084359 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1991/3928] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:19.097768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b80136c2-caf6-48b7-8d47-c0461c092348 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:19.099158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b80136c2-caf6-48b7-8d47-c0461c092348 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:19.553983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:19.564643 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f11158fc-fd01-44c9-9c3f-a0e0d62e3dcc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 1.162173 Aug 30 03:43:19.568733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1938/3929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:18 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:19.581708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:19.583944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:19.599065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:19.601512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:19.602206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:19.603161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:19.605564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:19.609744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:19.643966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b80136c2-caf6-48b7-8d47-c0461c092348 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:19.652773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b80136c2-caf6-48b7-8d47-c0461c092348 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1224 microversion: 2.1 time: 0.566968 Aug 30 03:43:19.660179 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1992/3930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:19 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1224 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:19.675338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf2d062-d1dc-46b3-8147-c33a4f694bd6 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897aa77820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-120819214", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:19.681012 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-cbf2d062-d1dc-46b3-8147-c33a4f694bd6 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Security group id should be uuid Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf2d062-d1dc-46b3-8147-c33a4f694bd6 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 130 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-120819214", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group id should be uuid Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-120819214', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:19.685259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:19.689193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 30 03:43:19.689193 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:19.695264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf2d062-d1dc-46b3-8147-c33a4f694bd6 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 400 to user: Security group id should be uuid {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:19.698656 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbf2d062-d1dc-46b3-8147-c33a4f694bd6 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.036329 Aug 30 03:43:19.700644 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1993/3931] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:19 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:43:19.715439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b4acd30-9faf-45ba-99d7-98e5d453f4d8 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897b1f7dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-590338824", "description": "tempest-description-1250292144"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:20.312457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:20.328720 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d71b4a9-8414-4ce6-b2fd-88469450e9ba tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 0.755496 Aug 30 03:43:20.331877 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1939/3932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:19 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:20.579326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8fc33402-5f2e-4a20-82d9-4081590fca60 req-d96c74bc-95bb-4f6e-af69-03687374aa91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f959cab0-e17b-4234-8fe0-622e9082efbe", "tag": "ef0b61b2-ea12-46d8-8fd0-0b3bfa568147"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:20.620008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8fc33402-5f2e-4a20-82d9-4081590fca60 req-d96c74bc-95bb-4f6e-af69-03687374aa91 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:20.622829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8fc33402-5f2e-4a20-82d9-4081590fca60 req-d96c74bc-95bb-4f6e-af69-03687374aa91 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:20.623587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8fc33402-5f2e-4a20-82d9-4081590fca60 req-d96c74bc-95bb-4f6e-af69-03687374aa91 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:20.684513 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8fc33402-5f2e-4a20-82d9-4081590fca60 req-d96c74bc-95bb-4f6e-af69-03687374aa91 service nova] Creating event network-changed:ef0b61b2-ea12-46d8-8fd0-0b3bfa568147 for instance f959cab0-e17b-4234-8fe0-622e9082efbe on n-h1-854924-5 Aug 30 03:43:20.718793 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8fc33402-5f2e-4a20-82d9-4081590fca60 req-d96c74bc-95bb-4f6e-af69-03687374aa91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138423 Aug 30 03:43:20.728051 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1940/3933] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:43:20.740267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:20.759342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:20.781066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:20.786714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:20.787538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:20.790670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:20.794016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:20.795044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:21.174429 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b4acd30-9faf-45ba-99d7-98e5d453f4d8 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.468842 Aug 30 03:43:21.175258 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1994/3934] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:43:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:43:21.187627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:21.188380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:21.223889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:21.247051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:21.247430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:21.248385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:21.248912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:21.249366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:21.461170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:21.476270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-705f5024-4a3c-44ff-a3e5-b47b735f8eb9 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1228 microversion: 2.1 time: 0.299520 Aug 30 03:43:21.481102 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1995/3935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:21 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1228 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:21.493479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-95a47ac6-f029-4ec7-9e0d-57dddad36657 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f8983cb99d0>, body: {"security_group_rule": {"parent_group_id": "1af68629-8128-4295-924f-f4cd2010801b", "ip_protocol": "tempest-999-2049338670", "from_port": 22, "to_port": 22}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:21.701500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:21.719391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b52a4ee-3c55-438b-8354-132c34c1a84d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.987058 Aug 30 03:43:21.740676 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1941/3936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:20 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:21.746785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:21.747640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:21.758756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:21.761251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:21.763812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:21.766372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:21.767109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:21.769958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:22.177962 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-95a47ac6-f029-4ec7-9e0d-57dddad36657 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Invalid IP protocol tempest-999-2049338670. Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-95a47ac6-f029-4ec7-9e0d-57dddad36657 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 157 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: {"security_group_rule": {"parent_group_id": "1af68629-8128-4295-924f-f4cd2010801b", "ip_protocol": "tempest-999-2049338670", "from_port": 22, "to_port": 22}} Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid IP protocol tempest-999-2049338670. Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1af68629-8128-4295-924f-f4cd2010801b', 'ip_protocol': 'tempest-999-2049338670', 'from_port': 22, 'to_port': 22}}} Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2049338670. Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2049338670. Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:22.180379 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2049338670. Aug 30 03:43:22.184842 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:22.187624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-95a47ac6-f029-4ec7-9e0d-57dddad36657 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 400 to user: Invalid IP protocol tempest-999-2049338670. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:22.188741 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-95a47ac6-f029-4ec7-9e0d-57dddad36657 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.701594 Aug 30 03:43:22.189898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1996/3937] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:21 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 703 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:43:22.205921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c9caa8e-e105-45be-abc7-80db6c9eb1cf tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897a983430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1135342300", "description": "tempest-description-1516182073"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:23.662586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:23.702045 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57644bc0-aaca-4807-bc26-debc8a65f82e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.959667 Aug 30 03:43:23.705426 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1942/3938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:21 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:23.711230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:23.715148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:23.720455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:23.735794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:23.736352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:23.736990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:23.737909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:23.738520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:23.739103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:23.946076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:23.957451 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8be503a6-5b87-4e1f-9f53-cc6dba6b7142 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1276 microversion: 2.1 time: 0.250697 Aug 30 03:43:23.958056 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1943/3939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:23 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:24.006152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:24.007789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:24.035592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:24.041153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:24.042108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:24.045460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:24.049292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:24.053330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:24.068933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:24.384829 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c9caa8e-e105-45be-abc7-80db6c9eb1cf tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.189710 Aug 30 03:43:24.385536 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1997/3940] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:43:22 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:43:24.401732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-302a21b9-6097-4632-b7b8-65a9e8f81e8a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897a9d2790>, body: {"security_group_rule": {"parent_group_id": "6ae0ab03-221f-4b54-87ea-4818160dfc73", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:24.888369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-302a21b9-6097-4632-b7b8-65a9e8f81e8a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-302a21b9-6097-4632-b7b8-65a9e8f81e8a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 138 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: {"security_group_rule": {"parent_group_id": "6ae0ab03-221f-4b54-87ea-4818160dfc73", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6ae0ab03-221f-4b54-87ea-4818160dfc73', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 03:43:24.890817 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-302a21b9-6097-4632-b7b8-65a9e8f81e8a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:24.895509 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-302a21b9-6097-4632-b7b8-65a9e8f81e8a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.495587 Aug 30 03:43:24.896825 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1998/3941] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:24 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 500 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:43:24.914857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:24.922779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:24.947150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:24.965896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:24.971107 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b837daa1-1153-4b5f-94b4-fc13ffb5a79d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.992484 Aug 30 03:43:24.974096 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1944/3942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:23 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:24.988913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:24.989895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:24.991099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:24.991723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:24.992612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:24.998124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0ec45cb-85d3-47b3-86d0-c2a7ee42a563 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f8983d32dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1025512176", "description": "tempest-description-804001726"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:25.514085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:25.523340 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0e822d52-c33d-4376-8c69-29d2f8114425 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 0.625034 Aug 30 03:43:25.527842 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 1999/3943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:24 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:25.555828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:25.556664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:25.581262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:25.582342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:25.583186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:25.584392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:25.585080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:25.586014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:25.622302 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0ec45cb-85d3-47b3-86d0-c2a7ee42a563 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.646697 Aug 30 03:43:25.623069 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1945/3944] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:43:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:25.635840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c57b3680-0632-4519-8045-072e67b53cbc tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897b712040>, body: {"security_group_rule": {"parent_group_id": "8f4c34a4-4437-4e63-b634-b9b0ceb21b9c", "ip_protocol": "tcp", "from_port": 22, "to_port": 243197920}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:25.830560 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c57b3680-0632-4519-8045-072e67b53cbc tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Invalid port range 22:243197920. Valid TCP ports should be between 1-65535 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c57b3680-0632-4519-8045-072e67b53cbc tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 145 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: {"security_group_rule": {"parent_group_id": "8f4c34a4-4437-4e63-b634-b9b0ceb21b9c", "ip_protocol": "tcp", "from_port": 22, "to_port": 243197920}} Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid port range 22:243197920. Valid TCP ports should be between 1-65535 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8f4c34a4-4437-4e63-b634-b9b0ceb21b9c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 243197920}}} Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:243197920. Valid TCP ports should be between 1-65535 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:243197920. Valid TCP ports should be between 1-65535 Aug 30 03:43:25.832261 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:243197920. Valid TCP ports should be between 1-65535 Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c57b3680-0632-4519-8045-072e67b53cbc tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 400 to user: Invalid port range 22:243197920. Valid TCP ports should be between 1-65535 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:25.836468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c57b3680-0632-4519-8045-072e67b53cbc tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.202252 Aug 30 03:43:25.839606 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1946/3945] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:25 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:43:25.845620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Action: 'create', calling method: .version_select at 0x7f897b8abaf0>, body: {"security_group_rule": {"parent_group_id": "d9bc2f01-574e-4d33-b189-1e8b81bd613b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:26.116948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:26.135214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f811035-3c8c-4775-a47f-976d9a7b3b93 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1276 microversion: 2.1 time: 0.602511 Aug 30 03:43:26.163540 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2000/3946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:25 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1276 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:26.202531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:43:26.203387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Neutron security group d9bc2f01-574e-4d33-b189-1e8b81bd613b not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:43:26.203982 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.203982 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 138 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: {"security_group_rule": {"parent_group_id": "d9bc2f01-574e-4d33-b189-1e8b81bd613b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: exception: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd9bc2f01-574e-4d33-b189-1e8b81bd613b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:43:26.206367 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 404 to user: Security group d9bc2f01-574e-4d33-b189-1e8b81bd613b does not exist Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-b5eefac9-f1a1-43cc-aedf-6641d76e55de'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04c6ca1c-9763-4f26-b41c-96e3d7117b3a tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.367183 Aug 30 03:43:26.210128 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1947/3947] 10.222.0.30 () {60 vars in 1195 bytes} [Tue Aug 30 03:43:25 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:26.216886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:26.216886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:26.230488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897bcc10d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:26.260913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:26.261442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:26.262148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:26.262951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:26.281969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:43:26.282828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:26.282963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Neutron security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 not found {{(pid=122167) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 30 03:43:26.283385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:26.283496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] HTTP exception thrown: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.283496 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Request method failure captured: Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-security-group-rules/a683065f-5c6d-46f7-9b93-d154c5c28399 HTTP/1.1 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdKr2_OcAYyraNAf_m2OxBa3u4Twkcv9Bs6IvC9VSrvVToRzRHKFA2vB2Q2PwrOleZ6ih9fd1uhHjqGYWnoLUM2h1ENgGKI1862RMJD4WDsBYHVfOLvIbGZCcZNlPv1BgoR2SbNqG27YHUWD5-M2cU4v4kNJdzAm2SVxGTgYfI3ZTA Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a07f0a2a39741d8af4a8be35776f45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a07f0a2a39741d8af4a8be35776f45b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a07f0a2a39741d8af4a8be35776f45b"}]}] Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7a07f0a2a39741d8af4a8be35776f45b Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d052ef41b4a94d8a9ebd9ca6e35845e7 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: exception: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a683065f-5c6d-46f7-9b93-d154c5c28399'} Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:43:26.287728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Returning 404 to user: Security group rule a683065f-5c6d-46f7-9b93-d154c5c28399 does not exist Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-0fbe351e-6d92-4607-95e9-06d90d98fc0a'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:26.291212 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef7b0f31-9bd0-4d6a-b30d-aa412b586bfd tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/a683065f-5c6d-46f7-9b93-d154c5c28399" status: 404 len: 199 microversion: 2.1 time: 0.073004 Aug 30 03:43:26.298278 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1948/3948] 10.222.0.30 () {58 vars in 1287 bytes} [Tue Aug 30 03:43:26 2022] DELETE /compute/v2.1/os-security-group-rules/a683065f-5c6d-46f7-9b93-d154c5c28399 => generated 199 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:26.312161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc93f7fb-b194-42e5-a725-8c8e6de9f952 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897b84d0d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:27.784119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:27.924667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:28.629738 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc93f7fb-b194-42e5-a725-8c8e6de9f952 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8f4c34a4-4437-4e63-b634-b9b0ceb21b9c" status: 202 len: 0 microversion: 2.1 time: 2.333929 Aug 30 03:43:28.636568 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1949/3949] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:43:26 2022] DELETE /compute/v2.1/os-security-groups/8f4c34a4-4437-4e63-b634-b9b0ceb21b9c => generated 0 bytes in 2341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:28.645421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:28.649203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:28.667707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:28.668221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:28.668761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:28.674398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:28.678737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:28.678984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:28.705158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:28.715057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9c8b40c-1ab3-4ccf-ba47-b51e832c2314 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 2.544380 Aug 30 03:43:28.719598 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2001/3950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:26 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 2555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:28.728009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:28.734208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:28.751908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:28.753445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:28.758035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:28.759173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:28.759874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:28.760522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:28.859810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:29.219782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:29.228972 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59ef7405-e595-4e08-9544-3c649771571f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1282 microversion: 2.1 time: 0.507970 Aug 30 03:43:29.240163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2002/3951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:28 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1282 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:29.245447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7575d5a-a6e0-4807-aa88-dedfb1f69f4f tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897a981f70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:29.649092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:29.820236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:29.835091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4a9b276-e2ad-4f2a-89de-b3bb6feb64dd tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.196374 Aug 30 03:43:29.837870 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1950/3952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:28 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:29.851813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:29.852902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:29.885186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:29.888236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:29.892426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:29.893573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:29.894553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:29.895346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:30.586188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:30.602461 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa055e73-7434-4a03-b480-dde946a819a3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.762624 Aug 30 03:43:30.605019 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1951/3953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:29 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:30.623531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:30.626525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:30.648408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:30.650113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:30.651504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:30.654101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:30.654821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:30.656594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:30.742138 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7575d5a-a6e0-4807-aa88-dedfb1f69f4f tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/6ae0ab03-221f-4b54-87ea-4818160dfc73" status: 202 len: 0 microversion: 2.1 time: 1.500494 Aug 30 03:43:30.745753 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2003/3954] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:43:29 2022] DELETE /compute/v2.1/os-security-groups/6ae0ab03-221f-4b54-87ea-4818160dfc73 => generated 0 bytes in 1502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:30.751647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65b27038-d6e0-4cc5-a6d5-3afe410d5c0b tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897a99a310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:31.652676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:31.704520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6d5e44c-cac6-4ee8-a37b-4fbbb5f3e705 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 1.092481 Aug 30 03:43:31.705922 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1952/3955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:30 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:31.723085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:31.724695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:31.740712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:31.741832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:31.742295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:31.743577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:31.744373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:31.745904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:32.080792 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65b27038-d6e0-4cc5-a6d5-3afe410d5c0b tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1af68629-8128-4295-924f-f4cd2010801b" status: 202 len: 0 microversion: 2.1 time: 1.333281 Aug 30 03:43:32.081740 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2004/3956] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:43:30 2022] DELETE /compute/v2.1/os-security-groups/1af68629-8128-4295-924f-f4cd2010801b => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:32.086431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:32.087312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:32.100016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:32.109188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:32.110900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:32.118365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:32.121367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:32.123216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:32.866363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:32.880396 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92612166-0fba-4d21-8c9b-4a27bc5204be tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.172027 Aug 30 03:43:32.881000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1953/3957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:31 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:32.894653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5981c70-9bbf-423b-ad7b-6889e5d2f0c2 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897b7ca3a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:32.931180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:32.975773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21854bae-b56b-4b08-be66-a1843e38f7b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.892902 Aug 30 03:43:32.982123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2005/3958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:32 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:33.001465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:33.002835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:33.011575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:33.019891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:33.020735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:33.023251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:33.024692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:33.025770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:33.990429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:34.013196 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6269b4f-9321-4c34-bc98-995055da0eb7 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 1.029737 Aug 30 03:43:34.026292 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2006/3959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:32 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:34.031436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:34.032290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:34.054762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:34.060411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:34.061159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:34.064697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:34.067244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:34.067907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:34.162349 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c5981c70-9bbf-423b-ad7b-6889e5d2f0c2 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/b4e8b79e-6ece-4113-9b00-b3cb30b628b1" status: 202 len: 0 microversion: 2.1 time: 1.276475 Aug 30 03:43:34.164087 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1954/3960] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:43:32 2022] DELETE /compute/v2.1/os-security-groups/b4e8b79e-6ece-4113-9b00-b3cb30b628b1 => generated 0 bytes in 1280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:34.170769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f5b9b3da-c0e4-4348-a630-9025a93f1612 req-087688c5-506e-4487-801b-950683ca45c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5bd277-41fb-4592-b55b-356bd04eb9c4", "name": "network-vif-plugged", "status": "completed", "tag": "dfbd7479-1472-40e5-a490-412db6b45e36"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:34.241240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f5b9b3da-c0e4-4348-a630-9025a93f1612 req-087688c5-506e-4487-801b-950683ca45c0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:34.248071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f5b9b3da-c0e4-4348-a630-9025a93f1612 req-087688c5-506e-4487-801b-950683ca45c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:34.254806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f5b9b3da-c0e4-4348-a630-9025a93f1612 req-087688c5-506e-4487-801b-950683ca45c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:34.312740 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f5b9b3da-c0e4-4348-a630-9025a93f1612 req-087688c5-506e-4487-801b-950683ca45c0 service nova] Creating event network-vif-plugged:dfbd7479-1472-40e5-a490-412db6b45e36 for instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 on n-h2-854924-5 Aug 30 03:43:34.335424 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f5b9b3da-c0e4-4348-a630-9025a93f1612 req-087688c5-506e-4487-801b-950683ca45c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169603 Aug 30 03:43:34.336692 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1955/3961] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:34.346050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:34.352456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:34.383270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:34.383812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:34.385321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:34.386337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:34.387328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:34.388091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:35.133560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:35.158946 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ff27e8a-3b8a-4173-b76d-7dcaa25d76da tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.130394 Aug 30 03:43:35.175861 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2007/3962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:34 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:35.184311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-289a1bc5-18b7-4e97-acaa-51597370c583 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] Calling method '.version_select at 0x7f897a9ccaf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:35.267950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:35.293541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c59dfb2-d971-4792-a80e-7a74a8edcc03 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.952775 Aug 30 03:43:35.297826 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1956/3963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:34 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:35.323960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-32080f9d-32f5-4750-bc54-e819c18892bb req-a2e4ec40-d13d-460f-8d7f-df2eb110dee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f79def-51a4-4a27-9fb3-23a5713b38bd", "tag": "00df361c-b08b-4fd9-b027-993ac61816ac"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:35.353161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-32080f9d-32f5-4750-bc54-e819c18892bb req-a2e4ec40-d13d-460f-8d7f-df2eb110dee9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:35.354001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-32080f9d-32f5-4750-bc54-e819c18892bb req-a2e4ec40-d13d-460f-8d7f-df2eb110dee9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:35.354586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-32080f9d-32f5-4750-bc54-e819c18892bb req-a2e4ec40-d13d-460f-8d7f-df2eb110dee9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:35.387401 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-32080f9d-32f5-4750-bc54-e819c18892bb req-a2e4ec40-d13d-460f-8d7f-df2eb110dee9 service nova] Creating event network-changed:00df361c-b08b-4fd9-b027-993ac61816ac for instance 51f79def-51a4-4a27-9fb3-23a5713b38bd on n-h1-854924-5 Aug 30 03:43:35.403692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-32080f9d-32f5-4750-bc54-e819c18892bb req-a2e4ec40-d13d-460f-8d7f-df2eb110dee9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103426 Aug 30 03:43:35.404510 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1957/3964] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:35.422555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:35.423209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:35.439721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:35.441943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:35.443419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:35.444281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:35.450479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:35.451708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:36.250353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:36.273047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ba1a1ee-3e00-4360-801b-2b51577b87eb tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 0.866067 Aug 30 03:43:36.288279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1958/3965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:35 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:36.308350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:36.313283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:36.342310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:36.343680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:36.349952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:36.351001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:36.353413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:36.358157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:37.152272 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-289a1bc5-18b7-4e97-acaa-51597370c583 tempest-SecurityGroupRulesNegativeTestJSON-2142790608 tempest-SecurityGroupRulesNegativeTestJSON-2142790608-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/38047f2c-4202-40e7-a7e5-1b1f21eef82c" status: 202 len: 0 microversion: 2.1 time: 1.971737 Aug 30 03:43:37.173682 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2008/3966] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:43:35 2022] DELETE /compute/v2.1/os-security-groups/38047f2c-4202-40e7-a7e5-1b1f21eef82c => generated 0 bytes in 1997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:37.184546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:37.196843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:37.227998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:37.228504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:37.228949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:37.229710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:37.230172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:37.230600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:37.464677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:37.502179 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ff01d8b5-ede8-448d-8f71-24b1f184ceca tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.209170 Aug 30 03:43:37.509799 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1959/3967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:36 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:37.527462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-bb758ac9-35cd-41a2-8bd2-2df3704ef37c req-6ff07352-bfd2-42ae-a28c-ad7176cea630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad47ef0-3fc1-45bb-b291-46eeb9d55717", "name": "network-vif-plugged", "status": "completed", "tag": "58ededfe-7a19-45cd-8ce5-d8e76bcb9899"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:37.559764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bb758ac9-35cd-41a2-8bd2-2df3704ef37c req-6ff07352-bfd2-42ae-a28c-ad7176cea630 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:37.570684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bb758ac9-35cd-41a2-8bd2-2df3704ef37c req-6ff07352-bfd2-42ae-a28c-ad7176cea630 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:37.571875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bb758ac9-35cd-41a2-8bd2-2df3704ef37c req-6ff07352-bfd2-42ae-a28c-ad7176cea630 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:37.641099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-bb758ac9-35cd-41a2-8bd2-2df3704ef37c req-6ff07352-bfd2-42ae-a28c-ad7176cea630 service nova] Creating event network-vif-plugged:58ededfe-7a19-45cd-8ce5-d8e76bcb9899 for instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 on n-h1-854924-5 Aug 30 03:43:37.652856 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-bb758ac9-35cd-41a2-8bd2-2df3704ef37c req-6ff07352-bfd2-42ae-a28c-ad7176cea630 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140512 Aug 30 03:43:37.657577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1960/3968] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:37.748933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:37.758848 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99787613-e0d6-453b-81a5-5524215103f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.578516 Aug 30 03:43:37.762938 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2009/3969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:37 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:37.769194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:37.788009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:37.810667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:37.812307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:37.818259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:37.819143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:37.820636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:37.821226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:38.100785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c6763da-5a14-48e0-9dc7-5f15afc3159a tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897bd79790>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtsX/f+E1/hJ7F9AW9m9gj833ObdKR/EqvWeBS4AfiuXs9IiPNUlpcXz5YTJiS7MjWDFztEpt4zMGM/MQLT0+1mv/YOy44K2yxHkv3uw8t5FfjmgOu4x6Cs8S8KrG1MSg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c6763da-5a14-48e0-9dc7-5f15afc3159a tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 257 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtsX/f+E1/hJ7F9AW9m9gj833ObdKR/EqvWeBS4AfiuXs9IiPNUlpcXz5YTJiS7MjWDFztEpt4zMGM/MQLT0+1mv/YOy44K2yxHkv3uw8t5FfjmgOu4x6Cs8S8KrG1MSg=="}} Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtsX/f+E1/hJ7F9AW9m9gj833ObdKR/EqvWeBS4AfiuXs9IiPNUlpcXz5YTJiS7MjWDFztEpt4zMGM/MQLT0+1mv/YOy44K2yxHkv3uw8t5FfjmgOu4x6Cs8S8KrG1MSg=='}}} Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 30 03:43:38.117853 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 03:43:38.122359 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.131876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c6763da-5a14-48e0-9dc7-5f15afc3159a tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:38.133494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7c6763da-5a14-48e0-9dc7-5f15afc3159a tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.474352 Aug 30 03:43:38.138075 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1961/3970] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:43:37 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 479 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:43:38.163759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897b78eca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-960849311", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:38.211861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:38.230693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for user 53a98915cc9a4876ac7bbdf54c777180 and project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:38.280770 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 2166 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-960849311", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:38.302890 n-d-854924-5 devstack@n-api.service[122167]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-960849311', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:38.305468 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:38.308379 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.313238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:38.314905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a19df472-968a-44f2-bf2f-8e2b844f1574 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.169618 Aug 30 03:43:38.316093 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1962/3971] 10.222.0.30 () {60 vars in 1160 bytes} [Tue Aug 30 03:43:38 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:43:38.347784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8faf77ab-bea2-4f66-8a20-8e90b99aae7e tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897b8111f0>, body: {"keypair": {"name": "tempest-keypair-814779804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSxmuus+LnCAUGE/wW4j9ro/chk+MvsL1+GI/QoVSv9zOhk91MUt64q2Znhi7YQFrrAMcSaU8bZiXquutxOtTv1a5uBzjQ0WNcIjptrJFB6mKJqN9Ufg0F80VUC2Cf+Qg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:38.382808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8faf77ab-bea2-4f66-8a20-8e90b99aae7e tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:38.395379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8faf77ab-bea2-4f66-8a20-8e90b99aae7e tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for user 53a98915cc9a4876ac7bbdf54c777180 and project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:38.437227 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8faf77ab-bea2-4f66-8a20-8e90b99aae7e tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101616 Aug 30 03:43:38.438259 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1963/3972] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:43:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:43:38.463624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f898017f820>, body: {"keypair": {"name": "tempest-keypair-814779804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZnn+bQr3PLOn/wCbjCDa+d59UAkAKPZCnCT/ks1sJTDHf5yrLyrFHcxHy5uyxVvvcDtb3/MMbiTj3v8kW5c2rmsMgbk2Gg3sVHn+03+DeE7s+vX4WB8IEeCEYnCqjaQQ=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:38.493707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:38.507718 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c65e4220-3a5c-41b4-85b6-86db8fa944f2 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 0.742914 Aug 30 03:43:38.509666 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2010/3973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:37 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:38.521001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:38.527856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for user 53a98915cc9a4876ac7bbdf54c777180 and project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:38.545492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:38.546979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:38.563260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:38.564008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:38.566691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:38.567589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:38.568204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:38.569457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:38.597935 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] HTTP exception thrown: Key pair 'tempest-keypair-814779804' already exists. Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 272 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: {"keypair": {"name": "tempest-keypair-814779804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZnn+bQr3PLOn/wCbjCDa+d59UAkAKPZCnCT/ks1sJTDHf5yrLyrFHcxHy5uyxVvvcDtb3/MMbiTj3v8kW5c2rmsMgbk2Gg3sVHn+03+DeE7s+vX4WB8IEeCEYnCqjaQQ=="}} Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: exception: Key pair 'tempest-keypair-814779804' already exists. Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-814779804', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZnn+bQr3PLOn/wCbjCDa+d59UAkAKPZCnCT/ks1sJTDHf5yrLyrFHcxHy5uyxVvvcDtb3/MMbiTj3v8kW5c2rmsMgbk2Gg3sVHn+03+DeE7s+vX4WB8IEeCEYnCqjaQQ=='}}} Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result.read() Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '53a98915cc9a4876ac7bbdf54c777180-tempest-keypair-814779804' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 03:43:38.610066 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result.read() Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 03:43:38.615250 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '53a98915cc9a4876ac7bbdf54c777180-tempest-keypair-814779804' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 3, 43, 38, 581496), 'updated_at': None, 'name': 'tempest-keypair-814779804', 'user_id': '53a98915cc9a4876ac7bbdf54c777180', 'fingerprint': '61:bb:1a:8a:7c:ec:18:bb:10:46:18:5e:06:73:b4:ad', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZnn+bQr3PLOn/wCbjCDa+d59UAkAKPZCnCT/ks1sJTDHf5yrLyrFHcxHy5uyxVvvcDtb3/MMbiTj3v8kW5c2rmsMgbk2Gg3sVHn+03+DeE7s+vX4WB8IEeCEYnCqjaQQ==', 'type': 'ssh'}] Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi keypair.create() Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._create() Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-814779804' already exists. Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 30 03:43:38.618544 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-814779804' already exists. Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-814779804' already exists. Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 409 to user: Key pair 'tempest-keypair-814779804' already exists. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-432d8ed0-fc1e-460e-83d5-8c8b212384b1 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.163819 Aug 30 03:43:38.628414 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1964/3974] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:43:38 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:43:38.645259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-424ca8c2-ed17-4950-b17d-ae8886ecb5f0 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Calling method '.version_select at 0x7f897b7eb790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:38.707980 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-424ca8c2-ed17-4950-b17d-ae8886ecb5f0 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814779804" status: 202 len: 0 microversion: 2.1 time: 0.080136 Aug 30 03:43:38.712365 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1965/3975] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814779804 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:38.727049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7730853d-6f60-4471-9ed3-8d3193b4636c tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897b811dc0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJbl8qWGEIlUEUPxzcj5rd/4x67WPQs/EvoXamp+8SELAgn0nJJrRcZnr/6hH1mfik/sD9rZscnjn6lCsA9HK0TTpaMuGz7h/iGk4PQnN5U4lnnecoWm7nIvFO4QED1Fw=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7730853d-6f60-4471-9ed3-8d3193b4636c tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 247 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJbl8qWGEIlUEUPxzcj5rd/4x67WPQs/EvoXamp+8SELAgn0nJJrRcZnr/6hH1mfik/sD9rZscnjn6lCsA9HK0TTpaMuGz7h/iGk4PQnN5U4lnnecoWm7nIvFO4QED1Fw=="}} Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJbl8qWGEIlUEUPxzcj5rd/4x67WPQs/EvoXamp+8SELAgn0nJJrRcZnr/6hH1mfik/sD9rZscnjn6lCsA9HK0TTpaMuGz7h/iGk4PQnN5U4lnnecoWm7nIvFO4QED1Fw=='}}} Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi '' Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:43:38.738803 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 03:43:38.756264 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:38.770130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7730853d-6f60-4471-9ed3-8d3193b4636c tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:38.773707 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7730853d-6f60-4471-9ed3-8d3193b4636c tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.054001 Aug 30 03:43:38.775574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1966/3976] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:43:38 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:43:38.799444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:38.801042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:38.828707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:38.828707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:38.828707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:38.830056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:38.830531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:38.830962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:40.515168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:40.535040 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff3ed818-cdd8-4b63-969a-6a6248333719 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.996618 Aug 30 03:43:40.540063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2011/3977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:38 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:40.551485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897a99ac10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1573896201", "public_key": " "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:40.616398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:40.639291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for user 53a98915cc9a4876ac7bbdf54c777180 and project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:40.739940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 95 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1573896201", "public_key": " "}} Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1573896201', 'public_key': ' '}}} Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:40.747550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:40.752449 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:40.756565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:40.760085 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-103aa4cf-2fc6-4854-86cb-88a1abee31ea tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.214524 Aug 30 03:43:40.762734 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2012/3978] 10.222.0.30 () {60 vars in 1158 bytes} [Tue Aug 30 03:43:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:43:40.773761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:40.779644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:40.795098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:40.797281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:40.799212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:40.800442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:40.802784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:40.803528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:40.972740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:41.005098 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-19eaee57-9ca8-44ab-86fb-a5f3b10a407a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 2.223235 Aug 30 03:43:41.005770 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1967/3979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:38 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:41.034331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-44a97234-328a-4d78-acd3-5a77f2513f5d req-05f2ad6f-7eb4-4611-a71d-bc4d422ba8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f959cab0-e17b-4234-8fe0-622e9082efbe", "name": "network-vif-plugged", "status": "completed", "tag": "ef0b61b2-ea12-46d8-8fd0-0b3bfa568147"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:41.055302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-44a97234-328a-4d78-acd3-5a77f2513f5d req-05f2ad6f-7eb4-4611-a71d-bc4d422ba8cc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:41.059532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-44a97234-328a-4d78-acd3-5a77f2513f5d req-05f2ad6f-7eb4-4611-a71d-bc4d422ba8cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:41.060342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-44a97234-328a-4d78-acd3-5a77f2513f5d req-05f2ad6f-7eb4-4611-a71d-bc4d422ba8cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:41.104425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-44a97234-328a-4d78-acd3-5a77f2513f5d req-05f2ad6f-7eb4-4611-a71d-bc4d422ba8cc service nova] Creating event network-vif-plugged:ef0b61b2-ea12-46d8-8fd0-0b3bfa568147 for instance f959cab0-e17b-4234-8fe0-622e9082efbe on n-h1-854924-5 Aug 30 03:43:41.116820 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-44a97234-328a-4d78-acd3-5a77f2513f5d req-05f2ad6f-7eb4-4611-a71d-bc4d422ba8cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097590 Aug 30 03:43:41.120030 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1968/3980] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:41.134038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07f466e2-a6d0-44fd-9fdf-4b8b5966284d tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897b6ee790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxK57lM1YFtHI/oAwL4iB87NhR8/1+BHv4KtqP63uwFMih3izbZLk3AZmooBSVpmenCdZx4Kr9cdssMsn68VOGiU4JXX9xET9/rd9v2yE7RmfgIhGuJihHBsQypUFTydw=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07f466e2-a6d0-44fd-9fdf-4b8b5966284d tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 507 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxK57lM1YFtHI/oAwL4iB87NhR8/1+BHv4KtqP63uwFMih3izbZLk3AZmooBSVpmenCdZx4Kr9cdssMsn68VOGiU4JXX9xET9/rd9v2yE7RmfgIhGuJihHBsQypUFTydw=="}} Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxK57lM1YFtHI/oAwL4iB87NhR8/1+BHv4KtqP63uwFMih3izbZLk3AZmooBSVpmenCdZx4Kr9cdssMsn68VOGiU4JXX9xET9/rd9v2yE7RmfgIhGuJihHBsQypUFTydw=='}}} Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 03:43:41.151093 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 03:43:41.154025 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.157968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07f466e2-a6d0-44fd-9fdf-4b8b5966284d tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:41.159346 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-07f466e2-a6d0-44fd-9fdf-4b8b5966284d tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.035172 Aug 30 03:43:41.160103 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1969/3981] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:43:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:43:41.169668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Action: 'create', calling method: .version_select at 0x7f897b712d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-450257247", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:41.229296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:43:41.245535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Getting quotas for user 53a98915cc9a4876ac7bbdf54c777180 and project fc637ed5bbe649bd916cca9b74dc92cb. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:43:41.295179 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 117 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-450257247", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-450257247', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 03:43:41.300354 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-667fa361-3f5f-49e3-b041-79be690a0bce tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.136413 Aug 30 03:43:41.304596 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1970/3982] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:43:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 03:43:41.318076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1923efb-b477-4fb9-ae20-c095dd92fa08 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Calling method '.version_select at 0x7f897b8ab9d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d1923efb-b477-4fb9-ae20-c095dd92fa08 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1940540691 not found for user 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1923efb-b477-4fb9-ae20-c095dd92fa08 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Request method failure captured: Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1940540691 HTTP/1.1 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdor_5F-vURkQi5IYqmcGHlz3XvX3Xk4pkLbu_D4EJ2AcVbRomWCX0IYBBbNBFLY4ZN6hr0G-mvy_Um-aRp2o9wtjNffCT0MmcZhQI3j-Ps_gFthSFOwDMQ7Z6qDLAG_ZQcaxBM6qXHRQrq-zdzDyzUPWEECfmRUcn5LQJRzwbXlhA Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fc637ed5bbe649bd916cca9b74dc92cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fc637ed5bbe649bd916cca9b74dc92cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fc637ed5bbe649bd916cca9b74dc92cb"}]}] Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: fc637ed5bbe649bd916cca9b74dc92cb Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1755398234 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1755398234-project Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: exception: Keypair tempest-keypair-non-existent-1940540691 not found for user 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'tempest-keypair-non-existent-1940540691'} Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:43:41.363095 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1940540691 not found for user 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1940540691 not found for user 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1940540691 not found for user 53a98915cc9a4876ac7bbdf54c777180 Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:43:41.366482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1923efb-b477-4fb9-ae20-c095dd92fa08 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1940540691 not found for user 53a98915cc9a4876ac7bbdf54c777180 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:41.369726 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1923efb-b477-4fb9-ae20-c095dd92fa08 tempest-KeyPairsNegativeTestJSON-1755398234 tempest-KeyPairsNegativeTestJSON-1755398234-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1940540691" status: 404 len: 145 microversion: 2.1 time: 0.048828 Aug 30 03:43:41.372024 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1971/3983] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 03:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1940540691 => generated 145 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:41.524867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:41.535339 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5262f77-fb5c-477d-9dec-1346f8e464bd tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 0.768319 Aug 30 03:43:41.536708 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2013/3984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:40 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:41.562455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:41.564191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:41.583230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:41.584083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:41.584545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:41.585280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:41.585782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:41.586208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:42.081792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:42.085267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:42.135111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=46 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:42.158478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:42.161717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:42.163734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:42.166107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:42.167983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:42.169854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:42.348679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:42.374792 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0c6e127-01c5-4ca3-92c0-08d85d029ac2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 0.810242 Aug 30 03:43:42.380097 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1972/3985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:41 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:42.559596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:42.562237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:42.571572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:42.572065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:42.572514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:42.589478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:42.591499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:42.595376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:42.750447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:42.761276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4101590-735e-40ef-86da-76ff721f4c91 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 0.694407 Aug 30 03:43:42.766636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2014/3986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:42 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:43.106060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:43.117315 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8111921b-4e92-4798-af74-a11081540976 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 0.562506 Aug 30 03:43:43.118439 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1973/3987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:42 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:43.409739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:43.411358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:43.438809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:43.443896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:43.448635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:43.451217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:43.451977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:43.456905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:43.792197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:43.793956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:43.817647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:43.818151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:43.818594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:43.819334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:43.819834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:43.820537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:44.620147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:44.629637 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5845474e-270f-46fa-95e5-488b8bef2ae9 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1321 microversion: 2.1 time: 1.223955 Aug 30 03:43:44.633255 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2015/3988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:43 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1321 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:44.646387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:44.647684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:44.660188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:44.665145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:44.665988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:44.667591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:44.668823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:44.670090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:45.056166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:45.088940 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-72339485-dd79-4a24-ac1d-3a3968989c25 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 1.298008 Aug 30 03:43:45.102257 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1974/3989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:43 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:45.667636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:45.669113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:45.683576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:45.684239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:45.684934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:45.687683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:45.688605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:45.692267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:46.162397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:46.173173 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5205475d-e4fe-49cf-8cca-600a5bb43b6c tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 1.538503 Aug 30 03:43:46.185369 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2016/3990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:44 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:46.198521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:46.205844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:46.227128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:46.227689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:46.228091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:46.228778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:46.229325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:46.229835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:46.669577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:46.710212 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-83a9cc3d-d0f0-47fb-a286-8a254a92675f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1512 microversion: 2.1 time: 1.045952 Aug 30 03:43:46.726891 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1975/3991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:45 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1512 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:46.755786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:46.756465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:46.777718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:46.782216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:46.782732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:46.783317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:46.784557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:46.790973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:46.791585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:46.792027 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a0caf39-62b5-492d-9bcf-ac61d2f612de tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1505 microversion: 2.1 time: 0.605438 Aug 30 03:43:46.792960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2017/3992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:46 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:47.005534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b6a268e5-9efd-4cd1-9d1a-eb61e19aac82 req-2ee279e6-6887-4a19-95e5-4f512049eca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f79def-51a4-4a27-9fb3-23a5713b38bd", "name": "network-vif-plugged", "status": "completed", "tag": "00df361c-b08b-4fd9-b027-993ac61816ac"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:47.024207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b6a268e5-9efd-4cd1-9d1a-eb61e19aac82 req-2ee279e6-6887-4a19-95e5-4f512049eca5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.026993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b6a268e5-9efd-4cd1-9d1a-eb61e19aac82 req-2ee279e6-6887-4a19-95e5-4f512049eca5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.028065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b6a268e5-9efd-4cd1-9d1a-eb61e19aac82 req-2ee279e6-6887-4a19-95e5-4f512049eca5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:47.052762 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b6a268e5-9efd-4cd1-9d1a-eb61e19aac82 req-2ee279e6-6887-4a19-95e5-4f512049eca5 service nova] Creating event network-vif-plugged:00df361c-b08b-4fd9-b027-993ac61816ac for instance 51f79def-51a4-4a27-9fb3-23a5713b38bd on n-h1-854924-5 Aug 30 03:43:47.060127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b6a268e5-9efd-4cd1-9d1a-eb61e19aac82 req-2ee279e6-6887-4a19-95e5-4f512049eca5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060607 Aug 30 03:43:47.062057 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2018/3993] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:47.205766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:47.206380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:47.214539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.215280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.216043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:47.219209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.219946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.220742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:47.513806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:47.523999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b44c7d3-45ee-4212-bf3d-df705c44d584 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1512 microversion: 2.1 time: 0.774915 Aug 30 03:43:47.529248 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1976/3994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:46 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1512 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:47.550225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:47.552534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:47.575851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.576721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.577949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:47.578902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.579585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.580350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:47.621814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:47.633764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9a23be5d-faf3-498e-9172-70e0a086ca55 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 0.432479 Aug 30 03:43:47.647338 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2019/3995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:47 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:47.837196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:47.839141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:47.857922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.861536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.863691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:47.869462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:47.870046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:47.871156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:48.228787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:48.288426 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64bd7724-5ebf-4cb1-a270-1fd254adc748 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 200 len: 1512 microversion: 2.1 time: 0.738514 Aug 30 03:43:48.295040 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1977/3996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:47 2022] GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:48.340656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:48.355056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:48.357365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:48.384742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:48.385220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:48.385876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:48.386839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:48.387850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:48.388480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:48.538909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:48.561695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:48.664222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:48.688803 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca92629a-2a0e-4738-835a-8a9278e2f70e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1505 microversion: 2.1 time: 0.860204 Aug 30 03:43:48.692434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2020/3997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:47 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1505 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:48.725747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:48.726840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:48.760846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:48.761168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:48.769897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:48.770691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:48.771867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:48.773098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:48.773889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:48.774314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:48.775342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:48.776340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:49.094996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-657a529d-7e1c-46c5-a599-135543648745 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.764460 Aug 30 03:43:49.096220 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1978/3998] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 03:43:48 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:49.115328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:49.119879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:49.126083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:49.126840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1255685426', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:49.128088 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-823a740a-2c7a-48f7-b150-1e08309c387a tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1324 microversion: 2.1 time: 0.432122 Aug 30 03:43:49.142835 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2021/3999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:48 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:49.155569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:49.156444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:49.163184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:49.165995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:49.166598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:49.166773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:49.286709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e6f3fe6b-ce22-47c8-8e7d-6997a5584874 req-ca194cd2-bd0c-4623-94c8-806f5ce66871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f", "name": "network-vif-unplugged", "status": "completed", "tag": "3ac228a9-f1ed-491c-b85a-54fb04b449f1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:49.329120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e6f3fe6b-ce22-47c8-8e7d-6997a5584874 req-ca194cd2-bd0c-4623-94c8-806f5ce66871 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:49.329689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e6f3fe6b-ce22-47c8-8e7d-6997a5584874 req-ca194cd2-bd0c-4623-94c8-806f5ce66871 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:49.330126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e6f3fe6b-ce22-47c8-8e7d-6997a5584874 req-ca194cd2-bd0c-4623-94c8-806f5ce66871 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:49.376014 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e6f3fe6b-ce22-47c8-8e7d-6997a5584874 req-ca194cd2-bd0c-4623-94c8-806f5ce66871 service nova] Creating event network-vif-unplugged:3ac228a9-f1ed-491c-b85a-54fb04b449f1 for instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f on n-h2-854924-5 Aug 30 03:43:49.385287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e6f3fe6b-ce22-47c8-8e7d-6997a5584874 req-ca194cd2-bd0c-4623-94c8-806f5ce66871 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108710 Aug 30 03:43:49.386635 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2022/4000] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:49.415971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:49.536181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:49.545451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:49.546417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:49.547354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:49.749317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:49.750059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:49.813446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:49.813961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:49.814411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:49.837190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:49.844696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:49.845488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:50.672943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:50.720642 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd057b8d-30ec-41d5-b81d-ec6f02541902 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1255685426" status: 200 len: 1515 microversion: 2.1 time: 1.604904 Aug 30 03:43:50.721507 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1979/4001] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:43:49 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1255685426 => generated 1515 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:50.729256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:50.729914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:50.732027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:50.743955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:50.744458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:50.753790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:50.754647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:50.755133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:50.755589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:50.800910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:50.818595 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52dd16b7-2a33-479c-a591-7c8ead70f845 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 200 len: 1508 microversion: 2.1 time: 1.089321 Aug 30 03:43:50.819233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2023/4002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:49 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 1508 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:50.835490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:50.840474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:50.859845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:50.876552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:50.885046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:50.885638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:50.886422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:50.887055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:50.898115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:51.112613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:51.121521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:51.558431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:51.601863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:51.604357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:51.608480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:51.620636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:51.630299 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3906a938-e189-4fdd-9fe3-70ff48887f68 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1521 microversion: 2.1 time: 0.907615 Aug 30 03:43:51.641684 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1980/4003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:50 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1521 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:51.649222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:51.650315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:51.657581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:51.662105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:51.662993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:51.668848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:51.669605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:51.670544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.394247 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3676f37-450f-4200-8107-e284fa7c23e4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.570334 Aug 30 03:43:52.410287 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2024/4004] 10.222.0.30 () {58 vars in 1173 bytes} [Tue Aug 30 03:43:50 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:52.432106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:52.432665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:52.511695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.515043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.515734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.515992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:52.526081 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78c35c81-c34e-4c58-98c1-222d1b1e7ead tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.882874 Aug 30 03:43:52.530641 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1981/4005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:51 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:52.556197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.556959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.557676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.566544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:52.586804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:52.589418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.servers [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Removing options 'limit' from query {{(pid=122167) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 03:43:52.592902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:52.606258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.607905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.609316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.610384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.611510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.613478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.614511 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] HTTP exception thrown: Action 999 not found Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Request method failure captured: Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd/os-instance-actions/999 HTTP/1.1 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdQtn371xBtjVsUeSgTSCK99yHzq28GlJnon3I-2lyyyAIS0SoINS-YVeJFec9RtJpgSF68R9ZCBmxW831LLOuPMeSAcbJ7XYqqe54uN8EySh-Klyuxt7FDaDm2BybRA-alhRv7XrJS0biaJ6ZqeKx285o59d5CCe1SzO22ix0kwoo Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f69bf4f4b2704bab8bee42616c8d7030 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f69bf4f4b2704bab8bee42616c8d7030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f69bf4f4b2704bab8bee42616c8d7030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f69bf4f4b2704bab8bee42616c8d7030", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f69bf4f4b2704bab8bee42616c8d7030"}]}] Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f69bf4f4b2704bab8bee42616c8d7030 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceActionsNegativeTestJSON-1005317866-project Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c0e4e198274d4c9da6c0f4a598aee165 Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1005317866-project Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: exception: Action 999 not found Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': '51f79def-51a4-4a27-9fb3-23a5713b38bd', 'id': '999'} Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 30 03:43:52.621059 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:52.629468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Returning 404 to user: Action 999 not found {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:52.629468 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5742ae08-225f-4ed1-a95b-a1ecf2275ace tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.227573 Aug 30 03:43:52.632104 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2025/4006] 10.222.0.30 () {58 vars in 1308 bytes} [Tue Aug 30 03:43:52 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd/os-instance-actions/999 => generated 66 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:43:52.637971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:52.639150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:52.648453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.649181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.649886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.651894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.652713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.653438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:52.697327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:52.728350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:52.736927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:52.737881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.538157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:53.548107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fe1911c-5165-4d35-93e5-7d5584a6f481 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.914489 Aug 30 03:43:53.550548 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2026/4007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:52 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:53.562332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3b7af10-30e8-400f-a207-807c472d3d75 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '.version_select at 0x7f897a984c10>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:53.569124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3b7af10-30e8-400f-a207-807c472d3d75 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 5f4966cf-1987-4e26-8149-8f2d59d98b68] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:53.570840 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b76eb90-cad2-4a50-a63c-6fc20b0a7a27 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.039064 Aug 30 03:43:53.575620 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e3b7af10-30e8-400f-a207-807c472d3d75 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] HTTP exception thrown: Instance 5f4966cf-1987-4e26-8149-8f2d59d98b68 could not be found. Aug 30 03:43:53.582628 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1982/4008] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 03:43:52 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3b7af10-30e8-400f-a207-807c472d3d75 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Request method failure captured: Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/5f4966cf-1987-4e26-8149-8f2d59d98b68/os-instance-actions HTTP/1.1 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdQtn371xBtjVsUeSgTSCK99yHzq28GlJnon3I-2lyyyAIS0SoINS-YVeJFec9RtJpgSF68R9ZCBmxW831LLOuPMeSAcbJ7XYqqe54uN8EySh-Klyuxt7FDaDm2BybRA-alhRv7XrJS0biaJ6ZqeKx285o59d5CCe1SzO22ix0kwoo Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f69bf4f4b2704bab8bee42616c8d7030 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f69bf4f4b2704bab8bee42616c8d7030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f69bf4f4b2704bab8bee42616c8d7030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f69bf4f4b2704bab8bee42616c8d7030", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f69bf4f4b2704bab8bee42616c8d7030"}]}] Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f69bf4f4b2704bab8bee42616c8d7030 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceActionsNegativeTestJSON-1005317866-project Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c0e4e198274d4c9da6c0f4a598aee165 Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1005317866-project Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 5f4966cf-1987-4e26-8149-8f2d59d98b68 could not be found. Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': '5f4966cf-1987-4e26-8149-8f2d59d98b68'} Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f4966cf-1987-4e26-8149-8f2d59d98b68 could not be found. Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:43:53.584866 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4966cf-1987-4e26-8149-8f2d59d98b68 could not be found. Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4966cf-1987-4e26-8149-8f2d59d98b68 could not be found. Aug 30 03:43:53.588462 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:43:53.590854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3b7af10-30e8-400f-a207-807c472d3d75 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Returning 404 to user: Instance 5f4966cf-1987-4e26-8149-8f2d59d98b68 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:43:53.592180 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3b7af10-30e8-400f-a207-807c472d3d75 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/5f4966cf-1987-4e26-8149-8f2d59d98b68/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.040269 Aug 30 03:43:53.592323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:53.592859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:53.593249 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2027/4009] 10.222.0.30 () {58 vars in 1296 bytes} [Tue Aug 30 03:43:53 2022] GET /compute/v2.1/servers/5f4966cf-1987-4e26-8149-8f2d59d98b68/os-instance-actions => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:43:53.603983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:53.611865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:53.612526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:53.613035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.619377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:53.620648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:53.624447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:53.625053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:53.627599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.643473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:53.645081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:53.646251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.647731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:53.648742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:53.650197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.711813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:53.761373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-32762818-ce0d-4b80-901c-dfb4dfcb24f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.166897 Aug 30 03:43:53.763085 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2028/4010] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:43:53 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:53.776646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:53.780531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:53.796668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:53.799110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:53.799794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.802602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:53.803459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:53.804815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:53.902352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:43:54.102136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5e9c5f0-6676-4b32-afce-f7bc4d97a0fc tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 204 len: 0 microversion: 2.1 time: 0.337327 Aug 30 03:43:54.104309 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2029/4011] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:43:53 2022] DELETE /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:43:54.145634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:54.161321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:54.162280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.servers [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Removing options 'limit' from query {{(pid=122168) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 03:43:54.166178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:54.184252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:54.185790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:54.187282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:54.188756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:54.189896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:54.190921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:54.255386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:54.260700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:54.264233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fae58887-c58c-4a2b-a318-98197f55ea7e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.680374 Aug 30 03:43:54.264836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1983/4012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:53 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:54.297142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:54.297810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:54.319986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:54.320486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:54.320920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:54.321671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:54.322118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:54.325563 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89c25f1a-dc0c-4e06-a4ae-abdb94087e72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.207415 Aug 30 03:43:54.326149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:54.327612 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2030/4013] 10.222.0.30 () {58 vars in 1150 bytes} [Tue Aug 30 03:43:54 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:54.337800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:54.341376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:54.357615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:54.359290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:54.362480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:54.363730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:54.366434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:54.367053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.050826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:55.063703 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ed9d56b5-8b9f-4142-90df-17fc88983fc1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1527 microversion: 2.1 time: 0.796850 Aug 30 03:43:55.064333 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1984/4014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:54 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1527 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:55.078196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:55.080638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a4b901f-23b6-46df-bc85-ff579c408260 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.751797 Aug 30 03:43:55.081436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:55.081574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2031/4015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:54 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:55.110822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0411c661-4d70-4771-80c8-4dc09663b6b5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:55.122267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:55.123643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:55.124872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0411c661-4d70-4771-80c8-4dc09663b6b5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.131686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.132160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0411c661-4d70-4771-80c8-4dc09663b6b5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.133093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0411c661-4d70-4771-80c8-4dc09663b6b5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.133884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.139663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.141718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.142896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.143914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.183475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:55.196131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0411c661-4d70-4771-80c8-4dc09663b6b5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Going to try to stop instance {{(pid=122168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:43:55.237488 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb73f381-47c6-4131-bd7b-6b9786b4b839 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.172002 Aug 30 03:43:55.246128 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1985/4016] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:43:55 2022] GET /compute/v2.1/servers => generated 1012 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:55.258722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:55.272736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:55.274688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:55.287854 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0411c661-4d70-4771-80c8-4dc09663b6b5 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.184731 Aug 30 03:43:55.291032 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2032/4017] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:43:55 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:43:55.303940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:55.306536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.306912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:55.307941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.310337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.311807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.314007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.314627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.322476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.322976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.323416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.324310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.325545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.329996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.600352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:55.795200 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2549b8cc-c30b-4e5b-88a5-d21f171d0290 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.547689 Aug 30 03:43:55.796603 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1986/4018] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:43:55 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:55.812874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:55.823842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:55.825491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.servers [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Removing options 'limit' from query {{(pid=122167) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 03:43:55.826911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:55.839992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.846308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.847555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.849470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.853897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.861330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.914552 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be602117-bc1a-43e2-be50-04f24c03ffc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.108692 Aug 30 03:43:55.921768 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1987/4019] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 30 03:43:55 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:55.933962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:55.947415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:55.953211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1255685426', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:43:55.967021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.981510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.983439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:55.987922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:55.989240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:55.990308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:56.214551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:43:56.367083 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2dd8e40a-aee6-4320-96f2-dbc68e88ffb3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1255685426" status: 200 len: 346 microversion: 2.1 time: 0.436517 Aug 30 03:43:56.374140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1988/4020] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:43:55 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1255685426 => generated 346 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:43:56.392870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:56.394280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:56.408986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:56.412259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:56.412839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:56.413744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:56.416764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:56.417325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:56.883548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:56.897394 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5016da83-8558-40bc-b588-1abbcc40663c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.601283 Aug 30 03:43:56.897988 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2033/4021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:55 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:56.903063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db2e7a44-58dc-4eeb-ab7e-be83b1d614f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:56.923774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db2e7a44-58dc-4eeb-ab7e-be83b1d614f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:56.926558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db2e7a44-58dc-4eeb-ab7e-be83b1d614f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:56.931321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db2e7a44-58dc-4eeb-ab7e-be83b1d614f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:56.976534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db2e7a44-58dc-4eeb-ab7e-be83b1d614f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Going to try to stop instance {{(pid=122168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:43:57.081464 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db2e7a44-58dc-4eeb-ab7e-be83b1d614f5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "POST /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717/action" status: 202 len: 0 microversion: 2.1 time: 0.179527 Aug 30 03:43:57.087654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2034/4022] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:43:56 2022] POST /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:43:57.104781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:57.105704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:57.107544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:57.128270 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70ad5b66-169e-43e1-81ec-300d2dfc5353 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1527 microversion: 2.1 time: 0.742694 Aug 30 03:43:57.130002 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1989/4023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:56 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1527 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:57.155462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:57.157374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:57.159187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:57.160049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:57.160529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:57.161995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:57.778436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:57.791343 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b555a76a-1eb1-4e3b-bd24-5525825f4a2f tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.697293 Aug 30 03:43:57.792230 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2035/4024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:57 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:57.923108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:57.923792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:57.948802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:57.949366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:57.958328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:57.959142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:57.961669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:57.962155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:58.153004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:58.153684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:58.185147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:58.188860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:58.189628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:58.190826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:58.201232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:58.203323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:58.768440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:58.788147 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fe0edf4-8e95-4942-b58e-ec6275fa65e1 tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1527 microversion: 2.1 time: 0.640082 Aug 30 03:43:58.790680 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2036/4025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:58 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1527 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:58.822813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:58.823914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:58.835905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:58.836857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:58.838298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:58.840597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:58.846728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:58.849131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:58.916944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:43:58.929012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:58.955107 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2878cfef-2897-4ba6-9134-b1f4943e11bc tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.039694 Aug 30 03:43:58.955709 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1990/4026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:57 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:43:59.003922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5c4d9b85-86f6-4099-935f-4a8d615a65c0 req-19ae2041-cdf7-4fe7-8b7d-ae441669d37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f79def-51a4-4a27-9fb3-23a5713b38bd", "name": "network-vif-deleted", "tag": "00df361c-b08b-4fd9-b027-993ac61816ac"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:43:59.075805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5c4d9b85-86f6-4099-935f-4a8d615a65c0 req-19ae2041-cdf7-4fe7-8b7d-ae441669d37c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:59.076307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5c4d9b85-86f6-4099-935f-4a8d615a65c0 req-19ae2041-cdf7-4fe7-8b7d-ae441669d37c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:59.077313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5c4d9b85-86f6-4099-935f-4a8d615a65c0 req-19ae2041-cdf7-4fe7-8b7d-ae441669d37c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:59.168551 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5c4d9b85-86f6-4099-935f-4a8d615a65c0 req-19ae2041-cdf7-4fe7-8b7d-ae441669d37c service nova] Creating event network-vif-deleted:00df361c-b08b-4fd9-b027-993ac61816ac for instance 51f79def-51a4-4a27-9fb3-23a5713b38bd on n-h1-854924-5 Aug 30 03:43:59.186518 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5c4d9b85-86f6-4099-935f-4a8d615a65c0 req-19ae2041-cdf7-4fe7-8b7d-ae441669d37c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185518 Aug 30 03:43:59.189582 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1991/4027] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:43:59.719897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:43:59.740509 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62c33f82-5211-460c-b948-dc0f83e3045b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.927070 Aug 30 03:43:59.760594 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2037/4028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:58 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:43:59.835790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:43:59.836710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:43:59.857670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:59.863136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:59.864603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:59.867371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:59.867895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:59.868337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:59.969017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:43:59.970159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:43:59.973661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:43:59.973892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lazy-loading 'fault' on Instance uuid 51f79def-51a4-4a27-9fb3-23a5713b38bd {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:44:00.005521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:00.008880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:00.066321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:00.075667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:00.081913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:00.091375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:00.096289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:00.098649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:00.443144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e4e198274d4c9da6c0f4a598aee165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69bf4f4b2704bab8bee42616c8d7030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:00.453850 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8b5f714-5531-4868-9dbd-75fafdd4289d tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 200 len: 1314 microversion: 2.1 time: 0.623431 Aug 30 03:44:00.454463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1992/4029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:59 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:00.769686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:00.771511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:00.814009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:00.814904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:00.816177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:00.818185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:00.820221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:00.821885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:01.544768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:01.584130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:01.597382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d0c42b2c-1ac5-4d42-a6c1-2a84c55808a0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.610638 Aug 30 03:44:01.600133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2038/4030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:43:59 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:01.611824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:01.612713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] [instance: 51f79def-51a4-4a27-9fb3-23a5713b38bd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:01.630920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:01.631611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:01.632300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:01.633170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:01.633774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:01.636960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:01.671601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] HTTP exception thrown: Instance 51f79def-51a4-4a27-9fb3-23a5713b38bd could not be found. Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Request method failure captured: Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd HTTP/1.1 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdQtn371xBtjVsUeSgTSCK99yHzq28GlJnon3I-2lyyyAIS0SoINS-YVeJFec9RtJpgSF68R9ZCBmxW831LLOuPMeSAcbJ7XYqqe54uN8EySh-Klyuxt7FDaDm2BybRA-alhRv7XrJS0biaJ6ZqeKx285o59d5CCe1SzO22ix0kwoo Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: f69bf4f4b2704bab8bee42616c8d7030 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f69bf4f4b2704bab8bee42616c8d7030"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f69bf4f4b2704bab8bee42616c8d7030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f69bf4f4b2704bab8bee42616c8d7030", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f69bf4f4b2704bab8bee42616c8d7030"}]}] Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: f69bf4f4b2704bab8bee42616c8d7030 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1005317866 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceActionsNegativeTestJSON-1005317866-project Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c0e4e198274d4c9da6c0f4a598aee165 Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1005317866-project Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 51f79def-51a4-4a27-9fb3-23a5713b38bd could not be found. Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '51f79def-51a4-4a27-9fb3-23a5713b38bd'} Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f79def-51a4-4a27-9fb3-23a5713b38bd could not be found. Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f79def-51a4-4a27-9fb3-23a5713b38bd could not be found. Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:01.673740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f79def-51a4-4a27-9fb3-23a5713b38bd could not be found. Aug 30 03:44:01.677534 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:01.682120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] Returning 404 to user: Instance 51f79def-51a4-4a27-9fb3-23a5713b38bd could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:01.688145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f0f1627c-6abb-4421-b28e-af92bcbb2b1f tempest-InstanceActionsNegativeTestJSON-1005317866 tempest-InstanceActionsNegativeTestJSON-1005317866-project] 10.222.0.30 "GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd" status: 404 len: 111 microversion: 2.1 time: 0.086391 Aug 30 03:44:01.689048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2039/4031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:01 2022] GET /compute/v2.1/servers/51f79def-51a4-4a27-9fb3-23a5713b38bd => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:01.698745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:01.705867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:01.709106 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80d42540-02e4-4b1f-8ac8-d7d54bc577ab tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.943426 Aug 30 03:44:01.710739 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1993/4032] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:00 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:02.624238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:02.626183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:02.656385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:02.657106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:02.657849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:02.659185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:02.659866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:02.660797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:02.693131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=22 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:02.911739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Calling method '.version_select at 0x7f8983d54310>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:02.913777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:02.914274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:02.914776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:02.950629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:02.954401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:02.954892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:02.981025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:02.981725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:02.982182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:02.994648 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b7a57704-b2bc-4787-8ebc-2af878c8ca62 tempest-PortsAdminExtendedAttrsTestJSON-1860328530 tempest-PortsAdminExtendedAttrsTestJSON-1860328530-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.476966 Aug 30 03:44:03.000600 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2040/4033] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:44:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:03.009841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:03.010498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:03.032928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:03.033591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:03.034046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:03.034793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:03.035247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:03.035672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:03.892605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:03.909761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3594da7b-f76f-49e7-a28c-e9a904037f68 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.289337 Aug 30 03:44:03.922102 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1994/4034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:02 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:03.955756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:03.971491 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8818b16d-a3a9-4ea3-9836-19b424e14607 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.967933 Aug 30 03:44:03.973389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2041/4035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:03 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:04.932590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:04.933216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:04.947723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:04.948223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:04.948661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:04.949425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:04.949895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:04.950326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:05.000371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:05.000999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:05.003030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:05.026891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:05.027409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:05.046606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:05.052855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:05.053395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:05.054011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:05.502433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:05.521696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29d3fc77-67e5-44ed-8fac-bebbff6fc2f4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.524555 Aug 30 03:44:05.537656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:05.542010 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2042/4036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:04 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:05.552262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-825821f6-87b0-4369-96ed-7383b8baef54 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 0.623467 Aug 30 03:44:05.552867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1995/4037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:04 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:06.123243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Calling method '.version_select at 0x7f897b1f7700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:06.197028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:44:06.201377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Neutron security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:44:06.205278 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] HTTP exception thrown: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.205278 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Request method failure captured: Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-security-groups/645ab3b4-ef16-4ef5-bb30-bbf302c7e648 HTTP/1.1 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYeFwxccBAw9wPZekoYNzkWzei2v25xUcTIo-uqYuxrhr6s-2BUtVYwho0nz0NQlq3bkIty7ywVy8LgYpMiAKsTpefnQwSwxV-KwF21MgUBXEOVqcEtn5nDHJcFF3QQA5D7j8rjCTuChVFjfw6PbWt_x2FdIWmftqhQQ7beNABBc3gU Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e96004b7e49d42c79164e8e32aa252e4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}] Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: be28d7dec5bf4499bd9a048bf79c65ad Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '645ab3b4-ef16-4ef5-bb30-bbf302c7e648'} Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:44:06.217143 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] Aug 30 03:44:06.220802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:06.227727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Returning 404 to user: Security group 645ab3b4-ef16-4ef5-bb30-bbf302c7e648 does not exist Aug 30 03:44:06.227727 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-39284cd0-e74d-4b18-89ce-c2a1e9c2d2c1'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:06.230144 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16cec292-b5ef-4fae-973f-24e1c657ca14 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/645ab3b4-ef16-4ef5-bb30-bbf302c7e648" status: 404 len: 194 microversion: 2.1 time: 0.235323 Aug 30 03:44:06.246615 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2043/4038] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:44:05 2022] DELETE /compute/v2.1/os-security-groups/645ab3b4-ef16-4ef5-bb30-bbf302c7e648 => generated 194 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:06.272173 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cad35d0c-473f-4110-b792-175bbd720b2d tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.021378 Aug 30 03:44:06.273220 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1996/4039] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Aug 30 03:44:06 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 03:44:06.283304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1ec5c8f-8e42-4e9e-a27d-91e727c0b7d4 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Calling method '.version_select at 0x7f897b1fef70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:06.549930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:06.550674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:06.566102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:06.576358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:06.578664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:06.579126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:06.581081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:06.581929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:06.583424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:06.869045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1ec5c8f-8e42-4e9e-a27d-91e727c0b7d4 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.589190 Aug 30 03:44:06.870242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2044/4040] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 03:44:06 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:06.877906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:06.879025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:06.895876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:06.896756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:06.897995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:06.898930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:06.901932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:06.902609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:07.324906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:07.338126 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fa4a121c-e3ed-4e58-96d7-59b4e66c1e8c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.792767 Aug 30 03:44:07.338742 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1997/4041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:06 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:07.354508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4eb83e3c-bf8c-41e8-850a-d92d863df638 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Calling method '.version_select at 0x7f897b8b8ee0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:07.646340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:07.659877 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45d95213-63c7-469b-b04f-9eaa68b9d82d tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 0.787399 Aug 30 03:44:07.674814 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2045/4042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:06 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:07.843392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-4eb83e3c-bf8c-41e8-850a-d92d863df638 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:44:07.844546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4eb83e3c-bf8c-41e8-850a-d92d863df638 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 30 03:44:07.844546 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4eb83e3c-bf8c-41e8-850a-d92d863df638 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Request method failure captured: Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-security-groups/02601daf-41ea-4ce3-9950-b243b4581fc5 HTTP/1.1 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYeFwxccBAw9wPZekoYNzkWzei2v25xUcTIo-uqYuxrhr6s-2BUtVYwho0nz0NQlq3bkIty7ywVy8LgYpMiAKsTpefnQwSwxV-KwF21MgUBXEOVqcEtn5nDHJcFF3QQA5D7j8rjCTuChVFjfw6PbWt_x2FdIWmftqhQQ7beNABBc3gU Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e96004b7e49d42c79164e8e32aa252e4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}] Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: be28d7dec5bf4499bd9a048bf79c65ad Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: exception: Insufficient rights for removing default security group. Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '02601daf-41ea-4ce3-9950-b243b4581fc5'} Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:44:07.848572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] Aug 30 03:44:07.852670 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:07.858619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4eb83e3c-bf8c-41e8-850a-d92d863df638 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 30 03:44:07.858619 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-d9cf23cf-b61d-470b-b487-53e85b495174'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:07.859850 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4eb83e3c-bf8c-41e8-850a-d92d863df638 tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/02601daf-41ea-4ce3-9950-b243b4581fc5" status: 400 len: 182 microversion: 2.1 time: 0.515693 Aug 30 03:44:07.870081 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1998/4043] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:44:07 2022] DELETE /compute/v2.1/os-security-groups/02601daf-41ea-4ce3-9950-b243b4581fc5 => generated 182 bytes in 526 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:44:07.875624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Calling method '.version_select at 0x7f8983cb7670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:08.025287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG neutronclient.v2_0.client [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist", "detail": ""}} {{(pid=122168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:44:08.025826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.security_group_api [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Neutron security group 67269fec-71b2-4447-9996-6e74c24c255d not found {{(pid=122168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:44:08.026375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] HTTP exception thrown: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.026375 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Request method failure captured: Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-security-groups/67269fec-71b2-4447-9996-6e74c24c255d HTTP/1.1 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYeFwxccBAw9wPZekoYNzkWzei2v25xUcTIo-uqYuxrhr6s-2BUtVYwho0nz0NQlq3bkIty7ywVy8LgYpMiAKsTpefnQwSwxV-KwF21MgUBXEOVqcEtn5nDHJcFF3QQA5D7j8rjCTuChVFjfw6PbWt_x2FdIWmftqhQQ7beNABBc3gU Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e96004b7e49d42c79164e8e32aa252e4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}] Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: be28d7dec5bf4499bd9a048bf79c65ad Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: exception: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '67269fec-71b2-4447-9996-6e74c24c255d'} Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:44:08.028218 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] Aug 30 03:44:08.032622 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.039471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Returning 404 to user: Security group 67269fec-71b2-4447-9996-6e74c24c255d does not exist Aug 30 03:44:08.039471 n-d-854924-5 devstack@n-api.service[122168]: Neutron server returns request_ids: ['req-77382b21-e85f-4a08-8c00-28663c3048fe'] {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:08.040631 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d5073f5-1d5c-47df-9fa1-81f34314930b tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/67269fec-71b2-4447-9996-6e74c24c255d" status: 404 len: 194 microversion: 2.1 time: 0.169357 Aug 30 03:44:08.041972 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2046/4044] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:44:07 2022] GET /compute/v2.1/os-security-groups/67269fec-71b2-4447-9996-6e74c24c255d => generated 194 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:08.052378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Action: 'update', calling method: .version_select at 0x7f8983d32dc0>, body: {"security_group": {"name": "tempest-sg-1784291977", "description": "tempest-description-405528746"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:08.140073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG neutronclient.v2_0.client [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist", "detail": ""}} {{(pid=122167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 03:44:08.141381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.security_group_api [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Neutron security group 73d03b48-8bac-4d33-b734-872bc9299287 not found {{(pid=122167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 03:44:08.142081 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] HTTP exception thrown: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.142081 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Request method failure captured: Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: request: PUT /compute/v2.1/os-security-groups/73d03b48-8bac-4d33-b734-872bc9299287 HTTP/1.1 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 101 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYeFwxccBAw9wPZekoYNzkWzei2v25xUcTIo-uqYuxrhr6s-2BUtVYwho0nz0NQlq3bkIty7ywVy8LgYpMiAKsTpefnQwSwxV-KwF21MgUBXEOVqcEtn5nDHJcFF3QQA5D7j8rjCTuChVFjfw6PbWt_x2FdIWmftqhQQ7beNABBc3gU Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e96004b7e49d42c79164e8e32aa252e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e96004b7e49d42c79164e8e32aa252e4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e96004b7e49d42c79164e8e32aa252e4"}]}] Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e96004b7e49d42c79164e8e32aa252e4 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806 Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: be28d7dec5bf4499bd9a048bf79c65ad Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1348296806-project Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: {"security_group": {"name": "tempest-sg-1784291977", "description": "tempest-description-405528746"}} Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: exception: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '73d03b48-8bac-4d33-b734-872bc9299287', 'body': {'security_group': {'name': 'tempest-sg-1784291977', 'description': 'tempest-description-405528746'}}} Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 03:44:08.144504 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] Aug 30 03:44:08.148057 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:08.153123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] Returning 404 to user: Security group 73d03b48-8bac-4d33-b734-872bc9299287 does not exist Aug 30 03:44:08.153123 n-d-854924-5 devstack@n-api.service[122167]: Neutron server returns request_ids: ['req-ff059dbb-fed8-4c51-94f6-8b1649bed85b'] {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:08.155156 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b1e1a2e-55ff-44e7-ad6b-2f1d70f8a48e tempest-SecurityGroupsNegativeTestJSON-1348296806 tempest-SecurityGroupsNegativeTestJSON-1348296806-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/73d03b48-8bac-4d33-b734-872bc9299287" status: 404 len: 194 microversion: 2.1 time: 0.107744 Aug 30 03:44:08.175015 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 1999/4045] 10.222.0.30 () {60 vars in 1290 bytes} [Tue Aug 30 03:44:08 2022] PUT /compute/v2.1/os-security-groups/73d03b48-8bac-4d33-b734-872bc9299287 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:08.359911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:08.361030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:08.382059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:08.383843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:08.384407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:08.386113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:08.391296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:08.395870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:08.690340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:08.690966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:08.725641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:08.726563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:08.726908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:08.733959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:08.734806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:08.735257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:08.948789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:08.965139 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1baed4f5-828e-45ca-adc7-51978a39e7eb tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.609560 Aug 30 03:44:08.973923 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2047/4046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:08 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:09.322679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b900eb0-4523-4433-9bee-747757f235fe tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Action: 'create', calling method: .version_select at 0x7f897b1655e0>, body: {"keypair": {"name": "tempest-keypair-832018515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA9D3DR+KIrsL1TbkBZcoxFrQNFVqxWA+Rists/afHKaK584QadzH/MoiQCrb8q0hV0skFtnYJw41+FWXWtf6EWMSFPT1IJ1l+A7gdjrfsQp0BTxicFqVycMLdro1ay7w=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:09.368843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7b900eb0-4523-4433-9bee-747757f235fe tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Getting quotas for project 84abd5de7b764865b2f47938cb4a1f77. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:44:09.385706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7b900eb0-4523-4433-9bee-747757f235fe tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Getting quotas for user 82f00437d34c4a61a31742cd14848630 and project 84abd5de7b764865b2f47938cb4a1f77. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:44:09.450173 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b900eb0-4523-4433-9bee-747757f235fe tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253039 Aug 30 03:44:09.452329 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2048/4047] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:44:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:44:10.017327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:10.018283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:10.036255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:10.040812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:10.050842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:10.052832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:10.053629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:10.054683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:10.278096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:10.288600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8263a03e-ea55-46bb-ad1a-a78f16ae35b9 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1680 microversion: 2.1 time: 1.608990 Aug 30 03:44:10.297863 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2000/4048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:08 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1680 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:10.877377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:10.890457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-979da1b1-b75c-43ec-86ac-4cfd129b0cc0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.879484 Aug 30 03:44:10.895946 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2049/4049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:10 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:11.326523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:11.327475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:11.349773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:11.352750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:11.356318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:11.357216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:11.359142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:11.359588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:11.748574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:11.772336 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a3af6763-cacd-4ef5-a900-6ce13cc50218 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1657 microversion: 2.1 time: 0.455235 Aug 30 03:44:11.778632 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2001/4050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:11 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1657 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:11.808387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0fb6ff8f-0353-4d21-b3f2-f50d160acfbb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:11.840273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb6ff8f-0353-4d21-b3f2-f50d160acfbb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:11.841850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb6ff8f-0353-4d21-b3f2-f50d160acfbb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:11.844645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb6ff8f-0353-4d21-b3f2-f50d160acfbb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:11.907972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0fb6ff8f-0353-4d21-b3f2-f50d160acfbb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 03:44:11.930549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:11.931329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:11.944307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:11.947764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:11.951160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:11.952812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:11.953450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:11.953991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:12.023409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0fb6ff8f-0353-4d21-b3f2-f50d160acfbb tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.221617 Aug 30 03:44:12.031288 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2050/4051] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:44:11 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:44:12.046553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:12.047895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:12.058918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:12.059992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:12.062135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:12.064393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:12.080056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:12.081104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:12.493579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:12.514091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-820f6677-387a-4845-b6eb-68386c062f3a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.589828 Aug 30 03:44:12.515411 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2002/4052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:11 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:12.555987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:12.573823 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61c33fb6-06fb-47ae-b682-3def54633020 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1666 microversion: 2.1 time: 0.540702 Aug 30 03:44:12.575419 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2051/4053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:12 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1666 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:13.535402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:13.536089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:13.552250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:13.552755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:13.553192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:13.553964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:13.556737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:13.557146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:13.599497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:13.600103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:13.604099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:13.628280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:13.629514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:13.629961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:13.632902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:13.633399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:13.633972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:14.157564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:14.174313 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cff84af6-1964-4540-8adf-c29ef3ce377d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.642476 Aug 30 03:44:14.176430 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2003/4054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:13 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:14.227675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:14.237581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f7cc8f5-f8f6-4574-834e-7c232dd2b6fd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1666 microversion: 2.1 time: 0.641780 Aug 30 03:44:14.238160 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2052/4055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:13 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1666 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:15.196991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:15.198601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:15.208728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:15.212374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:15.213115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:15.214725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:15.217397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:15.218046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:15.263062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:15.263868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:15.288428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:15.288931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:15.292004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:15.293837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:15.294528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:15.294918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:15.972523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:15.985882 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78799331-10bb-42d8-8963-d90074939e29 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1666 microversion: 2.1 time: 0.725376 Aug 30 03:44:15.987538 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2053/4056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:15 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1666 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:16.082517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:16.107055 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6bb3a4f-cb6d-4eb5-808a-93d25d6070bc tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1522 microversion: 2.1 time: 0.914852 Aug 30 03:44:16.107677 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2004/4057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:15 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1522 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:17.010865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:17.011700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:17.036368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:17.037123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:17.038845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:17.040383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:17.043891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:17.044575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:17.334882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-657868400", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": "none"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:17.433518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:44:17.433935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:44:17.434407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:44:17.434811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:44:17.436066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:44:17.476419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:17.477167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:17.480016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:17.480821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:17.482812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:17.483241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:17.532860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Getting quotas for project f80f2e26479146b2991d6080b8cbb623. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:44:17.551481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Getting quotas for user fb59f1aa1c42480cbaf0cfed6babc790 and project f80f2e26479146b2991d6080b8cbb623. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:44:17.609720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:44:17.615057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:44:17.737499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-960e9a2c-18a0-477b-9bef-609f518c06c3 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.636137 Aug 30 03:44:17.748206 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2005/4058] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 03:44:17.760079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:17.760886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:17.773061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:17.773306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:17.773863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:17.774823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:17.775465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:17.776102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:17.913207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:17.945153 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e987d884-c665-4151-965e-d4ce976588b4 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.938313 Aug 30 03:44:17.945784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2054/4059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:17 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:18.005839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3b0d0ec-6ab8-46b2-b61a-4f0305bf861f tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:18.006543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b3b0d0ec-6ab8-46b2-b61a-4f0305bf861f tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:18.089259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:18.105176 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5949d559-29b2-4cb9-8db7-2a9fb6b9fc4b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1499 microversion: 2.1 time: 0.353322 Aug 30 03:44:18.107537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2006/4060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:17 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1499 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:18.130820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:18.131661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:18.166758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.167431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.168018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.168891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.169640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.170793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.191380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3b0d0ec-6ab8-46b2-b61a-4f0305bf861f tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:18.203705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3b0d0ec-6ab8-46b2-b61a-4f0305bf861f tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:18.209583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3b0d0ec-6ab8-46b2-b61a-4f0305bf861f tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:18.218350 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3b0d0ec-6ab8-46b2-b61a-4f0305bf861f tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1280 microversion: 2.47 time: 0.269115 Aug 30 03:44:18.223939 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2055/4061] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:17 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:18.253022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:18.278296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:18.279305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:18.313377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.314354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.314947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.315841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.316458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.317044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.350745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:18.398086 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77948cb1-5d38-41b8-b17b-f1226fb2db56 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.172707 Aug 30 03:44:18.399624 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2056/4062] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Aug 30 03:44:18 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:18.413104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3191cf1c-b4aa-491f-b6c5-663d0799fda3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:18.421563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3191cf1c-b4aa-491f-b6c5-663d0799fda3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.423119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3191cf1c-b4aa-491f-b6c5-663d0799fda3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.425596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3191cf1c-b4aa-491f-b6c5-663d0799fda3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.454254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3191cf1c-b4aa-491f-b6c5-663d0799fda3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 03:44:18.502935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:18.553726 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3191cf1c-b4aa-491f-b6c5-663d0799fda3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "POST /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717/action" status: 202 len: 0 microversion: 2.1 time: 0.146199 Aug 30 03:44:18.554512 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2057/4063] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:44:18 2022] POST /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:44:18.570986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:18.572978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:18.587486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:18.588905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.589984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.590439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.594148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.596835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.597282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.603974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-43046bd1-c67f-4838-a577-960a42330e7c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.492167 Aug 30 03:44:18.606151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2007/4064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:18 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:18.634511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:18.635268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:18.674169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.674734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.675189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:18.677481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:18.678562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:18.680806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:19.124349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:19.134853 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea80d570-d4f1-473f-8999-2c7c7f7fecaa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1508 microversion: 2.1 time: 0.575829 Aug 30 03:44:19.138626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2058/4065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:18 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1508 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:19.203933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:19.223906 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef9be43d-650c-4ec4-adec-c7b5687606d0 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.595854 Aug 30 03:44:19.234545 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2008/4066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:18 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:19.260640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:19.265164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:19.268771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:19.270479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:19.286057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:19.286587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:19.287061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:19.287835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:19.288291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:19.288717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:19.298171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:19.298680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:19.299114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:19.299821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:19.300274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:19.300694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:19.595382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:19.611673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:19.613392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:19.616436 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3fefdbd0-df9f-4841-967f-6b2fc7b97870 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1284 microversion: 2.47 time: 0.360535 Aug 30 03:44:19.619459 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2059/4067] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:19 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:19.772854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:19.783598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64cc1a75-d072-4493-b861-7ad94bef2650 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.525399 Aug 30 03:44:19.789364 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2009/4068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:19 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:19.813426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:19.814282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:19.825746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:19.829090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:19.829840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:19.830912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:19.833428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:19.834455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.162859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:20.163475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:20.173178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.173692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.184859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.185914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.186712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.187328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.271712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:20.283609 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58ef93b6-4ec2-4d45-8de2-e9e2027ab293 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.473924 Aug 30 03:44:20.285082 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2060/4069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:19 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:20.309900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:20.310992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:20.321445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.321948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.324348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.327906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.328624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.329264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.391263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lazy-loading 'flavor' on Instance uuid b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:44:20.552479 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df9ca829-ba1e-46e6-a591-d65134910ab3 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.247409 Aug 30 03:44:20.556694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2061/4070] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:44:20 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:44:20.571272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:20.574284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:20.593623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.595352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.599388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.600357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.604450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.605225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.658112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:20.666024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f57469f-f284-42b0-940d-f59639396c68 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1508 microversion: 2.1 time: 0.507132 Aug 30 03:44:20.670708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2010/4071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:20 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1508 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:20.682063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:20.682947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:20.690320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.690969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.691682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.692533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:20.693290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:20.693882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:20.874672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:20.896139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:20.898044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:20.903151 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-edd46402-d192-4321-8360-35d158e9328a tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1332 microversion: 2.47 time: 0.231281 Aug 30 03:44:20.904000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2011/4072] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:20 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:21.105098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:21.113249 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23c65fb5-5f58-4b44-928c-cd7e30c9128a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1678 microversion: 2.1 time: 0.554993 Aug 30 03:44:21.120002 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2062/4073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:20 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1678 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:21.702001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:21.707000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:21.724989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:21.733675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:21.736156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:21.738288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:21.740883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:21.742734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:21.747097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:21.935161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:21.936168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:21.959787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:21.959787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:21.959787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:21.959787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:21.959787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:21.959787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:22.096962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:22.107464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:22.111790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:22.117007 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e6d237a-a8aa-4416-a178-330b8d2eb0cd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1338 microversion: 2.47 time: 0.189765 Aug 30 03:44:22.119306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2063/4074] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:21 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:22.147463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:22.148269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:22.159928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:22.162867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:22.163549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:22.164281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:22.165223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:22.166062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:22.174520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:22.186528 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0dfa3b48-5d5e-49c3-bbf1-e0c0c16da556 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1508 microversion: 2.1 time: 0.499300 Aug 30 03:44:22.191741 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2012/4075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:21 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:22.500598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:22.520469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8242cca9-ec7d-48c3-9ea7-4e723cf28adf tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1661 microversion: 2.1 time: 0.378672 Aug 30 03:44:22.524294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2064/4076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:22 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1661 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:22.551667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:22.552207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:22.561537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:22.563206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:22.565372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:22.568133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:22.570405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:22.571137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:22.656334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:22.727360 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a7d0f0f-b035-467b-9cb2-63c140ab8d76 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.177804 Aug 30 03:44:22.729496 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2013/4077] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:44:22 2022] POST /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:44:22.740662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:22.741474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:22.770685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:22.772246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:22.777090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:22.779626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:22.780630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:22.781825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.022660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:23.038596 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23be5fb0-3559-4fbd-8411-8a6f66fd3e90 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1667 microversion: 2.1 time: 0.305075 Aug 30 03:44:23.050186 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2065/4078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:22 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1667 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:23.143785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:23.145827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:23.167031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.167844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.168449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.170764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.171563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.172144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.220565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:23.221302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:23.233512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.249137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.250615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.255246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.255871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.265549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.296807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:23.320436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:23.333957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:23.335890 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40590f73-e013-4451-b609-88404228aa0d tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1338 microversion: 2.47 time: 0.199219 Aug 30 03:44:23.340267 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2014/4079] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:23 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:23.626175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:23.628453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.629248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.629976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.630941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.632124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.632913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.634267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:23.647148 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d26e5eba-2de8-4197-acaa-1f527ce64a59 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1512 microversion: 2.1 time: 0.431643 Aug 30 03:44:23.649709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2066/4080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:23 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:23.673010 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4c07aa9-e00f-4270-b7d2-e2e162913fc2 tempest-AZV2TestJSON-1343109846 tempest-AZV2TestJSON-1343109846-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.252281 Aug 30 03:44:23.673693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2015/4081] 10.222.0.30 () {58 vars in 1164 bytes} [Tue Aug 30 03:44:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:44:23.687936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:23.694334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:23.697919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.servers [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Removing options 'limit' from query {{(pid=122168) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 03:44:23.700633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:23.708463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.712716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.713381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.714360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.714998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.715931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.718350 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bea3530e-5b91-4df0-8b03-222f3bda4270 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.039787 Aug 30 03:44:23.719583 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2067/4082] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 30 03:44:23 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:44:23.733260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:23.735908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:23.758303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.759071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.759662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:23.760587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:23.771680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:23.774006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.064057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:24.064838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:24.074373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.076686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.077312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.078250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.079673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.080268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.094857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:24.104973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dbdca632-ba1e-4826-83c5-704c6b4d1d9c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1512 microversion: 2.1 time: 0.377235 Aug 30 03:44:24.110457 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2016/4083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:23 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1512 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:24.147089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:24.148907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:24.162770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.163536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.165076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.167796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.169195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.171283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.640496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:24.652278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:24.668117 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1ea5742-6a93-4432-8052-5ee83d88b5fe tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 200 len: 1512 microversion: 2.1 time: 0.536732 Aug 30 03:44:24.669040 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9511c9a-ff04-4375-92e2-b77b274521c8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1667 microversion: 2.1 time: 0.607739 Aug 30 03:44:24.672403 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2017/4084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:24 2022] GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 1512 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:24.673093 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2068/4085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:24 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1667 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:24.678485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:24.679104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:24.692050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:24.692686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:24.702224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.702734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.703183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.703899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.707587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.708095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.708539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.709132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.709643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.711792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:24.712269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:24.712705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:24.969559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:25.006143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:25.013225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:25.018671 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b2c3d997-6d12-4060-a63e-482c2adf3a18 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1338 microversion: 2.47 time: 0.343090 Aug 30 03:44:25.033802 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2018/4086] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:24 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1338 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:25.179771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:25.191154 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-670b9dcd-0fc6-488d-9076-e0929367ae25 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1512 microversion: 2.1 time: 0.504505 Aug 30 03:44:25.191675 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2069/4087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:24 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:25.218656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:25.231906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:25.233608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:25.487071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:25.487641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:25.488557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:25.493481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:25.494476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:25.495199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:25.661374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:25.696209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:25.697335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:25.707522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:25.710377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:25.710940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:25.711708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:25.712188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:25.714476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:25.878304 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-208bb9dd-2c7f-4a9f-ba56-b9ce94c3cd97 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 346 microversion: 2.1 time: 0.661896 Aug 30 03:44:25.880060 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2019/4088] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:44:25 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 346 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:25.904507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:25.905130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:25.932117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:25.932661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:25.933089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:25.938821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:25.939322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:25.939934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:26.643922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:26.658158 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7c61ebed-d2bb-4c3f-913b-f7bc3c4916e7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1667 microversion: 2.1 time: 0.968071 Aug 30 03:44:26.674637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2070/4089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:25 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1667 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:26.681924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:26.682880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:26.691368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:26.692205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:26.693024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:26.694367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:26.695746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:26.696550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:26.786045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:26.804904 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5cd85932-92fa-4df2-af31-c68034b8142d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1512 microversion: 2.1 time: 0.912863 Aug 30 03:44:26.810247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2020/4090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:25 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1512 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:26.834325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:26.838703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:26.868020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:26.870539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:26.870736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:26.871467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:26.871924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:26.872345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:26.971611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:26.991336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:26.997154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:27.001434 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e836767a-5d3f-4717-8465-299571b4b968 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1359 microversion: 2.47 time: 0.324564 Aug 30 03:44:27.002631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2071/4091] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:26 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:27.029646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-647016275"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:27.036234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:27.043626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.044411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.045762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.046940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.047629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.048487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.331957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:27.350552 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-455e6d33-813c-4d83-b895-e37a359b4b93 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 200 len: 1512 microversion: 2.1 time: 0.519248 Aug 30 03:44:27.353588 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2021/4092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:26 2022] GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:27.390765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:27.394334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:27.412309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:27.423024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.424440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.427278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.428033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.428495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.428919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.525304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b9dc228-186f-47c0-9a38-ebdac879120b tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "POST /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e/action" status: 202 len: 52 microversion: 2.47 time: 0.503252 Aug 30 03:44:27.529874 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2072/4093] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:44:27 2022] POST /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e/action => generated 52 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 30 03:44:27.560110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:27.561497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:27.575643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.576004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.576692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.581830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.581830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.581830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.590671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:27.636848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:27.840204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a58033ee-f019-4b45-99ee-f32296e807b7 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 204 len: 0 microversion: 2.47 time: 0.298006 Aug 30 03:44:27.842889 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2073/4094] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:44:27 2022] DELETE /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:44:27.859997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:27.863316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:27.881585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.882509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.883155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:27.884109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:27.886547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:27.889507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:28.199998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:28.330174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:28.706081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.716091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-085dc5a2-4b0e-4019-81cd-a8edde931303 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1512 microversion: 2.1 time: 1.342017 Aug 30 03:44:28.718744 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2022/4095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:27 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1512 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:28.730245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:28.731212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:28.743865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:28.745996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:28.750290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:28.751473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:28.751922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:28.752603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:28.795089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.803185 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae378824-fc9e-4562-9d22-b5bb7e8b02f2 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1667 microversion: 2.1 time: 0.955419 Aug 30 03:44:28.805337 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2074/4096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:27 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1667 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:28.821524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:28.834427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.835322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:28.856385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:28.857095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:28.857565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:28.858273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:28.858964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:28.859604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:28.893646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:28.941286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.955653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.957127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.973294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:28.976684 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6f747a3-b667-471b-949b-eb3eab728dfd tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1365 microversion: 2.47 time: 0.256671 Aug 30 03:44:28.977294 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2023/4097] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:28 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:28.999055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:28.999566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:29.000058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:29.612807 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6ee2b15-7fe9-441b-b06a-1c36e529d049 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.802551 Aug 30 03:44:29.614091 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2075/4098] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:44:28 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:29.642659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:29.647866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:29.648536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:29.826891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:29.827414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:29.840963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:29.842670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:29.843262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:29.844231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:29.844857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:29.847293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.147983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.148998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.149656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.150739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.151344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.151989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.223486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:30.291375 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c240b27c-b6fc-4bed-be33-fdf0a235a9a4 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.653467 Aug 30 03:44:30.296856 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2024/4099] 10.222.0.30 () {58 vars in 1150 bytes} [Tue Aug 30 03:44:29 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:30.309101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:30.310197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:30.326890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.331682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.332495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.334354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.340383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.341175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.406997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:30.419048 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-161e4294-1854-493b-841f-68d6c3c45bc7 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1667 microversion: 2.1 time: 0.598046 Aug 30 03:44:30.421518 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2076/4100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:29 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1667 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:30.435900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:30.442567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:30.448994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:30.455449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.456364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.457017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.458015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.458744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.459400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.503601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:30.516519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:30.517991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:30.519164 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2582714-31ea-41b8-9553-6a2be075a7df tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1365 microversion: 2.47 time: 0.220658 Aug 30 03:44:30.529879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2025/4101] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:30 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:30.597845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:30.770962 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e57e23ed-644a-4e39-8cbe-292d98f093e6 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.337667 Aug 30 03:44:30.780612 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2077/4102] 10.222.0.30 () {58 vars in 1212 bytes} [Tue Aug 30 03:44:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:30.784659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:30.790311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:30.800095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:30.821851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.822666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.823430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:30.824542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:30.825254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:30.831791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.117829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:31.204443 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e3e0f5a-6004-47f9-a9e4-14b41c576f72 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.422954 Aug 30 03:44:31.221263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:31.232911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2026/4103] 10.222.0.30 () {58 vars in 1196 bytes} [Tue Aug 30 03:44:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:31.233596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:31.234884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': '1255685426', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:31.241639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.242622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.243223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.244145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.245617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.247251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.459209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:31.461040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:31.520377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.521135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.521880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.522743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.523428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.524089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.541382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:31.616373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2222962-41ae-4f51-9eeb-51c86ba91fa2 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?name=1255685426" status: 200 len: 346 microversion: 2.1 time: 0.400544 Aug 30 03:44:31.621486 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2078/4104] 10.222.0.30 () {58 vars in 1156 bytes} [Tue Aug 30 03:44:31 2022] GET /compute/v2.1/servers?name=1255685426 => generated 346 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:31.631022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:31.634671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:31.649126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.649255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.649699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.650552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.651195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.651894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.809591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:31.825750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:31.832139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:31.834669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dbe08a84-484c-4154-81b7-3f699d486e20 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1365 microversion: 2.47 time: 0.215203 Aug 30 03:44:31.836048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2079/4105] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:31 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:31.847779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:31.871707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:31.873651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:31.883015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.883789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.884415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.885291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.885862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.886889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.925562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:31.933379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3f8ffcef-485d-40c3-a17c-fbb1d4c13789 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.493279 Aug 30 03:44:31.933956 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2027/4106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:31 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:31.958412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:31.959072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:31.973016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.973547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.973984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:31.974681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:31.975134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:31.983891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.059298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:32.172245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ebc86a09-6c7f-4706-8b0a-84fefc81fc95 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.333978 Aug 30 03:44:32.172846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2080/4107] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Aug 30 03:44:31 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:32.184867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:32.191184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:32.191851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-125568542', 'deleted': False, 'project_id': '1b3cf8d76fba40b296de4f021faebd37'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:44:32.197212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.197718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.198146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.198850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.199295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.199707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.299647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:44:32.448545 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7424b735-6c84-4b38-9adc-a958809e2954 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-125568542" status: 200 len: 346 microversion: 2.1 time: 0.267446 Aug 30 03:44:32.449763 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2081/4108] 10.222.0.30 () {58 vars in 1228 bytes} [Tue Aug 30 03:44:32 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-125568542 => generated 346 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:44:32.463969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:32.464849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:32.478413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.479080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.479667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.485947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.486689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.487280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.538638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:32.550581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:32.554977 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a429b6b6-eac0-419d-8cf9-c617f4836a0c tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1670 microversion: 2.1 time: 0.600425 Aug 30 03:44:32.555761 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2028/4109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:31 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1670 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:32.583550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:32.584050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:32.596777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.597268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.597733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.598441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.598890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.599306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.676495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:32.720194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:32.729556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Working on deleting snapshot bdc3b073-00e4-4fe7-b52a-f565246b993f from shelved instance... Aug 30 03:44:32.794851 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-26bc952c-46bd-48d8-9ac8-8c8fc6fbcc44 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 204 len: 0 microversion: 2.1 time: 0.334139 Aug 30 03:44:32.798702 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2082/4110] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:32 2022] DELETE /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:44:32.805000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:32.805201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:32.818418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.818784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.819219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.819921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:32.820369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:32.820788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:32.845929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:33.478973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:33.499946 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bb1ed55e-e665-4de5-8ab0-4be91fbfe25a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1518 microversion: 2.1 time: 0.700231 Aug 30 03:44:33.500543 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2083/4111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:32 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1518 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:33.507777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:33.508482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:33.555288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:33.561105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:33.564727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:33.566094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:33.568327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:33.568807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:33.901033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:33.915252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:33.923297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:33.924517 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30da3c76-87a3-48da-b25b-bbb423900c0e tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1365 microversion: 2.47 time: 0.422251 Aug 30 03:44:33.925091 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2084/4112] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:33 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:34.258900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Doing local delete in cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=122167) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 03:44:34.270608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:34.271411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:34.272062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:34.272686 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 03:44:34.277138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] deallocate_for_instance() {{(pid=122167) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 03:44:34.523148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:34.524240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:34.534728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:34.538279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:34.544367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:34.547566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:34.548208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:34.548804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:35.313317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:35.322511 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6600cd2f-ba68-42f8-88fd-21bad2dc5ee3 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1518 microversion: 2.1 time: 0.804501 Aug 30 03:44:35.323108 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2085/4113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:34 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1518 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:35.345934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:35.346549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:35.368581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:35.369084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:35.369555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:35.370276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:35.370735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:35.371166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:35.574165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:35.599050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:35.603176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb59f1aa1c42480cbaf0cfed6babc790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80f2e26479146b2991d6080b8cbb623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:35.609196 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e1c15bc1-9dd5-42d3-90b8-01646f477d75 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 200 len: 1365 microversion: 2.47 time: 0.283535 Aug 30 03:44:35.611354 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2086/4114] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:35 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:44:36.345906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:36.347120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:36.361219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:36.362628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:36.371138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:36.372193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:36.380440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:36.381278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:36.396362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Updating instance_info_cache with network_info: [] {{(pid=122167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:44:36.979145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:36.990884 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a4694ef-97b9-4dd3-8ec4-24f36a8e2802 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1518 microversion: 2.1 time: 0.650951 Aug 30 03:44:36.992845 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2087/4115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:36 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1518 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:44:37.300580 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3f1cce4-d764-4e69-a75f-a2ca0cc7a782 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "DELETE /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 204 len: 0 microversion: 2.1 time: 4.727317 Aug 30 03:44:37.301955 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2029/4116] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:32 2022] DELETE /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 0 bytes in 4729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:44:37.307717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:37.312746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] [instance: 9a21bbb4-9933-4b63-a12f-95561582765e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:37.346430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.347019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.347727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.350095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.351082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.354777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.387039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-01c83ba5-0eab-4348-b23b-3fac3e85a1e9 req-f4991bc1-b619-4050-aa89-1ed29f7cb706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f", "name": "network-vif-deleted", "tag": "3ac228a9-f1ed-491c-b85a-54fb04b449f1"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:37.425093 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] HTTP exception thrown: Instance 9a21bbb4-9933-4b63-a12f-95561582765e could not be found. Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Request method failure captured: Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e HTTP/1.1 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYeQoaY2tc7t4dsZcd5cALNqxFUzd08ejR703Fq43NNIUYf1IbrXO2gJ03wlc1cqMPWuLImUlzKHwiAQ2Oh2pret1Pr_WfQjE0VCKk9WJ_PCZ-gTe7d3i245QrIieJ479nwgvth1tdWIySfpfvU3Tmet0f-Sqrpou1ToeEPjpjepWds Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: f80f2e26479146b2991d6080b8cbb623 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAaction247Test-145792312 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f80f2e26479146b2991d6080b8cbb623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f80f2e26479146b2991d6080b8cbb623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f80f2e26479146b2991d6080b8cbb623", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f80f2e26479146b2991d6080b8cbb623"}]}] Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAaction247Test-145792312 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: f80f2e26479146b2991d6080b8cbb623 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAaction247Test-145792312 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAaction247Test-145792312-project Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: fb59f1aa1c42480cbaf0cfed6babc790 Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAaction247Test-145792312-project Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 9a21bbb4-9933-4b63-a12f-95561582765e could not be found. Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '9a21bbb4-9933-4b63-a12f-95561582765e'} Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a21bbb4-9933-4b63-a12f-95561582765e could not be found. Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a21bbb4-9933-4b63-a12f-95561582765e could not be found. Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:37.428111 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a21bbb4-9933-4b63-a12f-95561582765e could not be found. Aug 30 03:44:37.437186 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.438720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] Returning 404 to user: Instance 9a21bbb4-9933-4b63-a12f-95561582765e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:37.448544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-53f45e70-a202-486f-bdcd-6c8c101efc87 tempest-ServersAaction247Test-145792312 tempest-ServersAaction247Test-145792312-project] 10.222.0.30 "GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e" status: 404 len: 111 microversion: 2.47 time: 0.144988 Aug 30 03:44:37.454641 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2030/4117] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:44:37 2022] GET /compute/v2.1/servers/9a21bbb4-9933-4b63-a12f-95561582765e => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:44:37.477039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-01c83ba5-0eab-4348-b23b-3fac3e85a1e9 req-f4991bc1-b619-4050-aa89-1ed29f7cb706 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.481011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-01c83ba5-0eab-4348-b23b-3fac3e85a1e9 req-f4991bc1-b619-4050-aa89-1ed29f7cb706 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.481609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-01c83ba5-0eab-4348-b23b-3fac3e85a1e9 req-f4991bc1-b619-4050-aa89-1ed29f7cb706 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.511270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:37.515701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:37.539667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.server_external_events [req-01c83ba5-0eab-4348-b23b-3fac3e85a1e9 req-f4991bc1-b619-4050-aa89-1ed29f7cb706 service nova] Unable to find a host for instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f. Dropping event network-vif-deleted {{(pid=122168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 03:44:37.541288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-01c83ba5-0eab-4348-b23b-3fac3e85a1e9 req-f4991bc1-b619-4050-aa89-1ed29f7cb706 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.547387 Aug 30 03:44:37.544750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.545150 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2088/4118] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 552 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 03:44:37.547638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.552218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.553145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.554001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.559181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.624508 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] HTTP exception thrown: Instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f could not be found. Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Request method failure captured: Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f HTTP/1.1 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSkRC7mvkSSQ1lX1xKrSIA6Mubx5KergXQoT7nSfZnNaFWcMfzumDAn7wYyYOFqXeGHWyB4zT_yXjaxq2zRFexhg_11fod4ch6JVlvqHzSRWHzvT3St1wbgClIcK8DYiIMjJB63vYlwtbk-27QA_Mt0S9ZgP694Yhodf7lAyPf0ZYk Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34b80862ddfb408fb212f9bd047a292a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}] Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a681b194cdb24b6fbb49eb39711ffa1c Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f could not be found. Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f'} Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f could not be found. Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f could not be found. Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:37.627125 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f could not be found. Aug 30 03:44:37.632973 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:37.634630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Returning 404 to user: Instance 929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:37.640006 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00bd3b33-05a8-48db-b8dd-3c12d9f63464 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f" status: 404 len: 111 microversion: 2.1 time: 0.175866 Aug 30 03:44:37.641855 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2031/4119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:37 2022] GET /compute/v2.1/servers/929c5b9a-2282-4258-9ecc-d2bd6cbe4a6f => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:37.660184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:37.661254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:37.694332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.694841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.695282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.702944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:37.703739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:37.705293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:37.844411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:38.017459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:38.018352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:38.063107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:38.064004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:38.064686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:38.078109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:38.078615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:38.079062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:38.304186 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5246ab84-1bba-4317-bd3d-a9d2d3f9cc7a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 204 len: 0 microversion: 2.1 time: 0.658488 Aug 30 03:44:38.306305 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2089/4120] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:37 2022] DELETE /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:44:38.323059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:38.331786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:38.402701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:38.403575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:38.403711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:38.435749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:38.436367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:38.436810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:38.965943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:39.208195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:39.241868 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12c1fe06-1234-4c5b-b163-24b33922e78a tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1467 microversion: 2.1 time: 0.916466 Aug 30 03:44:39.247556 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2090/4121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:38 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1467 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:39.437083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:39.496606 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cdefe1ff-fa8b-4459-acbe-3970c83732bf tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1476 microversion: 2.1 time: 1.483592 Aug 30 03:44:39.511974 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2032/4122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:38 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1476 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:40.140318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b09758e4-a1bd-45bc-a05a-57e2d2ffe921 req-ff60e449-3e98-4f14-b6a5-af0d1e8120a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f959cab0-e17b-4234-8fe0-622e9082efbe", "name": "network-vif-deleted", "tag": "ef0b61b2-ea12-46d8-8fd0-0b3bfa568147"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:40.188724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b09758e4-a1bd-45bc-a05a-57e2d2ffe921 req-ff60e449-3e98-4f14-b6a5-af0d1e8120a0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:40.189508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b09758e4-a1bd-45bc-a05a-57e2d2ffe921 req-ff60e449-3e98-4f14-b6a5-af0d1e8120a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:40.190090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b09758e4-a1bd-45bc-a05a-57e2d2ffe921 req-ff60e449-3e98-4f14-b6a5-af0d1e8120a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:40.211440 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b09758e4-a1bd-45bc-a05a-57e2d2ffe921 req-ff60e449-3e98-4f14-b6a5-af0d1e8120a0 service nova] Creating event network-vif-deleted:ef0b61b2-ea12-46d8-8fd0-0b3bfa568147 for instance f959cab0-e17b-4234-8fe0-622e9082efbe on n-h1-854924-5 Aug 30 03:44:40.240095 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b09758e4-a1bd-45bc-a05a-57e2d2ffe921 req-ff60e449-3e98-4f14-b6a5-af0d1e8120a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118025 Aug 30 03:44:40.241277 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2091/4123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:40.266880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:40.268057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:40.311058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:40.311750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:40.323245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:40.324971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:40.325679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:40.326331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:40.529546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:40.530793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:40.533038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:40.550289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:40.555293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:40.556040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:40.556933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:40.557589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:40.560120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:40.692484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:40.693297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:40.706311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:40.706966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lazy-loading 'fault' on Instance uuid f959cab0-e17b-4234-8fe0-622e9082efbe {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:44:40.921948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:40.965540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:40.974422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea929c1a-9f7d-41ff-88a8-e141b94adbd8 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 200 len: 1311 microversion: 2.1 time: 0.451131 Aug 30 03:44:40.978622 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2092/4124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:40 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 1311 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:40.995379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:41.007973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b626872-e385-42c8-9099-01e8cf20ed38 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1467 microversion: 2.1 time: 0.748290 Aug 30 03:44:41.016965 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2033/4125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:40 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1467 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:41.999779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:42.000983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: f959cab0-e17b-4234-8fe0-622e9082efbe] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:42.034340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.045133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:42.046445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.047058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.047962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.048753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.049362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.053929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:42.069088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.075505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.081135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.084653 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] HTTP exception thrown: Instance f959cab0-e17b-4234-8fe0-622e9082efbe could not be found. Aug 30 03:44:42.085639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.086385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.086991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Request method failure captured: Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe HTTP/1.1 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYdCCkvA6xz823oDjJfYbcKX3dhBFnysGnkgtjsEe7D_2I_i7j7hQIYmnuLfngzEaIoiqz_3npbSCKvp9wmt2TjC1Pnt08QkxwMnH7TTiSKtJSnZD8aJMvg_dkTxjtnp_3jY_cqX5BWgOj7_N9Av1rkW1ZQYATuWggCUaSAmDZkyMjU Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1b3cf8d76fba40b296de4f021faebd37 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1b3cf8d76fba40b296de4f021faebd37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1b3cf8d76fba40b296de4f021faebd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1b3cf8d76fba40b296de4f021faebd37", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1b3cf8d76fba40b296de4f021faebd37"}]}] Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1b3cf8d76fba40b296de4f021faebd37 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ListServerFiltersTestJSON-2027699577-project Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: e772fa68b30842b3b97fbc3796651bf2 Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ListServerFiltersTestJSON-2027699577-project Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f959cab0-e17b-4234-8fe0-622e9082efbe could not be found. Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f959cab0-e17b-4234-8fe0-622e9082efbe'} Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f959cab0-e17b-4234-8fe0-622e9082efbe could not be found. Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f959cab0-e17b-4234-8fe0-622e9082efbe could not be found. Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:42.088580 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f959cab0-e17b-4234-8fe0-622e9082efbe could not be found. Aug 30 03:44:42.094099 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:42.097098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Returning 404 to user: Instance f959cab0-e17b-4234-8fe0-622e9082efbe could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:42.098528 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fdf48fac-ff56-4933-84ff-b13ec5cbc84a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe" status: 404 len: 111 microversion: 2.1 time: 0.106733 Aug 30 03:44:42.109580 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2093/4126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:41 2022] GET /compute/v2.1/servers/f959cab0-e17b-4234-8fe0-622e9082efbe => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:42.116139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:42.117301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:42.128098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.128952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.129569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.131851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.132527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.134584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.185828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:42.201178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.205946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.206505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.213614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lazy-loading 'fault' on Instance uuid 60fc9719-d228-445b-a2cf-2290906c266d {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:44:42.305251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:42.322261 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7141fbf-e0e6-4b30-8718-083de5fb716e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 200 len: 1305 microversion: 2.1 time: 0.281488 Aug 30 03:44:42.325564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2034/4127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:42 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 1305 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:42.347710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=10 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:42.398576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4732eca4-df1c-4ae6-ab4b-05fbba52caad req-a37c6620-686d-4bcd-829c-03dfdb54ca6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fc9719-d228-445b-a2cf-2290906c266d", "name": "network-vif-deleted", "tag": "2de6fbbe-e94a-4897-99c8-73c2f47a451a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:42.420534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4732eca4-df1c-4ae6-ab4b-05fbba52caad req-a37c6620-686d-4bcd-829c-03dfdb54ca6d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.440687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4732eca4-df1c-4ae6-ab4b-05fbba52caad req-a37c6620-686d-4bcd-829c-03dfdb54ca6d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.443102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4732eca4-df1c-4ae6-ab4b-05fbba52caad req-a37c6620-686d-4bcd-829c-03dfdb54ca6d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.489928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4732eca4-df1c-4ae6-ab4b-05fbba52caad req-a37c6620-686d-4bcd-829c-03dfdb54ca6d service nova] Creating event network-vif-deleted:2de6fbbe-e94a-4897-99c8-73c2f47a451a for instance 60fc9719-d228-445b-a2cf-2290906c266d on n-h2-854924-5 Aug 30 03:44:42.491055 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-368b8863-db1b-4e48-abd6-f304389c7e20 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 204 len: 0 microversion: 2.1 time: 0.379462 Aug 30 03:44:42.491859 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2094/4128] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:42 2022] DELETE /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:44:42.516276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:42.517773 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4732eca4-df1c-4ae6-ab4b-05fbba52caad req-a37c6620-686d-4bcd-829c-03dfdb54ca6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126792 Aug 30 03:44:42.518036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:42.522021 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2035/4129] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 03:44:42.551352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.551631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.563386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:42.564157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:42.564639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:42.565078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:43.109919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:43.130090 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-123c6090-9138-4d78-aada-1628fe6c39b5 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 200 len: 1518 microversion: 2.1 time: 0.627235 Aug 30 03:44:43.132346 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2095/4130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:42 2022] GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 1518 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:43.350401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:43.351308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 60fc9719-d228-445b-a2cf-2290906c266d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:43.368254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:43.373764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:43.374469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:43.376675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:43.377409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:43.378080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:43.413359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] HTTP exception thrown: Instance 60fc9719-d228-445b-a2cf-2290906c266d could not be found. Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Request method failure captured: Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d HTTP/1.1 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSkRC7mvkSSQ1lX1xKrSIA6Mubx5KergXQoT7nSfZnNaFWcMfzumDAn7wYyYOFqXeGHWyB4zT_yXjaxq2zRFexhg_11fod4ch6JVlvqHzSRWHzvT3St1wbgClIcK8DYiIMjJB63vYlwtbk-27QA_Mt0S9ZgP694Yhodf7lAyPf0ZYk Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34b80862ddfb408fb212f9bd047a292a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}] Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a681b194cdb24b6fbb49eb39711ffa1c Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 60fc9719-d228-445b-a2cf-2290906c266d could not be found. Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '60fc9719-d228-445b-a2cf-2290906c266d'} Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fc9719-d228-445b-a2cf-2290906c266d could not be found. Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fc9719-d228-445b-a2cf-2290906c266d could not be found. Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:43.415606 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fc9719-d228-445b-a2cf-2290906c266d could not be found. Aug 30 03:44:43.420071 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:43.425059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Returning 404 to user: Instance 60fc9719-d228-445b-a2cf-2290906c266d could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:43.425059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92633d19-c672-4ff6-9477-08e1727ec8da tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d" status: 404 len: 111 microversion: 2.1 time: 0.080631 Aug 30 03:44:43.426544 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2036/4131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:43 2022] GET /compute/v2.1/servers/60fc9719-d228-445b-a2cf-2290906c266d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:43.435509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:43.436114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:43.455523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:43.457383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:43.459952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:43.460732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:43.466157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:43.466599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:43.545054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:43.636779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:43.750591 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bc45408-e605-4834-95fc-5744c3ff2075 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 204 len: 0 microversion: 2.1 time: 0.319647 Aug 30 03:44:43.751662 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2096/4132] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:43 2022] DELETE /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:44:43.760186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:43.760885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:43.782346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:43.783230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:43.785890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:43.787798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:43.789861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:43.792052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:44.170364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:44.173834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:44.187205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:44.187877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:44.188775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:44.190299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:44.190763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:44.191196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:44.796135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:44.808383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e802929d-9cfb-4dd4-ad22-ac2f00696450 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1508 microversion: 2.1 time: 1.052637 Aug 30 03:44:44.814809 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2037/4133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:43 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1508 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:45.718271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a7bc886a-aa2a-461f-817e-aba455a69a4a req-59469d25-8801-48b2-8351-7d0ac56e12ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5bd277-41fb-4592-b55b-356bd04eb9c4", "name": "network-vif-deleted", "tag": "dfbd7479-1472-40e5-a490-412db6b45e36"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:45.784091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7bc886a-aa2a-461f-817e-aba455a69a4a req-59469d25-8801-48b2-8351-7d0ac56e12ab service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:45.799177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7bc886a-aa2a-461f-817e-aba455a69a4a req-59469d25-8801-48b2-8351-7d0ac56e12ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:45.805981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7bc886a-aa2a-461f-817e-aba455a69a4a req-59469d25-8801-48b2-8351-7d0ac56e12ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:45.855084 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a7bc886a-aa2a-461f-817e-aba455a69a4a req-59469d25-8801-48b2-8351-7d0ac56e12ab service nova] Creating event network-vif-deleted:dfbd7479-1472-40e5-a490-412db6b45e36 for instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 on n-h2-854924-5 Aug 30 03:44:45.874327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a7bc886a-aa2a-461f-817e-aba455a69a4a req-59469d25-8801-48b2-8351-7d0ac56e12ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160685 Aug 30 03:44:45.877504 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2038/4134] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:45.883512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:45.888973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:45.891927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:45.892571 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f13c4ec9-49e1-4ab1-a231-9901652ae14b tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 200 len: 1518 microversion: 2.1 time: 1.739619 Aug 30 03:44:45.893168 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2097/4135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:44 2022] GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 1518 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:45.951891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:45.953587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:45.954051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:45.961099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:45.961642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:45.962426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:46.347095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-bceb3385-999b-4c51-bd2e-7e2d3901b292 req-5546334e-f09a-496c-991b-84e2384ffb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb1e090-dbc1-44bc-8496-ee675e4960f0", "name": "network-vif-deleted", "tag": "4e894a78-6f20-4251-8646-5dc37f92d806"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:46.381186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bceb3385-999b-4c51-bd2e-7e2d3901b292 req-5546334e-f09a-496c-991b-84e2384ffb1c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:46.390457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bceb3385-999b-4c51-bd2e-7e2d3901b292 req-5546334e-f09a-496c-991b-84e2384ffb1c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:46.391191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bceb3385-999b-4c51-bd2e-7e2d3901b292 req-5546334e-f09a-496c-991b-84e2384ffb1c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:46.401055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:46.416078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9473a36-07ad-4dd5-8370-f6801f1d8a43 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1466 microversion: 2.1 time: 0.530260 Aug 30 03:44:46.424465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2039/4136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:45 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1466 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:46.446098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-bceb3385-999b-4c51-bd2e-7e2d3901b292 req-5546334e-f09a-496c-991b-84e2384ffb1c service nova] Creating event network-vif-deleted:4e894a78-6f20-4251-8646-5dc37f92d806 for instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 on n-h2-854924-5 Aug 30 03:44:46.464997 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-bceb3385-999b-4c51-bd2e-7e2d3901b292 req-5546334e-f09a-496c-991b-84e2384ffb1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121642 Aug 30 03:44:46.466180 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2098/4137] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:44:46.932588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:46.933909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: 0d5bd277-41fb-4592-b55b-356bd04eb9c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:46.942264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:46.943100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:46.943782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:46.945203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:46.946243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:46.947128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:46.962688 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] HTTP exception thrown: Instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 could not be found. Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Request method failure captured: Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 HTTP/1.1 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdCCkvA6xz823oDjJfYbcKX3dhBFnysGnkgtjsEe7D_2I_i7j7hQIYmnuLfngzEaIoiqz_3npbSCKvp9wmt2TjC1Pnt08QkxwMnH7TTiSKtJSnZD8aJMvg_dkTxjtnp_3jY_cqX5BWgOj7_N9Av1rkW1ZQYATuWggCUaSAmDZkyMjU Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 1b3cf8d76fba40b296de4f021faebd37 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1b3cf8d76fba40b296de4f021faebd37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1b3cf8d76fba40b296de4f021faebd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1b3cf8d76fba40b296de4f021faebd37", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1b3cf8d76fba40b296de4f021faebd37"}]}] Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 1b3cf8d76fba40b296de4f021faebd37 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServerFiltersTestJSON-2027699577-project Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: e772fa68b30842b3b97fbc3796651bf2 Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServerFiltersTestJSON-2027699577-project Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 could not be found. Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '0d5bd277-41fb-4592-b55b-356bd04eb9c4'} Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 could not be found. Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 could not be found. Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:46.965515 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 could not be found. Aug 30 03:44:46.970133 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:46.972326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Returning 404 to user: Instance 0d5bd277-41fb-4592-b55b-356bd04eb9c4 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:46.973501 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4ab8a98f-8c2e-4059-a607-e0cac84e2faa tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4" status: 404 len: 111 microversion: 2.1 time: 0.060550 Aug 30 03:44:46.974294 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2040/4138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:46 2022] GET /compute/v2.1/servers/0d5bd277-41fb-4592-b55b-356bd04eb9c4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:46.985068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:46.985781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:47.003646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.004152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.004596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.005311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.005833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.006262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.077194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:47.311480 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c193d69a-f2e4-4601-bcd4-ce17b0faf4b0 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 204 len: 0 microversion: 2.1 time: 0.332283 Aug 30 03:44:47.312317 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2099/4139] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:46 2022] DELETE /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:44:47.324688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:47.329159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:47.345905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.347879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.349634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.351068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.352912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.354566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.450089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:47.463827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:47.490549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.499407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.500139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.501102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.502966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.503575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.605192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:47.606405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:47.607097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:47.607926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lazy-loading 'fault' on Instance uuid 4bb1e090-dbc1-44bc-8496-ee675e4960f0 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:44:47.852494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:47.877624 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d66dda67-2908-419f-ac99-6b2e892a3b83 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 200 len: 1305 microversion: 2.1 time: 0.430962 Aug 30 03:44:47.879443 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2100/4140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:47 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 1305 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:48.905609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:48.907827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 4bb1e090-dbc1-44bc-8496-ee675e4960f0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:48.930910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:48.931402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:48.931835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:48.935616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:48.936119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:48.938102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:48.986363 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] HTTP exception thrown: Instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 could not be found. Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Request method failure captured: Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 HTTP/1.1 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSkRC7mvkSSQ1lX1xKrSIA6Mubx5KergXQoT7nSfZnNaFWcMfzumDAn7wYyYOFqXeGHWyB4zT_yXjaxq2zRFexhg_11fod4ch6JVlvqHzSRWHzvT3St1wbgClIcK8DYiIMjJB63vYlwtbk-27QA_Mt0S9ZgP694Yhodf7lAyPf0ZYk Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34b80862ddfb408fb212f9bd047a292a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}] Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a681b194cdb24b6fbb49eb39711ffa1c Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 could not be found. Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '4bb1e090-dbc1-44bc-8496-ee675e4960f0'} Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 could not be found. Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 could not be found. Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:48.988160 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 could not be found. Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Returning 404 to user: Instance 4bb1e090-dbc1-44bc-8496-ee675e4960f0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:48.993105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4a2786d-0a01-4515-adc2-f63944f06712 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0" status: 404 len: 111 microversion: 2.1 time: 0.092924 Aug 30 03:44:49.015499 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2101/4141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:48 2022] GET /compute/v2.1/servers/4bb1e090-dbc1-44bc-8496-ee675e4960f0 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:49.021468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:49.022196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:49.046309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:49.053457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:49.054450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:49.055066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:49.058381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:49.060393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:49.064723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:49.088503 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9e985cf-d8c9-4595-82a1-cb7794f6664a tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1518 microversion: 2.1 time: 1.771881 Aug 30 03:44:49.089544 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2041/4142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:47 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1518 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:49.145929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:49.360860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c190abf2-456f-4109-8601-2539587429dd tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 204 len: 0 microversion: 2.1 time: 0.343847 Aug 30 03:44:49.361762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2102/4143] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:49 2022] DELETE /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:44:49.371151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:49.371786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:49.389605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:49.390601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:49.398014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:49.399044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:49.400312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:49.400912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:50.264588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37501c5a-d356-463c-a80a-f0fb751c9a99 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Action: 'create', calling method: .version_select at 0x7f897b70caf0>, body: {"keypair": {"name": "tempest-keypair-769916449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7us/QEfinHK6KpVJj2hLp4u0GvJvG54CX4JYE6Pf/qS4flvlOja1LWAHzZgbe22AvtaLYXTy01XgK2dqcxEuyB+VzrrTZCNSm4ldnlLMHuu3OvLIaP2o/bSPG3IpoXzg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:50.289085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-37501c5a-d356-463c-a80a-f0fb751c9a99 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Getting quotas for project 67f828a77110419e92ab1dbacc30ef11. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:44:50.297259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-37501c5a-d356-463c-a80a-f0fb751c9a99 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Getting quotas for user 4b12ad922f3d46c7bbf5d2879c6a63eb and project 67f828a77110419e92ab1dbacc30ef11. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:44:50.329021 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37501c5a-d356-463c-a80a-f0fb751c9a99 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.306290 Aug 30 03:44:50.336959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2103/4144] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:44:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:44:50.345078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:50.351681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:50.364870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:50.365829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:50.369267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:50.372450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:50.376279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:50.387087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:50.768341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:50.797618 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-97ad1bb9-4aa4-4d39-94e8-5d3442c2158b tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1496 microversion: 2.1 time: 1.412428 Aug 30 03:44:50.800663 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2042/4145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:49 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1496 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:51.497410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:51.532573 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-665b513a-55b2-429e-aeb3-889f7107f16e tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1518 microversion: 2.1 time: 1.193971 Aug 30 03:44:51.533402 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2104/4146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:50 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1518 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:51.820738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:51.822253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:51.829515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:51.844227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:51.845005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:51.845665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:51.849040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:51.851963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:51.852712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:51.928155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:44:52.558447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:52.559155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:52.584247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:52.585958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:52.586452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:52.592768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:52.595297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:52.595763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:52.817369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:52.828742 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5b79df7-c5ad-47d4-93a4-720043f74b5c tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1476 microversion: 2.1 time: 0.272219 Aug 30 03:44:52.843340 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2105/4147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:52 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:53.005622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:53.023978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e52f94a7-4c0d-4b4e-8587-a576bb71c4db tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1496 microversion: 2.1 time: 1.208149 Aug 30 03:44:53.032623 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2043/4148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:51 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1496 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:53.868546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:53.871482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:53.892174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:53.892683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:53.898223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:53.906985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:53.907591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:53.908307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:54.007564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d3b2f1b7-e18c-4927-9eaa-61d9bee6cfa8 req-a14ab5e8-d89c-4db0-b391-a04094ecfb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad47ef0-3fc1-45bb-b291-46eeb9d55717", "name": "network-vif-deleted", "tag": "58ededfe-7a19-45cd-8ce5-d8e76bcb9899"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:54.040256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d3b2f1b7-e18c-4927-9eaa-61d9bee6cfa8 req-a14ab5e8-d89c-4db0-b391-a04094ecfb6b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:54.040766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d3b2f1b7-e18c-4927-9eaa-61d9bee6cfa8 req-a14ab5e8-d89c-4db0-b391-a04094ecfb6b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:54.041269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d3b2f1b7-e18c-4927-9eaa-61d9bee6cfa8 req-a14ab5e8-d89c-4db0-b391-a04094ecfb6b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:54.074974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d3b2f1b7-e18c-4927-9eaa-61d9bee6cfa8 req-a14ab5e8-d89c-4db0-b391-a04094ecfb6b service nova] Creating event network-vif-deleted:58ededfe-7a19-45cd-8ce5-d8e76bcb9899 for instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 on n-h1-854924-5 Aug 30 03:44:54.083837 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d3b2f1b7-e18c-4927-9eaa-61d9bee6cfa8 req-a14ab5e8-d89c-4db0-b391-a04094ecfb6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228239 Aug 30 03:44:54.085091 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2044/4149] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:54.103891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:54.104948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:54.112474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:54.113271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:54.113923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:54.114842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:54.115549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:54.116168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:54.593373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:54.600659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e772fa68b30842b3b97fbc3796651bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b3cf8d76fba40b296de4f021faebd37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:54.607828 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c0ed223-f0bc-4e24-bc35-357d8400dbd1 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1454 microversion: 2.1 time: 0.507456 Aug 30 03:44:54.608601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2045/4150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:54 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1454 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:54.618085 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-352c3d06-5c1e-4116-8817-66c94774f74d tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 200 len: 1306 microversion: 2.1 time: 0.763940 Aug 30 03:44:54.623398 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2106/4151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:53 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 1306 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:54.628084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-10d506f0-9af5-4680-a49c-ea6078be3773 req-9d4c097b-e056-4e38-a9df-99eb9457b5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf21208-d87a-4ef0-b2a0-405d26661c6d", "name": "network-vif-deleted", "tag": "ee0895c9-832c-4a9a-90b6-bf5eeb4c5f42"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:54.683425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-10d506f0-9af5-4680-a49c-ea6078be3773 req-9d4c097b-e056-4e38-a9df-99eb9457b5ab service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:54.688787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-10d506f0-9af5-4680-a49c-ea6078be3773 req-9d4c097b-e056-4e38-a9df-99eb9457b5ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:54.690606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-10d506f0-9af5-4680-a49c-ea6078be3773 req-9d4c097b-e056-4e38-a9df-99eb9457b5ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:54.738848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-10d506f0-9af5-4680-a49c-ea6078be3773 req-9d4c097b-e056-4e38-a9df-99eb9457b5ab service nova] Creating event network-vif-deleted:ee0895c9-832c-4a9a-90b6-bf5eeb4c5f42 for instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d on n-h1-854924-5 Aug 30 03:44:54.761141 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-10d506f0-9af5-4680-a49c-ea6078be3773 req-9d4c097b-e056-4e38-a9df-99eb9457b5ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147097 Aug 30 03:44:54.768747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2046/4152] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:44:55.629923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:55.631069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:55.646221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:55.646994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] [instance: cad47ef0-3fc1-45bb-b291-46eeb9d55717] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:55.650933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:55.656837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:55.658151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:55.659244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:55.664438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:55.665092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:55.665647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:55.666609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:55.667256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:55.668965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:55.669899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:55.670617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:55.692071 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] HTTP exception thrown: Instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 could not be found. Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Request method failure captured: Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 HTTP/1.1 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYdCCkvA6xz823oDjJfYbcKX3dhBFnysGnkgtjsEe7D_2I_i7j7hQIYmnuLfngzEaIoiqz_3npbSCKvp9wmt2TjC1Pnt08QkxwMnH7TTiSKtJSnZD8aJMvg_dkTxjtnp_3jY_cqX5BWgOj7_N9Av1rkW1ZQYATuWggCUaSAmDZkyMjU Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 1b3cf8d76fba40b296de4f021faebd37 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1b3cf8d76fba40b296de4f021faebd37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1b3cf8d76fba40b296de4f021faebd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1b3cf8d76fba40b296de4f021faebd37", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1b3cf8d76fba40b296de4f021faebd37"}]}] Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 1b3cf8d76fba40b296de4f021faebd37 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2027699577 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ListServerFiltersTestJSON-2027699577-project Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: e772fa68b30842b3b97fbc3796651bf2 Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ListServerFiltersTestJSON-2027699577-project Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 could not be found. Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'cad47ef0-3fc1-45bb-b291-46eeb9d55717'} Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 could not be found. Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 could not be found. Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:55.700258 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 could not be found. Aug 30 03:44:55.706696 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:55.712086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] Returning 404 to user: Instance cad47ef0-3fc1-45bb-b291-46eeb9d55717 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:55.714195 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4f5c6f07-ba10-4aca-a34b-d5ca4dc2a775 tempest-ListServerFiltersTestJSON-2027699577 tempest-ListServerFiltersTestJSON-2027699577-project] 10.222.0.30 "GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717" status: 404 len: 111 microversion: 2.1 time: 0.073395 Aug 30 03:44:55.726432 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2047/4153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:55 2022] GET /compute/v2.1/servers/cad47ef0-3fc1-45bb-b291-46eeb9d55717 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:55.772235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:55.774271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:55.774880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:55.775627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lazy-loading 'fault' on Instance uuid 5cf21208-d87a-4ef0-b2a0-405d26661c6d {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:44:55.977190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:55.992318 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8183daf-a93f-47cf-bb88-b7c59f40de12 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 200 len: 1305 microversion: 2.1 time: 0.367452 Aug 30 03:44:55.995444 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2107/4154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:55 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:57.014045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:57.014666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: 5cf21208-d87a-4ef0-b2a0-405d26661c6d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:57.040982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:57.045698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:57.046464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:57.046796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-378269842", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5255afcc-3cea-4067-a18c-f20809522151"}], "security_groups": [{"name": "tempest-securitygroup--727651223"}], "key_name": "tempest-keypair-832018515", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ae82f12c-b2e9-4773-bb76-ee33f66e85aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:44:57.051015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:57.051508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:57.051949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:57.108097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] HTTP exception thrown: Instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d could not be found. Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Request method failure captured: Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d HTTP/1.1 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYSkRC7mvkSSQ1lX1xKrSIA6Mubx5KergXQoT7nSfZnNaFWcMfzumDAn7wYyYOFqXeGHWyB4zT_yXjaxq2zRFexhg_11fod4ch6JVlvqHzSRWHzvT3St1wbgClIcK8DYiIMjJB63vYlwtbk-27QA_Mt0S9ZgP694Yhodf7lAyPf0ZYk Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34b80862ddfb408fb212f9bd047a292a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}] Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a681b194cdb24b6fbb49eb39711ffa1c Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d could not be found. Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '5cf21208-d87a-4ef0-b2a0-405d26661c6d'} Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d could not be found. Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d could not be found. Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:44:57.110341 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d could not be found. Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Returning 404 to user: Instance 5cf21208-d87a-4ef0-b2a0-405d26661c6d could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-88defb23-583d-4a9e-896c-22585935bde8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d" status: 404 len: 111 microversion: 2.1 time: 0.102175 Aug 30 03:44:57.116591 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2048/4155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:57 2022] GET /compute/v2.1/servers/5cf21208-d87a-4ef0-b2a0-405d26661c6d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:44:57.124956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:57.125491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:57.141726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:57.142235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:57.144756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:57.145570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:57.146032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:57.149833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:57.204077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:44:57.327199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4ede652-db09-402c-9f71-38f7abbe4392 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 204 len: 0 microversion: 2.1 time: 0.207411 Aug 30 03:44:57.330224 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2049/4156] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:44:57 2022] DELETE /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:44:57.340310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:57.341653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:57.349603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:57.350333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:57.351303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:57.352162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:57.352772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:57.353531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:57.564651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] validate_networks() for [('5255afcc-3cea-4067-a18c-f20809522151', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:44:58.614225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:44:58.624159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2674309-3cf8-4ab5-a199-7c11d5d4d9a8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1676 microversion: 2.1 time: 1.289132 Aug 30 03:44:58.630194 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2050/4157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:57 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1676 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:44:59.655326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:44:59.656000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:44:59.670616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:59.675410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:59.676072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:44:59.676976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:44:59.678573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:44:59.680618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:00.307629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:01.153160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:01.170199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e9ad584f-86cb-490c-a961-f20491607467 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1676 microversion: 2.1 time: 1.518247 Aug 30 03:45:01.171418 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2051/4158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:44:59 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1676 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:01.853995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Getting quotas for project 84abd5de7b764865b2f47938cb4a1f77. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:01.879142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Getting quotas for user 82f00437d34c4a61a31742cd14848630 and project 84abd5de7b764865b2f47938cb4a1f77. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:01.931721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:45:01.932361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:45:01.932954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:45:01.938653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:45:01.942153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:45:01.971660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:01.976224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:01.976806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:01.977739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:01.983128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:01.983698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:02.066230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Getting quotas for project 84abd5de7b764865b2f47938cb4a1f77. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:02.092745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Getting quotas for user 82f00437d34c4a61a31742cd14848630 and project 84abd5de7b764865b2f47938cb4a1f77. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:02.193991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:02.194767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:02.212545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:02.216214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:02.217798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:02.218810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:02.219980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:02.221377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:02.243109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:45:02.245881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae82f12c-b2e9-4773-bb76-ee33f66e85aa',volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:45:02.539275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-543e0b26-9dae-439f-9c51-bc944f218c0c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.499201 Aug 30 03:45:02.546712 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2108/4159] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:44:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 5507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:45:02.557804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b414e4e-b124-43c1-9cca-c97ce56f5770 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:02.558676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b414e4e-b124-43c1-9cca-c97ce56f5770 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:02.568865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:03.570886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b414e4e-b124-43c1-9cca-c97ce56f5770 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:03.576346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:03.581924 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b414e4e-b124-43c1-9cca-c97ce56f5770 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1120 microversion: 2.1 time: 1.031930 Aug 30 03:45:03.583042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2109/4160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:02 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1120 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:03.603137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c4ff441-1322-4798-bc44-6c0009424cd8 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1609 microversion: 2.1 time: 1.414933 Aug 30 03:45:03.604080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2052/4161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:02 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1609 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:03.773766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c80b2ee1-c083-4e04-bcf2-607d7c3c7b8a req-02cbc04a-1dcc-48fc-8135-5f4a91ba42be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5", "name": "network-vif-deleted", "tag": "e6f1a120-d205-4e76-a5ab-0f563ec4e837"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:03.788280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c80b2ee1-c083-4e04-bcf2-607d7c3c7b8a req-02cbc04a-1dcc-48fc-8135-5f4a91ba42be service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:03.789004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c80b2ee1-c083-4e04-bcf2-607d7c3c7b8a req-02cbc04a-1dcc-48fc-8135-5f4a91ba42be service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:03.789815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c80b2ee1-c083-4e04-bcf2-607d7c3c7b8a req-02cbc04a-1dcc-48fc-8135-5f4a91ba42be service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:03.817175 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c80b2ee1-c083-4e04-bcf2-607d7c3c7b8a req-02cbc04a-1dcc-48fc-8135-5f4a91ba42be service nova] Creating event network-vif-deleted:e6f1a120-d205-4e76-a5ab-0f563ec4e837 for instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 on n-h1-854924-5 Aug 30 03:45:03.825097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c80b2ee1-c083-4e04-bcf2-607d7c3c7b8a req-02cbc04a-1dcc-48fc-8135-5f4a91ba42be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056173 Aug 30 03:45:03.827010 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2110/4162] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:04.327244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-904187385", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d88af88e-d5b5-4179-a676-95f15a9fd93d"}], "security_groups": [{"name": "tempest-securitygroup--1933594793"}], "key_name": "tempest-keypair-769916449", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:04.559344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] validate_networks() for [('d88af88e-d5b5-4179-a676-95f15a9fd93d', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:45:04.607361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:04.608696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:04.626763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:04.633219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:04.634142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:04.634904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:04.635523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:04.636102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:04.873882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:04.895372 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc95cae3-df01-481e-ab63-34d7e70ad332 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1218 microversion: 2.1 time: 0.294147 Aug 30 03:45:04.896188 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2111/4163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:04 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:04.914465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:04.915767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:04.924569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:04.925556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:04.926175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:04.927226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:04.928086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:04.928785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:04.984997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:04.985869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:04.986534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:04.987390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lazy-loading 'fault' on Instance uuid b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:45:05.327956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a681b194cdb24b6fbb49eb39711ffa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b80862ddfb408fb212f9bd047a292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:05.338008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-04f4ae32-61ae-443e-b735-c75a42a7fe5e tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 200 len: 1328 microversion: 2.1 time: 0.437808 Aug 30 03:45:05.339029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2112/4164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:04 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 1328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:05.917258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:05.919788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:05.943627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:05.944481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:05.945674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:05.947498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:05.948243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:05.948933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:06.010497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:06.323476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:06.334107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f4abba8-9b44-4435-af57-73ec7992dcbb tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1236 microversion: 2.1 time: 0.421519 Aug 30 03:45:06.335629 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2113/4165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:05 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1236 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:06.369878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:06.371305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] [instance: b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:06.379086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:06.379801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:06.380392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:06.381271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:06.382209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:06.382790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:06.400629 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] HTTP exception thrown: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 could not be found. Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Request method failure captured: Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 HTTP/1.1 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYSkRC7mvkSSQ1lX1xKrSIA6Mubx5KergXQoT7nSfZnNaFWcMfzumDAn7wYyYOFqXeGHWyB4zT_yXjaxq2zRFexhg_11fod4ch6JVlvqHzSRWHzvT3St1wbgClIcK8DYiIMjJB63vYlwtbk-27QA_Mt0S9ZgP694Yhodf7lAyPf0ZYk Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34b80862ddfb408fb212f9bd047a292a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34b80862ddfb408fb212f9bd047a292a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34b80862ddfb408fb212f9bd047a292a"}]}] Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-729372994 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 34b80862ddfb408fb212f9bd047a292a Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-729372994 Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a681b194cdb24b6fbb49eb39711ffa1c Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-729372994-project Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 could not be found. Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5'} Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 could not be found. Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 could not be found. Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:45:06.404363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 could not be found. Aug 30 03:45:06.409142 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:06.410663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Returning 404 to user: Instance b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:45:06.411690 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-11819124-769f-4948-9a6a-941abe8d0150 tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5" status: 404 len: 111 microversion: 2.1 time: 0.051289 Aug 30 03:45:06.416372 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2114/4166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:06 2022] GET /compute/v2.1/servers/b1bcf7b4-74e8-4d0b-9e13-17879c4b2ee5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:45:06.432230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ed8781a-56ae-4bb8-9f89-046bc525680f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] Calling method '.version_select at 0x7f897b8979d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:06.499579 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ed8781a-56ae-4bb8-9f89-046bc525680f tempest-ServerActionsTestJSON-729372994 tempest-ServerActionsTestJSON-729372994-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550249929" status: 202 len: 0 microversion: 2.1 time: 0.081825 Aug 30 03:45:06.501822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2115/4167] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550249929 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:45:07.359647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:07.361642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:07.385268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:07.386708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:07.389690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:07.395055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:07.397744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:07.399283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:07.765773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:07.779049 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1236 microversion: 2.1 time: 0.426736 Aug 30 03:45:07.779960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2116/4168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:07 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1236 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:08.326348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:08.327344 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53a2c3db-d809-4c50-9e00-807f2c97efb0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001352 Aug 30 03:45:08.327689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2117/4169] 10.222.0.30 () {56 vars in 886 bytes} [Tue Aug 30 03:45:08 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 30 03:45:08.458520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Getting quotas for project 67f828a77110419e92ab1dbacc30ef11. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:08.486767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Getting quotas for user 4b12ad922f3d46c7bbf5d2879c6a63eb and project 67f828a77110419e92ab1dbacc30ef11. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:08.541558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:45:08.541987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:45:08.542464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:45:08.542998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:45:08.543413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:45:08.579959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:08.580458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:08.580901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:08.599441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:08.600230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:08.600858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:08.661063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Getting quotas for project 67f828a77110419e92ab1dbacc30ef11. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:08.670622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Getting quotas for user 4b12ad922f3d46c7bbf5d2879c6a63eb and project 67f828a77110419e92ab1dbacc30ef11. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:08.707140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:45:08.715824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:45:08.808555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:08.810351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:08.823269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:08.823772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:08.824228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:08.824927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:08.825977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:08.826411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:08.842193 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5bc3994a-2e87-4c36-83bf-57d60a57a7c2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.519962 Aug 30 03:45:08.842863 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2053/4170] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:45:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 4521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:45:08.858860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f300af75-30e7-4b06-b725-f4c6a7ca1834 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:08.859733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f300af75-30e7-4b06-b725-f4c6a7ca1834 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:09.061966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f300af75-30e7-4b06-b725-f4c6a7ca1834 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:09.073834 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f300af75-30e7-4b06-b725-f4c6a7ca1834 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1268 microversion: 2.1 time: 0.223222 Aug 30 03:45:09.074525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2054/4171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:08 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:09.198435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:09.211962 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-97faa541-a4b2-40a5-b046-0adf1c074d0a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1236 microversion: 2.1 time: 0.407348 Aug 30 03:45:09.212590 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2118/4172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:08 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1236 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:10.097039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:10.098971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:10.115514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:10.120139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:10.121788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:10.122662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:10.124365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:10.124981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:10.237016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:10.238350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:10.269657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:10.278871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:10.279712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:10.283788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:10.285694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:10.287822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:11.302088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:11.335810 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d2a8a38-a7fd-4221-8e65-893bfb81b6ec tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1272 microversion: 2.1 time: 1.242526 Aug 30 03:45:11.338412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:11.339759 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2055/4173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:10 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1272 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:11.371837 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6051436e-9832-4291-8940-85159d9b6b7c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1236 microversion: 2.1 time: 1.136650 Aug 30 03:45:11.375690 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2119/4174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:10 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1236 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:12.367928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:12.371805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:12.400323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:12.402430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:12.405326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:12.408127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:12.408627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:12.414431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:12.416168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:12.424478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:12.425310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:12.433837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:12.433837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:12.436473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:12.437534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:12.438180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:12.438826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:12.764522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:12.793747 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32209052-26aa-4404-939b-91dd536a577f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1326 microversion: 2.1 time: 0.430322 Aug 30 03:45:12.801520 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2056/4175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:12 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1326 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:13.491122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:13.516208 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42478beb-132f-491d-995e-a66c3969db9b tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1303 microversion: 2.1 time: 1.119810 Aug 30 03:45:13.518507 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2120/4176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:12 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1303 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:13.817090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:13.817746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:13.827340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:13.828082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:13.828733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:13.829756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:13.831312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:13.832559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:14.534317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:14.541283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:14.542157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:14.558307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:14.558811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:14.566072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:14.575918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:14.578564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:14.582181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:14.662421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:14.686322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef9ca36f-ad6e-49dd-81b0-bb162aa5810b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1326 microversion: 2.1 time: 0.869326 Aug 30 03:45:14.687105 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2057/4177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:13 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1326 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:15.334500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:15.346371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc791af4-a52b-43cd-ae4e-1ff497717733 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1303 microversion: 2.1 time: 0.811854 Aug 30 03:45:15.362812 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2121/4178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:14 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1303 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:15.713940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:15.715313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:15.723347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:15.736845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:15.738727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:15.739647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:15.740300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:15.740899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:16.130636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:16.143309 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc3e9e8a-ff6d-4295-ab98-a49908788e60 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1326 microversion: 2.1 time: 0.433064 Aug 30 03:45:16.144596 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2058/4179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:15 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1326 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:16.368497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:16.369224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:16.385513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:16.386093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:16.387875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:16.398014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:16.398629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:16.399229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:17.161990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:17.169553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:17.170171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:17.173430 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a947ea6-c603-4c78-ba17-d948b1eed151 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1303 microversion: 2.1 time: 0.808969 Aug 30 03:45:17.176441 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2122/4180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:16 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1303 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:17.194395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:17.198017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:17.200662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:17.201767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:17.205064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:17.206010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:18.196629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:18.197377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:18.212448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:18.212949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:18.216880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:18.220901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:18.222091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:18.222547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:18.634724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:19.067037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:20.199604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:20.216896 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-09ae9d79-ca49-4fa0-bb0c-daa2894decbc tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 3.052187 Aug 30 03:45:20.222777 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2059/4181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:17 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 3058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:20.472049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-95488be9-ba3e-4e69-bf16-488f5a55b782 req-f55b8936-08af-48f3-9997-5b7d94d06969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc14771a-3fcd-4efd-a98e-bff65e28aeb3", "tag": "5ad9b982-31cf-4f92-8d39-a1510a67f160"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:20.494505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-95488be9-ba3e-4e69-bf16-488f5a55b782 req-f55b8936-08af-48f3-9997-5b7d94d06969 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:20.495002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-95488be9-ba3e-4e69-bf16-488f5a55b782 req-f55b8936-08af-48f3-9997-5b7d94d06969 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:20.495443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-95488be9-ba3e-4e69-bf16-488f5a55b782 req-f55b8936-08af-48f3-9997-5b7d94d06969 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:20.527616 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-95488be9-ba3e-4e69-bf16-488f5a55b782 req-f55b8936-08af-48f3-9997-5b7d94d06969 service nova] Creating event network-changed:5ad9b982-31cf-4f92-8d39-a1510a67f160 for instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 on n-h1-854924-5 Aug 30 03:45:20.540358 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-95488be9-ba3e-4e69-bf16-488f5a55b782 req-f55b8936-08af-48f3-9997-5b7d94d06969 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072070 Aug 30 03:45:20.540750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:20.542338 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2060/4182] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:20.553645 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-97a8013b-fa4b-4177-8a3e-586c0e82e6b0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1303 microversion: 2.1 time: 2.361758 Aug 30 03:45:20.556784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2123/4183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:18 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1303 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:21.256516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:21.259736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:21.282419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:21.283301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:21.283891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:21.284912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:21.285591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:21.286168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:21.585046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:21.587767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:21.618519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:21.631649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:21.632367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:21.633504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:21.636414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:21.638949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:22.429679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:22.451881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:22.473828 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c01eca11-59dc-4b36-9d77-cb0d0f4c5a87 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 1.230266 Aug 30 03:45:22.475773 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2061/4184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:21 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:22.614969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-762c6c5d-02fe-4026-8bf4-39c30efc339f req-091c5b0b-dcbf-4364-ac7c-6627882e2a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f8a9a8-34d3-4023-98d1-f00924dd5716", "tag": "c0be39b6-6ead-481a-83dc-102f0759dcf9"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:22.624941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:22.636385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-762c6c5d-02fe-4026-8bf4-39c30efc339f req-091c5b0b-dcbf-4364-ac7c-6627882e2a87 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:22.637462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-762c6c5d-02fe-4026-8bf4-39c30efc339f req-091c5b0b-dcbf-4364-ac7c-6627882e2a87 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:22.639869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-762c6c5d-02fe-4026-8bf4-39c30efc339f req-091c5b0b-dcbf-4364-ac7c-6627882e2a87 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:22.662756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-762c6c5d-02fe-4026-8bf4-39c30efc339f req-091c5b0b-dcbf-4364-ac7c-6627882e2a87 service nova] Creating event network-changed:c0be39b6-6ead-481a-83dc-102f0759dcf9 for instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 on n-h2-854924-5 Aug 30 03:45:22.674622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-762c6c5d-02fe-4026-8bf4-39c30efc339f req-091c5b0b-dcbf-4364-ac7c-6627882e2a87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066219 Aug 30 03:45:22.679640 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2062/4185] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:22.693933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:22.711870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-abdc6d88-8204-43f7-b165-a40725404e8a tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 1.133755 Aug 30 03:45:22.713226 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2124/4186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:21 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:23.499685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:23.500323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:23.529181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:23.529734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:23.530184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:23.530907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:23.533068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:23.535154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:23.735332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:23.735981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:23.754293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:23.754700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:23.755143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:23.755863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:23.756321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:23.764844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:24.567638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:24.577008 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6799fd10-766c-44e1-9ae1-ac3481e22939 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 1.082991 Aug 30 03:45:24.588863 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2063/4187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:23 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:24.686577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:24.710120 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b51a1c26-0bfc-48cd-a56a-2f0e3d362d34 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 0.979728 Aug 30 03:45:24.729006 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2125/4188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:23 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:25.613737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:25.615308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:25.656464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:25.658549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:25.660927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:25.662218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:25.663396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:25.664068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:25.750147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:25.750987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:25.769718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:25.772985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:25.773699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:25.775400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:25.776149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:25.776807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:27.059296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:27.077383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e0a460c-62e5-460d-9921-551e8d1cb304 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 1.472006 Aug 30 03:45:27.107931 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2064/4189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:25 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:27.131730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:27.149674 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7385e040-62c8-4e7b-acbb-b65178cfd558 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 1.403808 Aug 30 03:45:27.173614 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2126/4190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:25 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:28.123234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:28.124413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:28.150957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:28.152434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:28.153921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:28.155354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:28.157671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:28.170555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:28.185620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:28.187558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:28.242943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:28.244098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:28.245140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:28.246789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:28.247873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:28.248834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:29.204093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:29.219041 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c657775-8db3-4560-bd78-7a038589b626 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 1.042337 Aug 30 03:45:29.219799 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2127/4191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:28 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:29.242151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:29.259137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b178c03-4d68-486d-8726-1b9e5885b372 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 1.155508 Aug 30 03:45:29.264474 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2065/4192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:28 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:30.248986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:30.249731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:30.262818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:30.275005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:30.275710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:30.279147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:30.280032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:30.280834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:30.438000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-166c8296-405d-487d-bd35-4ccb1a225186 req-846991ef-b05b-4398-931b-124e5fa2ad4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc14771a-3fcd-4efd-a98e-bff65e28aeb3", "name": "network-vif-plugged", "status": "completed", "tag": "5ad9b982-31cf-4f92-8d39-a1510a67f160"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:30.461377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-166c8296-405d-487d-bd35-4ccb1a225186 req-846991ef-b05b-4398-931b-124e5fa2ad4e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:30.461769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-166c8296-405d-487d-bd35-4ccb1a225186 req-846991ef-b05b-4398-931b-124e5fa2ad4e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:30.462081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-166c8296-405d-487d-bd35-4ccb1a225186 req-846991ef-b05b-4398-931b-124e5fa2ad4e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:30.491087 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-166c8296-405d-487d-bd35-4ccb1a225186 req-846991ef-b05b-4398-931b-124e5fa2ad4e service nova] Creating event network-vif-plugged:5ad9b982-31cf-4f92-8d39-a1510a67f160 for instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 on n-h1-854924-5 Aug 30 03:45:30.499498 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-166c8296-405d-487d-bd35-4ccb1a225186 req-846991ef-b05b-4398-931b-124e5fa2ad4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406329 Aug 30 03:45:30.501417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2128/4193] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:30.511298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:30.512043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:30.531573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:30.532078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:30.532525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:30.533274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:30.533781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:30.534212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:30.837516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:30.850456 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-28a66ca1-2de8-4a24-98d2-473cefd8b5af tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 0.605641 Aug 30 03:45:30.862749 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2066/4194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:30 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:30.970683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:30.979189 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a643fd82-27ae-4cd6-aff2-b1c24a0d822b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 0.476619 Aug 30 03:45:30.983318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a532b74-7908-4ab0-8165-73fd5084ee43 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Action: 'create', calling method: .version_select at 0x7f897a777e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1643797083", "policies": ["affinity"]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:30.998215 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2129/4195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:30 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:31.031188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4a532b74-7908-4ab0-8165-73fd5084ee43 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.049446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4a532b74-7908-4ab0-8165-73fd5084ee43 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.122219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4a532b74-7908-4ab0-8165-73fd5084ee43 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.129374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4a532b74-7908-4ab0-8165-73fd5084ee43 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.147969 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a532b74-7908-4ab0-8165-73fd5084ee43 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.278853 Aug 30 03:45:31.156280 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2067/4196] 10.222.0.30 () {60 vars in 1174 bytes} [Tue Aug 30 03:45:30 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:31.159875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4d978f6-31b2-444d-b7a4-5127408a8d11 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Action: 'create', calling method: .version_select at 0x7f897bb53dc0>, body: {"server_group": {"name": "tempest-server-group-438531182", "policies": ["affinity"]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:31.179314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f4d978f6-31b2-444d-b7a4-5127408a8d11 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.186749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f4d978f6-31b2-444d-b7a4-5127408a8d11 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.248418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f4d978f6-31b2-444d-b7a4-5127408a8d11 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.254728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f4d978f6-31b2-444d-b7a4-5127408a8d11 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.271451 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4d978f6-31b2-444d-b7a4-5127408a8d11 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.115320 Aug 30 03:45:31.284447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e9507875-a499-4be7-93b3-1f05a2b2bcb9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Action: 'create', calling method: .version_select at 0x7f897adea9d0>, body: {"server_group": {"name": "tempest-server-group-438531182", "policies": ["affinity"]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:31.290594 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2130/4197] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Aug 30 03:45:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:31.327154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e9507875-a499-4be7-93b3-1f05a2b2bcb9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.335061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e9507875-a499-4be7-93b3-1f05a2b2bcb9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.390645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e9507875-a499-4be7-93b3-1f05a2b2bcb9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.396871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e9507875-a499-4be7-93b3-1f05a2b2bcb9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.412711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e9507875-a499-4be7-93b3-1f05a2b2bcb9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.132566 Aug 30 03:45:31.424510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eee48561-a905-4270-86d8-4b017a6a3930 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:31.431580 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2068/4198] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Aug 30 03:45:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:31.459878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eee48561-a905-4270-86d8-4b017a6a3930 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/df6bf48e-793c-4b67-8791-49858ceba9e6" status: 204 len: 0 microversion: 2.1 time: 0.039444 Aug 30 03:45:31.472579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:31.473425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:31.480135 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2131/4199] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:45:31 2022] DELETE /compute/v2.1/os-server-groups/df6bf48e-793c-4b67-8791-49858ceba9e6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:45:31.489130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-87462887-fbd9-4108-80c5-7c8772c2a670 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:31.493778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:31.495029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:31.495651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:31.497135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:31.498844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:31.501489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:31.521437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-87462887-fbd9-4108-80c5-7c8772c2a670 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.039759 Aug 30 03:45:31.524551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2132/4200] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:45:31 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:31.540624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12479527-b599-4c61-8b7c-58792927746a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:31.602503 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12479527-b599-4c61-8b7c-58792927746a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/10964171-020b-4bac-bc2c-c04e65560511" status: 204 len: 0 microversion: 2.1 time: 0.068954 Aug 30 03:45:31.603897 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2133/4201] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:45:31 2022] DELETE /compute/v2.1/os-server-groups/10964171-020b-4bac-bc2c-c04e65560511 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:45:31.618806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b6789fc-8819-4820-8626-637facbc8507 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:31.651669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b6789fc-8819-4820-8626-637facbc8507 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038486 Aug 30 03:45:31.652559 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2134/4202] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:45:31 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:31.665052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76a5013d-8a90-429f-960d-2b333ed57b62 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Action: 'create', calling method: .version_select at 0x7f897b5351f0>, body: {"server_group": {"name": "tempest-server-group-1668138833", "policies": ["affinity"]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:31.693817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lazy-loading 'services' on Instance uuid e72b9fc7-5a88-4419-a22a-53f569b4d111 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:45:31.728538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-76a5013d-8a90-429f-960d-2b333ed57b62 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.735235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-76a5013d-8a90-429f-960d-2b333ed57b62 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.752099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:31.833683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-76a5013d-8a90-429f-960d-2b333ed57b62 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:31.857038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-76a5013d-8a90-429f-960d-2b333ed57b62 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:31.866934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae15a952-c8d1-4c97-a22f-3018f1f7c0a6 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111/os-volume_attachments/f01a6265-56f2-40e3-9ba0-7c1dd706455f" status: 202 len: 0 microversion: 2.1 time: 0.401113 Aug 30 03:45:31.868003 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2069/4203] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:45:31 2022] DELETE /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111/os-volume_attachments/f01a6265-56f2-40e3-9ba0-7c1dd706455f => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:45:31.901945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:31.911555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:31.933180 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76a5013d-8a90-429f-960d-2b333ed57b62 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.271966 Aug 30 03:45:31.935649 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2135/4204] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Aug 30 03:45:31 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:45:31.942406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:31.943209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:31.944545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:31.953131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:31.955499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:31.959337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:31.969704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0206f9fd-7cd0-4374-9ddb-2beeaa7794ae tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:32.046268 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0206f9fd-7cd0-4374-9ddb-2beeaa7794ae tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/65d574ac-c31f-4b10-a050-4f1ea4f2fc0e" status: 204 len: 0 microversion: 2.1 time: 0.104546 Aug 30 03:45:32.047631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2136/4205] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:45:31 2022] DELETE /compute/v2.1/os-server-groups/65d574ac-c31f-4b10-a050-4f1ea4f2fc0e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:45:32.061473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:32.062367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:32.076849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:32.077561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:32.078332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:32.079957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:32.080975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:32.081830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:32.683934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:32.688643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:32.699160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ef4780a-364b-4026-93a4-3b1e328fbb8b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1394 microversion: 2.1 time: 0.647364 Aug 30 03:45:32.699805 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2137/4206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:32 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1394 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:32.713810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0cbe4cc-573e-4571-908e-d7cafb42274d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:32.744549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0cbe4cc-573e-4571-908e-d7cafb42274d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034166 Aug 30 03:45:32.746048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2138/4207] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:45:32 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:32.747229 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d90467eb-0320-482a-a14f-192cd65e4146 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 0.873182 Aug 30 03:45:32.757378 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2070/4208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:31 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:32.767597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42422e48-d51d-45ef-adc9-fe03d6fd9911 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Action: 'create', calling method: .version_select at 0x7f897b3181f0>, body: {"server_group": {"name": "tempest-server-group-1224085145", "policies": ["anti-affinity"]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:32.812502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-42422e48-d51d-45ef-adc9-fe03d6fd9911 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:32.820872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-42422e48-d51d-45ef-adc9-fe03d6fd9911 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:32.881407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-42422e48-d51d-45ef-adc9-fe03d6fd9911 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:32.890564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-42422e48-d51d-45ef-adc9-fe03d6fd9911 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_groups'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:32.914396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42422e48-d51d-45ef-adc9-fe03d6fd9911 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.153938 Aug 30 03:45:32.916233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2139/4209] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Aug 30 03:45:32 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:32.943516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b2a6712-916c-4855-bc4a-66e910724728 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:33.039862 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b2a6712-916c-4855-bc4a-66e910724728 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a4142c17-afcb-495a-a85c-cd8b863630bb" status: 204 len: 0 microversion: 2.1 time: 0.111640 Aug 30 03:45:33.042521 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2071/4210] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:45:32 2022] DELETE /compute/v2.1/os-server-groups/a4142c17-afcb-495a-a85c-cd8b863630bb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:45:33.058673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffafc03c-3d38-418b-b7b0-e1d52d527220 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:33.084672 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffafc03c-3d38-418b-b7b0-e1d52d527220 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036359 Aug 30 03:45:33.086566 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2140/4211] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:45:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:45:33.256128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-938676479", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "9d41cda4-8989-41e4-9f98-2ae1ff375597"}]}, "os:scheduler_hints": {"group": "7f81b03e-e815-4f22-9180-35749162711f"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:33.404508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] validate_networks() for [('9d41cda4-8989-41e4-9f98-2ae1ff375597', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:45:33.728852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:33.735594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:33.766239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:33.767784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:33.768815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:33.770443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:33.773484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:33.774832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:34.960300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:34.975102 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a51c15b7-968b-4f86-8245-66120b1f2c6f tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1576 microversion: 2.1 time: 1.249075 Aug 30 03:45:34.989384 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2141/4212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:33 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1576 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:34.989384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:34.990668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:35.007047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:35.008597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:35.015318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:35.016710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:35.017454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:35.018326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:35.858680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:35.893701 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b35bd37b-4f2c-4121-a9be-9bbeab72ff03 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 0.912491 Aug 30 03:45:35.908079 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2142/4213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:34 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:35.930358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:35.930909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:35.945316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:35.945843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:35.946284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:35.947004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:35.947461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:35.947897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:35.971136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:37.116548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8508e7c9-e23a-45b4-bf57-4ea86a50234a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.201051 Aug 30 03:45:37.117993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2143/4214] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:45:35 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3/os-interface => generated 285 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:37.125926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1a1cd7d3-45ca-43bc-91aa-bcbd71bf7a41 req-73f52715-3fc9-4a71-b244-8dd4f6acf977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f8a9a8-34d3-4023-98d1-f00924dd5716", "name": "network-vif-plugged", "status": "completed", "tag": "c0be39b6-6ead-481a-83dc-102f0759dcf9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:37.154282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1a1cd7d3-45ca-43bc-91aa-bcbd71bf7a41 req-73f52715-3fc9-4a71-b244-8dd4f6acf977 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:37.155853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1a1cd7d3-45ca-43bc-91aa-bcbd71bf7a41 req-73f52715-3fc9-4a71-b244-8dd4f6acf977 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:37.157023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1a1cd7d3-45ca-43bc-91aa-bcbd71bf7a41 req-73f52715-3fc9-4a71-b244-8dd4f6acf977 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:37.189207 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1a1cd7d3-45ca-43bc-91aa-bcbd71bf7a41 req-73f52715-3fc9-4a71-b244-8dd4f6acf977 service nova] Creating event network-vif-plugged:c0be39b6-6ead-481a-83dc-102f0759dcf9 for instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 on n-h2-854924-5 Aug 30 03:45:37.205114 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1a1cd7d3-45ca-43bc-91aa-bcbd71bf7a41 req-73f52715-3fc9-4a71-b244-8dd4f6acf977 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085012 Aug 30 03:45:37.207355 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2144/4215] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:37.213176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:37.214398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:37.237735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:37.239095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:37.240084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:37.242533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:37.243269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:37.244041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:37.576742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:45:37.577295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:45:37.577765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:45:37.578209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:45:37.578800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:45:37.622447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:37.622869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:37.623315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:37.627356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:37.627847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:37.629533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:37.694668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:37.714004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:37.817623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:45:37.823344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:45:38.034663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:38.042672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:38.044661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:38.131167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:38.146930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Getting quotas for user b95691a7dece466a977eed0f8cb157b1 and project d6313e953ea94fe4a117d914d7c4db19. Resources: {'server_group_members'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:38.208076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df6b5eb4-6f15-487f-bd26-e804250cfa9d tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.955746 Aug 30 03:45:38.217441 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2072/4216] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:45:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:45:38.224959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b347073-a7a4-47cd-87cb-2c9613f7d141 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:38.228934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b347073-a7a4-47cd-87cb-2c9613f7d141 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:38.743282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:38.756557 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67a8fd5c-db5c-4a6e-a49e-88ca7030ebfa tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1291 microversion: 2.1 time: 1.544005 Aug 30 03:45:38.770502 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2145/4217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:37 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1291 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:38.785211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b347073-a7a4-47cd-87cb-2c9613f7d141 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:38.817666 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b347073-a7a4-47cd-87cb-2c9613f7d141 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1212 microversion: 2.1 time: 0.592487 Aug 30 03:45:38.822733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2073/4218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:38 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1212 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:39.785608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:39.786872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:39.804424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:39.804924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:39.811330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:39.815483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:39.818244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:39.818733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:39.873784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:39.874562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:39.896695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:39.901392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:39.902265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:39.923547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:39.924047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:39.924498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:40.445969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:40.462989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6314cf48-ce20-4538-9eb4-4678c63fdf17 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1216 microversion: 2.1 time: 0.593682 Aug 30 03:45:40.464736 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2074/4219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:39 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1216 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:41.460584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:41.478113 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bd4709b4-22be-4874-a619-12013f6575a6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1482 microversion: 2.1 time: 1.696858 Aug 30 03:45:41.482606 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2146/4220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:39 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1482 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:41.497266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:41.500402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:41.521276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:41.525496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:41.539375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:41.540486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:41.547453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:41.548360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:41.548490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:41.549956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:41.550715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:41.553216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:41.553817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:41.554887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:41.555594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:41.556396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.009631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:42.037797 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b6c3e679-2301-427e-8acc-910fed266ca4 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1270 microversion: 2.1 time: 0.552134 Aug 30 03:45:42.039945 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2075/4221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:41 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1270 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:42.111204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-59f7b92d-e74d-49e0-b6be-63700fa1fe5c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.608513 Aug 30 03:45:42.112059 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2147/4222] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:45:41 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716/os-interface => generated 284 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:42.516392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:42.524931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:42.542302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:42.542797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:42.543292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.544490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:42.552572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:42.555084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.609101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:45:42.781660 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-51b70c2c-6d73-4d77-aea8-f76e638d4ebd tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 204 len: 0 microversion: 2.1 time: 0.274899 Aug 30 03:45:42.782544 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2076/4223] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:45:42 2022] DELETE /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:45:42.787421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:42.788237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:42.791195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:42.792119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:42.796438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:42.797434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:42.798495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.799703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:42.800619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:42.801324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.802287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:42.802766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:42.808573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.810203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:42.810844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:42.811448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:42.903718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=24 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:43.982962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:43.994373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0dc2505a-6a25-48e0-8358-555c5b449fea tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1576 microversion: 2.1 time: 1.214105 Aug 30 03:45:43.995705 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2148/4224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:42 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1576 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:44.017383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9c003009-6810-426f-b302-1adfcf320936 req-c4be9209-e74b-49e9-b056-4ef8d092a8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc14771a-3fcd-4efd-a98e-bff65e28aeb3", "tag": "5ad9b982-31cf-4f92-8d39-a1510a67f160"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:44.062725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c003009-6810-426f-b302-1adfcf320936 req-c4be9209-e74b-49e9-b056-4ef8d092a8d3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:44.063205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c003009-6810-426f-b302-1adfcf320936 req-c4be9209-e74b-49e9-b056-4ef8d092a8d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:44.077701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c003009-6810-426f-b302-1adfcf320936 req-c4be9209-e74b-49e9-b056-4ef8d092a8d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:44.111008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9c003009-6810-426f-b302-1adfcf320936 req-c4be9209-e74b-49e9-b056-4ef8d092a8d3 service nova] Creating event network-changed:5ad9b982-31cf-4f92-8d39-a1510a67f160 for instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 on n-h1-854924-5 Aug 30 03:45:44.133409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9c003009-6810-426f-b302-1adfcf320936 req-c4be9209-e74b-49e9-b056-4ef8d092a8d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133670 Aug 30 03:45:44.138180 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2149/4225] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:44.152851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:44.153900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:44.160971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:44.162283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:44.162886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:44.163775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:44.164401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:44.165112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:44.761670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:44.771698 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e6fef16-a110-4216-8511-2635d57930f2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1270 microversion: 2.1 time: 0.631810 Aug 30 03:45:44.774072 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2150/4226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:44 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1270 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:44.832796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:44.848578 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ddd5d4a-b187-4a4b-bc41-4332e6b4b768 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1469 microversion: 2.1 time: 2.061678 Aug 30 03:45:44.850564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2077/4227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:42 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1469 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:44.927915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-841678781", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "d3ba36d6-9d8d-43e8-994c-2182fdfc412f"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:45.006547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] validate_networks() for [('d3ba36d6-9d8d-43e8-994c-2182fdfc412f', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:45:45.799110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:45.800061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:45.841745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:45.842705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:45.845014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:45.845884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:45.847749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:45.849673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:46.171491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:46.197874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc496b5c-23d2-43d4-9d2c-6406c30c4fca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1270 microversion: 2.1 time: 0.401764 Aug 30 03:45:46.218797 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2078/4228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:45 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1270 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:46.232807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:46.234473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:46.256361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:46.257280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:46.258166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:46.259070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:46.259689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:46.260323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:46.956438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:46.969051 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6cef04e8-0ae2-430e-a272-8d501e6e2828 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1469 microversion: 2.1 time: 0.747194 Aug 30 03:45:46.970613 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2079/4229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:46 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1469 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:47.055380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c95e56df-1895-459d-ab97-dfd559c090e6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: .version_select at 0x7f8983b8f790>, body: {"keypair": {"name": "tempest-keypair-1807018137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgq8Qx9SOf2ZiewvlKH6+1SeDsTb/hT2DR+nX3xuNVbR+F6fS5jwct+4pvfOWIjXCjaitr0q2x4njtPnipp/1o75T2Xc6OKsJ3JeKNYcMuWlgt4vEgOdZT2uRD5s0emkA=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:47.108931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-c95e56df-1895-459d-ab97-dfd559c090e6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for project 1ccee9310d244210867a17f0d093c18e. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:47.128240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-c95e56df-1895-459d-ab97-dfd559c090e6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for user 51986d3cb9614471bce790af1e6be2df and project 1ccee9310d244210867a17f0d093c18e. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:47.183067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c95e56df-1895-459d-ab97-dfd559c090e6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210787 Aug 30 03:45:47.191338 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2080/4230] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:45:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:47.224478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:47.225561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:47.238941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:47.240728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:47.241739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:47.244001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:47.244941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:47.249579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:47.664284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:48.204962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:48.213894 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5cf6e992-cf03-46ba-a6c4-4983c32642f7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 0.993182 Aug 30 03:45:48.214502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2081/4231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:47 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:48.237617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:48.240331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:48.249066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:48.250568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:48.251262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:48.252316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:48.253105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:48.253889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:48.275471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:45:48.275997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:45:48.276357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:45:48.276766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:45:48.277173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:45:48.283075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:48.298349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:48.298845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:48.299288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:48.300003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:48.300633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:48.302252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:48.351390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Getting quotas for project 6cfa673878404b44b64b93dc169dc739. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:48.363466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Getting quotas for user b1afd452d94d4a6f893df3cade99fe82 and project 6cfa673878404b44b64b93dc169dc739. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:48.395974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:45:48.413210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:45:48.495023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:48.503912 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-771185a3-bfa4-4331-886d-5ed810a0054b tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1427 microversion: 2.1 time: 0.287778 Aug 30 03:45:48.510190 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2082/4232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:48 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1427 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:48.558135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e19f31d-fd8a-4aa7-af3a-de7a046d532a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.721645 Aug 30 03:45:48.560013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2151/4233] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:45:48.570890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3401db1-6de1-44f6-bb1a-77b21682f935 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:48.571869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3401db1-6de1-44f6-bb1a-77b21682f935 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:48.851629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5f5dc772-0b66-4b0f-b46f-d47f63694c43 req-5426a33f-baac-4742-b725-a0234b0d749a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72b9fc7-5a88-4419-a22a-53f569b4d111", "name": "network-vif-deleted", "tag": "4fd17ee9-6099-4c76-aedd-596dc6338fad"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:48.893081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f5dc772-0b66-4b0f-b46f-d47f63694c43 req-5426a33f-baac-4742-b725-a0234b0d749a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:48.896312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f5dc772-0b66-4b0f-b46f-d47f63694c43 req-5426a33f-baac-4742-b725-a0234b0d749a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:48.896991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3401db1-6de1-44f6-bb1a-77b21682f935 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:48.899032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f5dc772-0b66-4b0f-b46f-d47f63694c43 req-5426a33f-baac-4742-b725-a0234b0d749a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:48.909931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3401db1-6de1-44f6-bb1a-77b21682f935 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:48.921048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3401db1-6de1-44f6-bb1a-77b21682f935 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:48.924088 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3401db1-6de1-44f6-bb1a-77b21682f935 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1261 microversion: 2.26 time: 0.357409 Aug 30 03:45:48.927456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2083/4234] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:48 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1261 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:45:48.938961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5f5dc772-0b66-4b0f-b46f-d47f63694c43 req-5426a33f-baac-4742-b725-a0234b0d749a service nova] Creating event network-vif-deleted:4fd17ee9-6099-4c76-aedd-596dc6338fad for instance e72b9fc7-5a88-4419-a22a-53f569b4d111 on n-h2-854924-5 Aug 30 03:45:48.967936 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5f5dc772-0b66-4b0f-b46f-d47f63694c43 req-5426a33f-baac-4742-b725-a0234b0d749a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125411 Aug 30 03:45:48.969187 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2152/4235] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:49.252449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:49.254272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:49.541193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:49.542716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:49.573298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:49.575037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:49.577038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:49.581593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:49.583696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:49.584889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:49.710685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:49.717217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:49.724711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:49.725954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:49.728422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lazy-loading 'fault' on Instance uuid e72b9fc7-5a88-4419-a22a-53f569b4d111 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:45:49.922859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:49.923105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:49.923633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:49.924890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:49.924890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:49.925523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:50.149881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26c1c055c63453e9d8894a3455796c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86282e199f940ef838aa5809d607b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:50.162959 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b1ecdf2-fa9e-4093-ab01-558648d8ee04 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 200 len: 1304 microversion: 2.1 time: 0.625864 Aug 30 03:45:50.164272 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2153/4236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:49 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 1304 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:50.177459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:50.180849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:50.218792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:50.219506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:50.220059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:50.222603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:50.225499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:50.226001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:50.540640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:50.556239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f82491a-ae7b-45a8-b1e4-79e2a876f8b9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 1.310175 Aug 30 03:45:50.556841 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2084/4237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:49 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:50.567423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:50.569770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:50.570439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:50.582878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:50.586775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:50.588415 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3469ce2d-746f-4dba-ba74-67479d5b3bae tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1313 microversion: 2.26 time: 0.421520 Aug 30 03:45:50.590879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2154/4238] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:50 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:45:50.610744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:50.611249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:50.615619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:50.616649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:50.617117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:50.617578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.166788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-169600cb-4c34-4523-ab09-7b022368a747 req-7bdc63c7-c5be-4c9f-b211-8812838846e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f8a9a8-34d3-4023-98d1-f00924dd5716", "tag": "c0be39b6-6ead-481a-83dc-102f0759dcf9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:51.199932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-169600cb-4c34-4523-ab09-7b022368a747 req-7bdc63c7-c5be-4c9f-b211-8812838846e5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.200556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-169600cb-4c34-4523-ab09-7b022368a747 req-7bdc63c7-c5be-4c9f-b211-8812838846e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.201318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-169600cb-4c34-4523-ab09-7b022368a747 req-7bdc63c7-c5be-4c9f-b211-8812838846e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.238330 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-169600cb-4c34-4523-ab09-7b022368a747 req-7bdc63c7-c5be-4c9f-b211-8812838846e5 service nova] Creating event network-changed:c0be39b6-6ead-481a-83dc-102f0759dcf9 for instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 on n-h2-854924-5 Aug 30 03:45:51.253792 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-169600cb-4c34-4523-ab09-7b022368a747 req-7bdc63c7-c5be-4c9f-b211-8812838846e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088278 Aug 30 03:45:51.254849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2155/4239] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:51.281468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:51.282521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] [instance: e72b9fc7-5a88-4419-a22a-53f569b4d111] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:51.298620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.299648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.300959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.302079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.304230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.304833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.341700 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] HTTP exception thrown: Instance e72b9fc7-5a88-4419-a22a-53f569b4d111 could not be found. Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Request method failure captured: Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 HTTP/1.1 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYcpodn6ko9RMbkys9dMsDGWasBK1yy84w_MogXprEefSrp92mKmr5AajwH6yvHFti-NmiFsOneocg25EoLyAMcpCQdlGvF6mw3seR2ml8r66f2UqjY9-UCGGSGJJ4bzEyIb0Em9oUlaQN2Z2aqa1YA94q7GWSWKiFWujg__6XV6EK4 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: b86282e199f940ef838aa5809d607b22 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesBackupsTest-1475651635 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b86282e199f940ef838aa5809d607b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b86282e199f940ef838aa5809d607b22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b86282e199f940ef838aa5809d607b22", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b86282e199f940ef838aa5809d607b22"}]}] Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesBackupsTest-1475651635 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: b86282e199f940ef838aa5809d607b22 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesBackupsTest-1475651635 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesBackupsTest-1475651635-project Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: d26c1c055c63453e9d8894a3455796c2 Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesBackupsTest-1475651635-project Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e72b9fc7-5a88-4419-a22a-53f569b4d111 could not be found. Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e72b9fc7-5a88-4419-a22a-53f569b4d111'} Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72b9fc7-5a88-4419-a22a-53f569b4d111 could not be found. Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72b9fc7-5a88-4419-a22a-53f569b4d111 could not be found. Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:45:51.343476 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72b9fc7-5a88-4419-a22a-53f569b4d111 could not be found. Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:45:51.348897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] Returning 404 to user: Instance e72b9fc7-5a88-4419-a22a-53f569b4d111 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:45:51.349551 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d220ae6f-9ade-443e-ab45-e936b38ad622 tempest-VolumesBackupsTest-1475651635 tempest-VolumesBackupsTest-1475651635-project] 10.222.0.30 "GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111" status: 404 len: 111 microversion: 2.1 time: 0.093002 Aug 30 03:45:51.350560 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2156/4240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:51 2022] GET /compute/v2.1/servers/e72b9fc7-5a88-4419-a22a-53f569b4d111 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:45:51.583957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:51.589553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:51.602460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.618626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.619900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.620529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.621001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.621173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:51.621675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.646973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9cb96fae-4a3b-4720-b5e7-d10cd6efc8ee tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1482 microversion: 2.1 time: 1.080053 Aug 30 03:45:51.650140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2085/4241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:50 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1482 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:51.664038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:51.673382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:51.696531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.697219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.700104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.705949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:51.707078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:51.707666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:51.965954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:51.985617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:51.993028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:51.994328 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-991a53d4-03ed-496a-988b-d9f966a6f8a3 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1319 microversion: 2.26 time: 0.342960 Aug 30 03:45:51.994939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2086/4242] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:51 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:45:52.185904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-388905412", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64c320f1-15a6-4c07-9792-194d32e05876"}], "security_groups": [{"name": "tempest-securitygroup--497365702"}], "key_name": "tempest-keypair-1807018137", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:52.876162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:52.897629 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-651e45b8-bf95-4084-b722-85be8bca09e9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 1.311038 Aug 30 03:45:52.913990 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2157/4243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:51 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:53.023042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:53.023867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:53.029793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] validate_networks() for [('64c320f1-15a6-4c07-9792-194d32e05876', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:45:53.035129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:53.037806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:53.038434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:53.046469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:53.048128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:53.049020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:53.447895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:53.462741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:53.472758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:53.474295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-90fa247d-a95b-457d-95c5-ebab6077a6f4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1319 microversion: 2.26 time: 0.455961 Aug 30 03:45:53.488400 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2158/4244] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:53 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:45:53.509197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-408ba2d5-fae4-48e4-badb-57303dab7950 req-63cb7337-d8a0-43a0-8e47-22e0f80ab5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24537fe-2bc0-46a0-aec3-648c167b4091", "tag": "dbe7369b-f2e7-4148-b1c2-7d9c49383336"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:53.531857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-408ba2d5-fae4-48e4-badb-57303dab7950 req-63cb7337-d8a0-43a0-8e47-22e0f80ab5dd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:53.539364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-408ba2d5-fae4-48e4-badb-57303dab7950 req-63cb7337-d8a0-43a0-8e47-22e0f80ab5dd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:53.540389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-408ba2d5-fae4-48e4-badb-57303dab7950 req-63cb7337-d8a0-43a0-8e47-22e0f80ab5dd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:53.565678 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-408ba2d5-fae4-48e4-badb-57303dab7950 req-63cb7337-d8a0-43a0-8e47-22e0f80ab5dd service nova] Creating event network-changed:dbe7369b-f2e7-4148-b1c2-7d9c49383336 for instance d24537fe-2bc0-46a0-aec3-648c167b4091 on n-h1-854924-5 Aug 30 03:45:53.575110 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-408ba2d5-fae4-48e4-badb-57303dab7950 req-63cb7337-d8a0-43a0-8e47-22e0f80ab5dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084954 Aug 30 03:45:53.578757 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2159/4245] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:45:53.923312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:53.924056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:53.946250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:53.954700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:53.955472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:53.956479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:53.957192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:53.957883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:56.005696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:56.018241 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-688729ce-3a7a-4fd2-87a6-00cfe416dda7 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 2.101704 Aug 30 03:45:56.034794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2160/4246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:53 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:56.040320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:56.041654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:56.050862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:56.053025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:56.053766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:56.055306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:56.056044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:56.056768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:56.409067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:45:56.409669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:45:56.410153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:45:56.410564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:45:56.410978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:45:56.432586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:56.433657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:56.437765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:56.439044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:56.445635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:56.446541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:56.483372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for project 1ccee9310d244210867a17f0d093c18e. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:45:56.494153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for user 51986d3cb9614471bce790af1e6be2df and project 1ccee9310d244210867a17f0d093c18e. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:45:56.515664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:45:56.519435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:45:56.611943 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1dfb7e8a-b687-448f-98c1-37f2f43595f4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.433915 Aug 30 03:45:56.624094 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2087/4247] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:45:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 4440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:45:56.654086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5e0e207-5ce4-4254-bebf-576c6e7ed249 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:56.655065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5e0e207-5ce4-4254-bebf-576c6e7ed249 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:56.836367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:56.857791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5e0e207-5ce4-4254-bebf-576c6e7ed249 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:56.864630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:56.871554 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5e0e207-5ce4-4254-bebf-576c6e7ed249 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1237 microversion: 2.1 time: 0.241928 Aug 30 03:45:56.876902 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2088/4248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:56 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1237 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:56.878091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:56.888373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b2b927a2-1651-429f-93c5-428ee2b52994 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 0.851875 Aug 30 03:45:56.904752 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2161/4249] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:56 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:45:57.051562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:57.055188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:57.090620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:57.097859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:57.098383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:57.103840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:57.104544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:57.104968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:57.909633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:57.911108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:57.923520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:57.924491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:57.925087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:57.926203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:57.927000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:57.927730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:58.179982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:58.215253 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fcbab08d-423b-4fd8-b86d-f22eed88f562 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 1.174237 Aug 30 03:45:58.218821 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2089/4250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:57 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:58.282289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:58.284494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:58.311403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:58.311821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:58.312264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:58.323205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:58.325117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:58.325646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:58.326092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:58.386966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:45:58.450527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:58.496872 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edc52847-1b14-4257-8c90-8941bf9f5252 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1241 microversion: 2.1 time: 0.592015 Aug 30 03:45:58.512409 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2162/4251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:57 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1241 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:45:58.788430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:58.814290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:58.817157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:58.819285 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-799bd67c-1d0b-40bf-955a-e17f7ce92465 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 0.597904 Aug 30 03:45:58.823205 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2090/4252] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:58 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:45:59.240300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:59.241043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:59.263047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.263760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.267301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.269970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.270828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.272299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.339244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b002ae92-4a24-40b9-99ce-0754782af415 req-680ad75d-94b2-40aa-921d-737fda68b80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4caf128-d418-4ff6-936b-516ad41dd9a7", "tag": "d8c70088-478e-4072-b18e-c635e9c97e5b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:45:59.383351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b002ae92-4a24-40b9-99ce-0754782af415 req-680ad75d-94b2-40aa-921d-737fda68b80c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.383874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b002ae92-4a24-40b9-99ce-0754782af415 req-680ad75d-94b2-40aa-921d-737fda68b80c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.384312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b002ae92-4a24-40b9-99ce-0754782af415 req-680ad75d-94b2-40aa-921d-737fda68b80c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.433622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b002ae92-4a24-40b9-99ce-0754782af415 req-680ad75d-94b2-40aa-921d-737fda68b80c service nova] Creating event network-changed:d8c70088-478e-4072-b18e-c635e9c97e5b for instance e4caf128-d418-4ff6-936b-516ad41dd9a7 on n-h2-854924-5 Aug 30 03:45:59.447496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b002ae92-4a24-40b9-99ce-0754782af415 req-680ad75d-94b2-40aa-921d-737fda68b80c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120749 Aug 30 03:45:59.449057 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2091/4253] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:45:59.523094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:59.524067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:59.535455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.536192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.538177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.539302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.540033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.540954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.755428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:59.777901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb1dcb22-e8f5-441a-93ce-9b94e1ac2648 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1295 microversion: 2.1 time: 0.260142 Aug 30 03:45:59.778769 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2092/4254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:59 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1295 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:45:59.852836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:45:59.853822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:45:59.868799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.872722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.874084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.876964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:45:59.879839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:45:59.880586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:45:59.916122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:45:59.941903 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7fb75f70-e249-4366-b397-b5625dee38cb tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 0.706105 Aug 30 03:45:59.946801 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2163/4255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:45:59 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:00.801290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:00.802035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:00.811367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:00.812447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:00.813103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:00.814170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:00.828922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:00.829561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:00.961517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:00.988801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1eb280b-7b4b-4942-9d2f-46d7a74feccc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1295 microversion: 2.1 time: 0.192199 Aug 30 03:46:00.991993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2164/4256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:00 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1295 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:00.997895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:00.998839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:01.009913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:01.014016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:01.018586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:01.019701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:01.022828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:01.028020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:01.035180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:01.150972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:01.175107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:01.178015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:01.180450 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0af8665-08a1-4bbf-8ca0-827f458527d9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 1.332083 Aug 30 03:46:01.181574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2093/4257] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:45:59 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:46:01.611216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:01.622706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-563dc015-5cdc-4689-8acf-31d7208e649c tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 0.629372 Aug 30 03:46:01.628489 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2165/4258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:00 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:02.016636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:02.017374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:02.037175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:02.037852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:02.038487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:02.039405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:02.040454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:02.041056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:02.208541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:02.209269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:02.240979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:02.243136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:02.243815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:02.246302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:02.250116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:02.251794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:02.445891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:02.468905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3902ddeb-d564-43a1-9b53-49364d79e2cf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1362 microversion: 2.1 time: 0.458330 Aug 30 03:46:02.470393 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2094/4259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:02 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:02.656285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:02.656844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:02.658955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:02.670354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:02.670889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:02.671334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:02.672062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:02.672523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:02.672956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:02.986285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:02.999553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:03.001098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:03.002239 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c10e45c2-fd75-47ed-af61-db583ac4eb6a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 0.801899 Aug 30 03:46:03.026369 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2166/4260] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:02 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:46:03.134293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c83fa09f-3fda-43ab-97b2-05d878747875 req-21726b28-0270-4716-8bb9-d0d7e29413e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7271fb16-3136-46c9-8b26-e981c6391d9b", "tag": "903d5209-3eab-4090-aa26-70fe35877664"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:03.158184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c83fa09f-3fda-43ab-97b2-05d878747875 req-21726b28-0270-4716-8bb9-d0d7e29413e7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:03.159005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c83fa09f-3fda-43ab-97b2-05d878747875 req-21726b28-0270-4716-8bb9-d0d7e29413e7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:03.159784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c83fa09f-3fda-43ab-97b2-05d878747875 req-21726b28-0270-4716-8bb9-d0d7e29413e7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:03.181027 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c83fa09f-3fda-43ab-97b2-05d878747875 req-21726b28-0270-4716-8bb9-d0d7e29413e7 service nova] Creating event network-changed:903d5209-3eab-4090-aa26-70fe35877664 for instance 7271fb16-3136-46c9-8b26-e981c6391d9b on n-h2-854924-5 Aug 30 03:46:03.199513 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c83fa09f-3fda-43ab-97b2-05d878747875 req-21726b28-0270-4716-8bb9-d0d7e29413e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068776 Aug 30 03:46:03.200784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2167/4261] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:03.497827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:03.498635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:03.517901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:03.518410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:03.518938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:03.519623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:03.520084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:03.528650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:03.575309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:03.586076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-221f0611-edf2-42f0-bd9b-ba9724c3a12a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 0.934455 Aug 30 03:46:03.611745 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2095/4262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:02 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:46:04.031344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:04.031991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:04.056290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:04.056905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:04.059312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:04.065773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:04.069322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:04.070549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:05.093584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:05.120449 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5316517a-3a7b-43fe-8efb-ea21be24c3e8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1362 microversion: 2.1 time: 1.626120 Aug 30 03:46:05.122105 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2168/4263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:03 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1362 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:05.144482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5df17d38-ca86-422a-a6cb-002e141203d1 req-a20fe4ee-af03-4bc9-9bf6-efcf576959df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24537fe-2bc0-46a0-aec3-648c167b4091", "name": "network-vif-plugged", "status": "completed", "tag": "dbe7369b-f2e7-4148-b1c2-7d9c49383336"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:05.164217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5df17d38-ca86-422a-a6cb-002e141203d1 req-a20fe4ee-af03-4bc9-9bf6-efcf576959df service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:05.164942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5df17d38-ca86-422a-a6cb-002e141203d1 req-a20fe4ee-af03-4bc9-9bf6-efcf576959df service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:05.165454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5df17d38-ca86-422a-a6cb-002e141203d1 req-a20fe4ee-af03-4bc9-9bf6-efcf576959df service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:05.192034 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5df17d38-ca86-422a-a6cb-002e141203d1 req-a20fe4ee-af03-4bc9-9bf6-efcf576959df service nova] Creating event network-vif-plugged:dbe7369b-f2e7-4148-b1c2-7d9c49383336 for instance d24537fe-2bc0-46a0-aec3-648c167b4091 on n-h1-854924-5 Aug 30 03:46:05.199211 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5df17d38-ca86-422a-a6cb-002e141203d1 req-a20fe4ee-af03-4bc9-9bf6-efcf576959df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075344 Aug 30 03:46:05.208532 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2169/4264] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:05.227273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:05.228302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:05.238221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:05.238823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:05.239921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:05.240747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:05.241729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:05.242404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:05.500972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:05.515622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:05.517958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:05.520055 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dee0484-dfb6-4b35-a4c4-02b037230c3b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 1.494096 Aug 30 03:46:05.534700 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2096/4265] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:04 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:46:05.814368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:05.826380 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-47f1c655-ff94-483a-8f0a-977fed3724ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 0.614819 Aug 30 03:46:05.847820 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2170/4266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:05 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:06.151325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:06.152382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:06.167191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:06.171946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:06.174002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:06.174844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:06.178621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:06.179335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:06.466627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:06.562175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:06.563605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:06.571911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:06.572659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:06.573257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:06.574663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:06.575357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:06.575791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:06.590755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:06.609431 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c34f18bd-d114-4d77-b4bd-2ddc125f1986 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1362 microversion: 2.1 time: 0.464789 Aug 30 03:46:06.612520 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2097/4267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:06 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:06.860723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:06.861387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:06.869324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=46 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:06.871231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:06.871786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:06.872122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:06.873072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:06.873895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:06.874322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:06.952035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:06.965380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:06.996982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:06.998492 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9f96aea-05da-4e91-af8f-0b46540daffa tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 0.451364 Aug 30 03:46:07.021445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2171/4268] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:06 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:46:07.124073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:07.135435 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-597cc7e8-df17-4e73-b8e2-65e4d39c55ec tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1312 microversion: 2.1 time: 0.280660 Aug 30 03:46:07.150571 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2098/4269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:06 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:46:07.227519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a475028d-784c-4481-8ead-ce3841578553 req-dd3255a8-cf6a-4467-87cd-0b96faff2692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4caf128-d418-4ff6-936b-516ad41dd9a7", "name": "network-vif-plugged", "status": "completed", "tag": "d8c70088-478e-4072-b18e-c635e9c97e5b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:07.248113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a475028d-784c-4481-8ead-ce3841578553 req-dd3255a8-cf6a-4467-87cd-0b96faff2692 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:07.248696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a475028d-784c-4481-8ead-ce3841578553 req-dd3255a8-cf6a-4467-87cd-0b96faff2692 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:07.249730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a475028d-784c-4481-8ead-ce3841578553 req-dd3255a8-cf6a-4467-87cd-0b96faff2692 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:07.287375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a475028d-784c-4481-8ead-ce3841578553 req-dd3255a8-cf6a-4467-87cd-0b96faff2692 service nova] Creating event network-vif-plugged:d8c70088-478e-4072-b18e-c635e9c97e5b for instance e4caf128-d418-4ff6-936b-516ad41dd9a7 on n-h2-854924-5 Aug 30 03:46:07.298131 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a475028d-784c-4481-8ead-ce3841578553 req-dd3255a8-cf6a-4467-87cd-0b96faff2692 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074887 Aug 30 03:46:07.305287 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2172/4270] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:46:07.635197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:07.635836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:07.644051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:07.644546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:07.644999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:07.648653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:07.648653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:07.648653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.043256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:08.044649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:08.059336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.060975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.061607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.062526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.063150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.063741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.122640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:08.136218 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-324c2802-1d51-4916-82b4-1775d7acf67d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1362 microversion: 2.1 time: 0.505013 Aug 30 03:46:08.153181 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2099/4271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:07 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:08.161893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:08.169220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:08.193911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.194712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.195343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.196234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.196869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.197996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.677614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:08.695096 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6da4f9ab-a5e6-4c2f-a76c-fc260a85d5c5 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1498 microversion: 2.1 time: 0.537001 Aug 30 03:46:08.696812 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2100/4272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:08 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1498 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:08.725076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:08.732276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90813bc3-4b75-43c3-a449-39ef3e186d6b tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:08.757270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:08.764020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:08.769295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ec22d7a-ed29-458c-a5f3-2c3c25856661 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1361 microversion: 2.26 time: 0.728852 Aug 30 03:46:08.772684 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2173/4273] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:08 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1361 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:46:08.775762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.server_groups [None req-90813bc3-4b75-43c3-a449-39ef3e186d6b tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Querying cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) for 1 instances {{(pid=122167) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 03:46:08.776691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90813bc3-4b75-43c3-a449-39ef3e186d6b tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.778080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90813bc3-4b75-43c3-a449-39ef3e186d6b tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.779285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90813bc3-4b75-43c3-a449-39ef3e186d6b tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.814820 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90813bc3-4b75-43c3-a449-39ef3e186d6b tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/7f81b03e-e815-4f22-9180-35749162711f" status: 200 len: 222 microversion: 2.1 time: 0.097296 Aug 30 03:46:08.816173 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2101/4274] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:46:08 2022] GET /compute/v2.1/os-server-groups/7f81b03e-e815-4f22-9180-35749162711f => generated 222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:08.839728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:08.840275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:08.861335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.863877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.865101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.869463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:08.872628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:08.873322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:08.941597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:46:09.169105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:09.169796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:09.184030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.186119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.189224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:09.191933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.196454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.199236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:09.207498 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34bbc551-d69e-4d68-989b-7b49f569e073 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 204 len: 0 microversion: 2.1 time: 0.384204 Aug 30 03:46:09.209386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2174/4275] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:46:08 2022] DELETE /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:46:09.221716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:09.222968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:09.236925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.238095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.238987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:09.240166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.241762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.242471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:09.513161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:09.519828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:09.522289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:09.527225 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-03f8d6c3-c386-4b1e-89a8-b73b974070ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1504 microversion: 2.1 time: 0.312492 Aug 30 03:46:09.545839 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2175/4276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:09 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:46:09.553763 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2db151d1-5e38-4a55-bea6-4db0bdbe9812 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1362 microversion: 2.1 time: 0.391364 Aug 30 03:46:09.564536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3516c715-7ef1-4f15-b67d-f2596a7e4bdf req-992a6c01-8ed3-4efd-ba7c-a61d0e5ee758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7271fb16-3136-46c9-8b26-e981c6391d9b", "name": "network-vif-plugged", "status": "completed", "tag": "903d5209-3eab-4090-aa26-70fe35877664"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:09.565061 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2102/4277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:09 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:09.598616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3516c715-7ef1-4f15-b67d-f2596a7e4bdf req-992a6c01-8ed3-4efd-ba7c-a61d0e5ee758 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.600651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3516c715-7ef1-4f15-b67d-f2596a7e4bdf req-992a6c01-8ed3-4efd-ba7c-a61d0e5ee758 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.601953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3516c715-7ef1-4f15-b67d-f2596a7e4bdf req-992a6c01-8ed3-4efd-ba7c-a61d0e5ee758 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:09.622232 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3516c715-7ef1-4f15-b67d-f2596a7e4bdf req-992a6c01-8ed3-4efd-ba7c-a61d0e5ee758 service nova] Creating event network-vif-plugged:903d5209-3eab-4090-aa26-70fe35877664 for instance 7271fb16-3136-46c9-8b26-e981c6391d9b on n-h2-854924-5 Aug 30 03:46:09.628468 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3516c715-7ef1-4f15-b67d-f2596a7e4bdf req-992a6c01-8ed3-4efd-ba7c-a61d0e5ee758 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068226 Aug 30 03:46:09.629872 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2176/4278] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:09.809492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:09.811742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:09.832798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.834270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.837951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:09.839227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:09.842117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:09.842955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.157152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:10.169994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:10.172039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:10.174114 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54d0e864-50ab-4baf-9609-946ff31ff67a tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1545 microversion: 2.26 time: 0.376268 Aug 30 03:46:10.174934 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2103/4279] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:09 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1545 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:46:10.204655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b3191f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:10.223634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.225046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.225782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.227067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:10.234865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.235859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.236564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.237774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.238552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.239209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.276671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.278138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.278824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.295030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.295888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.296740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.338107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:10.367412 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9925b927-4ac8-48ea-8059-ca455467ddb7 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2052400596" status: 201 len: 0 microversion: 2.26 time: 0.169052 Aug 30 03:46:10.368789 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2177/4280] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Aug 30 03:46:10 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2052400596 => generated 0 bytes in 171 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 03:46:10.380629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-73dd535c-2e1c-4617-9184-3ed618b497c5 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae07f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:10.395161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73dd535c-2e1c-4617-9184-3ed618b497c5 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.395942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73dd535c-2e1c-4617-9184-3ed618b497c5 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.396607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-73dd535c-2e1c-4617-9184-3ed618b497c5 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.416235 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-73dd535c-2e1c-4617-9184-3ed618b497c5 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2052400596" status: 204 len: 0 microversion: 2.26 time: 0.040110 Aug 30 03:46:10.418154 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2104/4281] 10.222.0.30 () {60 vars in 1361 bytes} [Tue Aug 30 03:46:10 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2052400596 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:46:10.427757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b897040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:10.443800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.444367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.445197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.447311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:10.462226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.463123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.463567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.468986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.469869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.470517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.527574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.528514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.529199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.565925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:10.584057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:10.587991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:10.619290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.619930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.622941 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3dd1140c-dc5e-4881-b779-2c8a8e94a4cc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 204 len: 0 microversion: 2.26 time: 0.199779 Aug 30 03:46:10.623475 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2178/4282] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Aug 30 03:46:10 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:46:10.623973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.627345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.628374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.631830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.634709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:10.638486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:10.647155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.648287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.648746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.649543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.650031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.650466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:10.940888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:10.954803 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-254a9fe0-ee82-4b39-80c2-830cb0c0734f tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1504 microversion: 2.1 time: 0.406355 Aug 30 03:46:10.956226 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2105/4283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:10 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:46:10.963673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:10.976989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2dc9aa33-c75f-4168-b859-60c6ba8230eb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1362 microversion: 2.1 time: 0.344586 Aug 30 03:46:10.977699 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2179/4284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:10 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:10.979631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3078cd38-2152-4dea-8386-720c76c0eed2 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae62550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:10.993371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3078cd38-2152-4dea-8386-720c76c0eed2 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:10.994693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3078cd38-2152-4dea-8386-720c76c0eed2 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:10.995694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3078cd38-2152-4dea-8386-720c76c0eed2 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.019013 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3078cd38-2152-4dea-8386-720c76c0eed2 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 200 len: 12 microversion: 2.26 time: 0.049537 Aug 30 03:46:11.027051 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2106/4285] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:46:10 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:11.035453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897bab1f70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.057743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.058886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.059389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.059919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:11.068136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.068639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.069250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.070172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.070631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.071066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.097895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:11.112647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.113196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.114009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.127081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.127577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.128200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.193103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:11.212925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aeca73c6-35d0-4736-9bbf-f732b110c775 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-1724783087" status: 201 len: 0 microversion: 2.26 time: 0.185028 Aug 30 03:46:11.215023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2180/4286] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Aug 30 03:46:11 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-1724783087 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 30 03:46:11.226883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-032f739a-e2f8-4ac5-aac3-4ae44f2b8cc9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae074c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.243556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-032f739a-e2f8-4ac5-aac3-4ae44f2b8cc9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.244542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-032f739a-e2f8-4ac5-aac3-4ae44f2b8cc9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.247610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-032f739a-e2f8-4ac5-aac3-4ae44f2b8cc9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.263752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-032f739a-e2f8-4ac5-aac3-4ae44f2b8cc9 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 200 len: 36 microversion: 2.26 time: 0.040883 Aug 30 03:46:11.267102 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2107/4287] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:46:11 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 36 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:11.280587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b48daf0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.303421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.304756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.306855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.307562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:11.323633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.324200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.325667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.326607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.328014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.330373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.418399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.421256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.423693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.550121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:11.601614 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d11f6409-fd68-4180-a99c-815b6b89d6af tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-1724783087" status: 204 len: 0 microversion: 2.26 time: 0.327641 Aug 30 03:46:11.604638 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2181/4288] 10.222.0.30 () {60 vars in 1364 bytes} [Tue Aug 30 03:46:11 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-1724783087 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:46:11.614060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00c6c1af-515a-4106-941c-8fc36c55f066 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae07430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.629824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00c6c1af-515a-4106-941c-8fc36c55f066 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.630910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00c6c1af-515a-4106-941c-8fc36c55f066 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.631539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00c6c1af-515a-4106-941c-8fc36c55f066 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.667353 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00c6c1af-515a-4106-941c-8fc36c55f066 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 200 len: 12 microversion: 2.26 time: 0.057048 Aug 30 03:46:11.679786 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2108/4289] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:46:11 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:11.689092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b8023a0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.700751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.701220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.701876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.702496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:11.714358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.715562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.716005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.716718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.717326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.717961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.811334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.812130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.812666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.851885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:11.891924 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61fbb6cd-21ef-46f2-825e-235ae9413e26 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 204 len: 0 microversion: 2.26 time: 0.208799 Aug 30 03:46:11.893517 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2182/4290] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Aug 30 03:46:11 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 03:46:11.911060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae624c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.926677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.927263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.928008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.928509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:11.937896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.938688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.939300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.941654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.942994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.943483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.974643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.975349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.976002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.988194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:11.988928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:11.989246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:11.989937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:11.990253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:12.015403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.016717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.018092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.020304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.021371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.022275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.054771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:12.085023 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8921ecf-2a1a-424c-a7e7-2d39a9c5623e tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-537303197" status: 201 len: 0 microversion: 2.26 time: 0.180529 Aug 30 03:46:12.097747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2109/4291] 10.222.0.30 () {62 vars in 1377 bytes} [Tue Aug 30 03:46:11 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-537303197 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 03:46:12.106142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:12.116910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:12.133491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.134370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.135244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.136911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.142760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.145384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.189682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:12.203795 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3270f7ac-9c94-4bc2-9086-088d46d8c679 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1462 microversion: 2.1 time: 0.226801 Aug 30 03:46:12.210116 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2183/4292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:11 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1462 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:12.218164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b319c10>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:12.267194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.269569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.272276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.274651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:12.311326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.313778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.314510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.317181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.317917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.319818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.428320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.430826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.431287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.472946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.473537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.473986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.475529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:12.500359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25061702-a019-4c86-a33b-115349d1e68f tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1548 microversion: 2.1 time: 0.398419 Aug 30 03:46:12.501962 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2110/4293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:12 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1548 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:12.518973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-08d7b26e-fda3-442d-8332-5856038bee8f req-711774f6-133e-4e2b-a4b2-68e2c25d3836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24537fe-2bc0-46a0-aec3-648c167b4091", "name": "network-vif-deleted", "tag": "dbe7369b-f2e7-4148-b1c2-7d9c49383336"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:12.541098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:12.554027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-08d7b26e-fda3-442d-8332-5856038bee8f req-711774f6-133e-4e2b-a4b2-68e2c25d3836 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.555439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-08d7b26e-fda3-442d-8332-5856038bee8f req-711774f6-133e-4e2b-a4b2-68e2c25d3836 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.559222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-08d7b26e-fda3-442d-8332-5856038bee8f req-711774f6-133e-4e2b-a4b2-68e2c25d3836 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.583613 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-08d7b26e-fda3-442d-8332-5856038bee8f req-711774f6-133e-4e2b-a4b2-68e2c25d3836 service nova] Creating event network-vif-deleted:dbe7369b-f2e7-4148-b1c2-7d9c49383336 for instance d24537fe-2bc0-46a0-aec3-648c167b4091 on n-h1-854924-5 Aug 30 03:46:12.599686 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-08d7b26e-fda3-442d-8332-5856038bee8f req-711774f6-133e-4e2b-a4b2-68e2c25d3836 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095746 Aug 30 03:46:12.600352 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82f6a212-72e1-4921-a04b-a009aaaec1eb tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2108021044" status: 201 len: 0 microversion: 2.26 time: 0.388827 Aug 30 03:46:12.601135 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2111/4294] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:12.601864 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2184/4295] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Aug 30 03:46:12 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2108021044 => generated 0 bytes in 391 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 03:46:12.619292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:12.622346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897bab1d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:12.627329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:12.668604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.669108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.671752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.672284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:12.679309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.679825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.680275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.689560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.690283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.690769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.706977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.711833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.712294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.715867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.716647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.722510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.812545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.812965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.814934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:12.864949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:12.932040 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0de29325-32bb-4701-a00a-21def2af299d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 204 len: 0 microversion: 2.26 time: 0.317310 Aug 30 03:46:12.936396 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2185/4296] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Aug 30 03:46:12 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:46:12.954204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-066eb663-fc3e-4e01-b629-ff2d53781749 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ab97af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:12.987130 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c7a1179-2b63-43e4-b4ae-0eeaf3af2554 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.384474 Aug 30 03:46:12.989613 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2112/4297] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:46:12 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-interface => generated 285 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:12.993861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-066eb663-fc3e-4e01-b629-ff2d53781749 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:12.994619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-066eb663-fc3e-4e01-b629-ff2d53781749 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:12.995309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-066eb663-fc3e-4e01-b629-ff2d53781749 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.032001 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-066eb663-fc3e-4e01-b629-ff2d53781749 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 200 len: 12 microversion: 2.26 time: 0.090423 Aug 30 03:46:13.033008 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2186/4298] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:46:12 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 12 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:13.044019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae7b4c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:13.069549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.073299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.076146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.076767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:13.101374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.101374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.101374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.101374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.106358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.111308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.235491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:13.236594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:13.266326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.271438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.275325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.281053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.310240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.317501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.322272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.323160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.329759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:13.331775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.392079 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33363d3d-8db8-41ef-998b-e1003815c9bd tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 204 len: 0 microversion: 2.26 time: 0.350308 Aug 30 03:46:13.397399 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2113/4299] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Aug 30 03:46:13 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 03:46:13.415750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ae7b280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:13.446600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.447459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.448132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.448971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:13.458529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.459325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.460015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.461045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.461848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.462506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.474117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.474707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.475151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.475613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lazy-loading 'fault' on Instance uuid d24537fe-2bc0-46a0-aec3-648c167b4091 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:13.533253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.534026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.534614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.547258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.548344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.549373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.609488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:13.635581 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8428d94d-d137-4c27-819e-5261ca63bb16 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2036854148" status: 201 len: 0 microversion: 2.26 time: 0.228338 Aug 30 03:46:13.640474 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2114/4300] 10.222.0.30 () {62 vars in 1380 bytes} [Tue Aug 30 03:46:13 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-2036854148 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 03:46:13.658472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b78de50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:13.666096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95691a7dece466a977eed0f8cb157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6313e953ea94fe4a117d914d7c4db19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:13.673987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.674699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.675234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.675723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:13.679375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89231c97-5915-4b02-8754-34bf010358c2 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 200 len: 1302 microversion: 2.1 time: 0.454851 Aug 30 03:46:13.680545 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2187/4301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:13 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 1302 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:13.706880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.707381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.707820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.713712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.714736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.714736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.771199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.774072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.774564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.809063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.811377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.812671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.883647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:13.940086 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a929d53b-1b1a-4260-8408-544051973601 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-202319925" status: 201 len: 0 microversion: 2.26 time: 0.288188 Aug 30 03:46:13.950072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2115/4302] 10.222.0.30 () {62 vars in 1377 bytes} [Tue Aug 30 03:46:13 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags/tempest-tag-202319925 => generated 0 bytes in 301 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 03:46:13.955101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Action: 'update_all', calling method: .version_select at 0x7f897ab97af0>, body: {"tags": ["tempest-tag-780174943", "tempest-tag-281049827"]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:13.989672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:13.990444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:13.991007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:13.992308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:14.016704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.017527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.018200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.019132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.024720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.037015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.083203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.086210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.094372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.143194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:14.171446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9e8753b-9e8d-442d-9cbc-a666034bf2ef tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 200 len: 60 microversion: 2.26 time: 0.220656 Aug 30 03:46:14.174831 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2188/4303] 10.222.0.30 () {62 vars in 1312 bytes} [Tue Aug 30 03:46:13 2022] PUT /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 60 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:46:14.188318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66dacb7d-5ff3-4964-b641-a686f4e41cfc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897ada5a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.206715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66dacb7d-5ff3-4964-b641-a686f4e41cfc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.211196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66dacb7d-5ff3-4964-b641-a686f4e41cfc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.211705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66dacb7d-5ff3-4964-b641-a686f4e41cfc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.226730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:14.235757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66dacb7d-5ff3-4964-b641-a686f4e41cfc tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 200 len: 60 microversion: 2.26 time: 0.054052 Aug 30 03:46:14.244080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2116/4304] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 03:46:14 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 60 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:14.248727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '.version_select at 0x7f897b48ddc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.299549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.300043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.300488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.300974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:14.353677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.354935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.356318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.360911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.361933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.362608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.439077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.442557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.444304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.479042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lazy-loading 'flavor' on Instance uuid e4caf128-d418-4ff6-936b-516ad41dd9a7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:46:14.526621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbf62107-ecc2-482f-aaa1-d52970ea651d tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags" status: 204 len: 0 microversion: 2.26 time: 0.281938 Aug 30 03:46:14.539434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.540222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:14.543608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2189/4305] 10.222.0.30 () {60 vars in 1295 bytes} [Tue Aug 30 03:46:14 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7/tags => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:46:14.551689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.552530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.553150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.554090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.554724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.555712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.610545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:46:14.707211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.710044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:14.713322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:14.731985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.732489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.732935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.740473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.741117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.741609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.766680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=5 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:14.819271 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54fa3be6-cef8-4260-90af-ddd42b43723b tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 204 len: 0 microversion: 2.26 time: 0.284456 Aug 30 03:46:14.820785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2117/4306] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:46:14 2022] DELETE /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:46:14.825966 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:14.831137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.832250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 HTTP/1.1 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd24537fe-2bc0-46a0-aec3-648c167b4091'} Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:14.834662 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:14.838702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5879e09-4fb4-4835-b6b7-e5f965255dca tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 404 len: 111 microversion: 2.1 time: 0.133288 Aug 30 03:46:14.854957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.855909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.856609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.859881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2190/4307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:14 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:46:14.861193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.862057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.862881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.876908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d4f8663-bf3c-4497-9488-5208b8f056f9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.945097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.server_groups [None req-7d4f8663-bf3c-4497-9488-5208b8f056f9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Querying cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) for 1 instances {{(pid=122168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 03:46:14.946546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d4f8663-bf3c-4497-9488-5208b8f056f9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:14.948037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d4f8663-bf3c-4497-9488-5208b8f056f9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:14.949913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d4f8663-bf3c-4497-9488-5208b8f056f9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:14.965543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d4f8663-bf3c-4497-9488-5208b8f056f9 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.103962 Aug 30 03:46:14.966948 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2191/4308] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 03:46:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:14.981683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d342440b-57b7-485e-a6c9-97b92c00e6ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:14.999484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.server_groups [None req-d342440b-57b7-485e-a6c9-97b92c00e6ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Querying cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) for 1 instances {{(pid=122168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 03:46:15.000825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d342440b-57b7-485e-a6c9-97b92c00e6ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:15.019114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d342440b-57b7-485e-a6c9-97b92c00e6ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:15.022270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d342440b-57b7-485e-a6c9-97b92c00e6ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:15.040581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d342440b-57b7-485e-a6c9-97b92c00e6ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/7f81b03e-e815-4f22-9180-35749162711f" status: 200 len: 184 microversion: 2.1 time: 0.065087 Aug 30 03:46:15.043998 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2192/4309] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:46:14 2022] GET /compute/v2.1/os-server-groups/7f81b03e-e815-4f22-9180-35749162711f => generated 184 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:15.055599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.060774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:15.074183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:15.077033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:15.077820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:15.081840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:15.082768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:15.084517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:15.125588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 HTTP/1.1 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd24537fe-2bc0-46a0-aec3-648c167b4091'} Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:46:15.127420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.132584 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.135496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:15.137117 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65de8a38-4f97-41c5-8228-468f8d3ca9ff tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 404 len: 111 microversion: 2.1 time: 0.085320 Aug 30 03:46:15.139422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2193/4310] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:46:15 2022] DELETE /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:46:15.163732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.164560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] [instance: d24537fe-2bc0-46a0-aec3-648c167b4091] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:15.190922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:15.191429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:15.191878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:15.192612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:15.193128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:15.204157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:15.255695 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 HTTP/1.1 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd24537fe-2bc0-46a0-aec3-648c167b4091'} Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.257333 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.269299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance d24537fe-2bc0-46a0-aec3-648c167b4091 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:15.272689 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-606ee5e8-60f1-4de9-868c-8f2a18ac1c16 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091" status: 404 len: 111 microversion: 2.1 time: 0.123977 Aug 30 03:46:15.272689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2194/4311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:15 2022] GET /compute/v2.1/servers/d24537fe-2bc0-46a0-aec3-648c167b4091 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:46:15.284067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d75a810-6eb0-4967-9bd2-045abeaeec63 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.303789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4d75a810-6eb0-4967-9bd2-045abeaeec63 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance group a4142c17-afcb-495a-a85c-cd8b863630bb could not be found. Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d75a810-6eb0-4967-9bd2-045abeaeec63 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-server-groups/a4142c17-afcb-495a-a85c-cd8b863630bb HTTP/1.1 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance group a4142c17-afcb-495a-a85c-cd8b863630bb could not be found. Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a4142c17-afcb-495a-a85c-cd8b863630bb'} Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a4142c17-afcb-495a-a85c-cd8b863630bb could not be found. Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a4142c17-afcb-495a-a85c-cd8b863630bb could not be found. Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.311753 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.316451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.316451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.316451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:15.316451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:15.316451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a4142c17-afcb-495a-a85c-cd8b863630bb could not be found. Aug 30 03:46:15.316451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.319305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d75a810-6eb0-4967-9bd2-045abeaeec63 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance group a4142c17-afcb-495a-a85c-cd8b863630bb could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:15.320638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d75a810-6eb0-4967-9bd2-045abeaeec63 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a4142c17-afcb-495a-a85c-cd8b863630bb" status: 404 len: 117 microversion: 2.1 time: 0.040892 Aug 30 03:46:15.327848 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2195/4312] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:46:15 2022] DELETE /compute/v2.1/os-server-groups/a4142c17-afcb-495a-a85c-cd8b863630bb => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:46:15.333525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3106cba4-56e5-4f26-a516-6f780e1d8f2a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.352131 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3106cba4-56e5-4f26-a516-6f780e1d8f2a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance group 65d574ac-c31f-4b10-a050-4f1ea4f2fc0e could not be found. Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3106cba4-56e5-4f26-a516-6f780e1d8f2a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-server-groups/65d574ac-c31f-4b10-a050-4f1ea4f2fc0e HTTP/1.1 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance group 65d574ac-c31f-4b10-a050-4f1ea4f2fc0e could not be found. Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '65d574ac-c31f-4b10-a050-4f1ea4f2fc0e'} Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 65d574ac-c31f-4b10-a050-4f1ea4f2fc0e could not be found. Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 65d574ac-c31f-4b10-a050-4f1ea4f2fc0e could not be found. Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.358698 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.364335 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.364335 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.364335 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:15.364335 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:15.364335 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 65d574ac-c31f-4b10-a050-4f1ea4f2fc0e could not be found. Aug 30 03:46:15.364335 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.365988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3106cba4-56e5-4f26-a516-6f780e1d8f2a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance group 65d574ac-c31f-4b10-a050-4f1ea4f2fc0e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:15.367110 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3106cba4-56e5-4f26-a516-6f780e1d8f2a tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/65d574ac-c31f-4b10-a050-4f1ea4f2fc0e" status: 404 len: 117 microversion: 2.1 time: 0.037781 Aug 30 03:46:15.367977 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2196/4313] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:46:15 2022] DELETE /compute/v2.1/os-server-groups/65d574ac-c31f-4b10-a050-4f1ea4f2fc0e => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:46:15.383224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c419b8d9-70ed-4fa8-b599-b0b803df4f01 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.398677 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c419b8d9-70ed-4fa8-b599-b0b803df4f01 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance group 10964171-020b-4bac-bc2c-c04e65560511 could not be found. Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c419b8d9-70ed-4fa8-b599-b0b803df4f01 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-server-groups/10964171-020b-4bac-bc2c-c04e65560511 HTTP/1.1 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance group 10964171-020b-4bac-bc2c-c04e65560511 could not be found. Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '10964171-020b-4bac-bc2c-c04e65560511'} Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 10964171-020b-4bac-bc2c-c04e65560511 could not be found. Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 10964171-020b-4bac-bc2c-c04e65560511 could not be found. Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.400923 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.404940 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.404940 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.404940 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:15.404940 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:15.404940 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 10964171-020b-4bac-bc2c-c04e65560511 could not be found. Aug 30 03:46:15.404940 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.406162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c419b8d9-70ed-4fa8-b599-b0b803df4f01 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance group 10964171-020b-4bac-bc2c-c04e65560511 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:15.407241 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c419b8d9-70ed-4fa8-b599-b0b803df4f01 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/10964171-020b-4bac-bc2c-c04e65560511" status: 404 len: 117 microversion: 2.1 time: 0.034132 Aug 30 03:46:15.408136 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2197/4314] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:46:15 2022] DELETE /compute/v2.1/os-server-groups/10964171-020b-4bac-bc2c-c04e65560511 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:46:15.430948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eff6b5bf-dddd-437a-8f2f-5538b8fdbef0 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.439603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-eff6b5bf-dddd-437a-8f2f-5538b8fdbef0 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] HTTP exception thrown: Instance group df6bf48e-793c-4b67-8791-49858ceba9e6 could not be found. Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eff6b5bf-dddd-437a-8f2f-5538b8fdbef0 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Request method failure captured: Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-server-groups/df6bf48e-793c-4b67-8791-49858ceba9e6 HTTP/1.1 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfaDMtb5OEcaRfGYZd8XAHcGxp4q_F5qS_ah7PKfO7-TthUXAK3FDeQL1YefvitRujUubI8GcBCU3mpdNPwnxj7h0B_y3UGITRtmx0zTwRQYFFiclUV2_ruX4nYILTM0KyUFTpIS5dq543uVSSWL92rJGauGbBVMtEQ9BJiux4kx_g Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6313e953ea94fe4a117d914d7c4db19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6313e953ea94fe4a117d914d7c4db19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6313e953ea94fe4a117d914d7c4db19"}]}] Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6313e953ea94fe4a117d914d7c4db19 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerGroupTestJSON-906764530 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b95691a7dece466a977eed0f8cb157b1 Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerGroupTestJSON-906764530-project Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance group df6bf48e-793c-4b67-8791-49858ceba9e6 could not be found. Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'df6bf48e-793c-4b67-8791-49858ceba9e6'} Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group df6bf48e-793c-4b67-8791-49858ceba9e6 could not be found. Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group df6bf48e-793c-4b67-8791-49858ceba9e6 could not be found. Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.441451 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:15.446526 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:15.446526 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:15.446526 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:15.446526 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:15.446526 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group df6bf48e-793c-4b67-8791-49858ceba9e6 could not be found. Aug 30 03:46:15.446526 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:15.447735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eff6b5bf-dddd-437a-8f2f-5538b8fdbef0 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Returning 404 to user: Instance group df6bf48e-793c-4b67-8791-49858ceba9e6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:15.458969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eff6b5bf-dddd-437a-8f2f-5538b8fdbef0 tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/df6bf48e-793c-4b67-8791-49858ceba9e6" status: 404 len: 117 microversion: 2.1 time: 0.046549 Aug 30 03:46:15.462795 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2198/4315] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:46:15 2022] DELETE /compute/v2.1/os-server-groups/df6bf48e-793c-4b67-8791-49858ceba9e6 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:46:15.468391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b581f53d-4cf0-4076-b028-b459356f58ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:15.523033 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b581f53d-4cf0-4076-b028-b459356f58ac tempest-ServerGroupTestJSON-906764530 tempest-ServerGroupTestJSON-906764530-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/7f81b03e-e815-4f22-9180-35749162711f" status: 204 len: 0 microversion: 2.1 time: 0.058705 Aug 30 03:46:15.525133 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2199/4316] 10.222.0.30 () {58 vars in 1266 bytes} [Tue Aug 30 03:46:15 2022] DELETE /compute/v2.1/os-server-groups/7f81b03e-e815-4f22-9180-35749162711f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:46:15.685774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:15.709069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:15.712020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:15.716213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8eee244a-a099-4c91-8956-f7cd421aa266 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1551 microversion: 2.26 time: 0.890362 Aug 30 03:46:15.718528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2118/4317] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:14 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1551 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:46:16.334928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ffe6a8b7-d57a-49ff-9646-81cfc39d4d15 req-4ba00ea6-f1d3-411d-b68c-e70d148a4b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7271fb16-3136-46c9-8b26-e981c6391d9b", "tag": "903d5209-3eab-4090-aa26-70fe35877664"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:16.354495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ffe6a8b7-d57a-49ff-9646-81cfc39d4d15 req-4ba00ea6-f1d3-411d-b68c-e70d148a4b48 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:16.356024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ffe6a8b7-d57a-49ff-9646-81cfc39d4d15 req-4ba00ea6-f1d3-411d-b68c-e70d148a4b48 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:16.356711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ffe6a8b7-d57a-49ff-9646-81cfc39d4d15 req-4ba00ea6-f1d3-411d-b68c-e70d148a4b48 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:16.406507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ffe6a8b7-d57a-49ff-9646-81cfc39d4d15 req-4ba00ea6-f1d3-411d-b68c-e70d148a4b48 service nova] Creating event network-changed:903d5209-3eab-4090-aa26-70fe35877664 for instance 7271fb16-3136-46c9-8b26-e981c6391d9b on n-h2-854924-5 Aug 30 03:46:16.418556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ffe6a8b7-d57a-49ff-9646-81cfc39d4d15 req-4ba00ea6-f1d3-411d-b68c-e70d148a4b48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087787 Aug 30 03:46:16.423250 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2200/4318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:16.744662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:16.745773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:16.761953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:16.762461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:16.763107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:16.763827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:16.764353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:16.765042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:17.144269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:17.165640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:17.171662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:17.173957 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb416b31-09f8-4c09-9150-3ea7473a3159 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1551 microversion: 2.26 time: 0.433408 Aug 30 03:46:17.192493 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2119/4319] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:16 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1551 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:46:18.199536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:18.200248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:18.228450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:18.228958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:18.229603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:18.237215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:18.237741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:18.238185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:18.419470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1c6cb4f3-9322-4f22-8b37-9883430fd522 req-f0190e2e-d1bb-48f6-a7fe-c9745fffbd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4caf128-d418-4ff6-936b-516ad41dd9a7", "name": "network-vif-deleted", "tag": "d8c70088-478e-4072-b18e-c635e9c97e5b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:18.448312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:18.449262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1c6cb4f3-9322-4f22-8b37-9883430fd522 req-f0190e2e-d1bb-48f6-a7fe-c9745fffbd2e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:18.456323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1c6cb4f3-9322-4f22-8b37-9883430fd522 req-f0190e2e-d1bb-48f6-a7fe-c9745fffbd2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:18.457803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1c6cb4f3-9322-4f22-8b37-9883430fd522 req-f0190e2e-d1bb-48f6-a7fe-c9745fffbd2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:18.463234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:18.473087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1afd452d94d4a6f893df3cade99fe82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfa673878404b44b64b93dc169dc739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:18.477491 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1358890d-eaab-4bbd-8292-8fd28b8f16b4 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 200 len: 1509 microversion: 2.26 time: 0.282296 Aug 30 03:46:18.504436 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1c6cb4f3-9322-4f22-8b37-9883430fd522 req-f0190e2e-d1bb-48f6-a7fe-c9745fffbd2e service nova] Creating event network-vif-deleted:d8c70088-478e-4072-b18e-c635e9c97e5b for instance e4caf128-d418-4ff6-936b-516ad41dd9a7 on n-h2-854924-5 Aug 30 03:46:18.510710 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2201/4320] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:18 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:46:18.548390 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1c6cb4f3-9322-4f22-8b37-9883430fd522 req-f0190e2e-d1bb-48f6-a7fe-c9745fffbd2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126799 Aug 30 03:46:18.551077 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2120/4321] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:19.529640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:19.533643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] [instance: e4caf128-d418-4ff6-936b-516ad41dd9a7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:19.555015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:19.557654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:19.559854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:19.562208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:19.565728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:19.575100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:19.617591 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] HTTP exception thrown: Instance e4caf128-d418-4ff6-936b-516ad41dd9a7 could not be found. Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Request method failure captured: Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 HTTP/1.1 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfoIv1_drvgmXgWQ2GZL7DLPBhhbABeZwwYuliHRct7hNKlll19i6mzC8Kazp1gh5kLHQuxTePhQHYe_fqGpOlS-FsSs87UmqaFU8hgnuvjYNjvfEW-3EkcyTZdCegDd8YRs8W2igZCtOfoXxv2iilKEYzpkCr1H4iJGQhxv88fzns Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.26 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 6cfa673878404b44b64b93dc169dc739 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerTagsTestJSON-380410187 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cfa673878404b44b64b93dc169dc739"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6cfa673878404b44b64b93dc169dc739"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6cfa673878404b44b64b93dc169dc739", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6cfa673878404b44b64b93dc169dc739"}]}] Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerTagsTestJSON-380410187 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 6cfa673878404b44b64b93dc169dc739 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerTagsTestJSON-380410187 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerTagsTestJSON-380410187-project Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b1afd452d94d4a6f893df3cade99fe82 Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerTagsTestJSON-380410187-project Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e4caf128-d418-4ff6-936b-516ad41dd9a7 could not be found. Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e4caf128-d418-4ff6-936b-516ad41dd9a7'} Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4caf128-d418-4ff6-936b-516ad41dd9a7 could not be found. Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4caf128-d418-4ff6-936b-516ad41dd9a7 could not be found. Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:19.623961 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4caf128-d418-4ff6-936b-516ad41dd9a7 could not be found. Aug 30 03:46:19.631363 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:19.641017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] Returning 404 to user: Instance e4caf128-d418-4ff6-936b-516ad41dd9a7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:19.644093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f43ca7ad-8fdb-405e-a541-6806392d76d8 tempest-ServerTagsTestJSON-380410187 tempest-ServerTagsTestJSON-380410187-project] 10.222.0.30 "GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7" status: 404 len: 111 microversion: 2.26 time: 0.127883 Aug 30 03:46:19.647200 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2202/4322] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:46:19 2022] GET /compute/v2.1/servers/e4caf128-d418-4ff6-936b-516ad41dd9a7 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:46:20.490034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:20.498204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:20.499016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Searching by: {'deleted': False, 'project_id': '84abd5de7b764865b2f47938cb4a1f77'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:46:20.516010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:20.516497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:20.516935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:20.517701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:20.521253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:20.521794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:20.591257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:46:20.675389 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1687ae25-c87b-46ff-994c-9c2374fc592e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.188715 Aug 30 03:46:20.678204 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2121/4323] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:46:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:20.698266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:20.711670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:20.722717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Searching by: {'deleted': False, 'project_id': '84abd5de7b764865b2f47938cb4a1f77'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:46:20.737417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:20.738535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:20.739461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:20.740813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:20.743416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:20.744688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:20.809236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:46:20.931065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:20.947378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:20.948356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:20.949139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:21.426925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8c96620-b4b5-4243-a054-8c508932a826 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.739136 Aug 30 03:46:21.438695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2203/4324] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:46:20 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:21.463537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4828420-016a-48ca-8a32-77502cd85335 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:21.493725 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4828420-016a-48ca-8a32-77502cd85335 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039199 Aug 30 03:46:21.498585 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2122/4325] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:46:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:22.042228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:22.043255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:22.062946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:22.063446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:22.063837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:22.064686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:22.065254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:22.065840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:22.144250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:46:22.331536 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-830aab1c-175e-4f20-a192-4710e1cdd093 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 204 len: 0 microversion: 2.1 time: 0.292935 Aug 30 03:46:22.332727 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2204/4326] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:46:22 2022] DELETE /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:46:22.347056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:22.349767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:22.367316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:22.367833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:22.369812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:22.376612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:22.379757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:22.382786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:22.666596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:22.679901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6454c63a-4acf-430b-9e1a-4772eb8d2e71 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1607 microversion: 2.1 time: 0.341136 Aug 30 03:46:22.685725 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2123/4327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:22 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1607 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:23.713524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:23.714281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:23.727421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:23.727920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:23.728366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:23.729070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:23.729588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:23.730623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:24.256829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:24.273284 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99b41ad1-1cca-4aa3-aaba-2c295f2f3fe4 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1607 microversion: 2.1 time: 0.570453 Aug 30 03:46:24.289934 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2205/4328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:23 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1607 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:25.302208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:25.304530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:25.320682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:25.321584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:25.322255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:25.324730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:25.325607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:25.326682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:25.958914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:25.980807 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1fa0c1d-b66b-4a4b-b804-6d85100f477f tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1607 microversion: 2.1 time: 0.684179 Aug 30 03:46:25.991397 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2124/4329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:25 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1607 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:26.834966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c614a008-0c5a-4c24-a32a-745cda1a4e1b req-ba5da943-0d6a-4d2b-ae02-bef0a94f196d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f8a9a8-34d3-4023-98d1-f00924dd5716", "name": "network-vif-deleted", "tag": "c0be39b6-6ead-481a-83dc-102f0759dcf9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:26.868568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c614a008-0c5a-4c24-a32a-745cda1a4e1b req-ba5da943-0d6a-4d2b-ae02-bef0a94f196d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:26.873367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c614a008-0c5a-4c24-a32a-745cda1a4e1b req-ba5da943-0d6a-4d2b-ae02-bef0a94f196d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:26.874016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c614a008-0c5a-4c24-a32a-745cda1a4e1b req-ba5da943-0d6a-4d2b-ae02-bef0a94f196d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:26.913610 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c614a008-0c5a-4c24-a32a-745cda1a4e1b req-ba5da943-0d6a-4d2b-ae02-bef0a94f196d service nova] Creating event network-vif-deleted:c0be39b6-6ead-481a-83dc-102f0759dcf9 for instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 on n-h2-854924-5 Aug 30 03:46:26.933763 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c614a008-0c5a-4c24-a32a-745cda1a4e1b req-ba5da943-0d6a-4d2b-ae02-bef0a94f196d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100250 Aug 30 03:46:26.936845 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2206/4330] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:27.017330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:27.019297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:27.055124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:27.058039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:27.063672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:27.070166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:27.071784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:27.076980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:27.460055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:27.469922 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6051382-0f19-43ce-80aa-2f68f50e5667 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.456997 Aug 30 03:46:27.474058 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2125/4331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:27 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:28.497232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:28.498856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:28.510796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:28.512294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:28.513038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:28.514068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:28.516096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:28.516802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:28.819854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:28.853382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1df1d37d-abe8-453b-90b4-cab5c748d6e8 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.362599 Aug 30 03:46:28.854000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2207/4332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:28 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:29.878719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:29.880524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:29.895785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:29.901068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:29.905847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:29.906969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:29.907849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:29.911767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:30.166863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:30.183597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eaf1c166-08c7-411f-b5ca-12444a87aec0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.305531 Aug 30 03:46:30.187185 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2126/4333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:29 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:31.214415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:31.215882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:31.220912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:31.228768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:31.247496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:31.248661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:31.249292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:31.251685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:31.252812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:31.253564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:31.407333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:31.419540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-108a18d6-85ce-4afb-bd70-880815d11820 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.210546 Aug 30 03:46:31.434813 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2208/4334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:31 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:32.466232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:32.467373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:32.492707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:32.527494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:32.528334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:32.529054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:32.530284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:32.538217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:32.541707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:32.768845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:32.825630 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-202a4014-ffdf-4cd8-8a56-ad042b89144e tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.381080 Aug 30 03:46:32.826637 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2127/4335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:32 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:33.872835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:33.875181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:33.901463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:33.902878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:33.905193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:33.909053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:33.914059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:33.916934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:34.279864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:34.321793 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae8d94ba-704a-418d-8195-28adfd2ca43c tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.457353 Aug 30 03:46:34.326810 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2209/4336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:33 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:35.371923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:35.373473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:35.395377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:35.398592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:35.399462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:35.400397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:35.401848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:35.403111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:35.407001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:35.653673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:35.684487 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2520cc1a-a642-47ab-8701-65c2144560f6 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.322673 Aug 30 03:46:35.687212 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2128/4337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:35 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:36.720680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:36.721300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:36.741670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:36.745850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:36.763150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:36.772570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:36.774972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:36.775438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:37.470260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:37.480862 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bfa71d78-21f5-4e14-8f44-40c312a9b4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.762727 Aug 30 03:46:37.494952 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2210/4338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:36 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:38.503958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:38.504571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:38.522799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:38.530299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:38.530764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:38.531581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:38.532113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:38.532548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:38.942279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f00437d34c4a61a31742cd14848630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84abd5de7b764865b2f47938cb4a1f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:38.954208 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfc79c2a-2490-4272-9c14-832d918fdc00 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 200 len: 1251 microversion: 2.1 time: 0.454003 Aug 30 03:46:38.954802 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2129/4339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:38 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 1251 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:39.990824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:39.991598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] [instance: a4f8a9a8-34d3-4023-98d1-f00924dd5716] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:40.020715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:40.020715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:40.034025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:40.051938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:40.052870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:40.053523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:40.103177 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] HTTP exception thrown: Instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 could not be found. Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Request method failure captured: Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 HTTP/1.1 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYeIKKIWg6P9h3Rm2zIzUcBijiJCbm1gsIbZhoBU6nWNXOUICDTSkE9dpQA71HGXaPEx4hqnr6rQEw-0D4gXt6fjpH5E4HJ8o9D_rMjPuYbF6cePsNx8BA2mJnswoFQGvLsVn3YiPJJ69nJTlw9ATGlBlTYGCgmJiNtLMyn3MPzL9tQ Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 84abd5de7b764865b2f47938cb4a1f77 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestBootFromVolume-1844152175 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/84abd5de7b764865b2f47938cb4a1f77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/84abd5de7b764865b2f47938cb4a1f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_84abd5de7b764865b2f47938cb4a1f77", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/84abd5de7b764865b2f47938cb4a1f77"}]}] Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestBootFromVolume-1844152175 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 84abd5de7b764865b2f47938cb4a1f77 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1844152175 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestBootFromVolume-1844152175-project Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 82f00437d34c4a61a31742cd14848630 Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestBootFromVolume-1844152175-project Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 could not be found. Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a4f8a9a8-34d3-4023-98d1-f00924dd5716'} Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 could not be found. Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 could not be found. Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:40.112222 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 could not be found. Aug 30 03:46:40.117598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:40.121626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Returning 404 to user: Instance a4f8a9a8-34d3-4023-98d1-f00924dd5716 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:40.122741 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f12a3e83-0522-4c29-807c-8cc3c72e7c43 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716" status: 404 len: 111 microversion: 2.1 time: 0.143116 Aug 30 03:46:40.134328 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2211/4340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:39 2022] GET /compute/v2.1/servers/a4f8a9a8-34d3-4023-98d1-f00924dd5716 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:46:40.139606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dc7f25e-5dc6-4db2-ae8a-4fe819fcd4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] Calling method '.version_select at 0x7f897b758280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:40.201132 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9dc7f25e-5dc6-4db2-ae8a-4fe819fcd4e0 tempest-ServersTestBootFromVolume-1844152175 tempest-ServersTestBootFromVolume-1844152175-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832018515" status: 202 len: 0 microversion: 2.1 time: 0.063864 Aug 30 03:46:40.203077 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2130/4341] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832018515 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:46:46.809187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:46.824301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:46.825142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Searching by: {'deleted': False, 'project_id': '67f828a77110419e92ab1dbacc30ef11'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:46:46.827710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:46.838120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:46.838592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:46.844679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:46.845868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:46.846518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:46.847123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:46.904113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:46.908147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:46:46.977334 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50568f1e-6808-4e16-9d32-c6eff60c28d7 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.172695 Aug 30 03:46:46.978262 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2212/4342] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:46:46 2022] GET /compute/v2.1/servers => generated 333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:46.993742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:47.000507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:47.001279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Searching by: {'deleted': False, 'project_id': '67f828a77110419e92ab1dbacc30ef11'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:46:47.008405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:47.008896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:47.009331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:47.010098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:47.010833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:47.011428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:47.041620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:47.066713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:46:47.151751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:47.161226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:47.161739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:47.162177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:47.531495 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-60ad14fc-53dc-42c5-b983-205a693225d2 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.542524 Aug 30 03:46:47.532379 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2131/4343] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:46:46 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:47.560115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42b9486f-a7d2-46f5-8451-9dd5b4f0678b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:47.578394 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42b9486f-a7d2-46f5-8451-9dd5b4f0678b tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022643 Aug 30 03:46:47.584142 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2213/4344] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:46:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:47.899776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:47.900783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:47.941823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:47.942574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:47.943230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:47.944261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:47.945089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:47.946994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:48.014520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:46:48.209627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00fe5751-75f9-4409-a409-434941fbeab4 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 204 len: 0 microversion: 2.1 time: 0.320643 Aug 30 03:46:48.215193 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2132/4345] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:46:47 2022] DELETE /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:46:48.220281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:48.221628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:48.234581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:48.236056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:48.236673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:48.237789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:48.238797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:48.239574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:48.526832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:48.542872 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e8a65a1-8093-4025-aa1a-0cb9b011fd0c tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1700 microversion: 2.1 time: 0.326077 Aug 30 03:46:48.557592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2214/4346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:48 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1700 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:46:49.582877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:49.583697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:49.608633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:49.609221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:49.609616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:49.610578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:49.611057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:49.611496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:50.371399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:50.372569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:50.395533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:50.396000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:50.396460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:50.397271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:50.397787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:50.398219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:50.482156 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4672b87a-25eb-46ee-8928-26fc60c7a758 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/ips" status: 200 len: 146 microversion: 2.1 time: 0.115001 Aug 30 03:46:50.505793 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2215/4347] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:46:50 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/ips => generated 146 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:46:50.683136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:50.694776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6567e870-7b54-490b-9651-77ef6ca58177 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1700 microversion: 2.1 time: 1.130534 Aug 30 03:46:50.702759 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2133/4348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:49 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1700 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:51.721965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:51.722804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:51.738454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:51.739446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:51.740841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:51.741791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:51.745483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:51.748549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:52.245084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:52.264776 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5fd12ca1-f493-46f7-8187-a4703a979aa1 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1700 microversion: 2.1 time: 0.549246 Aug 30 03:46:52.266322 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2216/4349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:51 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1700 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:53.292963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:53.294379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:53.326565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:53.328047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:53.330240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:53.331855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:53.340939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:53.342274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:54.240081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:54.254537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e574155-93c8-43f4-8dbb-095c89bae15a tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1700 microversion: 2.1 time: 0.966567 Aug 30 03:46:54.264448 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2134/4350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:53 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1700 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:54.355284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ed88f58f-2c29-47c1-9d03-c79a7a27fee0 req-857a395a-acee-4fc4-b6e3-a138ff4d7f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc14771a-3fcd-4efd-a98e-bff65e28aeb3", "name": "network-vif-unplugged", "status": "completed", "tag": "5ad9b982-31cf-4f92-8d39-a1510a67f160"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:54.392333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ed88f58f-2c29-47c1-9d03-c79a7a27fee0 req-857a395a-acee-4fc4-b6e3-a138ff4d7f93 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:54.395108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ed88f58f-2c29-47c1-9d03-c79a7a27fee0 req-857a395a-acee-4fc4-b6e3-a138ff4d7f93 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:54.395761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ed88f58f-2c29-47c1-9d03-c79a7a27fee0 req-857a395a-acee-4fc4-b6e3-a138ff4d7f93 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:54.459385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ed88f58f-2c29-47c1-9d03-c79a7a27fee0 req-857a395a-acee-4fc4-b6e3-a138ff4d7f93 service nova] Creating event network-vif-unplugged:5ad9b982-31cf-4f92-8d39-a1510a67f160 for instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 on n-h1-854924-5 Aug 30 03:46:54.485301 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ed88f58f-2c29-47c1-9d03-c79a7a27fee0 req-857a395a-acee-4fc4-b6e3-a138ff4d7f93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134882 Aug 30 03:46:54.486287 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2217/4351] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:46:55.283985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:55.284573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:55.319643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b97fc67-7f81-434a-89b4-6a5278775d54"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:55.323349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:55.324149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:55.324789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:55.325715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:55.325926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:55.326535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:55.327127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:55.339831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:55.343296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:55.343745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:55.344472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:55.344927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:55.346434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:55.580555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:55.605078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ede3a0e-2901-4ef2-9037-95871607ee00 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1632 microversion: 2.1 time: 0.328496 Aug 30 03:46:55.611729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2135/4352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:55 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1632 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:55.894333 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-307d59b0-53d7-4ca8-b28d-5b343f5de6de tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581301 Aug 30 03:46:55.895029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2218/4353] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:46:55 2022] POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:46:56.394955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7ade5f2-a683-445f-baf7-d5fff43d79bb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'create', calling method: .version_select at 0x7f897ba9f9d0>, body: {"keypair": {"name": "tempest-keypair-807011676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKB0b0k7TvRBvpdAtx/+F+vDV4dSBRB11WIVsI4+wqGvhWKdCWQ27I5ALUK1pNTCxQ9N4iObqkPqasGoZJ9TJg+nzShZxW8iKEI811zT82hJzGzGrg1BD7ZzC7cmvIbGw=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:56.487800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e7ade5f2-a683-445f-baf7-d5fff43d79bb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:46:56.512477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e7ade5f2-a683-445f-baf7-d5fff43d79bb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for user b529d546df364eeca6e6665c76242906 and project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:46:56.580589 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7ade5f2-a683-445f-baf7-d5fff43d79bb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.520303 Aug 30 03:46:56.582280 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2136/4354] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:46:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 523 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:46:56.632145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:56.635248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:56.667626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:56.668815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:56.670278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:56.672819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:56.675634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:56.676376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:56.860771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:57.015820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:57.038722 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71f8defb-758d-47a1-adac-7ba4047be440 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1632 microversion: 2.1 time: 0.413848 Aug 30 03:46:57.039330 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2219/4355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:56 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1632 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:57.931142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:46:58.067198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:58.067910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:58.083583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:58.084086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:58.084533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:58.106530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:58.107044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:58.107491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:58.638310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1565000727", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:58.764812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] validate_networks() for [('3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:46:58.776025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b12ad922f3d46c7bbf5d2879c6a63eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f828a77110419e92ab1dbacc30ef11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:46:58.792744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e41dcc0f-a34c-4537-8248-5310fa11b576 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 200 len: 1632 microversion: 2.1 time: 0.725455 Aug 30 03:46:58.793417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2220/4356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:58 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 1632 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:46:58.858557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-069060be-c05c-438e-b9d4-5bf232b6f726 req-7cb7b802-1936-4576-a6ae-aec65cf6d678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc14771a-3fcd-4efd-a98e-bff65e28aeb3", "name": "network-vif-deleted", "tag": "5ad9b982-31cf-4f92-8d39-a1510a67f160"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:46:58.900956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-069060be-c05c-438e-b9d4-5bf232b6f726 req-7cb7b802-1936-4576-a6ae-aec65cf6d678 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:58.904021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-069060be-c05c-438e-b9d4-5bf232b6f726 req-7cb7b802-1936-4576-a6ae-aec65cf6d678 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:58.906597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-069060be-c05c-438e-b9d4-5bf232b6f726 req-7cb7b802-1936-4576-a6ae-aec65cf6d678 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:58.934467 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-069060be-c05c-438e-b9d4-5bf232b6f726 req-7cb7b802-1936-4576-a6ae-aec65cf6d678 service nova] Creating event network-vif-deleted:5ad9b982-31cf-4f92-8d39-a1510a67f160 for instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 on n-h1-854924-5 Aug 30 03:46:58.945594 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-069060be-c05c-438e-b9d4-5bf232b6f726 req-7cb7b802-1936-4576-a6ae-aec65cf6d678 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091201 Aug 30 03:46:58.951195 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2221/4357] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:46:59.815876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:59.817689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] [instance: dc14771a-3fcd-4efd-a98e-bff65e28aeb3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:46:59.837291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:59.841136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:59.841908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:59.844425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:46:59.845120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:46:59.846654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:46:59.895809 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] HTTP exception thrown: Instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 could not be found. Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Request method failure captured: Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 HTTP/1.1 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYexZaPB61IV9EX_vtp13XA3DxZPIt13mOie4jFu_Gfp3X6m1Z9SWElJwMrllnz7QWNy6XkhApZ5nRtzYJvLr1ELOH6JKUHKvDfARtwiwg1bveGqjRUJwOxgX2DVgRMfuTVIFUIkVRF8PucrBjQE-qew0YGehGhtCUHd-mTqZkMkluw Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 67f828a77110419e92ab1dbacc30ef11 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestJSON-696962948 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67f828a77110419e92ab1dbacc30ef11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/67f828a77110419e92ab1dbacc30ef11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_67f828a77110419e92ab1dbacc30ef11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67f828a77110419e92ab1dbacc30ef11"}]}] Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestJSON-696962948 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 67f828a77110419e92ab1dbacc30ef11 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestJSON-696962948 Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestJSON-696962948-project Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4b12ad922f3d46c7bbf5d2879c6a63eb Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestJSON-696962948-project Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 could not be found. Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'dc14771a-3fcd-4efd-a98e-bff65e28aeb3'} Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 could not be found. Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 could not be found. Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:59.904902 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 could not be found. Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Returning 404 to user: Instance dc14771a-3fcd-4efd-a98e-bff65e28aeb3 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:46:59.909425 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a509591b-9ec4-41ae-8da6-1a85a7d9e847 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3" status: 404 len: 111 microversion: 2.1 time: 0.095899 Aug 30 03:46:59.913330 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2222/4358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:46:59 2022] GET /compute/v2.1/servers/dc14771a-3fcd-4efd-a98e-bff65e28aeb3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:46:59.935763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-117dee7e-35c1-472d-94d8-316e886b0b06 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] Calling method '.version_select at 0x7f897b48d700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:46:59.985514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-117dee7e-35c1-472d-94d8-316e886b0b06 tempest-ServersTestJSON-696962948 tempest-ServersTestJSON-696962948-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-769916449" status: 202 len: 0 microversion: 2.1 time: 0.070764 Aug 30 03:46:59.986637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2223/4359] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-769916449 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:47:03.266281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:47:03.266831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:47:03.267241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:47:03.267667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:47:03.268248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:47:03.313981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:03.314677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:03.315140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:03.317909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:03.321299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:03.322253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:03.439212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Getting quotas for project 30815452f69549f7820eb764e8b11311. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:47:03.466356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Getting quotas for user 49a1db79b15c4dfeba570b3aae6df621 and project 30815452f69549f7820eb764e8b11311. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:47:03.518440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:47:03.523156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:47:03.757544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-11bf9c8f-3223-4c32-b655-9a6e16434a1c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.822309 Aug 30 03:47:03.767048 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2137/4360] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 5835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:47:03.784352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2fef59a5-fda2-441d-90c1-198981eab7d0 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:03.785766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2fef59a5-fda2-441d-90c1-198981eab7d0 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:04.250715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2fef59a5-fda2-441d-90c1-198981eab7d0 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:04.260984 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2fef59a5-fda2-441d-90c1-198981eab7d0 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1224 microversion: 2.1 time: 0.481984 Aug 30 03:47:04.262240 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2224/4361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:03 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1224 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:05.283154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:05.283744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:05.298472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-993376827", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2284a504-b8bb-4fc4-a795-1cf53ac3c40c"}], "security_groups": [{"name": "tempest-securitygroup--33484786"}], "key_name": "tempest-keypair-807011676", "user_data": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:05.299330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:05.299834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:05.301194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:05.301934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:05.304492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:05.304937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:05.480348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:05.499951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f439fac1-0af2-47e1-8be8-5ec4e289f209 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1220 microversion: 2.1 time: 0.218988 Aug 30 03:47:05.505981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2138/4362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:05 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1220 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:05.635128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] validate_networks() for [('2284a504-b8bb-4fc4-a795-1cf53ac3c40c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:47:06.525759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:06.525759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:06.548987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:06.553223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:06.554260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:06.555053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:06.556109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:06.557105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:06.558629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:06.735549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:06.745701 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad20232d-751c-4135-9300-a7d09edcebd3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1294 microversion: 2.1 time: 0.227487 Aug 30 03:47:06.749138 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2139/4363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:06 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1294 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:07.031757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:47:07.032236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:47:07.032642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:47:07.033053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:47:07.033823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:47:07.047884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:07.048883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:07.051334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:07.052291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:07.054683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:07.056032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:07.123653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:47:07.141945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for user b529d546df364eeca6e6665c76242906 and project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:47:07.187471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:47:07.191489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:47:07.294831 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bae77209-59a5-482c-989b-a5302017b2fd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.999391 Aug 30 03:47:07.299315 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2225/4364] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:47:05 2022] POST /compute/v2.1/servers => generated 400 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 03:47:07.308601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8175fbc8-d7a4-4fcd-ad1d-539f5c3c6657 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:07.309229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8175fbc8-d7a4-4fcd-ad1d-539f5c3c6657 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:07.507287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8175fbc8-d7a4-4fcd-ad1d-539f5c3c6657 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:07.520842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8175fbc8-d7a4-4fcd-ad1d-539f5c3c6657 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:07.532522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8175fbc8-d7a4-4fcd-ad1d-539f5c3c6657 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:07.535875 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8175fbc8-d7a4-4fcd-ad1d-539f5c3c6657 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1280 microversion: 2.20 time: 0.231234 Aug 30 03:47:07.550006 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2140/4365] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:07 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:07.773508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:07.774885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:07.801284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:07.802218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:07.803036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:07.809704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:07.810772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:07.811686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:08.006906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:08.018992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-353f0068-8d8a-4135-a0fb-be0d916e91e8 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1282 microversion: 2.1 time: 0.251355 Aug 30 03:47:08.020395 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2226/4366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:07 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1282 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:08.568566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:08.570484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:08.581911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:08.582423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:08.582865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:08.584861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:08.585369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:08.590662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:08.670218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:08.683356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:08.685326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:08.687074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1ab21ab-2ce1-4edb-9b9d-c0e9f395ee2e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1276 microversion: 2.20 time: 0.128413 Aug 30 03:47:08.688383 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2141/4367] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:08 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:09.045706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:09.046341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:09.074452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:09.075511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:09.076152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:09.077454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:09.080603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:09.081057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:09.360539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:09.375912 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d5f30a42-ee55-47db-8a18-412ec0906f69 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1282 microversion: 2.1 time: 0.339620 Aug 30 03:47:09.388462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2227/4368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:09 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:09.718032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:09.722194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:09.748696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:09.749203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:09.757840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:09.758621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:09.759372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:09.759718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:10.029226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:10.042419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:10.044919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:10.046920 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-85adf515-76a2-4301-961c-8ef9cc152e5b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1338 microversion: 2.20 time: 0.339052 Aug 30 03:47:10.062020 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2142/4369] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:09 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1338 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:10.406078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:10.406926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:10.425921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:10.430221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:10.433124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:10.437023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:10.439843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:10.447295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:10.850462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:10.863681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc837650-6799-4354-817b-675f5bc68ff5 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.464801 Aug 30 03:47:10.865762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2228/4370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:10 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:11.078963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:11.079562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:11.092584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:11.093439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:11.094114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:11.095076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:11.101580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:11.102464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:11.297016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:11.308726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:11.314682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:11.319021 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f5d403cb-8450-43a1-8b4d-1fd614b51feb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1338 microversion: 2.20 time: 0.250111 Aug 30 03:47:11.339170 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2143/4371] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:11 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1338 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:11.888324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:11.888971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:11.916078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:11.916848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:11.917529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:11.918451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:11.919059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:11.920005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:12.319964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:12.335146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2751fca3-fb61-4825-bdd7-c8fb5a025ba7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.451615 Aug 30 03:47:12.344224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:12.344827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:12.348801 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2229/4372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:11 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:12.358064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:12.358565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:12.359292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:12.359905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:12.362563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:12.363020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:12.486301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:12.495786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:12.503078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:12.505265 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8ae3efc-740d-40c4-9a8c-43d1eec00ce6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1338 microversion: 2.20 time: 0.164089 Aug 30 03:47:12.505910 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2144/4373] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:12 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1338 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:13.356887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:13.358205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:13.373500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:13.374272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:13.375051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:13.375956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:13.376832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:13.380852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:13.532261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:13.533649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:13.544312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:13.550336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:13.551428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:13.553510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:13.555731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:13.556453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:13.558650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:13.649629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:13.661859 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2612033c-9a79-4ec5-b9d9-71b494d8ffc3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.309164 Aug 30 03:47:13.662831 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2230/4374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:13 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:13.706509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:13.719792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:13.721668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:13.723535 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d78f27f-8a74-48d1-bb05-ed8c1ae67b9a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1338 microversion: 2.20 time: 0.195338 Aug 30 03:47:13.739379 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2145/4375] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:13 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1338 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:14.639716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-33c8bc9e-0eb6-4632-810b-2937646dd7f1 req-5043c45a-1b83-42e3-9855-f5116360170f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b75894-5ca0-4861-ad74-f34299e5fa24", "tag": "4d8bd602-908d-4fdf-980d-7486038a0314"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:14.663604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-33c8bc9e-0eb6-4632-810b-2937646dd7f1 req-5043c45a-1b83-42e3-9855-f5116360170f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:14.664395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-33c8bc9e-0eb6-4632-810b-2937646dd7f1 req-5043c45a-1b83-42e3-9855-f5116360170f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:14.665006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-33c8bc9e-0eb6-4632-810b-2937646dd7f1 req-5043c45a-1b83-42e3-9855-f5116360170f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:14.682720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:14.684448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:14.686134 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-33c8bc9e-0eb6-4632-810b-2937646dd7f1 req-5043c45a-1b83-42e3-9855-f5116360170f service nova] Creating event network-changed:4d8bd602-908d-4fdf-980d-7486038a0314 for instance 99b75894-5ca0-4861-ad74-f34299e5fa24 on n-h1-854924-5 Aug 30 03:47:14.692235 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-33c8bc9e-0eb6-4632-810b-2937646dd7f1 req-5043c45a-1b83-42e3-9855-f5116360170f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057591 Aug 30 03:47:14.693563 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2231/4376] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:47:14.697231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:14.698612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:14.699059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:14.702331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:14.707930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:14.709049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:14.761471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:14.763660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:14.782394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:14.786336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:14.787122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:14.795987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:14.797092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:14.798100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:15.957396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:15.967474 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1eecf11-5887-4097-bef7-cb6ade6f46dc tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 1.288787 Aug 30 03:47:15.973381 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2146/4377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:14 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:15.988399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:15.998452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:16.007211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:16.008398 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f2a0bc0-413a-410e-b2a7-10046bba6f88 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 1.261677 Aug 30 03:47:16.021896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2232/4378] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:14 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:47:16.992252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:16.994571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:17.016744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:17.018819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:17.032453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:17.034312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:17.040125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:17.042266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:17.050184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:17.053089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:17.054064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:17.061289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:17.067739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:17.068503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:17.071560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:17.077509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:17.081129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:17.082768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:17.181211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:17.516192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:17.539981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:17.542887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:17.552569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:17.561475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:17.563331 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c172c0c-b7ec-4878-861b-460b47c21fce tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.535140 Aug 30 03:47:17.565572 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2233/4379] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:17 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:47:17.618504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:17.623089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:17.658530 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6d85daae-588e-4a27-a431-c744ca51de25 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.670145 Aug 30 03:47:17.659129 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2147/4380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:16 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:18.604016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:18.605434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:18.644512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:18.645810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:18.648958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:18.653296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:18.656514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:18.657145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:18.681065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:18.683199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:18.701833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:18.703077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:18.703532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:18.704295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:18.704831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:18.705150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:19.187322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:19.199187 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f9638e57-42bc-4ecf-ab97-ff96a17b6837 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.518666 Aug 30 03:47:19.199846 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2148/4381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:18 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:19.222306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b359863d-5fad-4bc6-9c1e-d5508ccd4b0c req-e920355b-57bc-4b6b-a6d7-9e43b16a02bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:19.250368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b359863d-5fad-4bc6-9c1e-d5508ccd4b0c req-e920355b-57bc-4b6b-a6d7-9e43b16a02bf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:19.258220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b359863d-5fad-4bc6-9c1e-d5508ccd4b0c req-e920355b-57bc-4b6b-a6d7-9e43b16a02bf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:19.259090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b359863d-5fad-4bc6-9c1e-d5508ccd4b0c req-e920355b-57bc-4b6b-a6d7-9e43b16a02bf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:19.310151 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b359863d-5fad-4bc6-9c1e-d5508ccd4b0c req-e920355b-57bc-4b6b-a6d7-9e43b16a02bf service nova] Creating event network-changed:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:47:19.324099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b359863d-5fad-4bc6-9c1e-d5508ccd4b0c req-e920355b-57bc-4b6b-a6d7-9e43b16a02bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122644 Aug 30 03:47:19.327269 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2149/4382] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:47:19.404480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:19.425534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:19.427201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:19.438391 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf90bf23-39d7-4c6a-b791-c3759c39e875 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.840947 Aug 30 03:47:19.439051 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2234/4383] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:18 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:20.224494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:20.225205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:20.243393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:20.249107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:20.249699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:20.250702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:20.251380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:20.252058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:20.464993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:20.465738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:20.476154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:20.476701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:20.477117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:20.477937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:20.478323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:20.479284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:21.306400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:21.358148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:21.362815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:21.399076 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5af68a0-9b1d-4fa1-add9-9ff22ae1f6e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.906447 Aug 30 03:47:21.414309 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2235/4384] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:20 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:21.427897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c13cf77-c77a-484b-82d4-e6337a5aa294 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:21.437236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c13cf77-c77a-484b-82d4-e6337a5aa294 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:21.440066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c13cf77-c77a-484b-82d4-e6337a5aa294 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:21.442139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c13cf77-c77a-484b-82d4-e6337a5aa294 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:21.523780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c13cf77-c77a-484b-82d4-e6337a5aa294 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Going to try to stop instance {{(pid=122168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:47:21.713105 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c13cf77-c77a-484b-82d4-e6337a5aa294 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action" status: 202 len: 0 microversion: 2.1 time: 0.293145 Aug 30 03:47:21.714053 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2236/4385] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:47:21 2022] POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:47:21.730859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:21.732014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:21.751248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:21.752063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:21.752693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:21.753663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:21.754323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:21.755061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:22.001441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:22.011376 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5823aa49-6330-451c-9039-9c1d50d12d15 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 1.794488 Aug 30 03:47:22.017080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2150/4386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:20 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:22.425602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:22.426754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:22.443666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:22.445392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:22.468239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:22.472008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:22.472775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:22.493132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:23.584721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:23.600625 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-208fe4b9-e109-4dd2-a665-51fbc055a911 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 1.880491 Aug 30 03:47:23.621042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2237/4387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:21 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:23.632278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:23.637849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:23.662957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:23.675776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:23.676847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:23.678034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:23.696715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:23.697540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:24.040095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:24.070349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:24.079248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:24.105057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc5dd750-1ee5-4cbf-bdc3-6a6d0f545587 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 1.663514 Aug 30 03:47:24.105795 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2151/4388] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:22 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:24.289436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:24.301155 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ab3f1ea-6918-40ca-8d81-89618592f133 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.677319 Aug 30 03:47:24.302009 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2238/4389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:23 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:24.629026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:24.630501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:24.667078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:24.668214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:24.671578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:24.672733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:24.673409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:24.674015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:25.138391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:25.139270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:25.168276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:25.168792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:25.169239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:25.169985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:25.170436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:25.179682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:25.391809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:25.460080 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70fea92b-f6bf-4114-9bf6-c1483562ee43 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 0.832333 Aug 30 03:47:25.473948 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2152/4390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:24 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:25.479414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:25.480259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:25.489929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:25.490705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:25.491326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:25.492230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:25.492905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:25.493922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:25.537763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:25.548870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:25.571304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:25.573092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f3824bb-df12-4cfa-b00b-e09d782be73d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.446888 Aug 30 03:47:25.583978 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2239/4391] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:25 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:25.887916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:25.901886 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-65e224bf-881c-41e9-9f0a-b69e22f93e97 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.426648 Aug 30 03:47:25.902496 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2153/4392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:25 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:26.486546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:26.487178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:26.503982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:26.511011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:26.518708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:26.520232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:26.521755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:26.522911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:26.586833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1428246323", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:26.710334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:47:27.161539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:27.174403 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-841a233b-f7b3-4e26-80eb-2ae8594d1ed1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 0.692304 Aug 30 03:47:27.177865 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2154/4393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:26 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:27.195685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:27.196546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:27.205199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:27.205897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:27.206520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:27.207392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:27.208032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:27.232011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:27.730167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:27.739442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:27.741249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:27.743443 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-520ff07d-8b4a-47a0-a1f2-9b440cd03c7f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.563719 Aug 30 03:47:27.745298 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2155/4394] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:27 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:27.752461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:27.764194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:27.781898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:27.782562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:27.783131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:27.784120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:27.784961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:27.785921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:27.901115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:47:27.901689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:47:27.901961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:47:27.902379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:47:27.902793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:47:27.912422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:27.913149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:27.913779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:27.914877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:27.915344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:27.915947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:27.947900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:47:27.952184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:47:27.966000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:47:27.968574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:47:28.028876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4696f6be-4b83-4b83-a1dd-58a4573baa56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.021949 Aug 30 03:47:28.030243 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2240/4395] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:47:28.035171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6000deaf-e6f8-427d-b71f-43287d3f69df req-6c84c3bc-bb81-4d1d-8d4b-70c61c36f884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b75894-5ca0-4861-ad74-f34299e5fa24", "name": "network-vif-plugged", "status": "completed", "tag": "4d8bd602-908d-4fdf-980d-7486038a0314"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:28.047741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6000deaf-e6f8-427d-b71f-43287d3f69df req-6c84c3bc-bb81-4d1d-8d4b-70c61c36f884 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:28.048594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6000deaf-e6f8-427d-b71f-43287d3f69df req-6c84c3bc-bb81-4d1d-8d4b-70c61c36f884 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:28.049227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6000deaf-e6f8-427d-b71f-43287d3f69df req-6c84c3bc-bb81-4d1d-8d4b-70c61c36f884 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:28.068092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6000deaf-e6f8-427d-b71f-43287d3f69df req-6c84c3bc-bb81-4d1d-8d4b-70c61c36f884 service nova] Creating event network-vif-plugged:4d8bd602-908d-4fdf-980d-7486038a0314 for instance 99b75894-5ca0-4861-ad74-f34299e5fa24 on n-h1-854924-5 Aug 30 03:47:28.079346 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6000deaf-e6f8-427d-b71f-43287d3f69df req-6c84c3bc-bb81-4d1d-8d4b-70c61c36f884 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046921 Aug 30 03:47:28.088021 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2241/4396] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:47:28.095641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27935bc3-ccef-4b52-8c91-44dd64426d78 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:28.096889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-27935bc3-ccef-4b52-8c91-44dd64426d78 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:28.237131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27935bc3-ccef-4b52-8c91-44dd64426d78 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:28.248872 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27935bc3-ccef-4b52-8c91-44dd64426d78 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1215 microversion: 2.1 time: 0.157477 Aug 30 03:47:28.250599 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2242/4397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:28 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:28.258073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:28.258936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:28.269030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:28.269978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:28.270683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:28.271633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:28.272756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:28.273497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:28.409687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:28.446785 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10ee2952-4990-4526-8758-8c65df2bf39a tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.699548 Aug 30 03:47:28.448977 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2156/4398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:27 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:28.779418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:28.780079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:28.810471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:28.810901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:28.811384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:28.812159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:28.812769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:28.817760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:28.835254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:28.852816 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7280178e-4bcc-4ed6-becf-9fa3d259cc3e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 0.600774 Aug 30 03:47:28.853426 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2243/4399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:28 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:29.275174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:29.276651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:29.277957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:29.287094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:29.288370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:29.289086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:29.290176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:29.290904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:29.292147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:29.294303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:29.295918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:29.298625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ae62547-b91c-42d2-8e5b-410df71271fc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.521825 Aug 30 03:47:29.322325 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2157/4400] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:28 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:29.409641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:29.423457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c6d6132-45bd-4775-b9b0-e1de35b4c420 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1219 microversion: 2.1 time: 0.153653 Aug 30 03:47:29.429198 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2244/4401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:29 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:29.472254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:29.472884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:29.485103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:29.485914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:29.486597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:29.489223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:29.489801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:29.490418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:29.877324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:29.878082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:29.890643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:29.897932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:29.902168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:29.905019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:29.909787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:29.911906 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08e87567-d9c9-474c-9abf-60f02942c8c9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1324 microversion: 2.1 time: 0.443492 Aug 30 03:47:29.913894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:29.914462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:29.915146 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2158/4402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:29 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:30.307483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ca4ecfc5-f029-4ba8-9f0f-2e632c852981 req-f93a0e6e-4264-4a1c-8b66-8ce225061ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "name": "network-vif-plugged", "status": "completed", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:30.327652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ca4ecfc5-f029-4ba8-9f0f-2e632c852981 req-f93a0e6e-4264-4a1c-8b66-8ce225061ddf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:30.330409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ca4ecfc5-f029-4ba8-9f0f-2e632c852981 req-f93a0e6e-4264-4a1c-8b66-8ce225061ddf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:30.332510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ca4ecfc5-f029-4ba8-9f0f-2e632c852981 req-f93a0e6e-4264-4a1c-8b66-8ce225061ddf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:30.364611 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ca4ecfc5-f029-4ba8-9f0f-2e632c852981 req-f93a0e6e-4264-4a1c-8b66-8ce225061ddf service nova] Creating event network-vif-plugged:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:47:30.382780 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ca4ecfc5-f029-4ba8-9f0f-2e632c852981 req-f93a0e6e-4264-4a1c-8b66-8ce225061ddf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079331 Aug 30 03:47:30.383564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2159/4403] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:47:30.399907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:30.400932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:30.412941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:30.417226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:30.417774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:30.418762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:30.422002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:30.422719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:31.266635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:31.282670 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b3c9a7e-040c-4615-9eb6-b7eac1446dd6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 1.409923 Aug 30 03:47:31.283258 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2245/4404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:29 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:31.292696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:31.304364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:31.327743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:31.328365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:31.329863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:31.332374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:31.333246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:31.334466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:31.412544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:31.427362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:31.429187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:31.433829 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4aab810f-c3fb-4502-b180-c25c4df50504 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 1.048948 Aug 30 03:47:31.437647 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2160/4405] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:30 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:31.451173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:31.452344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:31.475846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:31.476744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:31.477427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:31.480650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:31.486926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:31.487736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:31.566227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:31.579469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b878e0d-cf1d-4ebe-bb22-e07160795a9b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1273 microversion: 2.1 time: 0.288074 Aug 30 03:47:31.581558 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2246/4406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:31 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:31.860711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:31.895092 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af9b1f28-cd8c-4800-80d7-d29b7786a3b9 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1520 microversion: 2.1 time: 0.453363 Aug 30 03:47:31.897916 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2161/4407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:31 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:32.204744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e89f7c0-69fe-4f0b-a885-1bc9425a020c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2080882497", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e89f7c0-69fe-4f0b-a885-1bc9425a020c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 243 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2080882497", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2080882497', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74'}]}}} Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:32.214412 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.220076 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.224246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e89f7c0-69fe-4f0b-a885-1bc9425a020c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:32.227507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1e89f7c0-69fe-4f0b-a885-1bc9425a020c tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027153 Aug 30 03:47:32.229445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2247/4408] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:47:32 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:47:32.241516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58c810b5-496d-4ce9-bd5f-06d68b55719d tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:32.242488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-58c810b5-496d-4ce9-bd5f-06d68b55719d tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: d98a6dd4-3553-43dc-928b-f64078e3a3fc] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:32.258811 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-58c810b5-496d-4ce9-bd5f-06d68b55719d tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] HTTP exception thrown: Instance d98a6dd4-3553-43dc-928b-f64078e3a3fc could not be found. Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58c810b5-496d-4ce9-bd5f-06d68b55719d tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/d98a6dd4-3553-43dc-928b-f64078e3a3fc/metadata HTTP/1.1 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance d98a6dd4-3553-43dc-928b-f64078e3a3fc could not be found. Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': 'd98a6dd4-3553-43dc-928b-f64078e3a3fc'} Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98a6dd4-3553-43dc-928b-f64078e3a3fc could not be found. Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98a6dd4-3553-43dc-928b-f64078e3a3fc could not be found. Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:32.267037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:32.272370 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:47:32.272370 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:47:32.272370 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98a6dd4-3553-43dc-928b-f64078e3a3fc could not be found. Aug 30 03:47:32.272370 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.275000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58c810b5-496d-4ce9-bd5f-06d68b55719d tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 404 to user: Instance d98a6dd4-3553-43dc-928b-f64078e3a3fc could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:32.276766 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-58c810b5-496d-4ce9-bd5f-06d68b55719d tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/d98a6dd4-3553-43dc-928b-f64078e3a3fc/metadata" status: 404 len: 111 microversion: 2.1 time: 0.040018 Aug 30 03:47:32.277973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2162/4409] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:47:32 2022] GET /compute/v2.1/servers/d98a6dd4-3553-43dc-928b-f64078e3a3fc/metadata => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:47:32.308657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:32.310529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:32.328367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:32.335212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:32.336694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:32.339217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:32.340315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:32.343091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:32.424466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7feb4f77-96fd-4295-8e50-d0518380a6c7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1651603619", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7feb4f77-96fd-4295-8e50-d0518380a6c7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 499 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1651603619", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1651603619', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74'}]}}} Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:47:32.434748 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:32.437920 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:47:32.444054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7feb4f77-96fd-4295-8e50-d0518380a6c7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:32.446481 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7feb4f77-96fd-4295-8e50-d0518380a6c7 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.028029 Aug 30 03:47:32.448749 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2163/4410] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:47:32 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:47:32.490779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:32.498414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:32.538630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:32.540026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:32.541063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:32.573911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:32.575886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:32.578705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:33.193533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:33.210750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:33.213276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:33.214812 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3f60d2e5-6716-4b26-91af-143215ececde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1404 microversion: 2.20 time: 0.759081 Aug 30 03:47:33.218382 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2164/4411] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:32 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1404 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:33.232764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:33.233770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:33.256745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:33.257933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:33.258562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:33.260055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:33.260556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:33.261095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:33.304595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:33.324728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6a9f624-d92d-491a-a4cf-f75b99082bde tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 1.021020 Aug 30 03:47:33.345048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2248/4412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:32 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:33.355715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-03fe28a2-f492-4cd4-9bf8-e0b1a410127f tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-636082843", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-03fe28a2-f492-4cd4-9bf8-e0b1a410127f tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 499 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-636082843", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-636082843', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74'}]}}} Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:47:33.369980 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.374414 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.390231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-03fe28a2-f492-4cd4-9bf8-e0b1a410127f tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:33.392078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-03fe28a2-f492-4cd4-9bf8-e0b1a410127f tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.045910 Aug 30 03:47:33.394401 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2249/4413] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:47:33 2022] POST /compute/v2.1/servers => generated 689 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:47:33.476013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee07c3b6-8ca0-4020-a631-a00e044a73b2 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-112329568", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee07c3b6-8ca0-4020-a631-a00e044a73b2 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 753 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-112329568", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-112329568', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74'}]}}} Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:47:33.488322 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:47:33.491611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:47:33.495167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.495167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.506292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee07c3b6-8ca0-4020-a631-a00e044a73b2 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:33.507467 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee07c3b6-8ca0-4020-a631-a00e044a73b2 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.036452 Aug 30 03:47:33.517822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2250/4414] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:47:33 2022] POST /compute/v2.1/servers => generated 1197 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 03:47:33.637401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d3d46ec-b0fb-490a-b040-deabfaa51bee tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-427538625", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d3d46ec-b0fb-490a-b040-deabfaa51bee tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 1265 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-427538625", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74"}]}} Aug 30 03:47:33.642686 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-427538625', 'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b5bc825-65f9-4dee-8ada-bb0d2d9d7c74'}]}}} Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.645320 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:47:33.646683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:47:33.648737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 03:47:33.648737 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.655774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d3d46ec-b0fb-490a-b040-deabfaa51bee tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:33.656943 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d3d46ec-b0fb-490a-b040-deabfaa51bee tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023736 Aug 30 03:47:33.662851 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2251/4415] 10.222.0.30 () {60 vars in 1148 bytes} [Tue Aug 30 03:47:33 2022] POST /compute/v2.1/servers => generated 2221 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 03:47:33.669707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82655026-5c2e-4383-a25b-447d2660c882 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:33.670406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82655026-5c2e-4383-a25b-447d2660c882 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: e367476f-af9d-473d-b65b-a09704fb5ade] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:33.677184 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-82655026-5c2e-4383-a25b-447d2660c882 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] HTTP exception thrown: Instance e367476f-af9d-473d-b65b-a09704fb5ade could not be found. Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82655026-5c2e-4383-a25b-447d2660c882 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e367476f-af9d-473d-b65b-a09704fb5ade/metadata/test2 HTTP/1.1 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e367476f-af9d-473d-b65b-a09704fb5ade could not be found. Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': 'e367476f-af9d-473d-b65b-a09704fb5ade', 'id': 'test2'} Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e367476f-af9d-473d-b65b-a09704fb5ade could not be found. Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e367476f-af9d-473d-b65b-a09704fb5ade could not be found. Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:33.679269 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:33.683730 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:47:33.683730 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:47:33.683730 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e367476f-af9d-473d-b65b-a09704fb5ade could not be found. Aug 30 03:47:33.683730 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:33.684840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82655026-5c2e-4383-a25b-447d2660c882 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 404 to user: Instance e367476f-af9d-473d-b65b-a09704fb5ade could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:33.691242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82655026-5c2e-4383-a25b-447d2660c882 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/e367476f-af9d-473d-b65b-a09704fb5ade/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027046 Aug 30 03:47:33.700636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2252/4416] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 03:47:33 2022] GET /compute/v2.1/servers/e367476f-af9d-473d-b65b-a09704fb5ade/metadata/test2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:47:33.708895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:33.716376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:33.724823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:33.728503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:33.729727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:33.731379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:33.732493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:33.733461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:33.767417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:47:33.946246 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae4f4aa6-42b5-4f4e-9080-59f033c8b3eb tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 204 len: 0 microversion: 2.1 time: 0.237870 Aug 30 03:47:33.947082 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2253/4417] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:47:33 2022] DELETE /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:47:33.961030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:33.982344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:34.004104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:34.005389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:34.008149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:34.009115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:34.013288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:34.015743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:34.272040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:34.282367 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1932042e-3599-42de-a3a9-69b946e0cbde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 1.062601 Aug 30 03:47:34.304313 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2165/4418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:33 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:34.310340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:34.314980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:34.337631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:34.338991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:34.339684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:34.348944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:34.349965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:34.351086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:34.555383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:34.568760 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99435d59-274f-4055-b651-91d456281e38 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1526 microversion: 2.1 time: 0.611889 Aug 30 03:47:34.574378 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2254/4419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:33 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1526 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:34.586750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:34.588333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:34.607807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:34.608610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:34.611123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:34.612135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:34.612782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:34.613811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:34.627499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:34.948495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:34.962655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:34.974070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:34.975675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f2469fed-70e5-48dc-be88-ce3dd02034db tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1595 microversion: 2.20 time: 0.669879 Aug 30 03:47:34.976481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2166/4420] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:47:34 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1595 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:47:35.002210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:35.003833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:35.019201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:35.019888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:35.022288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:35.025420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:35.026602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:35.034041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:35.236974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:35.260289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b391a01-263b-4472-9144-7e204ebfa766 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 0.683957 Aug 30 03:47:35.261483 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2255/4421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:34 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:35.282991 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-988380f6-01ed-4170-af09-799b868423f5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.284971 Aug 30 03:47:35.289151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2167/4422] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:47:34 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:47:35.311658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:35.312271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:35.319698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:35.323373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:35.324402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:35.327406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:35.330512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:35.331194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:35.596172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:35.596987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:35.607827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:35.610479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:35.611225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:35.617816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:35.618458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:35.619028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:35.622456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:36.517417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:36.553034 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e2aa58a-94c2-42a3-b61c-f4a4f155a709 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 1.245313 Aug 30 03:47:36.555947 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2256/4423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:35 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:36.579522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:36.588431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:36.603142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:36.604017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:36.604723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:36.605953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:36.611974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:36.613103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:36.787655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:36.795983 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb36a09e-2e98-4aa5-9d16-574756eb8953 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1526 microversion: 2.1 time: 1.203743 Aug 30 03:47:36.802147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2168/4424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:35 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1526 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:37.574605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:37.575270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:37.587282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=60 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:37.588780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:37.589281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:37.589749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:37.590458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:37.590913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:37.591344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:37.893156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:37.912302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1a610d1-6941-42bc-88e1-519970b6d5ba tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1723 microversion: 2.1 time: 1.354654 Aug 30 03:47:37.928863 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2257/4425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:36 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1723 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:37.935288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:37.936275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:37.942984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:37.955337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:37.956220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:37.956893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:37.957960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:37.958653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:37.959343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:38.245774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:38.435013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:38.451826 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45d80f20-cd86-4f9c-ad31-92a25c213a10 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1484 microversion: 2.1 time: 0.516993 Aug 30 03:47:38.474240 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2258/4426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:37 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1484 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:38.485098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2f431594-2b2d-45bf-b104-e60df519c740 req-12ab9c8f-7ec8-423a-a6a3-f7380fa867de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cec778-c0a3-466d-97b1-e7608b1e13ce", "tag": "4b60dc72-2168-4c2f-8c70-a4fedc831592"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:38.510588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f431594-2b2d-45bf-b104-e60df519c740 req-12ab9c8f-7ec8-423a-a6a3-f7380fa867de service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:38.512118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f431594-2b2d-45bf-b104-e60df519c740 req-12ab9c8f-7ec8-423a-a6a3-f7380fa867de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:38.512910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2f431594-2b2d-45bf-b104-e60df519c740 req-12ab9c8f-7ec8-423a-a6a3-f7380fa867de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:38.544540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2f431594-2b2d-45bf-b104-e60df519c740 req-12ab9c8f-7ec8-423a-a6a3-f7380fa867de service nova] Creating event network-changed:4b60dc72-2168-4c2f-8c70-a4fedc831592 for instance 74cec778-c0a3-466d-97b1-e7608b1e13ce on n-h1-854924-5 Aug 30 03:47:38.554906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2f431594-2b2d-45bf-b104-e60df519c740 req-12ab9c8f-7ec8-423a-a6a3-f7380fa867de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078729 Aug 30 03:47:38.560494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2259/4427] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:47:38.595365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:38.607110 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fdb3208c-1376-493e-b3cf-7be7fd2285a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 1.036819 Aug 30 03:47:38.617446 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2169/4428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:37 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:38.694029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-498c6b2a-77ff-403c-b1ec-5b8bc859ecba req-5a097ee8-7bc4-48d0-9ec7-63d8afb90a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b75894-5ca0-4861-ad74-f34299e5fa24", "name": "network-vif-deleted", "tag": "4d8bd602-908d-4fdf-980d-7486038a0314"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:38.720273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-498c6b2a-77ff-403c-b1ec-5b8bc859ecba req-5a097ee8-7bc4-48d0-9ec7-63d8afb90a04 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:38.726818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-498c6b2a-77ff-403c-b1ec-5b8bc859ecba req-5a097ee8-7bc4-48d0-9ec7-63d8afb90a04 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:38.727652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-498c6b2a-77ff-403c-b1ec-5b8bc859ecba req-5a097ee8-7bc4-48d0-9ec7-63d8afb90a04 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:38.773086 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-498c6b2a-77ff-403c-b1ec-5b8bc859ecba req-5a097ee8-7bc4-48d0-9ec7-63d8afb90a04 service nova] Creating event network-vif-deleted:4d8bd602-908d-4fdf-980d-7486038a0314 for instance 99b75894-5ca0-4861-ad74-f34299e5fa24 on n-h1-854924-5 Aug 30 03:47:38.797319 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-498c6b2a-77ff-403c-b1ec-5b8bc859ecba req-5a097ee8-7bc4-48d0-9ec7-63d8afb90a04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107281 Aug 30 03:47:38.798227 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2260/4429] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:47:38.940887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:38.942001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:38.959449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:38.964374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:38.967591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:38.968683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:38.971985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:38.973987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:39.479939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:39.480651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:39.507745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:39.508262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:39.513577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:39.518279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:39.519041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:39.526565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:39.680621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:39.681031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:39.689671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:39.690277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lazy-loading 'fault' on Instance uuid 99b75894-5ca0-4861-ad74-f34299e5fa24 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:47:39.727165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:39.747335 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92743a74-f8a8-42ee-ab1c-978e829c701a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1700 microversion: 2.1 time: 0.811435 Aug 30 03:47:39.752050 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2170/4430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:38 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1700 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:39.770504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:39.771507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:39.784988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:39.786354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:39.787058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:39.788630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:39.790685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:39.790685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:40.031232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a1db79b15c4dfeba570b3aae6df621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30815452f69549f7820eb764e8b11311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:40.051060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10a45adc-12c3-42d5-a292-9893ea75cad3 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 200 len: 1314 microversion: 2.1 time: 0.576098 Aug 30 03:47:40.078856 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2261/4431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:39 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:40.098706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80e064c1-c6bb-4cea-b83c-a77a08e6fbec tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:40.114318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80e064c1-c6bb-4cea-b83c-a77a08e6fbec tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:40.115221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80e064c1-c6bb-4cea-b83c-a77a08e6fbec tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:40.116023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80e064c1-c6bb-4cea-b83c-a77a08e6fbec tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:40.182601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-80e064c1-c6bb-4cea-b83c-a77a08e6fbec tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 03:47:40.298586 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80e064c1-c6bb-4cea-b83c-a77a08e6fbec tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action" status: 202 len: 0 microversion: 2.1 time: 0.218190 Aug 30 03:47:40.299563 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2262/4432] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:47:40 2022] POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:47:40.312558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:40.313656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:40.329857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:40.330730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:40.331432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:40.332376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:40.333056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:40.333799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:40.393708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:40.418975 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-96608cce-699a-469d-a877-b6e70be2e5fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.664914 Aug 30 03:47:40.420732 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2171/4433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:39 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:40.572019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:40.587853 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31206595-b717-4982-9f67-d62aea2df9fb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1709 microversion: 2.1 time: 0.273079 Aug 30 03:47:40.589221 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2263/4434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:40 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1709 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:40.616102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7d8f9690-1010-4958-9c0f-a592f375690c req-810d6377-16c3-4e6c-b79f-6d856e361605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:40.646910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7d8f9690-1010-4958-9c0f-a592f375690c req-810d6377-16c3-4e6c-b79f-6d856e361605 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:40.647995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7d8f9690-1010-4958-9c0f-a592f375690c req-810d6377-16c3-4e6c-b79f-6d856e361605 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:40.648675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7d8f9690-1010-4958-9c0f-a592f375690c req-810d6377-16c3-4e6c-b79f-6d856e361605 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:40.689464 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7d8f9690-1010-4958-9c0f-a592f375690c req-810d6377-16c3-4e6c-b79f-6d856e361605 service nova] Creating event network-changed:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:47:40.703404 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7d8f9690-1010-4958-9c0f-a592f375690c req-810d6377-16c3-4e6c-b79f-6d856e361605 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095576 Aug 30 03:47:40.704580 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2172/4435] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:47:41.093868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:41.094683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] [instance: 99b75894-5ca0-4861-ad74-f34299e5fa24] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:41.126530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:41.126530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:41.126530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:41.133510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:41.134459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:41.135241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:41.206236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] HTTP exception thrown: Instance 99b75894-5ca0-4861-ad74-f34299e5fa24 could not be found. Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Request method failure captured: Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 HTTP/1.1 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgxDD3zUPueOnSRJYIBeX1XrMUzG6aeHwDPWf68cjFDh_Tg6k3Fyut4Wxp7lui5jCbBirww9wRxk_yhgMCZMQkWdcy1gIE6LNCDVEJaZ21zjdB3GrIENRFzuEuwrP8xxh3M571rZ8oxCs8uPNklJUEsWDMm4xJnoHGvKM9L-2IzM8w Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/30815452f69549f7820eb764e8b11311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_30815452f69549f7820eb764e8b11311", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/30815452f69549f7820eb764e8b11311"}]}] Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 30815452f69549f7820eb764e8b11311 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1674343626 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 49a1db79b15c4dfeba570b3aae6df621 Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1674343626-project Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 99b75894-5ca0-4861-ad74-f34299e5fa24 could not be found. Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '99b75894-5ca0-4861-ad74-f34299e5fa24'} Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b75894-5ca0-4861-ad74-f34299e5fa24 could not be found. Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b75894-5ca0-4861-ad74-f34299e5fa24 could not be found. Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:41.208558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b75894-5ca0-4861-ad74-f34299e5fa24 could not be found. Aug 30 03:47:41.215172 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:47:41.224003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] Returning 404 to user: Instance 99b75894-5ca0-4861-ad74-f34299e5fa24 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:47:41.225489 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8688be5c-3b0c-4d5a-9082-d37a032f5452 tempest-ServerMetadataNegativeTestJSON-1674343626 tempest-ServerMetadataNegativeTestJSON-1674343626-project] 10.222.0.30 "GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24" status: 404 len: 111 microversion: 2.1 time: 0.135252 Aug 30 03:47:41.240185 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2264/4436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:41 2022] GET /compute/v2.1/servers/99b75894-5ca0-4861-ad74-f34299e5fa24 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:47:41.450992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:41.452691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:41.488409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:41.493833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:41.496991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:41.498396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:41.502742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:41.508504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:41.613117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:41.617075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:41.636491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:41.657123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:41.660942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:41.661957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:41.663964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:41.664666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:42.440924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:42.479859 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3b859f9-2310-45dd-8099-00bbe5fe2eb8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 1.033308 Aug 30 03:47:42.480490 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2173/4437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:41 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:42.685767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:42.696626 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1eb7e186-192d-4192-b7fe-25595cb3f727 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1709 microversion: 2.1 time: 1.087259 Aug 30 03:47:42.701210 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2265/4438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:41 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1709 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:43.500976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:43.501823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:43.518674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:43.519201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:43.519678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:43.520532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:43.522440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:43.523441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:43.724131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:43.724872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:43.737249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:43.737694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:43.738144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:43.738869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:43.739330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:43.739762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:44.137194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:44.153500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-084f6bcf-e43a-4574-8a4d-e2b32fb8e403 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.656474 Aug 30 03:47:44.153973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2174/4439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:43 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:44.748927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:44.762944 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d621323-0c5b-4c18-8d07-30ee763dcc99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1709 microversion: 2.1 time: 1.037983 Aug 30 03:47:44.764726 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2266/4440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:43 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1709 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:45.178791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:45.179507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:45.204867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:45.205858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:45.206393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:45.208034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:45.208680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:45.209197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:45.791906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:45.792640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:45.803684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:45.807048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:45.809141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:45.810151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:45.814971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:45.820492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:45.825287 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1bbd66c4-7cde-4d49-a07f-dd415b60b5e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.650411 Aug 30 03:47:45.826909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:45.833134 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2175/4441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:45 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:46.135817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ceccfa85-38ae-4052-8a62-13bb36c0cc23 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Action: 'create', calling method: .version_select at 0x7f897ba58040>, body: {"keypair": {"name": "tempest-keypair-1911378530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaCd8fyewOzgxpgo8vWaFga/vBI4ipuCoZE7ms8tDF6iFY8mXBKVJ0vsfggGAG1HCHTqGwAxtPZ4ShA+uyLRIhIXStu6Xw/idLQ6XJ1S+kmUryN5Pte4x+PUHi1Q9samA=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:46.186643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ceccfa85-38ae-4052-8a62-13bb36c0cc23 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Getting quotas for project 5c96faee3bfb4508ae69d4cd886e2c83. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:47:46.200434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-ceccfa85-38ae-4052-8a62-13bb36c0cc23 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Getting quotas for user edf92f77728045d3b9eacaa9ea34ac53 and project 5c96faee3bfb4508ae69d4cd886e2c83. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:47:46.266959 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ceccfa85-38ae-4052-8a62-13bb36c0cc23 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257359 Aug 30 03:47:46.273163 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2176/4442] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:47:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:47:46.346401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:46.358314 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-46747bef-155b-47bd-9cd7-d1f19df79646 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1713 microversion: 2.1 time: 0.571563 Aug 30 03:47:46.369825 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2267/4443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:45 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1713 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:46.859779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:46.860808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:46.874733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:46.876659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:46.880111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:46.881208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:46.887264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:46.888012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:47.240656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:47.259469 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-135613a3-1da2-4ef0-95b8-25b6967c20ed tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.406054 Aug 30 03:47:47.264879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2177/4444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:46 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:48.284807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:48.286208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:48.300125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:48.304703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:48.305958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:48.310288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:48.311349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:48.312039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:48.312685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:49.080969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:49.095760 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b9d399d-9a32-4052-ab73-b6de956e7b2c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.815228 Aug 30 03:47:49.098284 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2268/4445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:48 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:50.150558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:50.151182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:50.163610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:50.167266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:50.167771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:50.168506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:50.169602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:50.171917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:50.853986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:50.871045 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7183ff4-636b-4ff1-b7c9-291cb38bb0f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.724311 Aug 30 03:47:50.871635 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2178/4446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:50 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:51.187933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1580302720", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "537625ec-9f4f-441e-b680-9f40ac266178"}], "security_groups": [{"name": "tempest-securitygroup--637629330"}], "key_name": "tempest-keypair-1911378530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:51.520521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] validate_networks() for [('537625ec-9f4f-441e-b680-9f40ac266178', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:47:51.732606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5fa72f6d-1c16-432b-9372-716e7ae0bb2b req-df16b1a0-61b7-4c72-83e3-c5cbff62f370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cec778-c0a3-466d-97b1-e7608b1e13ce", "name": "network-vif-plugged", "status": "completed", "tag": "4b60dc72-2168-4c2f-8c70-a4fedc831592"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:47:51.778428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5fa72f6d-1c16-432b-9372-716e7ae0bb2b req-df16b1a0-61b7-4c72-83e3-c5cbff62f370 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:51.778920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5fa72f6d-1c16-432b-9372-716e7ae0bb2b req-df16b1a0-61b7-4c72-83e3-c5cbff62f370 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:51.787433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5fa72f6d-1c16-432b-9372-716e7ae0bb2b req-df16b1a0-61b7-4c72-83e3-c5cbff62f370 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:51.817787 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5fa72f6d-1c16-432b-9372-716e7ae0bb2b req-df16b1a0-61b7-4c72-83e3-c5cbff62f370 service nova] Creating event network-vif-plugged:4b60dc72-2168-4c2f-8c70-a4fedc831592 for instance 74cec778-c0a3-466d-97b1-e7608b1e13ce on n-h1-854924-5 Aug 30 03:47:51.837260 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5fa72f6d-1c16-432b-9372-716e7ae0bb2b req-df16b1a0-61b7-4c72-83e3-c5cbff62f370 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116710 Aug 30 03:47:51.837967 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2179/4447] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:47:51.897442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:51.898176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:51.942968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:51.954491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:51.955260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:51.956202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:51.956851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:51.958240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:52.708470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:52.717971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e776ff15-7b14-416a-bf8b-742f5ea3f691 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 0.825128 Aug 30 03:47:52.734809 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2180/4448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:51 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:53.156771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Getting quotas for project 5c96faee3bfb4508ae69d4cd886e2c83. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:47:53.179043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Getting quotas for user edf92f77728045d3b9eacaa9ea34ac53 and project 5c96faee3bfb4508ae69d4cd886e2c83. Resources: dict_keys(['metadata_items']) {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:47:53.214235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:47:53.219070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:47:53.219673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:47:53.220097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:47:53.220553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:47:53.246491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:53.247282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:53.247736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:53.248488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:53.248989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:53.249478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:53.293111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Getting quotas for project 5c96faee3bfb4508ae69d4cd886e2c83. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:47:53.306867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Getting quotas for user edf92f77728045d3b9eacaa9ea34ac53 and project 5c96faee3bfb4508ae69d4cd886e2c83. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:47:53.347081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:47:53.349770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:47:53.458480 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1b53da2c-5db9-490c-86a7-dbf84fb2a368 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.274822 Aug 30 03:47:53.472279 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2269/4449] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:47:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 2290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:47:53.477299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c134a0b-bed8-4f86-ac2e-ca5545de12ac tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:53.478722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0c134a0b-bed8-4f86-ac2e-ca5545de12ac tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:53.741667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:53.745376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:53.769910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:53.774742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:53.779283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:53.780685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:53.787771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:53.789477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:54.061105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0c134a0b-bed8-4f86-ac2e-ca5545de12ac tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:54.074639 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c134a0b-bed8-4f86-ac2e-ca5545de12ac tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1278 microversion: 2.1 time: 0.598538 Aug 30 03:47:54.098000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2181/4450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:53 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1278 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:55.115796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:55.116609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:55.160611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:55.161117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:55.164152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:55.164953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:55.165516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:55.168882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:55.218111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:55.234371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c20d132e-629c-43f1-bed7-abf78fd191ea tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1315 microversion: 2.1 time: 1.498407 Aug 30 03:47:55.235261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2270/4451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:53 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1315 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:55.302624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:55.311427 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e155676d-4008-4fb9-bb32-534bb874b9ed tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1330 microversion: 2.1 time: 0.212466 Aug 30 03:47:55.312187 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2182/4452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:55 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1330 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:56.256331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:56.257596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:56.272182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:56.272962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:56.273645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:56.281140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:56.281911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:56.282565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:56.345240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:56.345923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:56.358740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:56.359156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:56.359602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:56.364648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:56.365131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:56.365629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:56.631743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:56.673824 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7ce041a6-bbb3-4e0a-a561-f0445bbd53d7 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1336 microversion: 2.1 time: 0.326609 Aug 30 03:47:56.674530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2183/4453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:56 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1336 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:57.018290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:57.042786 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e3129d4-af5e-4199-8f98-ed3dffc25107 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1501 microversion: 2.1 time: 0.790360 Aug 30 03:47:57.048246 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2271/4454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:56 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1501 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:57.080065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:57.080953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:57.096784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:57.099422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:57.100729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:57.108192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:57.109220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:57.110546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:57.169586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:47:57.312126 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c4be70a-24d0-4143-b603-c38c9e40b8bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 204 len: 0 microversion: 2.1 time: 0.236790 Aug 30 03:47:57.312755 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2184/4455] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:47:57 2022] DELETE /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:47:57.354218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:57.354218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:57.380665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:57.383607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:57.385002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:57.389640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:57.390957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:57.395366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:57.697528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:57.698211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:57.710973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:57.711892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:57.712839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:57.714555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:57.715371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:57.716006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:58.030463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:58.039277 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa8cda7d-4e26-48d8-aec1-b8ef44b23def tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1336 microversion: 2.1 time: 0.346715 Aug 30 03:47:58.039966 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2185/4456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:57 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1336 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:58.192479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:58.209806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-169d264d-b081-4a39-ac65-ce05e13ef96f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1507 microversion: 2.1 time: 0.879435 Aug 30 03:47:58.210405 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2272/4457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:57 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1507 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:47:59.061416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:59.062849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:59.077754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:59.078751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:59.079361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:59.080260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:59.080884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:59.081545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:59.140919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:59.231801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:47:59.232428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:47:59.241907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:59.246045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:59.246735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:59.251277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:47:59.251963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:47:59.252549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:47:59.309540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:47:59.869408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:59.880967 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05471c4a-0f43-4085-bb5d-cbd905208685 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1507 microversion: 2.1 time: 0.652900 Aug 30 03:47:59.890472 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2273/4458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:59 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:47:59.894889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:47:59.912103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-503bce01-7234-4924-bfb8-f6145fe83c44 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1403 microversion: 2.1 time: 0.851654 Aug 30 03:47:59.925833 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2186/4459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:47:59 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1403 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:00.176452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-cfc4f04b-3f19-4b20-a543-31c21a86ef78 req-8146601c-4449-4946-a15f-96ca6dba15c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "569afdb5-9034-4ff4-b49a-3518ef22b279", "tag": "3ec57118-e2c5-48a3-ab72-da8c30aade0f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:00.193495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cfc4f04b-3f19-4b20-a543-31c21a86ef78 req-8146601c-4449-4946-a15f-96ca6dba15c2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:00.193984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cfc4f04b-3f19-4b20-a543-31c21a86ef78 req-8146601c-4449-4946-a15f-96ca6dba15c2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:00.194415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cfc4f04b-3f19-4b20-a543-31c21a86ef78 req-8146601c-4449-4946-a15f-96ca6dba15c2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:00.234280 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-cfc4f04b-3f19-4b20-a543-31c21a86ef78 req-8146601c-4449-4946-a15f-96ca6dba15c2 service nova] Creating event network-changed:3ec57118-e2c5-48a3-ab72-da8c30aade0f for instance 569afdb5-9034-4ff4-b49a-3518ef22b279 on n-h2-854924-5 Aug 30 03:48:00.249907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-cfc4f04b-3f19-4b20-a543-31c21a86ef78 req-8146601c-4449-4946-a15f-96ca6dba15c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077381 Aug 30 03:48:00.250453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2274/4460] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:48:00.919531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:00.920928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:00.933160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:00.938790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:00.939483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:00.941669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:00.942594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:00.943194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:00.943370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:00.944756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:00.957816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:00.958571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:00.959343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:00.981210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:00.998087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:00.999811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:01.167305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:01.191209 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5e428701-ea31-4919-bac8-6a1d91f18fa1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1507 microversion: 2.1 time: 0.268715 Aug 30 03:48:01.192518 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2187/4461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:00 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:01.593170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:01.610446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f1de7d4d-cfa8-4a37-a49d-e36ec19605e5 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1403 microversion: 2.1 time: 0.671375 Aug 30 03:48:01.640875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2275/4462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:00 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1403 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:01.877437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1b6b8257-3a4c-4600-ab25-058390220036 req-5fea05d6-2dd9-4c2d-8941-0f1f0b8f2f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cec778-c0a3-466d-97b1-e7608b1e13ce", "name": "network-vif-deleted", "tag": "4b60dc72-2168-4c2f-8c70-a4fedc831592"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:01.913868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1b6b8257-3a4c-4600-ab25-058390220036 req-5fea05d6-2dd9-4c2d-8941-0f1f0b8f2f2e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:01.915500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1b6b8257-3a4c-4600-ab25-058390220036 req-5fea05d6-2dd9-4c2d-8941-0f1f0b8f2f2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:01.917462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1b6b8257-3a4c-4600-ab25-058390220036 req-5fea05d6-2dd9-4c2d-8941-0f1f0b8f2f2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:01.988775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1b6b8257-3a4c-4600-ab25-058390220036 req-5fea05d6-2dd9-4c2d-8941-0f1f0b8f2f2e service nova] Creating event network-vif-deleted:4b60dc72-2168-4c2f-8c70-a4fedc831592 for instance 74cec778-c0a3-466d-97b1-e7608b1e13ce on n-h1-854924-5 Aug 30 03:48:02.002679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1b6b8257-3a4c-4600-ab25-058390220036 req-5fea05d6-2dd9-4c2d-8941-0f1f0b8f2f2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129925 Aug 30 03:48:02.008376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2188/4463] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:02.220858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:02.221526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:02.241372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:02.241881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:02.242322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:02.249182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:02.251276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:02.252225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:02.358003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:02.360096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:02.361738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:02.364720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'fault' on Instance uuid 74cec778-c0a3-466d-97b1-e7608b1e13ce {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:48:02.648652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:02.649543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:02.675021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:02.692984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:02.696326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:02.701648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:02.708319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:02.720401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:03.037555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:03.066825 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-25c78633-cb44-4f40-be9c-227a7d6fa2e9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 200 len: 1305 microversion: 2.1 time: 0.849770 Aug 30 03:48:03.099855 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2276/4464] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:02 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 1305 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:03.326940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:03.337598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-adb9117f-bf03-4427-969f-ce4f35505743 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1403 microversion: 2.1 time: 0.693882 Aug 30 03:48:03.340630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2189/4465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:02 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1403 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:04.105274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:04.106080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:04.128016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:04.129825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=10 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:04.136827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:04.140397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:04.141718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:04.149377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:04.151657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:04.155689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:04.226034 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce HTTP/1.1 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '74cec778-c0a3-466d-97b1-e7608b1e13ce'} Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:48:04.232907 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:48:04.238620 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-379386bc-cb43-4cc2-a38c-c919541c1fe1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 404 len: 111 microversion: 2.1 time: 0.136207 Aug 30 03:48:04.242092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2277/4466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:04 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:48:04.364042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:04.365178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:04.380706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:04.391292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:04.392048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:04.397871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:04.407118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-274243494", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:04.407320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:04.407754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:04.409787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:04.534088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:48:05.117610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:05.137567 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5a0bc36-5a47-48ab-95d1-b117d09d830b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1403 microversion: 2.1 time: 0.768703 Aug 30 03:48:05.138740 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2190/4467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:04 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1403 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:05.706828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-99d3224a-582a-48ff-9501-c71d1320b456 req-2b1ada98-be53-4cbf-892e-b422436a4ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569afdb5-9034-4ff4-b49a-3518ef22b279", "name": "network-vif-plugged", "status": "completed", "tag": "3ec57118-e2c5-48a3-ab72-da8c30aade0f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:05.732493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-99d3224a-582a-48ff-9501-c71d1320b456 req-2b1ada98-be53-4cbf-892e-b422436a4ef6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:05.733281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-99d3224a-582a-48ff-9501-c71d1320b456 req-2b1ada98-be53-4cbf-892e-b422436a4ef6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:05.733936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-99d3224a-582a-48ff-9501-c71d1320b456 req-2b1ada98-be53-4cbf-892e-b422436a4ef6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:05.788137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-99d3224a-582a-48ff-9501-c71d1320b456 req-2b1ada98-be53-4cbf-892e-b422436a4ef6 service nova] Creating event network-vif-plugged:3ec57118-e2c5-48a3-ab72-da8c30aade0f for instance 569afdb5-9034-4ff4-b49a-3518ef22b279 on n-h2-854924-5 Aug 30 03:48:05.815505 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-99d3224a-582a-48ff-9501-c71d1320b456 req-2b1ada98-be53-4cbf-892e-b422436a4ef6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114578 Aug 30 03:48:05.816129 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2191/4468] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:48:05.948455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:05.958703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:05.972028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:05.972520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:05.973259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:05.979792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:05.989205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:05.989943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:06.104875 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e2f40e5-2d3f-4476-84b9-79f8a1a7b7cc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/ips" status: 200 len: 151 microversion: 2.20 time: 0.161011 Aug 30 03:48:06.112110 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2192/4469] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Aug 30 03:48:05 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/ips => generated 151 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:48:06.159472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:06.160109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:06.172731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:06.176207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:06.176844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:06.177652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:06.178139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:06.178636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:06.784792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:06.801911 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-146387ce-9a87-44da-9e1d-b64e4710d63c tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1403 microversion: 2.1 time: 0.640054 Aug 30 03:48:06.823463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2193/4470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:06 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1403 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:06.980506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:48:06.981020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:48:06.981408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:48:06.981888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:48:06.982301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:48:07.009531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:07.010430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:07.011104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:07.012140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:07.013172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:07.013873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:07.053031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:48:07.066469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:48:07.103722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:48:07.110416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:48:07.237155 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-35818a18-2f62-4837-93db-605e08be9c9d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.838020 Aug 30 03:48:07.239724 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2278/4471] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:48:07.253313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49d23942-8b26-4a4e-8de9-98bacf4fa27c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:07.254546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-49d23942-8b26-4a4e-8de9-98bacf4fa27c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:07.386424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-49d23942-8b26-4a4e-8de9-98bacf4fa27c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:07.407951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-49d23942-8b26-4a4e-8de9-98bacf4fa27c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1214 microversion: 2.1 time: 0.160864 Aug 30 03:48:07.408599 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2194/4472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:07 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:07.830058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:07.831091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:07.843029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:07.846178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:07.846360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:07.847312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:07.849939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:07.851740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:08.249067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:08.265063 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-128c359f-3590-410f-9947-814feb4c1592 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1589 microversion: 2.1 time: 0.435326 Aug 30 03:48:08.277370 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2279/4473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:07 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1589 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:08.323734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:08.328130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:08.387456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:08.389053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:08.390752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:08.391221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:08.406634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:08.407251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:08.407714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:08.439060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17625d00-bd20-49b8-a8fc-1c748591a967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:08.447415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17625d00-bd20-49b8-a8fc-1c748591a967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:08.603860 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dac39de6-7e80-42d0-b3aa-2e13beab3a8e tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.307251 Aug 30 03:48:08.605016 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2195/4474] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:48:08 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:08.718307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17625d00-bd20-49b8-a8fc-1c748591a967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:08.727013 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17625d00-bd20-49b8-a8fc-1c748591a967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1214 microversion: 2.1 time: 0.299551 Aug 30 03:48:08.727777 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2280/4475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:08 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1214 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:08.994096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1541710999", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:09.207527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] validate_networks() for [('0a1ce1ae-379e-4b65-93eb-567286368551', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:48:09.753881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:09.755315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:09.769851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:09.790801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:09.791839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:09.792641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:09.793182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:09.793694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:10.341076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:10.360318 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cec099b1-96da-4837-ab9a-bf9fa2a2e9d4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1266 microversion: 2.1 time: 0.609553 Aug 30 03:48:10.362474 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2281/4476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:09 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1266 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:10.568290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:48:10.568785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:48:10.570299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:48:10.570775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:48:10.574194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:48:10.592682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:10.598286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:10.599064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:10.604442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:10.605433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:10.606604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:10.649832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Getting quotas for project a3e7cee69d0d498b8415ecc523013838. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:48:10.656225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Getting quotas for user 8d8f4bdce76e439188219d1b1b70005a and project a3e7cee69d0d498b8415ecc523013838. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:48:10.689494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:48:10.700117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:48:10.833924 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-037a5ffa-027e-47e5-815b-7630abda08bb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.220468 Aug 30 03:48:10.836846 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2196/4477] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:48:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:48:10.850683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7c3dda19-01d3-4f6e-b8e3-6616ff043aa9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:10.851299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7c3dda19-01d3-4f6e-b8e3-6616ff043aa9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:11.001763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7c3dda19-01d3-4f6e-b8e3-6616ff043aa9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:11.022402 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7c3dda19-01d3-4f6e-b8e3-6616ff043aa9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1214 microversion: 2.1 time: 0.176522 Aug 30 03:48:11.023312 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2282/4478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:10 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:11.095870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:11.096783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:11.116960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:11.120901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:11.123985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:11.141053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:11.141978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:11.142804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:11.260662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lazy-loading 'flavor' on Instance uuid afa19e79-3638-4c08-ab26-f3b68068e3e0 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:48:11.395919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:11.398888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:11.448180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:11.451881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:11.455947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:11.461241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:11.464678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:11.466294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:11.930214 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be0f4e28-2b26-4735-806e-300bd740f06e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/action" status: 202 len: 0 microversion: 2.20 time: 0.840279 Aug 30 03:48:11.945678 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2197/4479] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:48:11 2022] POST /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/action => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:48:11.958536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:11.959575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:11.980988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:11.989214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:11.994631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:11.995783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:11.999088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:12.007166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:12.441758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:12.467572 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e990125a-bd70-4ec5-9576-abe7a5036489 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1272 microversion: 2.1 time: 1.078995 Aug 30 03:48:12.469849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2283/4480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:11 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1272 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:12.492707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:12.495160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:12.509680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:12.510185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:12.510622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:12.511318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:12.517104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:12.517807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:12.724252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:12.737476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9ac97dfa-2cf9-44a0-8532-8ad2a7556518 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1266 microversion: 2.1 time: 0.264455 Aug 30 03:48:12.761675 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2284/4481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:12 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:12.943130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:12.954242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:12.955771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:12.964081 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb9b1fea-c237-4c4d-9c9d-995909e202b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 1.011114 Aug 30 03:48:12.972902 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2198/4482] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:11 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:13.494984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:13.496839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:13.517325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:13.530563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:13.533275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:13.540367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:13.541316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:13.548748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:13.762616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:13.763311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:13.779305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:13.779835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:13.780288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:13.791201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:13.792026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:13.801054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:14.057786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:14.082232 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c5fad25-de9a-4603-9edb-78dc8e4f3b4f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1272 microversion: 2.1 time: 0.324486 Aug 30 03:48:14.083460 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2199/4483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:13 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1272 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:14.089253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:14.090119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:14.097983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:14.098766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:14.099404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:14.100282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:14.100902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:14.102174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:14.288802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:14.316728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-41e67744-bd69-42d8-b17a-222ea075cbaf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 0.826436 Aug 30 03:48:14.330858 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2285/4484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:13 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:14.336097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-77b6c15d-b520-4c7d-b160-e31b1d730bef req-240cb848-946a-4eab-821b-3b44c97dc078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "569afdb5-9034-4ff4-b49a-3518ef22b279", "tag": "3ec57118-e2c5-48a3-ab72-da8c30aade0f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:14.365795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-77b6c15d-b520-4c7d-b160-e31b1d730bef req-240cb848-946a-4eab-821b-3b44c97dc078 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:14.368984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-77b6c15d-b520-4c7d-b160-e31b1d730bef req-240cb848-946a-4eab-821b-3b44c97dc078 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:14.369480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-77b6c15d-b520-4c7d-b160-e31b1d730bef req-240cb848-946a-4eab-821b-3b44c97dc078 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:14.410500 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-77b6c15d-b520-4c7d-b160-e31b1d730bef req-240cb848-946a-4eab-821b-3b44c97dc078 service nova] Creating event network-changed:3ec57118-e2c5-48a3-ab72-da8c30aade0f for instance 569afdb5-9034-4ff4-b49a-3518ef22b279 on n-h2-854924-5 Aug 30 03:48:14.423103 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-77b6c15d-b520-4c7d-b160-e31b1d730bef req-240cb848-946a-4eab-821b-3b44c97dc078 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090779 Aug 30 03:48:14.432888 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2286/4485] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:14.439301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:14.440056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:14.458892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:14.459607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:14.460216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:14.461185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:14.463198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:14.463807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:14.794147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:14.813055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:14.814698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:14.834464 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36d9c4d5-60e9-4c1e-9f58-e8ba83c932e9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.399989 Aug 30 03:48:14.837659 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2287/4486] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:14 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:15.105036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:15.105922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:15.120060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:15.120793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:15.121424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:15.122333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:15.122954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:15.125836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:15.154841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:15.192067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-051c1c9b-0c83-4793-b965-30970ef87db4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1589 microversion: 2.1 time: 1.106755 Aug 30 03:48:15.198849 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2200/4487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:14 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1589 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:15.339126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:15.346074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:15.370590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:15.379646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:15.382897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:15.383369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:15.384277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:15.384834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:15.385325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:15.405473 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f56a1893-3d53-43f3-83f6-9dc8f4c73ae3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1272 microversion: 2.1 time: 0.305083 Aug 30 03:48:15.406779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2288/4488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:15 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:15.870892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:15.872490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:15.889595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:15.890905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:15.891964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:15.892930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:15.893666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:15.898680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:16.556481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:16.571232 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8b745561-d97c-4a6f-9fd0-f204c15d2eac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 1.231195 Aug 30 03:48:16.573896 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2201/4489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:15 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:16.587928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:16.589215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:16.603426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:16.604303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:16.605283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:16.606395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:16.607272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:16.607867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:16.656069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:16.688233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:16.694659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:16.703201 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e72ef96e-a323-48a9-8922-e24683fb13b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.837393 Aug 30 03:48:16.705176 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2289/4490] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:15 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:16.756065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fc3717dd-fba9-4e0f-8575-d10ab1969b84 req-cb8f288a-e410-496f-a206-04d75e1f0448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0782294-915e-4d7b-b41a-e77ce446b232", "tag": "1c55d6dc-c840-4c2a-b5eb-bc11d669742a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:16.800916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fc3717dd-fba9-4e0f-8575-d10ab1969b84 req-cb8f288a-e410-496f-a206-04d75e1f0448 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:16.803436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fc3717dd-fba9-4e0f-8575-d10ab1969b84 req-cb8f288a-e410-496f-a206-04d75e1f0448 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:16.810475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fc3717dd-fba9-4e0f-8575-d10ab1969b84 req-cb8f288a-e410-496f-a206-04d75e1f0448 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:16.866900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fc3717dd-fba9-4e0f-8575-d10ab1969b84 req-cb8f288a-e410-496f-a206-04d75e1f0448 service nova] Creating event network-changed:1c55d6dc-c840-4c2a-b5eb-bc11d669742a for instance e0782294-915e-4d7b-b41a-e77ce446b232 on n-h1-854924-5 Aug 30 03:48:16.895443 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fc3717dd-fba9-4e0f-8575-d10ab1969b84 req-cb8f288a-e410-496f-a206-04d75e1f0448 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186641 Aug 30 03:48:16.896945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2290/4491] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:17.348447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:17.365556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12d789d0-7f6d-4771-a192-fa65fc184667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.789158 Aug 30 03:48:17.382273 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2202/4492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:16 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:17.597310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:17.598366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:17.600700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:17.611179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:17.612331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:17.615676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:17.624064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:17.626272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:17.626456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:17.741146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:17.741790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:17.761413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:17.761922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:17.762364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:17.763080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:17.763531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:17.763958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:18.092571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:18.113524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-245a0321-996b-4bcd-ad6d-e7c2da919883 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 0.520842 Aug 30 03:48:18.116699 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2291/4493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:17 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:18.216799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:18.232296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:18.233778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:18.235582 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dcca0f80-6bea-4818-9239-fab9a1f8652a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.506532 Aug 30 03:48:18.244049 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2203/4494] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:17 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:18.392823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:18.393878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:18.395829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:18.412107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:18.413812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:18.414289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:18.419687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:18.421632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:18.422842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:18.517237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b4eb3a27-a43c-4f81-b800-4cbc73647388 req-382f7933-0286-49e2-bd0d-1772caa02538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317d996a-0585-4cae-bf2f-81447f90186d", "tag": "3bbeae90-e629-42d9-b3e6-9717d5b6c717"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:18.535650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b4eb3a27-a43c-4f81-b800-4cbc73647388 req-382f7933-0286-49e2-bd0d-1772caa02538 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:18.536045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b4eb3a27-a43c-4f81-b800-4cbc73647388 req-382f7933-0286-49e2-bd0d-1772caa02538 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:18.536480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b4eb3a27-a43c-4f81-b800-4cbc73647388 req-382f7933-0286-49e2-bd0d-1772caa02538 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:18.589059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b4eb3a27-a43c-4f81-b800-4cbc73647388 req-382f7933-0286-49e2-bd0d-1772caa02538 service nova] Creating event network-changed:3bbeae90-e629-42d9-b3e6-9717d5b6c717 for instance 317d996a-0585-4cae-bf2f-81447f90186d on n-h1-854924-5 Aug 30 03:48:18.604984 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b4eb3a27-a43c-4f81-b800-4cbc73647388 req-382f7933-0286-49e2-bd0d-1772caa02538 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090757 Aug 30 03:48:18.611076 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2204/4495] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:48:18.749941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:18.778049 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7245f8d7-0bc1-4d0e-9cdd-4c48adc47667 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.390480 Aug 30 03:48:18.793236 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2292/4496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:18 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:19.152237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:19.152997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:19.174320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:19.175555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:19.176014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:19.178268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:19.178643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:19.179085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:19.254513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:19.292788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:19.294246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:19.312617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:19.315385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:19.315897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:19.316885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:19.317386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:19.317900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:20.120948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:20.152591 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca18396a-8e3c-4bed-b9ba-d035bb63b1d8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 1.013002 Aug 30 03:48:20.161925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2205/4497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:19 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:20.170527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:20.171261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:20.189588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:20.191441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:20.192074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:20.194887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:20.195634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:20.198973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:20.415965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lazy-loading 'services' on Instance uuid 7271fb16-3136-46c9-8b26-e981c6391d9b {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:48:20.492684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:20.512767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:20.515220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:20.516881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d86ee0a-892f-4881-afdc-83150aa04097 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 1.229329 Aug 30 03:48:20.518066 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2293/4498] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:19 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:20.530574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:20.531379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:20.554029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:20.557937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:20.558714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:20.560234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:20.562297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:20.563360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:20.607220 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aaf39df3-dbf0-4c7a-9f97-4ad89ca14e62 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-volume_attachments/6b97fc67-7f81-434a-89b4-6a5278775d54" status: 202 len: 0 microversion: 2.1 time: 0.443558 Aug 30 03:48:20.608449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2206/4499] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:48:20 2022] DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-volume_attachments/6b97fc67-7f81-434a-89b4-6a5278775d54 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:48:20.973453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:20.980870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:20.983826 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2df329d5-5ec1-496a-8ce2-bc13ecb130b5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.463805 Aug 30 03:48:20.988295 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2294/4500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:20 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:21.187073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:21.187848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:21.191058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:21.191747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:21.217317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:21.217967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:21.218427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:21.219180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:21.219646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:21.220078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:21.547253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:21.547861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:21.550234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=10 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:21.564989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:21.569241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:21.569978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:21.571133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:21.572474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:21.573879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:21.828386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:21.846248 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-76a2542e-5cea-46bc-830b-10a89110bc04 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 0.665170 Aug 30 03:48:21.860945 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2207/4501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:21 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:22.009109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:22.009803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:22.021254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:22.021803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:22.022261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:22.023000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:22.023469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:22.023905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:22.311222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:22.323917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:22.325788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:22.327220 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0fcf62a8-a537-4199-b260-c67d7c0bc3e0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.785489 Aug 30 03:48:22.330767 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2295/4502] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:21 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:48:22.562178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:22.573455 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8e898b5-9fb5-42bd-b7aa-10d9394f94d5 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.569158 Aug 30 03:48:22.592115 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2208/4503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:22 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:22.868862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:22.870244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:22.886168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:22.904114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:22.904999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:22.906186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:22.906897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:22.907571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:23.212021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:23.225858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba154d15-204a-4aad-b866-afe67a7b5702 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 0.361412 Aug 30 03:48:23.227218 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2296/4504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:22 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:23.356852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:23.357492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:23.380370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:23.381100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:23.381780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:23.383257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:23.385864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:23.388179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:23.596621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:23.597569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:23.615440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:23.616404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:23.617095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:23.618594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:23.620139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:23.622450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:23.682047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:23.697091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:23.698920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:23.700664 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-575a6eb8-dbac-4088-8be3-466df23eaaf0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.348125 Aug 30 03:48:23.701398 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2209/4505] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:23 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:48:23.905516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:23.918666 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7afcb1db-ec19-4a0b-9d91-0d5259b20736 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.324137 Aug 30 03:48:23.929909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2297/4506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:23 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:24.248627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:24.249259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:24.265113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.267941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.269988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:24.270867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.271409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.274156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:24.551684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:24.564027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-41a0709e-dbd0-4aa1-a842-d8ab9ebe6cd2 req-4adabc64-3dec-4424-9f27-48442b7ce264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0782294-915e-4d7b-b41a-e77ce446b232", "name": "network-vif-plugged", "status": "completed", "tag": "1c55d6dc-c840-4c2a-b5eb-bc11d669742a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:24.565129 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6a0c0d4-59d5-49e4-825b-76423ef1e79d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 0.320530 Aug 30 03:48:24.581121 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2210/4507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:24 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:24.581423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-41a0709e-dbd0-4aa1-a842-d8ab9ebe6cd2 req-4adabc64-3dec-4424-9f27-48442b7ce264 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.581423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-41a0709e-dbd0-4aa1-a842-d8ab9ebe6cd2 req-4adabc64-3dec-4424-9f27-48442b7ce264 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.581423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-41a0709e-dbd0-4aa1-a842-d8ab9ebe6cd2 req-4adabc64-3dec-4424-9f27-48442b7ce264 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:24.606717 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-41a0709e-dbd0-4aa1-a842-d8ab9ebe6cd2 req-4adabc64-3dec-4424-9f27-48442b7ce264 service nova] Creating event network-vif-plugged:1c55d6dc-c840-4c2a-b5eb-bc11d669742a for instance e0782294-915e-4d7b-b41a-e77ce446b232 on n-h1-854924-5 Aug 30 03:48:24.616773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-41a0709e-dbd0-4aa1-a842-d8ab9ebe6cd2 req-4adabc64-3dec-4424-9f27-48442b7ce264 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056753 Aug 30 03:48:24.618849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2298/4508] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:48:24.728565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:24.729381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:24.741033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.742682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.743311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:24.747094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.748123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.748817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:24.946948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:24.947658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:24.960656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.961842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.971268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:24.972402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:24.973541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:24.974745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:25.185019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:25.195271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:25.212028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:25.218902 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3760f7a2-8b21-41ed-a256-975a3800125b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.495430 Aug 30 03:48:25.220754 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2211/4509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:24 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:25.345184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:25.360663 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b6bc575-a79a-4e0f-882d-f737eba26993 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.419022 Aug 30 03:48:25.361702 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2299/4510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:24 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:25.588171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:25.589123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:25.603367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:25.605381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:25.607646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:25.608949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:25.609963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:25.611920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:25.885526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:25.904628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dcaf36d-e5db-430d-a90f-e95c01596d7e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1314 microversion: 2.1 time: 0.319405 Aug 30 03:48:25.908978 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2212/4511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:25 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:26.244304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:26.246459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:26.275623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:26.276670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:26.277409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:26.278420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:26.283536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:26.284573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:26.387811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:26.388829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:26.405642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:26.406474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:26.407234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:26.408137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:26.408727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:26.409295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:26.588532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:26.606790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:26.610525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:26.618615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50992eae-76bf-4f9b-a18d-c36ae8a8f368 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.378709 Aug 30 03:48:26.619464 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2300/4512] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:26 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:26.711252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:26.723658 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f950cd5d-ed43-4f3b-920c-c9e350d34260 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.340394 Aug 30 03:48:26.725110 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2213/4513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:26 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:26.928496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:26.929533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:26.941528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:26.942235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:26.942943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:26.943958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:26.945963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:26.947216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:27.255136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:27.267147 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6498001-0d23-4ea7-b567-f0bebd578de9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1500 microversion: 2.1 time: 0.342414 Aug 30 03:48:27.268454 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2301/4514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:26 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1500 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:27.646385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:27.647663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:27.668286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:27.673970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:27.675028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:27.676072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:27.677652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:27.678361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:27.746929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:27.747687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:27.761490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:27.763495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:27.766643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:27.770180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:27.770742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:27.771241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:28.151960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:28.161619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:28.178689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:28.182443 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7db46d4-127a-42ef-bf0e-212fe45782ad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1741 microversion: 2.20 time: 0.540937 Aug 30 03:48:28.183481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2214/4515] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:27 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1741 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:28.249482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:28.258268 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-339023e8-b4e0-4357-ae9b-073c4f6f92b8 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.516895 Aug 30 03:48:28.259464 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2302/4516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:27 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:29.211405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:29.212884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:29.226857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:29.227879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:29.236737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:29.237837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:29.245194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:29.251920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:29.282532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:29.285460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:29.306055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:29.312116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:29.314968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:29.318931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:29.323342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:29.324185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:29.619433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:29.631428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:29.634990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:29.637766 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2972ad7-36bb-4fe5-8584-b5ffea09514c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1741 microversion: 2.20 time: 0.430685 Aug 30 03:48:29.641617 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2215/4517] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:29 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:29.681884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:29.693993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6350e555-b9fb-419f-bf0f-a82d600e1ab9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.415962 Aug 30 03:48:29.705950 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2303/4518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:29 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:30.671715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:30.672476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:30.699420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:30.703417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:30.705947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:30.706751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:30.712716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:30.714954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:30.716237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:30.716961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:30.730744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:30.731870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:30.733941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:30.744384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:30.745102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:30.745691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:31.278633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:31.291841 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-977c8565-8836-4721-8249-e0f2eb9a8229 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.579935 Aug 30 03:48:31.297610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2304/4519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:30 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:31.301055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:31.313471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:31.315471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:31.317058 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4630a619-5b7c-4afc-b727-ec129edfa0d6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.649741 Aug 30 03:48:31.318272 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2216/4520] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:30 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:32.312749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:32.313294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:32.328225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:32.345298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:32.346535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:32.351025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:32.353714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:32.356279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:32.356939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:32.358748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:32.359387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:32.364928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:32.365617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:32.368720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:32.379903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:32.380567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:33.058511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:33.075287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-87e43a3b-5e32-4c3a-8825-17d54ad2803b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 0.766402 Aug 30 03:48:33.076005 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2305/4521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:32 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:33.115509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-77994991-3db6-497d-b0b8-a42cd87d972c req-d9bcd223-0930-498e-8cce-0a3237540412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317d996a-0585-4cae-bf2f-81447f90186d", "name": "network-vif-plugged", "status": "completed", "tag": "3bbeae90-e629-42d9-b3e6-9717d5b6c717"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:33.148507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:33.168022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:33.180250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-77994991-3db6-497d-b0b8-a42cd87d972c req-d9bcd223-0930-498e-8cce-0a3237540412 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:33.187601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:33.189068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-77994991-3db6-497d-b0b8-a42cd87d972c req-d9bcd223-0930-498e-8cce-0a3237540412 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:33.189803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-77994991-3db6-497d-b0b8-a42cd87d972c req-d9bcd223-0930-498e-8cce-0a3237540412 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:33.190387 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d061888f-0cd2-47dd-8001-592f45a61d11 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.848837 Aug 30 03:48:33.207559 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2217/4522] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:32 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:48:33.240235 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-77994991-3db6-497d-b0b8-a42cd87d972c req-d9bcd223-0930-498e-8cce-0a3237540412 service nova] Creating event network-vif-plugged:3bbeae90-e629-42d9-b3e6-9717d5b6c717 for instance 317d996a-0585-4cae-bf2f-81447f90186d on n-h1-854924-5 Aug 30 03:48:33.255475 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-77994991-3db6-497d-b0b8-a42cd87d972c req-d9bcd223-0930-498e-8cce-0a3237540412 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164011 Aug 30 03:48:33.256577 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2306/4523] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:33.277972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fbc356a-94e4-4604-ae37-cd66ac36f6f2"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:33.281213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:33.314785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:33.322975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:33.324056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:33.328787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:33.332132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:33.333462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:34.098505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:34.099852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:34.166609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:34.172167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:34.172726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:34.173530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:34.174012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:34.174468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:34.733848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc0d8762-6109-48ec-8ff3-d962f23f0e40 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.461018 Aug 30 03:48:34.734497 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2218/4524] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:48:33 2022] POST /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232/os-volume_attachments => generated 194 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:34.745005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea43858b-d712-4217-af0f-b5d950c656a6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:34.770086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43858b-d712-4217-af0f-b5d950c656a6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:34.770620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43858b-d712-4217-af0f-b5d950c656a6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:34.776560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea43858b-d712-4217-af0f-b5d950c656a6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:34.846405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea43858b-d712-4217-af0f-b5d950c656a6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Going to try to stop instance {{(pid=122167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:48:34.904636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:34.990715 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea43858b-d712-4217-af0f-b5d950c656a6 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action" status: 202 len: 0 microversion: 2.1 time: 0.254480 Aug 30 03:48:34.992036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2219/4525] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:48:34 2022] POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:48:35.012069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:35.014108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:35.037044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:35.037977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:35.038624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:35.039555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:35.043400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:35.044038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:35.163074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:35.182697 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0687bad-15f9-4007-b951-7d704b3e5180 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1314 microversion: 2.1 time: 1.088202 Aug 30 03:48:35.183925 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2307/4526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:34 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:35.191676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:35.220630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:35.259455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:35.260145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:35.260879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:35.268693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:35.269198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:35.275762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:35.658454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:35.684667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:35.687348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:35.689571 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b521e691-0898-41be-9ddf-df890743f72b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.693720 Aug 30 03:48:35.711306 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2220/4527] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:34 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:35.759763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-194e0eac-2197-4497-a2ac-3a6f9dd5ced9 req-80612510-ac11-4540-bac0-4a2edd904a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "name": "network-vif-plugged", "status": "completed", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:35.804317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-194e0eac-2197-4497-a2ac-3a6f9dd5ced9 req-80612510-ac11-4540-bac0-4a2edd904a3f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:35.804977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-194e0eac-2197-4497-a2ac-3a6f9dd5ced9 req-80612510-ac11-4540-bac0-4a2edd904a3f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:35.807664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-194e0eac-2197-4497-a2ac-3a6f9dd5ced9 req-80612510-ac11-4540-bac0-4a2edd904a3f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:35.836265 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-194e0eac-2197-4497-a2ac-3a6f9dd5ced9 req-80612510-ac11-4540-bac0-4a2edd904a3f service nova] Creating event network-vif-plugged:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:48:35.844371 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-194e0eac-2197-4497-a2ac-3a6f9dd5ced9 req-80612510-ac11-4540-bac0-4a2edd904a3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131274 Aug 30 03:48:35.849387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2221/4528] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:36.193208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:36.210140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:36.210873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:36.215449 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1ee6a6bc-1640-46cc-8e62-433fc994f75e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1677 microversion: 2.1 time: 1.030213 Aug 30 03:48:36.219385 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2308/4529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:35 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1677 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:36.242259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:36.243981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:36.246020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:36.246989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:36.250130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:36.250794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:36.627660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:36.642691 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a194eaa-af8d-4a6a-99a8-1f94646d7f3c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1499 microversion: 2.1 time: 0.437073 Aug 30 03:48:36.660113 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2222/4530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:36 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1499 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:36.666708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:36.669371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:36.702920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:36.709131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:36.714001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:36.715009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:36.717174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:36.718063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:36.719173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:36.719618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:36.728240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:36.731704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:36.735478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:36.736250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:36.741866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:36.742351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:36.796279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lazy-loading 'flavor' on Instance uuid 317d996a-0585-4cae-bf2f-81447f90186d {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:48:37.080219 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dda25557-2927-431f-b1be-77f207c3da20 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "POST /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d/action" status: 200 len: 32 microversion: 2.1 time: 0.418687 Aug 30 03:48:37.091763 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2309/4531] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:48:36 2022] POST /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d/action => generated 32 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 03:48:37.097269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:37.098044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:37.150975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:37.151539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:37.152143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:37.153027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:37.153524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:37.153966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:37.172499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:37.186425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:37.193275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:37.195372 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5c3d4a8-6827-45bd-87cd-62d66723ba86 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.482451 Aug 30 03:48:37.210726 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2223/4532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:36 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:48:37.245861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:37.246472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:37.261882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:37.267777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:37.267777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:37.270859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:37.272093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:37.275463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:37.785813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:37.789044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:37.803693 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4ffce9c-1ab9-4c8b-aaa4-265048b877fb tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.710544 Aug 30 03:48:37.810357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2310/4533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:37 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:37.834015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:37.851131 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ecf393f-1921-4ab1-93f9-e4ff43759be0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1677 microversion: 2.1 time: 0.612966 Aug 30 03:48:37.855651 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2224/4534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:37 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1677 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:38.225585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:38.226366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:38.251380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:38.251905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:38.255347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:38.259244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:38.259774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:38.260222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:38.715316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:38.729300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:38.731320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:38.732548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a121b472-d772-4b72-b749-ee42f9582cba tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.512913 Aug 30 03:48:38.733125 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2311/4535] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:38 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:38.833961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:38.834594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:38.851163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:38.854781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:38.855656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:38.856453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:38.857773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:38.858611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:38.879192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:38.880256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:38.901784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:38.921947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:38.930046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:38.942123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:38.943211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:38.950135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:38.950590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:39.551850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:39.569023 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b42368e8-9e10-4328-a4c0-1bdc739f9a7a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1677 microversion: 2.1 time: 0.697034 Aug 30 03:48:39.570373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2312/4536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:38 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1677 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:39.695045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:39.707817 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a17b28d-a7f6-4187-b321-9037a8d04553 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.877602 Aug 30 03:48:39.716267 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2225/4537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:38 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:39.794380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:39.795373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:39.814427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:39.817591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:39.819106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:39.820236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:39.823308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:39.824151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:40.073446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:40.085134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:40.087655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:40.089164 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a879332-ead6-4e02-89d3-481feca7de47 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.335984 Aug 30 03:48:40.101783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2313/4538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:39 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:40.592741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:40.594155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:40.605114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:40.626383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:40.627109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:40.630240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:40.637942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:40.641123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:40.732949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:40.733902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:40.767359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:40.768182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:40.768746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:40.771435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:40.773857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:40.775859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:41.392698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:41.396846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:41.406873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7be13280-a284-4687-a750-29b0d53450dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1677 microversion: 2.1 time: 0.818012 Aug 30 03:48:41.409627 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2226/4539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:40 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1677 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:41.415763 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31477e66-89f1-4e8d-bc0d-cff3d451194f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.681804 Aug 30 03:48:41.423587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:41.425679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:41.433909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2314/4540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:40 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:41.445018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:41.446167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:41.446872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:41.448773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:41.450182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:41.452272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:41.824693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:41.834924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:41.848663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:41.852541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4259def-c507-4bc1-ae72-62849f15957f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.440502 Aug 30 03:48:41.864471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2227/4541] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:41 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:42.435269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:42.437503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:42.447506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:42.448275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:42.459404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:42.460061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:42.460589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:42.462854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:42.463017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:42.463719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:42.464334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:42.464613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:42.465239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:42.465721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:42.466315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:42.466715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:43.408907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:43.420069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-043f9f0f-0984-4b98-a02c-e8cf0840e1ac tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.976726 Aug 30 03:48:43.458768 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2228/4542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:42 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:43.465765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:43.479250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:43.485232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:43.502729 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9604bdb-ec92-4480-8539-d00b491ba692 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1677 microversion: 2.1 time: 1.074654 Aug 30 03:48:43.507845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:43.510603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:43.512626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:43.518338 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2315/4543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:42 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1677 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:43.520294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:43.536369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:43.538979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:44.262748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:44.286854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:44.288357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:44.290189 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0b7b836-bac2-4cc7-9eeb-1fe674bd9289 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.829219 Aug 30 03:48:44.306503 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2229/4544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:43 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:44.450517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:44.452053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:44.468183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:44.469309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:44.472339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:44.474857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:44.478934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:44.480188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:44.528557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:44.529176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:44.545710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:44.547177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:44.547842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:44.549410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:44.550092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:44.551300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:44.974504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:44.988586 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa2a9072-e3ea-4108-8bf8-4747d6add4f0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.538289 Aug 30 03:48:44.989947 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2316/4545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:44 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:44.991059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:45.000244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7dbfe0c9-03ff-4c67-a2b9-44ed3057dbea tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1677 microversion: 2.1 time: 0.476178 Aug 30 03:48:45.007188 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2230/4546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:44 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1677 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:45.321464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:45.323059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:45.348650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:45.353540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:45.367449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:45.368874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:45.370033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:45.370741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:45.682504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:45.697437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:45.699367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:45.709858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-561b41c5-3c87-4a3d-b994-02d3fc182245 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.393817 Aug 30 03:48:45.711164 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2317/4547] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:45 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:46.012134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:46.016879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:46.033859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:46.034482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:46.040875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.044878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.054221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.054825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.055245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.055447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.056229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.056571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.056714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.057333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.058097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.060300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.557238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:46.578975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82148d60-8aa0-43df-a9b2-c63c8162b152 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1654 microversion: 2.1 time: 0.549187 Aug 30 03:48:46.580122 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2318/4548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:46 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1654 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:46.609520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-779d39ec-bede-4476-8589-311ec444ccaa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:46.627506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-779d39ec-bede-4476-8589-311ec444ccaa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.628453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-779d39ec-bede-4476-8589-311ec444ccaa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.630030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-779d39ec-bede-4476-8589-311ec444ccaa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.679496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-779d39ec-bede-4476-8589-311ec444ccaa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 03:48:46.754085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:46.767267 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-284e8c97-01b0-4f95-b5f5-012365f2f318 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.759887 Aug 30 03:48:46.768658 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2231/4549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:46 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:46.776872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:46.777876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:46.799006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.800285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.800958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.802032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.802182 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-779d39ec-bede-4476-8589-311ec444ccaa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action" status: 202 len: 0 microversion: 2.1 time: 0.198458 Aug 30 03:48:46.803657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.804017 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2319/4550] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:48:46 2022] POST /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:48:46.804642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.814676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:46.836126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:46.860448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.860959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.861429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:46.862157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:46.862616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:46.863045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:47.682752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:47.696101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-472eb2cf-f11d-4cbc-8afe-22bd74da33e1 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1663 microversion: 2.1 time: 0.885743 Aug 30 03:48:47.698700 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2320/4551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:46 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1663 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:47.720595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:47.728604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:47.741054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Searching by: {'deleted': False, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:48:47.766445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:47.776634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:47.777579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:47.779526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:47.782072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:47.783940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:47.784348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:47.786887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:47.792095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:47.795326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2902791e-b8f1-4a43-8751-ecf71c3223ca tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 1.023338 Aug 30 03:48:47.798633 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2232/4552] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:46 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:47.818865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:47.820100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:47.837053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:47.845293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:47.846061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:47.851516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:47.853004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:48:47.856994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:47.862315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:47.939675 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-051eb618-7ddb-43ba-ba77-03afc3f17867 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.237340 Aug 30 03:48:47.950315 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2321/4553] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 03:48:47 2022] GET /compute/v2.1/servers => generated 340 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:47.964197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:47.975176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:47.976422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Searching by: {'deleted': False, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 03:48:47.996384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.000658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.002000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:48.005812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.006584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.007248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:48.074620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 03:48:48.181455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:48.199193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.199498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.200064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:48.600465 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-306d5e57-8606-43b9-843f-39088fd9a96a tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.640410 Aug 30 03:48:48.601807 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2322/4554] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:48:47 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:48.623485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:48.630814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e25c7740-36d1-40e4-8da3-d1156cdb8be2 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:48.651470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=64 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:48.655532 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-96266b79-0c39-40d1-862d-5d7555c1e10e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.852553 Aug 30 03:48:48.658352 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e25c7740-36d1-40e4-8da3-d1156cdb8be2 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033464 Aug 30 03:48:48.674036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2233/4555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:47 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:48.674230 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2323/4556] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:48:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:48.723005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:48.724396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:48.744907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.745611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.746848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:48.748380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.755981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.759261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:48.827183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:48.828056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:48.839785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.843756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.844808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:48.850801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:48.851584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:48.852902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:49.280832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:49.314379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b715cb5e-565e-49b4-b2c1-00d9d119d805 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1663 microversion: 2.1 time: 0.596209 Aug 30 03:48:49.319865 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2234/4557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:48 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1663 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:49.343399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:49.349849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:49.380480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:49.394175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:49.394787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:49.395684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:49.396134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:49.396630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:49.492998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:49.496723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:48:49.514639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:49.516341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:49.520769 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49e9f523-3c4f-4e7c-8cb6-a416149823c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.697789 Aug 30 03:48:49.521608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2324/4558] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:48 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:48:49.699582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:49.699970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:49.700595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:49.727411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:49.727905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:49.728340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:49.729110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:49.729552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:49.729974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:49.921137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5708e3e0-b039-4ad4-86ba-99547d4dcc6f tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "DELETE /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 204 len: 0 microversion: 2.1 time: 0.596231 Aug 30 03:48:49.928098 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2235/4559] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:48:49 2022] DELETE /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:48:49.940732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:49.954744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:49.974618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:49.975362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:49.981054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:49.982108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:49.982758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:49.983362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:50.254729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:50.269320 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a08053ad-7791-45f9-98e3-c46543735d91 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.582506 Aug 30 03:48:50.274517 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2325/4560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:49 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:50.344173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:50.345219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:50.368935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:50.372139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:50.372820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:50.382078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:50.389842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:50.390342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:50.390792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:50.394881 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-474af324-3a91-45d6-a029-c0cc91aaefda tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1714 microversion: 2.1 time: 0.464512 Aug 30 03:48:50.414847 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2236/4561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:49 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1714 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:50.446912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:50.548105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:50.549268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:50.559647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:50.563359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:50.564136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:50.565148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:50.565904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:50.567745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:51.095648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:51.119944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:51.383939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:51.383939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:51.388712 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-93a6b08e-7a51-4c62-ac0a-e135c1b113f0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1667 microversion: 2.1 time: 0.857034 Aug 30 03:48:51.388712 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2326/4562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:50 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1667 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:51.389661 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-beda778c-07e9-4a72-a955-034d3101aad9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.637412 Aug 30 03:48:51.389661 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2237/4563] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:50 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:51.390116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:51.420088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:51.420725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:51.454863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:51.454863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:51.465610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:51.466529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:51.467084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:51.467540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:52.363767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:52.376558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:52.378002 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4c7b3f4c-7464-48f5-bc41-ae6fe4604511 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 1.071842 Aug 30 03:48:52.389375 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2327/4564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:51 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:52.389375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:52.389375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:52.400892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:52.403647 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-34216eb1-196a-4fbc-9195-d2050102566b tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1714 microversion: 2.1 time: 0.988460 Aug 30 03:48:52.406365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:52.407121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:52.407908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:52.408428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:52.408601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2238/4565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:51 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1714 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:48:52.408787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:52.796032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:52.808613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:52.810178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:52.811446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d833b91-6751-404f-9bcc-beeabd631a87 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.431412 Aug 30 03:48:52.812071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2328/4566] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:52 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:53.409682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:53.410455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:53.432926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:53.433634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:53.446877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:53.447658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:53.448129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:53.449132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:53.449654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:53.450093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:53.462848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:53.463191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:53.463634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:53.464362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:53.464820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:53.490101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:53.873648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:53.889438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3df1157b-7488-493d-a433-1ddd5529dad8 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1647 microversion: 2.1 time: 0.460761 Aug 30 03:48:53.892807 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2329/4567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:53 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1647 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:53.903716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:53.904354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:53.922800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:53.923903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:53.925268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:53.927553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:53.928030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:53.931128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:54.823564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:54.861832 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd0c7cb5-788c-4a2d-981b-01dae19dfd33 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 1.463031 Aug 30 03:48:54.876200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2239/4568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:53 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:54.912709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:54.913474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:54.941128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:54.942038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:54.942736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:54.943709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:54.944399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:54.946482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:55.057524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:55.074292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:55.075769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:55.077479 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58e92cd0-617c-45b1-9658-93ade34a045f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 1.183049 Aug 30 03:48:55.089646 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2330/4569] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:53 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:55.216342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:55.243159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a1453ae-6a6e-42b9-b3ed-5397c42914cf tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1647 microversion: 2.1 time: 0.334966 Aug 30 03:48:55.269878 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2240/4570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:54 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1647 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:55.478418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-871f85a9-15e6-4cf9-be1e-94cf6c3499c0 req-31ed570a-547a-4332-8d8e-46dd63eb28e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569afdb5-9034-4ff4-b49a-3518ef22b279", "name": "network-vif-deleted", "tag": "3ec57118-e2c5-48a3-ab72-da8c30aade0f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:48:55.540617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-871f85a9-15e6-4cf9-be1e-94cf6c3499c0 req-31ed570a-547a-4332-8d8e-46dd63eb28e6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:55.541105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-871f85a9-15e6-4cf9-be1e-94cf6c3499c0 req-31ed570a-547a-4332-8d8e-46dd63eb28e6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:55.541569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-871f85a9-15e6-4cf9-be1e-94cf6c3499c0 req-31ed570a-547a-4332-8d8e-46dd63eb28e6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:55.593402 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-871f85a9-15e6-4cf9-be1e-94cf6c3499c0 req-31ed570a-547a-4332-8d8e-46dd63eb28e6 service nova] Creating event network-vif-deleted:3ec57118-e2c5-48a3-ab72-da8c30aade0f for instance 569afdb5-9034-4ff4-b49a-3518ef22b279 on n-h2-854924-5 Aug 30 03:48:55.639647 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-871f85a9-15e6-4cf9-be1e-94cf6c3499c0 req-31ed570a-547a-4332-8d8e-46dd63eb28e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164684 Aug 30 03:48:55.657939 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2331/4571] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:48:55.897312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:55.900882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:55.930648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:55.931339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:55.932343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:55.934797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:55.938401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:55.941448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:56.112910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:56.114728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:56.221649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:56.225120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:56.225867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:56.227324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:56.228543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:56.229887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:56.458847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:56.467138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dcadb2be-7f4d-4fe9-9cf5-071000fed067 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.575292 Aug 30 03:48:56.470646 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2241/4572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:55 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:56.484402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:56.485527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:56.498983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:56.501758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:56.502220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:56.503208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:56.506050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:56.506783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:56.592781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:56.599264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:56.599903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:56.600538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lazy-loading 'fault' on Instance uuid 569afdb5-9034-4ff4-b49a-3518ef22b279 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:48:56.704893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf92f77728045d3b9eacaa9ea34ac53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c96faee3bfb4508ae69d4cd886e2c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:56.720279 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67e34960-c2e1-45c7-a831-70586b6b32fd tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 200 len: 1368 microversion: 2.1 time: 0.248341 Aug 30 03:48:56.723759 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2242/4573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:56 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:56.774924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:56.786652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:56.788377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:56.790175 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ef1f1f55-0f6e-4891-a3ad-70e8c619c594 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.681060 Aug 30 03:48:56.805553 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2332/4574] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:56 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:57.489442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:57.490108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:57.508558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:57.509138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:57.509611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:57.510386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:57.510922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:57.511375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:57.746428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:57.746973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] [instance: 569afdb5-9034-4ff4-b49a-3518ef22b279] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:57.762957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:57.763523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:57.764123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:57.764917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:57.765572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:57.766214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:57.832378 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] HTTP exception thrown: Instance 569afdb5-9034-4ff4-b49a-3518ef22b279 could not be found. Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Request method failure captured: Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 HTTP/1.1 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhhp16kWaNkgJqGSQdOFz_woNrjnwqbRkySB416Q5mGtCKlfpDxQa3Cpu41nVaClyQFZesI9yqBEL5nsaM_vsfbS74YqaFlPChengHVaUyKEVcwTqcsczcS3CeGKGb9OMlIf4woMATaoL4Pw9x2XMORgCmhVk_Kb38cQIrZdJnenAI Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 5c96faee3bfb4508ae69d4cd886e2c83 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersTestManualDisk-1098134300 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c96faee3bfb4508ae69d4cd886e2c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5c96faee3bfb4508ae69d4cd886e2c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5c96faee3bfb4508ae69d4cd886e2c83", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c96faee3bfb4508ae69d4cd886e2c83"}]}] Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersTestManualDisk-1098134300 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 5c96faee3bfb4508ae69d4cd886e2c83 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersTestManualDisk-1098134300 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersTestManualDisk-1098134300-project Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: edf92f77728045d3b9eacaa9ea34ac53 Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersTestManualDisk-1098134300-project Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 569afdb5-9034-4ff4-b49a-3518ef22b279 could not be found. Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '569afdb5-9034-4ff4-b49a-3518ef22b279'} Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 569afdb5-9034-4ff4-b49a-3518ef22b279 could not be found. Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 569afdb5-9034-4ff4-b49a-3518ef22b279 could not be found. Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:48:57.850293 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 569afdb5-9034-4ff4-b49a-3518ef22b279 could not be found. Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Returning 404 to user: Instance 569afdb5-9034-4ff4-b49a-3518ef22b279 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e14a82a-d7d9-4901-92c8-62e19dc02ed4 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279" status: 404 len: 111 microversion: 2.1 time: 0.111619 Aug 30 03:48:57.857968 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2333/4575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:57 2022] GET /compute/v2.1/servers/569afdb5-9034-4ff4-b49a-3518ef22b279 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:48:57.865367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:57.869680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:57.870301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:57.873571 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1665fe9f-e5ea-4e2e-93c1-d942118e0222 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.385928 Aug 30 03:48:57.877051 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2243/4576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:57 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:57.890318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba413933-1150-46a0-843a-7520d42cd652 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] Calling method '.version_select at 0x7f897ada5ca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:57.896604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:57.897101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:57.902002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:57.902906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:57.903615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:57.904229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:58.000556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba413933-1150-46a0-843a-7520d42cd652 tempest-ServersTestManualDisk-1098134300 tempest-ServersTestManualDisk-1098134300-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911378530" status: 202 len: 0 microversion: 2.1 time: 0.121791 Aug 30 03:48:58.001656 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2244/4577] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:48:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911378530 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:48:58.040112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:58.116971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:58.128498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:58.130337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:58.132293 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc85b5ea-af46-44b4-95cd-7a4cfb698e1c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1736 microversion: 2.20 time: 0.274424 Aug 30 03:48:58.134637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2334/4578] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:57 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:48:58.898407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:58.900258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:58.912782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:58.917698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:58.919827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:58.923422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:58.924706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:58.926164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:59.075281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:59.076508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:59.101651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:48:59.105544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:59.106313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:59.106963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:59.107912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:59.108576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:59.109877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:59.175623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:48:59.330860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:48:59.348838 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8fcee3c-1a02-4a2d-9269-646d3e852103 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.449719 Aug 30 03:48:59.353555 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2245/4579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:58 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:48:59.358912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:59.363273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:59.386250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:59.386753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:59.390310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:59.391075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:59.391550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:59.391986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:59.401722 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36b20d96-3077-46dd-ba36-e0ea7ab7a1ac tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 204 len: 0 microversion: 2.1 time: 0.330038 Aug 30 03:48:59.405711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2335/4580] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:48:59 2022] DELETE /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:48:59.425068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:48:59.426367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:48:59.437023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:59.437708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:59.438653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:48:59.440302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:48:59.441327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:48:59.442568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:00.165564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:00.181032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:00.183434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:00.185059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6c69fbb-c65f-4345-b3ee-dcc09f14c29d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1718 microversion: 2.20 time: 0.830323 Aug 30 03:49:00.186153 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2246/4581] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:48:59 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1718 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:00.197387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:00.206495 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a7672f7-6c06-49cc-a10f-ff5053d3b1bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1552 microversion: 2.1 time: 0.798605 Aug 30 03:49:00.213814 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2336/4582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:48:59 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1552 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:00.379338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:00.382403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:00.393297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:00.395209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:00.395861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:00.397003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:00.399722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:00.400437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:00.822469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:00.833920 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc95e85e-8f7d-41b1-8e66-214064226ea2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.465556 Aug 30 03:49:00.834823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2247/4583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:00 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:01.215470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:01.217523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:01.236870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:01.238208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:01.255061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:01.257612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:01.258103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:01.258836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:01.260724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:01.261438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:01.261885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:01.262419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:01.262945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:01.263651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:01.266978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:01.267717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:02.388256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:02.406893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:02.427164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:02.433492 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-774ba597-c1da-43e6-b0ba-fc15f5fa35a2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1718 microversion: 2.20 time: 1.224973 Aug 30 03:49:02.434112 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2337/4584] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:01 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1718 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:02.476428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:02.480748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4be53ad2-b554-4fad-952c-cd0af70355e1 req-2ac13c25-8b79-4523-8392-cfb82d737537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "name": "network-vif-unplugged", "status": "completed", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:02.509377 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1b8974b-134e-4355-b197-2084eda2cc9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1552 microversion: 2.1 time: 1.285580 Aug 30 03:49:02.510238 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2248/4585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:01 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1552 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:02.521639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4be53ad2-b554-4fad-952c-cd0af70355e1 req-2ac13c25-8b79-4523-8392-cfb82d737537 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:02.521639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4be53ad2-b554-4fad-952c-cd0af70355e1 req-2ac13c25-8b79-4523-8392-cfb82d737537 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:02.521639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4be53ad2-b554-4fad-952c-cd0af70355e1 req-2ac13c25-8b79-4523-8392-cfb82d737537 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:02.543616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:02.545103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:02.550558 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4be53ad2-b554-4fad-952c-cd0af70355e1 req-2ac13c25-8b79-4523-8392-cfb82d737537 service nova] Creating event network-vif-unplugged:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:49:02.553700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:02.555391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:02.556345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:02.557318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:02.558737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:02.559394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:02.564303 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4be53ad2-b554-4fad-952c-cd0af70355e1 req-2ac13c25-8b79-4523-8392-cfb82d737537 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111625 Aug 30 03:49:02.570272 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2338/4586] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:02.645734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9bc03991-b04c-4ae1-8898-169cbf02092f req-2ee9f4b2-e803-4fec-b001-1e5673404779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0782294-915e-4d7b-b41a-e77ce446b232", "name": "network-vif-deleted", "tag": "1c55d6dc-c840-4c2a-b5eb-bc11d669742a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:02.679730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9bc03991-b04c-4ae1-8898-169cbf02092f req-2ee9f4b2-e803-4fec-b001-1e5673404779 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:02.680730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9bc03991-b04c-4ae1-8898-169cbf02092f req-2ee9f4b2-e803-4fec-b001-1e5673404779 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:02.681172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9bc03991-b04c-4ae1-8898-169cbf02092f req-2ee9f4b2-e803-4fec-b001-1e5673404779 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:02.714824 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9bc03991-b04c-4ae1-8898-169cbf02092f req-2ee9f4b2-e803-4fec-b001-1e5673404779 service nova] Creating event network-vif-deleted:1c55d6dc-c840-4c2a-b5eb-bc11d669742a for instance e0782294-915e-4d7b-b41a-e77ce446b232 on n-h1-854924-5 Aug 30 03:49:02.724761 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9bc03991-b04c-4ae1-8898-169cbf02092f req-2ee9f4b2-e803-4fec-b001-1e5673404779 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084978 Aug 30 03:49:02.728842 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2339/4587] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:49:03.272183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:03.284789 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0fa3b28-a01c-45ce-b424-1709bb44c972 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.760742 Aug 30 03:49:03.290025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2249/4588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:02 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:03.464516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:03.465877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:03.483544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:03.485675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:03.486464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:03.489062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:03.490414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:03.491576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:03.535749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:03.536997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:03.547159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:03.547917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:03.548555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:03.554343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:03.555607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:03.556272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:03.735461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:03.759802 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7c4106ac-bb72-40f2-971b-754986fb1155 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1345 microversion: 2.1 time: 0.218771 Aug 30 03:49:03.774402 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2250/4589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:03 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1345 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:04.189969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:04.208232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:04.212400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:04.222711 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4c7b1324-a732-43a1-a686-3fef3176dcbd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1661 microversion: 2.20 time: 0.760235 Aug 30 03:49:04.236139 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2340/4590] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:03 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1661 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:04.266135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f88747-c3d7-49fc-becc-8f2184da296c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:04.269552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:04.292534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:04.293914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:04.294478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:04.295468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:04.296076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:04.296612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:04.314667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:04.315517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:04.327065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:04.327747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:04.328353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:04.329253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:04.331778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:04.332434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:04.421538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:04.858643 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2538d58b-9c86-4bd7-9d0e-28d8b0da8546 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.595089 Aug 30 03:49:04.866200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2251/4591] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Aug 30 03:49:04 2022] POST /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 188 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:49:04.874119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:04.875003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:04.883657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:04.884389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:04.885001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:04.886422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:04.887334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:04.889819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:04.891717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:04.903290 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2b32f10-5f28-4dab-a67d-3fd4c26452cd tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.595552 Aug 30 03:49:04.914581 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2341/4592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:04 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:05.119223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:05.120133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:05.139641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:05.140153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:05.147472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:05.148254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:05.148798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:05.155160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:05.257054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122168) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 03:49:05.302955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:05.311983 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea77ed6e-e355-435d-9287-6c2123092672 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1345 microversion: 2.1 time: 0.443481 Aug 30 03:49:05.324841 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2252/4593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:04 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1345 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:05.440421 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9e396620-44b0-4b9b-b121-335546aec3f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/action" status: 202 len: 0 microversion: 2.20 time: 0.325118 Aug 30 03:49:05.442740 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2342/4594] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:49:05 2022] POST /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:49:05.451370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:05.451997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:05.481758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:05.482279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:05.482731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:05.483448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:05.483910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:05.494168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:05.940988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:05.944736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:05.947120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:05.954851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:05.956619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:05.959011 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab009ac3-b60b-4f54-8fe3-f91944fb0fde tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1747 microversion: 2.20 time: 0.511499 Aug 30 03:49:05.960091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:05.960625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:05.966966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:05.967741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:05.968449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:05.968877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:05.975022 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2253/4595] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:05 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1747 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:06.015743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:06.212770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:06.229098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30cd9462-0914-4bf6-9ddc-c3ca90ae3c09 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.295707 Aug 30 03:49:06.230346 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2343/4596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:05 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:06.347545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:06.348488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:06.359392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:06.360313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:06.361868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:06.362799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:06.363372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:06.363912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:06.473078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:06.486947 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2248542a-d5e4-4b70-80d7-b87eabb75b63 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1345 microversion: 2.1 time: 0.148991 Aug 30 03:49:06.501594 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2254/4597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:06 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:06.986313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:06.986928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:07.006221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:07.013867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:07.029465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:07.030508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:07.031919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:07.033635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:07.251788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:07.255448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:07.275350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:07.277655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:07.279671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:07.282763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:07.283274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:07.290309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:07.512645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:07.532878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:07.536769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:07.553975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d043357-075b-4547-bd73-1e5ede306d46 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1747 microversion: 2.20 time: 0.572006 Aug 30 03:49:07.556773 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2344/4598] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:06 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1747 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:07.562048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:07.563732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:07.578856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:07.579699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:07.580338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:07.581364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:07.582952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:07.583633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:08.294673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:08.303159 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe823c03-e196-4118-8f78-57c7a34a1755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1345 microversion: 2.1 time: 0.744957 Aug 30 03:49:08.325674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:08.326383 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2345/4599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:07 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1345 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:08.337936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4bb66c80-f8fa-49ef-82e1-afca65c76861 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 1.091053 Aug 30 03:49:08.362197 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2255/4600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:07 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:08.595641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:08.596270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:08.613148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:08.624322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:08.627209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:08.628163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:08.628645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:08.629078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:09.121125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:09.135277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:09.140142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:09.146117 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f920ef2c-51b8-46a8-b841-e47e22647ed7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.570441 Aug 30 03:49:09.146711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2346/4601] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:08 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:09.328379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:09.329549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:09.333403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:09.369633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:09.371506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:09.372913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:09.375338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:09.377629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:09.378017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:09.378534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:09.379068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:09.392196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:09.395000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:09.395454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:09.396177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:09.396674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:09.403748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:09.543593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:09.557147 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8732121e-7a1f-44fe-bfe1-9de9c2cc7db8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1345 microversion: 2.1 time: 0.237121 Aug 30 03:49:09.561262 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2256/4602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:09 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1345 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:09.629512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:09.640952 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba89c51f-9e8b-4e27-8b93-2d5a22314fde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1505 microversion: 2.1 time: 0.268317 Aug 30 03:49:09.653374 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2347/4603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:09 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:10.180873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:10.181956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:10.190843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.191875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.192579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.194700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.196073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.196751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.501002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:10.511158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:10.513259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:10.515111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5b0ee1d2-e756-48be-af8e-a0fd6288d500 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.344280 Aug 30 03:49:10.519348 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2257/4604] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:10 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:10.584664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:10.586103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:10.598732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.599321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.601154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.602571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.603059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.605649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.667986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:10.668729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:10.675287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.675893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.676338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.677037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.677610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.678977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.700234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:10.701037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:10.701767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:10.702449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'fault' on Instance uuid e0782294-915e-4d7b-b41a-e77ce446b232 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:49:10.786667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:10.809072 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-db53ceb2-360d-4ea9-8d9d-0cc04ba4bc1a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 200 len: 1350 microversion: 2.1 time: 0.228472 Aug 30 03:49:10.811221 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2348/4605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:10 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 1350 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:10.871562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:10.880252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10b30262-5164-4a30-8841-00f029f86cf9 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1485 microversion: 2.1 time: 0.217044 Aug 30 03:49:10.881461 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2258/4606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:10 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1485 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:11.074278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-175141264", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:11.184113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] validate_networks() for [('0a1ce1ae-379e-4b65-93eb-567286368551', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:49:11.539975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:11.540604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:11.559244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:11.559746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:11.560187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:11.560956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:11.561466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:11.561851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:11.839049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:11.856750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:11.860360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:11.861984 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7008672c-3a9e-44f3-b01a-28876a7a5cad tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.326521 Aug 30 03:49:11.863346 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2259/4607] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:11 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:11.869969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:11.870829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:11.880005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:11.880771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:11.884541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:49:11.885271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:49:11.885776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:49:11.886178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:49:11.886775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:49:11.894095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:11.895016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:11.897748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:11.898197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:11.903953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:11.904880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:11.908326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:11.909516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:11.910161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:11.910591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:11.926540 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 HTTP/1.1 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e0782294-915e-4d7b-b41a-e77ce446b232'} Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:11.929188 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:11.935274 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:11.936394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Getting quotas for project a3e7cee69d0d498b8415ecc523013838. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:11.938125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:11.938462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Getting quotas for user 8d8f4bdce76e439188219d1b1b70005a and project a3e7cee69d0d498b8415ecc523013838. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:11.939637 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-440e4d22-15df-4612-a321-185bb337ceb0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 404 len: 111 microversion: 2.1 time: 0.075111 Aug 30 03:49:11.940744 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2260/4608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:11 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:49:11.957651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:49:11.959968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:49:12.049555 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5d3cfc0-a85e-4c1b-a6a7-81c0837e148c tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.978807 Aug 30 03:49:12.057686 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2349/4609] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:49:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:49:12.063183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bac0be5-dc9a-45e0-9cfe-b6fd48dbd7f3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:12.063809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5bac0be5-dc9a-45e0-9cfe-b6fd48dbd7f3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:12.101831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:12.104400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:12.125936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:12.126664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:12.127273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:12.128660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:12.129292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:12.129930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:12.149230 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232/os-volume_attachments HTTP/1.1 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': 'e0782294-915e-4d7b-b41a-e77ce446b232'} Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:12.151418 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:49:12.156577 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:12.158596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:12.159739 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-262882e7-df57-4411-89f2-ef6ff444946b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062098 Aug 30 03:49:12.164441 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2350/4610] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:49:12 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:49:12.294987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5bac0be5-dc9a-45e0-9cfe-b6fd48dbd7f3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:12.306140 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5bac0be5-dc9a-45e0-9cfe-b6fd48dbd7f3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1213 microversion: 2.1 time: 0.246734 Aug 30 03:49:12.306827 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2261/4611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:12 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:12.550311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-616356657", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:12.647377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:49:12.894829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:12.897637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:12.934154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:12.934984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:12.938805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:12.943662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:12.946105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:12.948396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:13.442820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:49:13.443434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:49:13.443758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:49:13.444170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:49:13.444577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:49:13.458475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:13.473206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:13.483445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:13.486891 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ffc4da4-5a5a-4277-b625-7017d438f0d5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.600866 Aug 30 03:49:13.491674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2262/4612] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:12 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:13.507724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:13.508604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:13.509150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:13.510971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:13.511343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:13.512766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:13.514058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:13.515673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:13.530070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:13.530851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:13.532269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:13.545645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:13.550026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:13.550821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:13.559306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:13.574659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:13.613256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:49:13.615854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:49:13.677658 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86931540-6896-4ba6-ac12-b5f951e2c9fc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131955 Aug 30 03:49:13.679141 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2351/4613] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:49:13.693666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff3fd0e2-5229-4016-bf8e-a314c90d66e4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:13.695625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff3fd0e2-5229-4016-bf8e-a314c90d66e4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:13.707872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:13.710651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:13.719995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a38cc74e-c8c6-4ee5-8cc9-7628bd66bc63 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1265 microversion: 2.1 time: 0.224973 Aug 30 03:49:13.720474 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2263/4614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:13 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:13.918406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ff3fd0e2-5229-4016-bf8e-a314c90d66e4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:13.934706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff3fd0e2-5229-4016-bf8e-a314c90d66e4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7" status: 200 len: 1214 microversion: 2.1 time: 0.248074 Aug 30 03:49:13.935731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2352/4615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:13 2022] GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:13.961450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9738c641-2273-4a61-87b4-6cf378b1e349 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:13.962243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9738c641-2273-4a61-87b4-6cf378b1e349 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:14.017087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9738c641-2273-4a61-87b4-6cf378b1e349 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:49:14.233188 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9738c641-2273-4a61-87b4-6cf378b1e349 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7" status: 204 len: 0 microversion: 2.1 time: 0.278041 Aug 30 03:49:14.234022 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2264/4616] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:49:13 2022] DELETE /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:49:14.244557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4b8feee-4c1e-42c6-8906-5789961feb23 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:14.245889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d4b8feee-4c1e-42c6-8906-5789961feb23 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:14.301088 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d4b8feee-4c1e-42c6-8906-5789961feb23 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4b8feee-4c1e-42c6-8906-5789961feb23 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 HTTP/1.1 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '17c0d5a5-2fcb-4014-b434-ac08e07feee7'} Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:14.315900 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4b8feee-4c1e-42c6-8906-5789961feb23 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:14.324065 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d4b8feee-4c1e-42c6-8906-5789961feb23 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7" status: 404 len: 111 microversion: 2.1 time: 0.084026 Aug 30 03:49:14.326676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2353/4617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:14 2022] GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:49:14.514967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:14.515390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:14.530965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:14.533042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:14.533924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:14.535913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:14.537579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:14.538309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:14.583161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1690260768", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:14.707601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:49:15.135372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:15.146057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:15.147642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:15.148883 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6a5b4d4c-d579-4558-95b4-ef0b35a8c90c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.639172 Aug 30 03:49:15.167630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2265/4618] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:14 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:15.173039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:15.173715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:15.200764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:15.204751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:15.205483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:15.206467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:15.206977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:15.207471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:15.427899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:15.445392 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4e05d87-4afc-4024-bc41-1d15ffa16271 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1271 microversion: 2.1 time: 0.276213 Aug 30 03:49:15.451000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2266/4619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:15 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:15.972024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:49:15.973028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:49:15.973942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:49:15.974602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:49:15.975397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:49:15.996183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:16.000092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:16.001540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:16.008745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:16.009907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:16.012570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:16.058650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:16.076754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:16.118202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:49:16.120575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:49:16.191127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:16.192347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:16.209025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:16.212352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:16.214173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:16.215100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:16.219209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:16.220098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:16.236054 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-794176fc-46b1-4645-bfec-3c3965fe83df tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657037 Aug 30 03:49:16.236735 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2354/4620] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:49:16.257564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7c8706a1-e0e7-415a-9737-d9252dd4d332 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:16.265672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7c8706a1-e0e7-415a-9737-d9252dd4d332 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:16.663935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7c8706a1-e0e7-415a-9737-d9252dd4d332 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:16.678864 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7c8706a1-e0e7-415a-9737-d9252dd4d332 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1215 microversion: 2.1 time: 0.425689 Aug 30 03:49:16.679494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2355/4621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:16 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1215 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:16.688437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:16.689053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:16.745666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:16.746061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:16.746505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:16.752729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:16.754805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:16.758069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:17.248309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:17.263610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:17.267275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:17.268799 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c95d361-e7d0-4b7f-b468-a3c72152782e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 1.082096 Aug 30 03:49:17.289760 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2267/4622] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:16 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:17.299738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:17.319831 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-238e04bb-5a36-434e-b1a4-959a4c27625d tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.629124 Aug 30 03:49:17.320909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2356/4623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:16 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:17.699732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:17.700403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:17.711823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:17.712322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:17.712760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:17.713504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:17.713962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:17.714388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:18.156388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:18.163248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:18.174510 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38639594-447d-4b01-8744-8752493e86b4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1219 microversion: 2.1 time: 0.478966 Aug 30 03:49:18.175407 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2268/4624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:17 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1219 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:18.295720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:18.296340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:18.318359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:18.325085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:18.326448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:18.328730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:18.330498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:18.332070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:18.347756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:18.349001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:18.368681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:18.373296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:18.381020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:18.384115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:18.390018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:18.394010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:18.969094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:18.978359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:18.991445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:18.996457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b3aa934-b639-4ae0-883a-1278952a4622 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.705158 Aug 30 03:49:18.997057 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2357/4625] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:18 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:19.126196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:19.137332 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40b9f80c-6bdb-48fd-83f3-fca21e853767 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.795137 Aug 30 03:49:19.141328 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2269/4626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:18 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:19.199435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:19.200055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:19.219308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:19.219815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:19.220251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:19.220946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:19.221675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:19.222384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:19.431531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:19.447686 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6041c109-205d-4d33-9ac5-e7b6e9e7c8e0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1273 microversion: 2.1 time: 0.255418 Aug 30 03:49:19.451147 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2358/4627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:19 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:19.555409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-37394b62-ab86-4a63-8cda-084e5a9ed3fc req-9310b4f7-4666-4e8f-802c-2e6bdbfc2043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19195ad-3496-483f-90bd-723163c6705f", "tag": "0d637a68-a35c-47fc-b99b-ab15de7d4818"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:19.599605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-37394b62-ab86-4a63-8cda-084e5a9ed3fc req-9310b4f7-4666-4e8f-802c-2e6bdbfc2043 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:19.600038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-37394b62-ab86-4a63-8cda-084e5a9ed3fc req-9310b4f7-4666-4e8f-802c-2e6bdbfc2043 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:19.600481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-37394b62-ab86-4a63-8cda-084e5a9ed3fc req-9310b4f7-4666-4e8f-802c-2e6bdbfc2043 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:19.640909 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-37394b62-ab86-4a63-8cda-084e5a9ed3fc req-9310b4f7-4666-4e8f-802c-2e6bdbfc2043 service nova] Creating event network-changed:0d637a68-a35c-47fc-b99b-ab15de7d4818 for instance f19195ad-3496-483f-90bd-723163c6705f on n-h2-854924-5 Aug 30 03:49:19.662822 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-37394b62-ab86-4a63-8cda-084e5a9ed3fc req-9310b4f7-4666-4e8f-802c-2e6bdbfc2043 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112191 Aug 30 03:49:19.667946 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2270/4628] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:20.024823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:20.025740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:20.033291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:20.036432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:20.037109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:20.039786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:20.040528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:20.043099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:20.377279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:20.394198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:20.399405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:20.401066 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a44f321c-92f9-4c36-9357-d7b0a956383e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.380891 Aug 30 03:49:20.403643 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2359/4629] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:20 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:20.413400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:20.416873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:20.428381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:20.430339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:20.432854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:20.434662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:20.436973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:20.437878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:20.450367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-253598245", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "039d3037-9232-429f-81e4-6b449f805789"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:20.532821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] validate_networks() for [('039d3037-9232-429f-81e4-6b449f805789', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:49:20.799031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:20.819098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c545c462-2d98-466d-bf18-14e9644d385e tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.414185 Aug 30 03:49:20.833881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2360/4630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:20 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:20.841336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:20.843031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:20.860205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:20.861141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:20.861852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:20.866536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:20.868441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:20.868969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:20.996482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.006797 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1ccf38cc-93ee-488f-965b-7e7a991c3527 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1273 microversion: 2.1 time: 0.169206 Aug 30 03:49:21.009106 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2361/4631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:20 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:21.435532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:21.436300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:21.449125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:21.451091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:21.451650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:21.457327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:21.458617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:21.459174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:21.611904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:49:21.613162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:49:21.613917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:49:21.614554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:49:21.615461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:49:21.625320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:21.626167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:21.626837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:21.627796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:21.628476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:21.629163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:21.658337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Getting quotas for project 26b1c67e02904fb9a5abafc0d82ef61c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:21.664942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Getting quotas for user 1189913a88cd41d2ba30465c94861ab2 and project 26b1c67e02904fb9a5abafc0d82ef61c. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:21.679859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:49:21.683237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:49:21.746163 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1677b152-e702-49fd-b028-fe80b7681600 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.645818 Aug 30 03:49:21.747607 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2271/4632] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:49:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:49:21.762883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-93eea9a3-3b65-46b4-a86f-4a4cc0fad247 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:21.763861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-93eea9a3-3b65-46b4-a86f-4a4cc0fad247 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:21.816527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.832776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.834631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.836714 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8c61b6f-51c0-4837-8cd8-414558da7865 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.405313 Aug 30 03:49:21.855263 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2362/4633] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:21 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:21.865732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93eea9a3-3b65-46b4-a86f-4a4cc0fad247 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.866248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:21.870879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:21.874227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93eea9a3-3b65-46b4-a86f-4a4cc0fad247 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.875803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-93eea9a3-3b65-46b4-a86f-4a4cc0fad247 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:21.882267 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-93eea9a3-3b65-46b4-a86f-4a4cc0fad247 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1258 microversion: 2.21 time: 0.128009 Aug 30 03:49:21.883645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:21.885261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:21.885519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:21.886255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:21.896363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:21.900762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:21.904384 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2272/4634] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:21 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:22.032251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:22.032866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:22.039837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:22.041185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:22.042035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:22.042954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:22.043599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:22.044203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:22.984073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:22.995202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-865eb60d-5130-474a-8706-9041b2fe14d2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 1.138614 Aug 30 03:49:22.995781 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2363/4635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:21 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:23.009424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:23.011533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:23.012386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.025470 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-343a2ad4-714b-46d1-973a-679f294b0f1f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 0.997210 Aug 30 03:49:23.027022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:23.027527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:23.028171 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2273/4636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:22 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:23.030301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:23.031030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:23.033058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:23.033600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:23.042049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:23.043028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:23.059445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:23.066136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:23.066979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:23.067962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:23.068694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:23.069431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:23.245281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.266299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.274287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.275864 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6681e801-49c9-4fad-9b89-722ed77784a1 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1310 microversion: 2.21 time: 0.244739 Aug 30 03:49:23.277124 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2274/4637] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:23 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1310 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:23.909425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.938339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.945523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:23.949773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-304cd00d-9771-4cc1-943d-d18be4680f51 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1749 microversion: 2.20 time: 0.951390 Aug 30 03:49:23.950506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2364/4638] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:22 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1749 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:23.999107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:24.003539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:24.019064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:24.019902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:24.023294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.024683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.034226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.035086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.036786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.038178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.040086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.040965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.042142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.046638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.047322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.048935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.057756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:24.212888 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0ee714c-5287-4f14-a7a0-f8744773c4b8 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.218296 Aug 30 03:49:24.220644 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2275/4639] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:49:23 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b/os-volume_attachments => generated 25 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:49:24.229630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-02b28f5b-1896-44c5-b460-19a607426fb5 req-09563e25-01c1-4d27-a3c9-8e53e06ff7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf3b2af-8c10-4657-baf0-7fefa16f1ae5", "tag": "0573bbc1-c593-4dff-a75d-3a9a3fdb6f40"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:24.252702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-02b28f5b-1896-44c5-b460-19a607426fb5 req-09563e25-01c1-4d27-a3c9-8e53e06ff7f5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.253862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-02b28f5b-1896-44c5-b460-19a607426fb5 req-09563e25-01c1-4d27-a3c9-8e53e06ff7f5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.254818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-02b28f5b-1896-44c5-b460-19a607426fb5 req-09563e25-01c1-4d27-a3c9-8e53e06ff7f5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.274739 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-02b28f5b-1896-44c5-b460-19a607426fb5 req-09563e25-01c1-4d27-a3c9-8e53e06ff7f5 service nova] Creating event network-changed:0573bbc1-c593-4dff-a75d-3a9a3fdb6f40 for instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 on n-h1-854924-5 Aug 30 03:49:24.290997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-02b28f5b-1896-44c5-b460-19a607426fb5 req-09563e25-01c1-4d27-a3c9-8e53e06ff7f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066407 Aug 30 03:49:24.292078 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2276/4640] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:24.334787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:24.336360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:24.344576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.345279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.345920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.346799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.347634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.348321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.603379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:24.612889 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-771ebc44-1e39-4e09-9173-94a8a4080277 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.600582 Aug 30 03:49:24.622856 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2365/4641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:24 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:24.635049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:24.640178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:24.664681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.670956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.671818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:24.672754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:24.673579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:24.674235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:25.407424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:25.422587 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc75b174-7e11-40e3-87a7-ff7c958e65ad tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 1.128912 Aug 30 03:49:25.438475 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2277/4642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:24 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:25.446465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:25.447397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:25.454466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:25.455229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:25.455986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:25.457023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:25.457704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:25.458373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:25.550248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:49:25.746892 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9736e13c-adeb-4d70-8107-2001deec43fc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 204 len: 0 microversion: 2.1 time: 0.306765 Aug 30 03:49:25.754301 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2278/4643] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:49:25 2022] DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:49:25.768235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:25.772921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:25.787399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:25.790335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:25.791186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:25.798403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:25.799177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:25.799840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:25.895603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:25.918759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:25.920202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:25.921578 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0a48e71f-2607-489a-9459-c8f5771e1c02 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 1.296988 Aug 30 03:49:25.926870 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2366/4644] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:24 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:25.941758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:25.942982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:25.957359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:25.958416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:25.961400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:25.962544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:25.965160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:25.965961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.044609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:26.270324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:26.284782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:26.287562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:26.291275 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1e80c7b-0a87-458a-b70b-4b8a83680f22 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.534178 Aug 30 03:49:26.293839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2279/4645] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:25 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:26.308293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:26.310321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:26.331014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.334203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.341577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.343634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.345221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.350368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.353301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:26.363854 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96772da3-4336-4d8e-99d6-97d801d0bb0f tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.435442 Aug 30 03:49:26.369155 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2367/4646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:25 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:26.444802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:26.453433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:26.465896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.466711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.467147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.473893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.474349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.474784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.655283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:26.663458 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-554ca876-5b52-4550-83d4-0b8566458310 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1673 microversion: 2.1 time: 0.365907 Aug 30 03:49:26.666876 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2280/4647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:26 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1673 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:26.670505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=22 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:26.707350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:26.716743 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6a02c87c-d997-4e61-b9e3-838e36334dfd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 0.275626 Aug 30 03:49:26.717326 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2368/4648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:26 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:26.789010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f7523c77-52d0-48a4-bc44-5530c4dcc150 req-530f58db-68b8-4173-9e49-669794507d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d", "tag": "2bf260e9-899c-42b6-ab53-f5072e802f38"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:26.804143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f7523c77-52d0-48a4-bc44-5530c4dcc150 req-530f58db-68b8-4173-9e49-669794507d3e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.805172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f7523c77-52d0-48a4-bc44-5530c4dcc150 req-530f58db-68b8-4173-9e49-669794507d3e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.805631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f7523c77-52d0-48a4-bc44-5530c4dcc150 req-530f58db-68b8-4173-9e49-669794507d3e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.830789 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f7523c77-52d0-48a4-bc44-5530c4dcc150 req-530f58db-68b8-4173-9e49-669794507d3e service nova] Creating event network-changed:2bf260e9-899c-42b6-ab53-f5072e802f38 for instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d on n-h1-854924-5 Aug 30 03:49:26.837550 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f7523c77-52d0-48a4-bc44-5530c4dcc150 req-530f58db-68b8-4173-9e49-669794507d3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052239 Aug 30 03:49:26.838423 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2281/4649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:26.949742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:26.951437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:26.958064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.958877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.959539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:26.960505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:26.961163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:26.961805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.123305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.140421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.144121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.145926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29609e6a-06be-4c7f-ba3d-85bed5b87dc9 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.200040 Aug 30 03:49:27.146705 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2369/4650] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:26 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:27.237765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c1585e49-d860-442a-b1cd-192edc31e52f req-32f31bde-5967-49d9-ab98-52843fb0c10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19195ad-3496-483f-90bd-723163c6705f", "name": "network-vif-plugged", "status": "completed", "tag": "0d637a68-a35c-47fc-b99b-ab15de7d4818"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:27.256176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c1585e49-d860-442a-b1cd-192edc31e52f req-32f31bde-5967-49d9-ab98-52843fb0c10e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.256679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c1585e49-d860-442a-b1cd-192edc31e52f req-32f31bde-5967-49d9-ab98-52843fb0c10e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.257097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c1585e49-d860-442a-b1cd-192edc31e52f req-32f31bde-5967-49d9-ab98-52843fb0c10e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.281841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c1585e49-d860-442a-b1cd-192edc31e52f req-32f31bde-5967-49d9-ab98-52843fb0c10e service nova] Creating event network-vif-plugged:0d637a68-a35c-47fc-b99b-ab15de7d4818 for instance f19195ad-3496-483f-90bd-723163c6705f on n-h2-854924-5 Aug 30 03:49:27.291958 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c1585e49-d860-442a-b1cd-192edc31e52f req-32f31bde-5967-49d9-ab98-52843fb0c10e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058780 Aug 30 03:49:27.294911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2282/4651] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:27.316542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:27.317161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:27.347122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.348790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.349492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.350848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.352120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.352754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.396013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:27.396720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:27.411250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.411862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.412465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.413288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.414339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.414777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.724412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.736171 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-650a9f1e-7a65-4f4b-93f3-f4cfc5abceba tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.344602 Aug 30 03:49:27.736755 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2283/4652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:27 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:27.745108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.747087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:27.747920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:27.754145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.754892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.755543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.756457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.757114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.757809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.765174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.768977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:27.770776 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a19b174a-0819-4c2c-ab01-73a63977a981 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.459249 Aug 30 03:49:27.781177 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2370/4653] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:27 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:27.791061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:27.793631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:27.804084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.806351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.808179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:27.812566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:27.813048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:27.813515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:28.120211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:28.134179 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-09957fa9-195a-4eae-bcd1-3e9962d14d13 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1673 microversion: 2.1 time: 0.393523 Aug 30 03:49:28.134789 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2284/4654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:27 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1673 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:28.159995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:28.168646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:28.169277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:28.184403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:28.184908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:28.187758 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37d66f40-3b1a-4ba0-a91c-f95c0d5618a8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 0.408562 Aug 30 03:49:28.188422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2371/4655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:27 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:28.188594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:28.190681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:28.191364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:28.195831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:28.465757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:28.493366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:28.496340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:28.497511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b9efe9ed-3039-451f-8c17-e4ebde283bdf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.333066 Aug 30 03:49:28.499939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2285/4656] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:28 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:28.760830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:28.761507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:28.786447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:28.787070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:28.787583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:28.788370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:28.788947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:28.789602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:28.801745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:28.802541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:28.821072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:28.830594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:28.831598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:28.837640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:28.841051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:28.846570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:29.422368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:29.435412 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e71e0e22-6c28-48f2-853d-af71a6f14727 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1313 microversion: 2.1 time: 0.680325 Aug 30 03:49:29.440398 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2372/4657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:28 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:29.447493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:29.448500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:29.461160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:29.469691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:29.471522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:29.478985 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ce17d67-647d-4e10-af9d-dc3be7021240 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.678347 Aug 30 03:49:29.491730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2286/4658] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:28 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:29.506988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:29.509674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:29.510913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:29.511179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:29.511549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:29.524626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:29.526334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:29.526842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:29.527278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:29.538170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:29.539048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:29.540855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:29.544274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:29.545457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:29.546085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:30.765243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:30.782795 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a40fe1b-2a55-4d30-8c04-dabc688e0c99 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 200 len: 1606 microversion: 2.1 time: 1.333284 Aug 30 03:49:30.783652 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2373/4659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:29 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 1606 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:30.792583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:30.796805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:30.816698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:30.830084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:30.831041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:30.835426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:30.836414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:30.840834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:31.196125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:31.211118 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1636e4a7-1869-4887-9e9d-eb6e719fa2c8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 1.715729 Aug 30 03:49:31.218508 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2287/4660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:29 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:31.236953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-71b59041-70bd-423d-9a1e-bbf46ea7ebda req-7985485d-356a-4966-b592-fa89433c7a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7271fb16-3136-46c9-8b26-e981c6391d9b", "name": "network-vif-deleted", "tag": "903d5209-3eab-4090-aa26-70fe35877664"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:31.285941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71b59041-70bd-423d-9a1e-bbf46ea7ebda req-7985485d-356a-4966-b592-fa89433c7a7a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:31.286832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71b59041-70bd-423d-9a1e-bbf46ea7ebda req-7985485d-356a-4966-b592-fa89433c7a7a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:31.287660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71b59041-70bd-423d-9a1e-bbf46ea7ebda req-7985485d-356a-4966-b592-fa89433c7a7a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:31.293669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:31.319608 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-71b59041-70bd-423d-9a1e-bbf46ea7ebda req-7985485d-356a-4966-b592-fa89433c7a7a service nova] Creating event network-vif-deleted:903d5209-3eab-4090-aa26-70fe35877664 for instance 7271fb16-3136-46c9-8b26-e981c6391d9b on n-h2-854924-5 Aug 30 03:49:31.326178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-71b59041-70bd-423d-9a1e-bbf46ea7ebda req-7985485d-356a-4966-b592-fa89433c7a7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099676 Aug 30 03:49:31.328344 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2288/4661] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:31.336476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:31.337637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:31.354808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:31.355756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:31.356504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:31.357527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:31.358242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:31.359450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:31.642218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:31.720577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:31.745024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:31.751491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:31.752662 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1799a2ed-158d-42e1-8aee-88ad738a4caa tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.967283 Aug 30 03:49:31.756798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2374/4662] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:30 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:31.774421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:31.784594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:31.800393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:31.806332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:31.818737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:31.820409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:31.821056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:31.821709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:31.871359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:32.114913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:32.127895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b74569b-8cb9-4ce8-94de-cee3e43069ff tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1499 microversion: 2.1 time: 0.797621 Aug 30 03:49:32.129524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2289/4663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:31 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1499 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:32.159192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:32.164724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:32.178321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.178830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.181618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.182669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.183143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.187746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.212793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:32.220869 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] HTTP exception thrown: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Request method failure captured: Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b HTTP/1.1 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYfqOxGvJIyD11qN793mFIKA4isSZ8dhEynAuoqQnQzxbNqD_xFozIZ9C-mFASEGolD3Ckd0QqvUpB3fd2iSOSX_k792UN4D9BUl6ne5gz7FNvU786QgbMbNQkV1I9C9OcVzTa56Qztbw2-t6jsCBaXuGQZXP_dud4Ru0gGZ-1T9_IQ Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1ccee9310d244210867a17f0d093c18e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}] Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 51986d3cb9614471bce790af1e6be2df Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7271fb16-3136-46c9-8b26-e981c6391d9b'} Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:32.225331 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:49:32.231722 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:32.233847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:32.234359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Returning 404 to user: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:32.235848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2720344b-b400-43e7-b4a2-ea4cb2d288bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 404 len: 111 microversion: 2.1 time: 0.105022 Aug 30 03:49:32.236712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2290/4664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:32 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:49:32.247211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:32.247777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:32.250277 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d1c41b15-4fca-4e46-9198-c6d790851557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.489576 Aug 30 03:49:32.250951 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2375/4665] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:31 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:32.259842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:32.272461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:32.273123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:32.277479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.277924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.278360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.279061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.279511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.279937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.285830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.287195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.288992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.296988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.298848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.303648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.345093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lazy-loading 'flavor' on Instance uuid f19195ad-3496-483f-90bd-723163c6705f {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:49:32.544478 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3cd6990a-d5fc-4013-a8f7-d58cb0da2ef7 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "POST /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f/action" status: 200 len: 32 microversion: 2.1 time: 0.301433 Aug 30 03:49:32.545517 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2291/4666] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:49:32 2022] POST /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:49:32.551093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e93a2bc-d493-4d27-923a-c6cc8ae28af4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '.version_select at 0x7f897b8b8550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:32.630622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e93a2bc-d493-4d27-923a-c6cc8ae28af4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807018137" status: 202 len: 0 microversion: 2.1 time: 0.082263 Aug 30 03:49:32.631127 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2292/4667] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 03:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807018137 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:49:32.655435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:32.658930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:32.674502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.675013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.675472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.676252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.676922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.677382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.840871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:32.857373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5f76d62-399b-41f2-8737-eced95bdd66d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 0.605111 Aug 30 03:49:32.858032 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2376/4668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:32 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:32.894865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:32.895399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:32.918222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.925743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.930690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:32.938435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:32.938923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:32.939357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:33.391869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:33.419635 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc895875-0ab7-4b64-845b-9176893aed1b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.781587 Aug 30 03:49:33.429623 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2293/4669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:32 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:33.451679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:33.464809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:33.491387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:33.492451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:33.493373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:33.494714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:33.495612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:33.497936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:33.640176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:33.653330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:33.656348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:33.657815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82a85867-048d-411a-a8c2-c456baf9b067 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.782015 Aug 30 03:49:33.658969 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2377/4670] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:32 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:33.887214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-96ed026d-a9cc-4652-aa12-69cc5b4a34f8 req-a7e48822-e409-449f-a32b-68b1632575b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf3b2af-8c10-4657-baf0-7fefa16f1ae5", "name": "network-vif-plugged", "status": "completed", "tag": "0573bbc1-c593-4dff-a75d-3a9a3fdb6f40"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:33.919060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-96ed026d-a9cc-4652-aa12-69cc5b4a34f8 req-a7e48822-e409-449f-a32b-68b1632575b3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:33.922874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-96ed026d-a9cc-4652-aa12-69cc5b4a34f8 req-a7e48822-e409-449f-a32b-68b1632575b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:33.923730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-96ed026d-a9cc-4652-aa12-69cc5b4a34f8 req-a7e48822-e409-449f-a32b-68b1632575b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:33.966059 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-96ed026d-a9cc-4652-aa12-69cc5b4a34f8 req-a7e48822-e409-449f-a32b-68b1632575b3 service nova] Creating event network-vif-plugged:0573bbc1-c593-4dff-a75d-3a9a3fdb6f40 for instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 on n-h1-854924-5 Aug 30 03:49:33.979674 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-96ed026d-a9cc-4652-aa12-69cc5b4a34f8 req-a7e48822-e409-449f-a32b-68b1632575b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099789 Aug 30 03:49:33.983185 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2378/4671] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:33.996469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:33.997619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:34.015155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:34.018333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:34.019034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:34.020063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:34.020760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:34.021432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:34.022863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:34.043778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:34.043778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:34.043778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fbd909d5-b907-43da-a3e5-35c809be38ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.598295 Aug 30 03:49:34.044113 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2294/4672] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:33 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:34.341481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:34.352858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3d1c208-023a-40b9-8cdf-ef16a8752303 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 0.368343 Aug 30 03:49:34.368999 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2379/4673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:33 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:34.459308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:34.461037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:34.483139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:34.486012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:34.486463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:34.489528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:34.490018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:34.494486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:34.681772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:34.683022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:34.705513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:34.708075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:34.708655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:34.712958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:34.719008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:34.720182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:35.128925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.150702 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-41072d6c-f6ca-444d-a7cb-855125b3e32a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.699200 Aug 30 03:49:35.151630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2295/4674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:34 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:35.156401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:35.161560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:35.174474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:35.174987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:35.175430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:35.176141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:35.176600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:35.177023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:35.461137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.471193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.481999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.484316 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2da36fd-2af5-4f7f-b839-02c51738d087 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.807030 Aug 30 03:49:35.503175 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2380/4675] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:34 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:35.521547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d25ea5e2-72f6-478d-958b-a2cd9acbec21 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: .version_select at 0x7f897a60caf0>, body: {"keypair": {"name": "tempest-keypair-802331843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoz+o1It/hdUi6TCAVbWlukD4a6lcSI4mpMavEbupSVNbEILrS4IYihCnRljsk1G22+AvQUmPznEt5sHVskTVM27JfyQ4I2DyeOkc++g9ov0Y2j1Y3YrdgN/pYakeuZOA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:35.562171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d25ea5e2-72f6-478d-958b-a2cd9acbec21 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for project 1ccee9310d244210867a17f0d093c18e. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:35.572816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d25ea5e2-72f6-478d-958b-a2cd9acbec21 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for user 51986d3cb9614471bce790af1e6be2df and project 1ccee9310d244210867a17f0d093c18e. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:35.652052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d25ea5e2-72f6-478d-958b-a2cd9acbec21 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147664 Aug 30 03:49:35.655407 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2381/4676] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:49:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:35.673096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:35.677777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:35.693265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.698091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:35.698824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:35.700044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:35.702217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:35.703882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:35.704472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:35.707687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.711131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:35.712972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d7c827b-4400-4a6f-89ec-75556421e6c7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.560184 Aug 30 03:49:35.725400 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2296/4677] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:35 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:36.031659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:36.046601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f0f901f-b34c-4258-aff8-cce6ea0bd24c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1315 microversion: 2.1 time: 0.381157 Aug 30 03:49:36.048585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2382/4678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:35 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:36.359806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:36.463140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:36.476050 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5b8197ab-6a26-4c3d-82ac-ff93a7a9b298 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.299216 Aug 30 03:49:36.496565 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2297/4679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:36 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:36.517302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:36.520709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:36.540272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:36.541544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:36.542708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:36.545083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:36.545600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:36.548425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:36.589198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:36.739874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:36.742836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:36.755163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:36.755925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:36.756880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:36.758761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:36.759672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:36.760454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:36.900417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:36.925482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:36.937226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:36.942300 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e547903b-46c2-4342-b08d-9bca0b161acf tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.433915 Aug 30 03:49:36.947031 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2383/4680] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:36 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:37.073141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:37.074100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:37.108030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.112707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.114564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.116250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.119524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.121427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.342470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:37.358476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:37.362408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:37.366047 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68929b4f-38aa-4915-be2c-bf44a7e1f1cf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.632842 Aug 30 03:49:37.382973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2298/4681] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:36 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:37.415266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:37.426846 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72c40b06-9071-4d44-8ea0-475becada45d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1501 microversion: 2.1 time: 0.361333 Aug 30 03:49:37.428209 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2384/4682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:37 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:37.450482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:37.451208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:37.458689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.460295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.460295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.461369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.461792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.462336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.503780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:37.505923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:37.519730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.521139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.525035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.526266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.528834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.529870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.564959 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-078717e8-88f2-4a74-b2ca-5885428c4b8a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.118508 Aug 30 03:49:37.567511 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2299/4683] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:49:37 2022] POST /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:49:37.586446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:37.589054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:37.605851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.607538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.609486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:37.610420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:37.611762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:37.613818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:38.058834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:38.067606 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0eed6dd-16c9-460a-8a0b-4f737d9d0a44 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.569070 Aug 30 03:49:38.084331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2385/4684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:37 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:38.114530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:38.117876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:38.120529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:38.121053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:38.131016 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-99427300-123e-4d72-96ea-d06a55ccfe54 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1506 microversion: 2.1 time: 0.559877 Aug 30 03:49:38.131893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2300/4685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:37 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:38.150992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:38.153734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:38.154222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:38.156392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:38.161686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:38.162211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:38.397484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:38.398397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:38.420137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:38.425902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:38.426496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:38.429673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:38.438332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:38.439002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:38.664562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:38.694355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:38.695747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:38.705647 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac41619c-d84f-4b16-bdb0-953e69fbcab6 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.615669 Aug 30 03:49:38.724016 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2386/4686] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:38 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:38.952369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:39.013500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:39.014971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:39.016178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae8e995a-1ce9-4996-ad82-f29d44fffb03 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.623920 Aug 30 03:49:39.033878 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2301/4687] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:38 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:39.123213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:39.124483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:39.155649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:39.159007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:39.193764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.195251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.197088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.198667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.199422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.200075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.201484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.202151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.202779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.203687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.206078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.209155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.827237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:39.853897 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4902cce8-d3b2-4bde-bab3-8fa338524637 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1486 microversion: 2.1 time: 0.702745 Aug 30 03:49:39.867983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:39.871151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2302/4688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:39 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1486 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:39.877324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:39.878232 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1fc89cab-7ee1-4c53-a654-6220b3eb8f94 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.774279 Aug 30 03:49:39.878374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:39.886704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.887447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.888055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.888943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.890897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.891636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.905463 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2387/4689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:39 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:39.920677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:39.921193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:39.943702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.946921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.949626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:39.953884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:39.954579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:39.955227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:40.075192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:49:40.308091 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3342c32-f4ef-4de9-9efe-71f96c986378 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 204 len: 0 microversion: 2.1 time: 0.412187 Aug 30 03:49:40.308704 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2388/4690] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:49:39 2022] DELETE /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:49:40.320541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:40.323977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:40.353568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:40.354359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:40.354973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:40.356033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:40.356772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:40.358267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:40.515552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:40.535976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:40.537770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:40.539033 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ee06dd1-3c64-472e-8154-bcc6badfc56d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.665942 Aug 30 03:49:40.545747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2303/4691] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:39 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:40.551834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1065944759", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64c320f1-15a6-4c07-9792-194d32e05876"}], "security_groups": [{"name": "tempest-securitygroup--389590940"}], "key_name": "tempest-keypair-802331843", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:40.864882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:40.888378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:40.890153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:40.891422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-194fe86a-d59a-4f5e-b5af-08f79a76ba37 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.581347 Aug 30 03:49:40.905763 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2389/4692] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:40 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:40.921432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:40.922084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:40.939725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:40.940495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:40.941122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:40.942066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:40.943058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:40.944478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:41.034079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] validate_networks() for [('64c320f1-15a6-4c07-9792-194d32e05876', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:49:41.461576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:41.476727 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-214c09a8-cd4d-4b86-bedc-26344f4fba55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1492 microversion: 2.1 time: 0.566266 Aug 30 03:49:41.493506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2390/4693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:40 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1492 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:41.516929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-026b6589-72b1-44a2-a4d7-4fad343c8617 req-d380e6c2-1ea0-42e3-865d-921d5492eb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d", "name": "network-vif-plugged", "status": "completed", "tag": "2bf260e9-899c-42b6-ab53-f5072e802f38"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:41.532002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-026b6589-72b1-44a2-a4d7-4fad343c8617 req-d380e6c2-1ea0-42e3-865d-921d5492eb1f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:41.532999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-026b6589-72b1-44a2-a4d7-4fad343c8617 req-d380e6c2-1ea0-42e3-865d-921d5492eb1f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:41.533966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-026b6589-72b1-44a2-a4d7-4fad343c8617 req-d380e6c2-1ea0-42e3-865d-921d5492eb1f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:41.551953 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-026b6589-72b1-44a2-a4d7-4fad343c8617 req-d380e6c2-1ea0-42e3-865d-921d5492eb1f service nova] Creating event network-vif-plugged:2bf260e9-899c-42b6-ab53-f5072e802f38 for instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d on n-h1-854924-5 Aug 30 03:49:41.562357 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-026b6589-72b1-44a2-a4d7-4fad343c8617 req-d380e6c2-1ea0-42e3-865d-921d5492eb1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066576 Aug 30 03:49:41.564421 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2391/4694] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:41.573972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:41.575225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:41.586367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:41.587419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:41.588337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:41.591586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:41.592859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:41.593582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.178274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:42.189229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0dd79c63-c4fd-4184-8536-6e52e1caa7e3 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.620521 Aug 30 03:49:42.200177 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2392/4695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:41 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:42.211066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:42.211993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:42.225159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.225773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.226225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.226945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.227399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.228630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.582464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:49:42.583570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:49:42.584530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:49:42.585873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:49:42.586581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:49:42.610405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.612051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.612715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.615073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.617800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.618482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:42.619154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.629911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:42.631586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:42.633614 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d200631d-2f3b-42f6-b99c-ccca55287564 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.431651 Aug 30 03:49:42.634692 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2393/4696] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:42 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:42.641417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:42.642512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:42.648790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:42.655973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.656824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.657888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.659187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.660141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.660848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.687755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for project 1ccee9310d244210867a17f0d093c18e. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:42.703795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Getting quotas for user 51986d3cb9614471bce790af1e6be2df and project 1ccee9310d244210867a17f0d093c18e. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:42.740118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:49:42.743438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:49:42.821679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-567c8c37-672f-4ae4-8cee-0353d2d32d0b tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.274017 Aug 30 03:49:42.825056 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2304/4697] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:49:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:49:42.838267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:42.841710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:42.852981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.854035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.856083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.857241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:42.857912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:42.858966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:42.982697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:42.994512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:42.997939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.004544 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f8c3945d-40ae-47cc-8ab7-350bae25becc tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.368265 Aug 30 03:49:43.006533 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2394/4698] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:42 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:43.026048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-458a115f-48b8-4100-ae26-60997c33d046 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:43.027738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-458a115f-48b8-4100-ae26-60997c33d046 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:43.125544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.152808 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-11114936-e69f-4621-9369-73f01bfaaba2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1450 microversion: 2.1 time: 0.323973 Aug 30 03:49:43.155247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2305/4699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:42 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1450 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:43.202723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-458a115f-48b8-4100-ae26-60997c33d046 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.218495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:43.219817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:43.229961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-458a115f-48b8-4100-ae26-60997c33d046 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1237 microversion: 2.1 time: 0.220503 Aug 30 03:49:43.246734 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2395/4700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:43 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1237 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:43.247920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:43.248433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:43.249088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:43.250768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:43.252033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:43.252579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:43.282763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ed0503cc-ff86-4478-af09-a53d521f1f55 req-a7eddcea-0407-4b25-b773-53e00e31eed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf3b2af-8c10-4657-baf0-7fefa16f1ae5", "name": "network-vif-deleted", "tag": "0573bbc1-c593-4dff-a75d-3a9a3fdb6f40"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:43.306329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ed0503cc-ff86-4478-af09-a53d521f1f55 req-a7eddcea-0407-4b25-b773-53e00e31eed9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:43.307483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ed0503cc-ff86-4478-af09-a53d521f1f55 req-a7eddcea-0407-4b25-b773-53e00e31eed9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:43.309070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ed0503cc-ff86-4478-af09-a53d521f1f55 req-a7eddcea-0407-4b25-b773-53e00e31eed9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:43.331607 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ed0503cc-ff86-4478-af09-a53d521f1f55 req-a7eddcea-0407-4b25-b773-53e00e31eed9 service nova] Creating event network-vif-deleted:0573bbc1-c593-4dff-a75d-3a9a3fdb6f40 for instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 on n-h1-854924-5 Aug 30 03:49:43.338284 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ed0503cc-ff86-4478-af09-a53d521f1f55 req-a7eddcea-0407-4b25-b773-53e00e31eed9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059594 Aug 30 03:49:43.339374 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2396/4701] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:43.512470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.530905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26281f66-ddb6-4f0e-9e11-a84e3e4e951a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.318569 Aug 30 03:49:43.532701 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2306/4702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:43 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:43.661700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:43.663191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:43.676787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:43.678395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:43.681163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:43.684643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:43.686844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:43.687712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:43.968744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.984291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.989535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:43.994479 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d8bd2722-f48e-48a6-a7c0-cf8431fddf0f tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1358 microversion: 2.21 time: 0.337807 Aug 30 03:49:43.996982 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2397/4703] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:43 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:44.037526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:44.038559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:44.054909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.055418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.055860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.056568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.111735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.055s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.114180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.188413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:44.193077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:44.218441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.219786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.221295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.222374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.223369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.224318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.292733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.293890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.294597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.297739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'fault' on Instance uuid fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:49:44.371176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:44.386775 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21750032-cba2-410b-badb-3f158a46be8f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 200 len: 1305 microversion: 2.1 time: 0.210715 Aug 30 03:49:44.403030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2398/4704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:44 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 1305 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:44.415105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:44.416607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:44.429361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.430803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.432611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.435689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.436365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.437568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.541196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:44.569026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:44.573542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:44.577865 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-978e4afa-de1f-4c9c-a423-df2450cb5c0a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.544814 Aug 30 03:49:44.580668 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2307/4705] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:44 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:44.592547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:44.595248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:44.618992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.624710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.625737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.628297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:44.629836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:44.631259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:44.634529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:44.640823 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-365399df-1ae9-497e-af6d-a16398cdf68c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1233 microversion: 2.1 time: 0.236360 Aug 30 03:49:44.644297 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2399/4706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:44 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1233 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:45.026741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:45.027800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:45.042172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.042542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.042996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.048784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.050381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.050837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.131654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:45.138068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:45.149962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23c0680d-02bc-4c19-b53f-98487ce713ec tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.566630 Aug 30 03:49:45.150563 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2308/4707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:44 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:45.418920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:45.420591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:45.420812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:45.433656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:45.440186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:45.441429 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5117f9d-5753-4d74-90f6-a9e3b0afbe6d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1550 microversion: 2.21 time: 0.419283 Aug 30 03:49:45.442054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.442567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.446989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.447787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.448293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.448749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.460974 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2400/4708] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:45 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1550 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:45.467443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:45.467940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:45.483161 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 HTTP/1.1 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'fbf3b2af-8c10-4657-baf0-7fefa16f1ae5'} Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:45.484900 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:45.490403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:45.493751 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c0f56f3-0d9c-4d9d-9309-fcec6819926d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 404 len: 111 microversion: 2.1 time: 0.087877 Aug 30 03:49:45.495011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.495704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.498853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.500258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.500980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.501693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.505961 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2309/4709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:45 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:49:45.581136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:49:45.609095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:45.609741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:45.635351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.636528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.641542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.643543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.644042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.645373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.787547 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5736085f-8bb9-4277-9b9c-0256eafa1e6a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 204 len: 0 microversion: 2.21 time: 0.322589 Aug 30 03:49:45.788706 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2401/4710] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:49:45 2022] DELETE /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:49:45.805981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:45.813211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:45.833685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.833685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.834856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.838500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:45.839370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:45.839984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:45.988845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.011786 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7a51046-1386-42b7-bf19-5e6345ebf776 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1289 microversion: 2.1 time: 0.214087 Aug 30 03:49:46.038010 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2402/4711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:45 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1289 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:46.059600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-900209841", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:46.174383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.191453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.193303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.194851 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6794eea-5073-4e8f-8d0c-d68b8d11cc23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.592410 Aug 30 03:49:46.196620 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2310/4712] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:45 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:49:46.204046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:46.204912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:46.214224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:46.215554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:46.216707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:46.224814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:49:46.230729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:46.244251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:46.245761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:46.810489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.827760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.829894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:46.832274 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de8668d8-416a-43b0-86c6-a491d5f71e9c tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1556 microversion: 2.21 time: 0.634290 Aug 30 03:49:46.833702 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2311/4713] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:46 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1556 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:46.839917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:46.852987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:46.860319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:46.861159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:46.861841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:46.862871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:46.863558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:46.864200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.367425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:47.383341 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c1e1788a-8615-4054-93eb-cfc900680e13 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.546660 Aug 30 03:49:47.385758 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2312/4714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:46 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:47.393020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:47.394763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:47.419810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:47.420671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:47.421319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.425201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:47.426133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:47.426783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.747996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:47.765884 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-507b904d-da93-47b6-9975-4641b4ba730e tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1295 microversion: 2.1 time: 0.374757 Aug 30 03:49:47.768981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2313/4715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:47 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1295 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:47.783281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:47.785362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:47.791319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:49:47.791791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:49:47.792276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:49:47.792850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:49:47.793368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:49:47.807138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:47.807677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:47.808063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.808798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:47.809260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:47.810040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.841663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:47.843857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:47.848586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:49:47.851704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.856397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:47.859145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:49:47.859514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:47.860086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:47.876857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:49:47.879830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:49:47.986241 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-877a5ba6-8707-40f4-9e56-7776cbe4b5ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946119 Aug 30 03:49:47.989063 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2403/4716] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:49:48.004114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:48.006205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:48.047945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:48.048654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:48.050963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:48.052176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:48.054809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:48.056209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:48.141773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.159928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.162780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.164989 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-916d30b1-70af-442b-af98-15e975e4fb6b tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.394557 Aug 30 03:49:48.168572 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2314/4717] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:47 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:48.189995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-826ad64e-4196-41cf-8300-61333b3fc3f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:48.191710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-826ad64e-4196-41cf-8300-61333b3fc3f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:48.367966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-826ad64e-4196-41cf-8300-61333b3fc3f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.384806 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-826ad64e-4196-41cf-8300-61333b3fc3f2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1214 microversion: 2.1 time: 0.212729 Aug 30 03:49:48.392951 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2315/4718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:48 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:48.416721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:48.417379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:48.470694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:48.471243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:48.471697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:48.472434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:48.472896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:48.473321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:48.636087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.650359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.654073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:48.658222 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3cc6c02e-7907-49f2-8326-5b85fb8e901d tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1556 microversion: 2.21 time: 0.667856 Aug 30 03:49:48.693553 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2404/4719] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:47 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1556 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:48.790156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:48.791256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:48.802738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:48.805818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:48.808527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:48.811385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:48.812092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:48.812686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:49.147031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:49.175664 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b203b846-b1e6-4cc0-9dcb-87c17220cfa2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.763303 Aug 30 03:49:49.190692 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2316/4720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:48 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:49.199036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:49.201450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:49.219001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:49.219499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:49.219931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:49.230180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:49.230947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:49.231879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:49.312765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:49.330191 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-60658285-6e8d-4ce0-980c-1d5291994381 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 0.544470 Aug 30 03:49:49.330785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2405/4721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:48 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:49.415052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:49.415968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:49.426879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:49.429276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:49.430221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:49.431153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:49.434100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:49.434854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:49.689322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:49.728205 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02a6e670-e7ec-439b-bb3a-ca4b1589d19a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1210 microversion: 2.1 time: 0.310793 Aug 30 03:49:49.744535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2406/4722] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:49 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1210 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:49.761766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:49.777646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:49.778269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:49.786087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:49.791252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:49.797029 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6018797-aeb7-4d62-9c0f-47a43c4a13f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.600219 Aug 30 03:49:49.802173 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2317/4723] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:49 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:49.817152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:49.820636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:49.821402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:49.822397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:49.824868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:49.826809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.006740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:50.021828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:50.027316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:50.030913 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70612174-291a-4929-a851-3aa14eeebf60 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1514 microversion: 2.21 time: 0.281791 Aug 30 03:49:50.032276 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2407/4724] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:49 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:50.074360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7f146a20-e8ac-47a3-93d7-08e17dacfcf9 req-5eb7c097-7183-4e7d-80a8-a2abbbed1feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d", "name": "network-vif-deleted", "tag": "2bf260e9-899c-42b6-ab53-f5072e802f38"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:50.109664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7f146a20-e8ac-47a3-93d7-08e17dacfcf9 req-5eb7c097-7183-4e7d-80a8-a2abbbed1feb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.110454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7f146a20-e8ac-47a3-93d7-08e17dacfcf9 req-5eb7c097-7183-4e7d-80a8-a2abbbed1feb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.111131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7f146a20-e8ac-47a3-93d7-08e17dacfcf9 req-5eb7c097-7183-4e7d-80a8-a2abbbed1feb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.147996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7f146a20-e8ac-47a3-93d7-08e17dacfcf9 req-5eb7c097-7183-4e7d-80a8-a2abbbed1feb service nova] Creating event network-vif-deleted:2bf260e9-899c-42b6-ab53-f5072e802f38 for instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d on n-h1-854924-5 Aug 30 03:49:50.161614 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7f146a20-e8ac-47a3-93d7-08e17dacfcf9 req-5eb7c097-7183-4e7d-80a8-a2abbbed1feb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092391 Aug 30 03:49:50.165854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2318/4725] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:50.200681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:50.201832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:50.209519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.210913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.211654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.212901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.213945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.214786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.354991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:50.358349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:50.366130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.367061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.368007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.370678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.371379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.372114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.547442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:50.565197 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2637d21c-1323-4427-a741-adc3b6599c95 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.370548 Aug 30 03:49:50.568385 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2408/4726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:50 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:50.682078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:50.694117 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b955708d-7e08-44a6-a71a-214587e1d044 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 0.346812 Aug 30 03:49:50.695465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2319/4727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:50 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:50.752909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:50.755553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:50.773517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.775432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.780241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.783688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.786120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.787317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.834335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:50.835152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:50.852146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.857052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.858102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:50.860882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:50.861508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:50.861961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.017062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.028107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0e46835-2a5f-4a00-a9ad-d3dbc775dbf1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1272 microversion: 2.1 time: 0.281724 Aug 30 03:49:51.034997 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2409/4728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:50 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:51.057643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:51.059120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:51.094341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.095241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.095942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.096879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.098548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.101462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.196254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.196788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.206698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.207201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lazy-loading 'fault' on Instance uuid 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:49:51.308848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.324803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.329211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1189913a88cd41d2ba30465c94861ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b1c67e02904fb9a5abafc0d82ef61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.332050 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f4ccc96-0c94-44bf-8595-59466593680a tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 200 len: 1348 microversion: 2.21 time: 0.279659 Aug 30 03:49:51.334883 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2410/4729] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:51 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 1348 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:51.468485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.493428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.500324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:51.505486 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3c2dce40-6784-4fc2-869f-8a30488b95c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.676324 Aug 30 03:49:51.509376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2320/4730] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:50 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:51.591766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:51.592647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:51.604625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.608977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.610546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.611977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.612650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.613380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.716638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:51.717260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:51.727467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.728079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.728396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.729109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:51.729596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:51.730029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:51.990893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:52.014399 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ab66a01-5ab7-43e7-8970-31292d59a816 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.430181 Aug 30 03:49:52.018973 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2411/4731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:51 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:52.055687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:52.056585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:52.068497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.069337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.070976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.076649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.077534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.078217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.106812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:52.122896 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e9d7ca3-4361-49e0-8caa-f75393e7e841 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 0.410880 Aug 30 03:49:52.136496 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2321/4732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:51 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:52.239686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:52.239686 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a5cc983b-a6c8-4bc2-a981-d0f06f284556 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1272 microversion: 2.1 time: 0.164200 Aug 30 03:49:52.239686 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2412/4733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:52 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:52.361000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:52.361923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:52.387212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.387945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.388576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.389511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.392586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.395957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.415628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] HTTP exception thrown: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Request method failure captured: Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d HTTP/1.1 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYi_oDSXYVL2pB3IdPvSQe8Ug-fBNS4yCfrFNXvjbGRj9ioROnaiVYcv3u0LzwIm720pn_m2c1nxN9Wvpsu3RK2_oL5Z077hpiUITgxmk3GMVEz0nX6XYlchoq84pBQ56zperzBd1RYLLSkhmbY6tsJcu9bdVROFBadHrvYARMeG8xY Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 26b1c67e02904fb9a5abafc0d82ef61c Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b1c67e02904fb9a5abafc0d82ef61c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/26b1c67e02904fb9a5abafc0d82ef61c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_26b1c67e02904fb9a5abafc0d82ef61c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b1c67e02904fb9a5abafc0d82ef61c"}]}] Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 26b1c67e02904fb9a5abafc0d82ef61c Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-InstanceActionsV221TestJSON-1887194438-project Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 1189913a88cd41d2ba30465c94861ab2 Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-InstanceActionsV221TestJSON-1887194438-project Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d'} Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.417683 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.422715 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.425249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Returning 404 to user: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:52.426416 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-17882a3c-9bb1-4222-bfee-1a36e7b03098 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 404 len: 111 microversion: 2.21 time: 0.069231 Aug 30 03:49:52.427228 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2322/4734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:52 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:49:52.436860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '.version_select at 0x7f897a62f0d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:52.437883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:52.451534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.452135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.452583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.453316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.453840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.454508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.534870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:52.535627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:52.559782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.565263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.566586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.567911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.571062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.573325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.627145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e7f1772-4afd-4a64-8342-58adff846235 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.194653 Aug 30 03:49:52.640826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2413/4735] 10.222.0.30 () {60 vars in 1337 bytes} [Tue Aug 30 03:49:52 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d/os-instance-actions => generated 611 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:49:52.646839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:52.647346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:52.649014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:52.654410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.654995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.655435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.656189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.656643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.657163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.685428 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] HTTP exception thrown: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Request method failure captured: Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d HTTP/1.1 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYi_oDSXYVL2pB3IdPvSQe8Ug-fBNS4yCfrFNXvjbGRj9ioROnaiVYcv3u0LzwIm720pn_m2c1nxN9Wvpsu3RK2_oL5Z077hpiUITgxmk3GMVEz0nX6XYlchoq84pBQ56zperzBd1RYLLSkhmbY6tsJcu9bdVROFBadHrvYARMeG8xY Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 26b1c67e02904fb9a5abafc0d82ef61c Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b1c67e02904fb9a5abafc0d82ef61c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/26b1c67e02904fb9a5abafc0d82ef61c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_26b1c67e02904fb9a5abafc0d82ef61c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b1c67e02904fb9a5abafc0d82ef61c"}]}] Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 26b1c67e02904fb9a5abafc0d82ef61c Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceActionsV221TestJSON-1887194438-project Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 1189913a88cd41d2ba30465c94861ab2 Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceActionsV221TestJSON-1887194438-project Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d'} Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:52.688947 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Returning 404 to user: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:52.695023 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc2a8c4f-9114-4973-9afa-667a8e1dae41 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 404 len: 111 microversion: 2.21 time: 0.051245 Aug 30 03:49:52.699869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2414/4736] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:49:52 2022] DELETE /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:49:52.711105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9b77c289-cb83-4f37-a5f4-c82600ce3714 req-13605424-f170-416f-a7b9-012f152c2d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba4d32e-9a76-4cca-8994-bdedcee1eb8e", "tag": "c1bbbe22-9168-4dbf-a0be-310da849d63d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:52.736538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b77c289-cb83-4f37-a5f4-c82600ce3714 req-13605424-f170-416f-a7b9-012f152c2d68 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.737360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b77c289-cb83-4f37-a5f4-c82600ce3714 req-13605424-f170-416f-a7b9-012f152c2d68 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.740322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9b77c289-cb83-4f37-a5f4-c82600ce3714 req-13605424-f170-416f-a7b9-012f152c2d68 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.764339 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9b77c289-cb83-4f37-a5f4-c82600ce3714 req-13605424-f170-416f-a7b9-012f152c2d68 service nova] Creating event network-changed:c1bbbe22-9168-4dbf-a0be-310da849d63d for instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e on n-h2-854924-5 Aug 30 03:49:52.778207 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9b77c289-cb83-4f37-a5f4-c82600ce3714 req-13605424-f170-416f-a7b9-012f152c2d68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076971 Aug 30 03:49:52.779149 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2415/4737] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:52.804659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:52.808097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] [instance: 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:52.828088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.829743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.832341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.834214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:52.837270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:52.837993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:52.869151 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] HTTP exception thrown: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Request method failure captured: Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d HTTP/1.1 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYi_oDSXYVL2pB3IdPvSQe8Ug-fBNS4yCfrFNXvjbGRj9ioROnaiVYcv3u0LzwIm720pn_m2c1nxN9Wvpsu3RK2_oL5Z077hpiUITgxmk3GMVEz0nX6XYlchoq84pBQ56zperzBd1RYLLSkhmbY6tsJcu9bdVROFBadHrvYARMeG8xY Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 26b1c67e02904fb9a5abafc0d82ef61c Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b1c67e02904fb9a5abafc0d82ef61c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/26b1c67e02904fb9a5abafc0d82ef61c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_26b1c67e02904fb9a5abafc0d82ef61c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b1c67e02904fb9a5abafc0d82ef61c"}]}] Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 26b1c67e02904fb9a5abafc0d82ef61c Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1887194438 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-InstanceActionsV221TestJSON-1887194438-project Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 1189913a88cd41d2ba30465c94861ab2 Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-InstanceActionsV221TestJSON-1887194438-project Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d'} Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.870863 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] Returning 404 to user: Instance 95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da34544a-396a-4bfe-b6fb-8ce08128f3a7 tempest-InstanceActionsV221TestJSON-1887194438 tempest-InstanceActionsV221TestJSON-1887194438-project] 10.222.0.30 "GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d" status: 404 len: 111 microversion: 2.21 time: 0.089446 Aug 30 03:49:52.876535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2416/4738] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:52 2022] GET /compute/v2.1/servers/95ee5d48-e13a-4c5c-ae87-42a5fe8f0b5d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:49:52.879202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:52.892525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:52.906762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:52.908679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ebeb2195-8e86-44b3-b71a-f53ffc4bb24c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.378482 Aug 30 03:49:52.926848 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2323/4739] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:52 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:53.040385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:53.041009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:53.057869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:53.058434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:53.068982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:53.070542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:53.071035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:53.071477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:53.145276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:53.146631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:53.157828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:53.165764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:53.166590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:53.167585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:53.168276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:53.168941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:53.207220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:54.101678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:54.104988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:54.133249 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4419dfb-81d4-4e88-9049-96e8bcd40196 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 1.094750 Aug 30 03:49:54.146169 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2417/4740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:53 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:54.153479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:54.158170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:54.183992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:54.184492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:54.187824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:54.189867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:54.191494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:54.191950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:54.253479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:54.266973 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b301444-617d-4240-8160-c5c9a47c9981 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 1.126983 Aug 30 03:49:54.280491 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2324/4741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:53 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:54.285871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:54.286499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:54.312337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:54.314150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:54.316258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:54.317225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:54.321032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:54.321598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:54.622290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:54.636009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fcfd647e-4dd2-4c25-9a82-d563fc76eaf5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 0.487992 Aug 30 03:49:54.636653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2418/4742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:54 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:54.773232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:54.789396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:54.790978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:54.796138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-02007692-e5a0-4fce-af87-dae3775c8c39 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.525196 Aug 30 03:49:54.810378 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2325/4743] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:54 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:55.154411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:55.155924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:55.171920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:55.175335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:55.181973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:55.182739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:55.186181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:55.186656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:55.287822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:55.288997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:55.300604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:55.301098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:55.301565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:55.302784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:55.303242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:55.303727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:55.757595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:55.777897 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b55e9293-d9dc-401a-8e3c-afeca30da443 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.627434 Aug 30 03:49:55.785467 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2419/4744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:55 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:56.025255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:56.037289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0f384da3-1d64-4f13-a471-6ed49fd67c86 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 0.752485 Aug 30 03:49:56.038879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2326/4745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:55 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:56.048770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:56.052695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:56.065640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:56.071978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:56.073107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:56.073891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:56.079441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:56.080228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:56.081863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:56.393161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6568a397-e5de-47d3-8dda-3ccdd0527efc req-d3ef4104-3271-45a6-bf57-dbb81c479aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65cf4560-2c13-4df2-b7f5-f378b4d79590", "tag": "1d13d08c-1ed0-44a0-928e-e5429314f323"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:56.403970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:56.431632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6568a397-e5de-47d3-8dda-3ccdd0527efc req-d3ef4104-3271-45a6-bf57-dbb81c479aa0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:56.439537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6568a397-e5de-47d3-8dda-3ccdd0527efc req-d3ef4104-3271-45a6-bf57-dbb81c479aa0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:56.440003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6568a397-e5de-47d3-8dda-3ccdd0527efc req-d3ef4104-3271-45a6-bf57-dbb81c479aa0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:56.763016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:56.781644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-948d149e-6354-408b-94bd-f9ec459cc63a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 0.739615 Aug 30 03:49:56.782257 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2327/4746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:56 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:56.787295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:56.787909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:56.810337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:56.810829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:56.811491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:56.812389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:56.813410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:56.814014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:56.984366 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6568a397-e5de-47d3-8dda-3ccdd0527efc req-d3ef4104-3271-45a6-bf57-dbb81c479aa0 service nova] Creating event network-changed:1d13d08c-1ed0-44a0-928e-e5429314f323 for instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 on n-h1-854924-5 Aug 30 03:49:56.991974 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6568a397-e5de-47d3-8dda-3ccdd0527efc req-d3ef4104-3271-45a6-bf57-dbb81c479aa0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.206560 Aug 30 03:49:56.995208 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2420/4747] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:57.004729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:57.005591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:57.012794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:57.022264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:57.024641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:57.025558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:57.026036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:57.026470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:57.660566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:57.691405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:57.696321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:57.701837 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-17d50ceb-6037-4f32-a1e1-c75199615fb8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.918515 Aug 30 03:49:57.702020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:57.703747 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2328/4748] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:56 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:57.714190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:57.714801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:57.733141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:57.734052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:57.734692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:57.736800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f158a602-42a5-4d17-80a9-9e3fbe8b4f78 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.740296 Aug 30 03:49:57.737034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:57.738659 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2421/4749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:56 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:57.739081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:57.740526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:57.755298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-13d4ee15-7438-4107-a474-e89db4582749 req-5ce9dfb5-535d-4c23-a247-b75c0e2b9578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba4d32e-9a76-4cca-8994-bdedcee1eb8e", "name": "network-vif-plugged", "status": "completed", "tag": "c1bbbe22-9168-4dbf-a0be-310da849d63d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:57.779667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-13d4ee15-7438-4107-a474-e89db4582749 req-5ce9dfb5-535d-4c23-a247-b75c0e2b9578 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:57.780148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-13d4ee15-7438-4107-a474-e89db4582749 req-5ce9dfb5-535d-4c23-a247-b75c0e2b9578 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:57.786228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-13d4ee15-7438-4107-a474-e89db4582749 req-5ce9dfb5-535d-4c23-a247-b75c0e2b9578 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:57.805893 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-13d4ee15-7438-4107-a474-e89db4582749 req-5ce9dfb5-535d-4c23-a247-b75c0e2b9578 service nova] Creating event network-vif-plugged:c1bbbe22-9168-4dbf-a0be-310da849d63d for instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e on n-h2-854924-5 Aug 30 03:49:57.817009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-13d4ee15-7438-4107-a474-e89db4582749 req-5ce9dfb5-535d-4c23-a247-b75c0e2b9578 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074466 Aug 30 03:49:57.818000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2422/4750] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:49:57.840441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:57.841713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:57.925324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:57.929032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:57.987052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:57.990775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:57.998232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:57.999969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:58.004400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:58.006414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:58.134213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:58.156045 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5edcb0a5-bdc1-4349-82b7-d8c20f5418dc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 0.443599 Aug 30 03:49:58.163647 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2329/4751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:57 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:58.428254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:58.437214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-07856383-b912-417b-8ff9-444ea064efc5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 0.615056 Aug 30 03:49:58.437820 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2423/4752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:57 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:58.737159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:58.755765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:58.763730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:58.768470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:58.781934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:49:58.792597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:58.793299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:58.793952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:58.798021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:58.798724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:58.799946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:58.813768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:58.814301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:58.815020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:58.815995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:58.826182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:58.828554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:59.140682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:59.150755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:59.156767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:59.158844 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfed609c-4257-4131-b772-0797ab8e0ca9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.430457 Aug 30 03:49:59.178609 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2330/4753] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:49:58 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:49:59.179470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:59.182249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:59.184496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:59.190881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:59.191388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:59.191836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:59.192549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:59.193012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:59.194403 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-740d19c7-7413-4651-8634-861bcc6aafde tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.434671 Aug 30 03:49:59.207932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:59.208762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2424/4754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:58 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:59.476202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:49:59.477041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:49:59.501997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:59.510125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:59.510575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:59.511329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:59.511793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:59.512224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:59.529125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:59.537405 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc8f9c4b-9c0d-4c84-8f5e-871867ddef96 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1362 microversion: 2.1 time: 0.362871 Aug 30 03:49:59.538157 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2331/4755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:59 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:49:59.765064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:49:59.779531 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d252f4bc-e300-4af5-9dcb-2c43cb65eda1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 0.324193 Aug 30 03:49:59.781515 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2425/4756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:49:59 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:49:59.845994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-982b1dc9-97a9-4206-ac9b-cd291b118bdc req-43aa02c4-39e5-41a4-abd5-402986b1bec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "name": "network-vif-plugged", "status": "completed", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:49:59.874819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-982b1dc9-97a9-4206-ac9b-cd291b118bdc req-43aa02c4-39e5-41a4-abd5-402986b1bec1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:49:59.875317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-982b1dc9-97a9-4206-ac9b-cd291b118bdc req-43aa02c4-39e5-41a4-abd5-402986b1bec1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:49:59.875761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-982b1dc9-97a9-4206-ac9b-cd291b118bdc req-43aa02c4-39e5-41a4-abd5-402986b1bec1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:49:59.909359 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-982b1dc9-97a9-4206-ac9b-cd291b118bdc req-43aa02c4-39e5-41a4-abd5-402986b1bec1 service nova] Creating event network-vif-plugged:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:49:59.928993 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-982b1dc9-97a9-4206-ac9b-cd291b118bdc req-43aa02c4-39e5-41a4-abd5-402986b1bec1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087370 Aug 30 03:49:59.931404 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2332/4757] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:00.189922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:00.190539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:00.207272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:00.207769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:00.208202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:00.217794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:00.218508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:00.221913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:00.222494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:00.222940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:00.243612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:00.244475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:00.245939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:00.247674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:00.250041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:00.251901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:00.924256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:00.950411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:00.956134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:00.962572 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7aa1b90-b717-4145-b7ef-9561edf44200 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.775909 Aug 30 03:50:00.964135 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2426/4758] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:00 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:50:00.972169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:00.976703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:00.988367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:00.994061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:00.994858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:00.995847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:00.996693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:00.997402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:01.080198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:01.107143 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-745382d9-c2cb-48d0-8b99-95a6975b5465 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.895236 Aug 30 03:50:01.130738 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2333/4759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:00 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:01.130738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:01.130738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:01.158646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:01.159150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:01.159596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:01.164308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:01.165004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:01.165235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:01.691611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:01.701883 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa51c38c-17c0-4fcd-8bd0-1f8af26ef5a7 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1547 microversion: 2.1 time: 0.736324 Aug 30 03:50:01.702482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2427/4760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:00 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1547 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:01.747667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:01.748828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:01.764991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:01.766545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:01.767157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:01.768043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:01.770172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:01.770608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:01.809198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:01.823144 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6aa7505e-d9d2-409e-81ea-9f755fb0a504 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 0.703367 Aug 30 03:50:01.836085 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2334/4761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:01 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:01.966438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68aa4599-d1f0-4593-843e-5ccfc76ee9b4 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236984 Aug 30 03:50:01.972301 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2428/4762] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:50:01 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:01.993800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:01.996573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:02.015300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.015815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.016268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.016992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.017753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.017881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.148897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:02.150374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:02.164767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.171060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.172218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.173221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.173963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.174642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.517232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:02.535576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:02.542240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:02.546549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:02.548012 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1ef7813-6848-49df-af91-8fe90e8b06b0 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.560427 Aug 30 03:50:02.549186 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2335/4763] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:01 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:50:02.554828 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10a44040-6d07-4d58-8e58-13291404fad2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1485 microversion: 2.1 time: 0.419790 Aug 30 03:50:02.555971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2429/4764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:02 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1485 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:02.590009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:02.590798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:02.597927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.598713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.599348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.600256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.601698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.602335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.806215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9db58b9e-5160-425a-96e2-61603076f2e3 req-c40596d6-62f2-480d-a6c3-1897b2f5e96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cf4560-2c13-4df2-b7f5-f378b4d79590", "name": "network-vif-plugged", "status": "completed", "tag": "1d13d08c-1ed0-44a0-928e-e5429314f323"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:02.828273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6623555-5264-4db9-96da-4b708dde7c07 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "POST /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f/action" status: 202 len: 0 microversion: 2.1 time: 0.239704 Aug 30 03:50:02.843562 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2336/4765] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:50:02 2022] POST /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:50:02.856108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9db58b9e-5160-425a-96e2-61603076f2e3 req-c40596d6-62f2-480d-a6c3-1897b2f5e96d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.856656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9db58b9e-5160-425a-96e2-61603076f2e3 req-c40596d6-62f2-480d-a6c3-1897b2f5e96d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.857093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9db58b9e-5160-425a-96e2-61603076f2e3 req-c40596d6-62f2-480d-a6c3-1897b2f5e96d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.866783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:02.868263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:02.902654 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9db58b9e-5160-425a-96e2-61603076f2e3 req-c40596d6-62f2-480d-a6c3-1897b2f5e96d service nova] Creating event network-vif-plugged:1d13d08c-1ed0-44a0-928e-e5429314f323 for instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 on n-h1-854924-5 Aug 30 03:50:02.924371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.925574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.926920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.927115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.927742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.928386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.932983 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9db58b9e-5160-425a-96e2-61603076f2e3 req-c40596d6-62f2-480d-a6c3-1897b2f5e96d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131936 Aug 30 03:50:02.935185 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2430/4766] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:02.945679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:02.946455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:02.953704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.954375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.954817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:02.955660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:02.956771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:02.959385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:04.142703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:04.169135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d8e51371-3373-4206-a770-9b7b08d044c1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1493 microversion: 2.1 time: 1.229262 Aug 30 03:50:04.171300 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2431/4767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:02 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1493 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:04.187934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:04.191704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:04.202475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:04.203263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:04.203804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:04.204619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:04.205704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:04.206439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:04.207063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:04.238024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cdfc028c-e21a-49b5-beda-504cdb516163 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 1.376274 Aug 30 03:50:04.238702 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2337/4768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:02 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:04.525206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:04.553626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:04.555766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:04.557057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09c9e428-df90-43e0-b995-9dd353c5fe23 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1805 microversion: 2.20 time: 0.382065 Aug 30 03:50:04.569571 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2432/4769] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:04 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1805 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:50:05.192059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:05.192849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:05.210405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:05.211877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:05.212536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:05.213546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:05.214232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:05.215030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:05.263409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:05.265465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:05.280667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:05.281180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:05.281653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:05.287423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:05.293127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:05.294896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:05.966088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:05.980044 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4eeb479b-2adc-43d2-b6d6-675b33c67bb0 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1493 microversion: 2.1 time: 0.792431 Aug 30 03:50:05.981235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2338/4770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:05 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1493 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:05.989463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:05.991584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:06.006585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:06.008684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:06.009303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:06.010216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:06.010829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:06.011439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:06.022538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:06.037141 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10a4a0f2-6e30-4b26-830c-39fe2443d009 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1314 microversion: 2.1 time: 0.778329 Aug 30 03:50:06.046411 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2433/4771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:05 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:06.057043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-95157a96-d996-4a88-9062-a5013a2ef284 req-9316282e-717a-4899-8a8d-1b2efbfc11e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba4d32e-9a76-4cca-8994-bdedcee1eb8e", "tag": "c1bbbe22-9168-4dbf-a0be-310da849d63d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:06.112407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-95157a96-d996-4a88-9062-a5013a2ef284 req-9316282e-717a-4899-8a8d-1b2efbfc11e2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:06.113058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-95157a96-d996-4a88-9062-a5013a2ef284 req-9316282e-717a-4899-8a8d-1b2efbfc11e2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:06.113526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-95157a96-d996-4a88-9062-a5013a2ef284 req-9316282e-717a-4899-8a8d-1b2efbfc11e2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:06.126918 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-95157a96-d996-4a88-9062-a5013a2ef284 req-9316282e-717a-4899-8a8d-1b2efbfc11e2 service nova] Creating event network-changed:c1bbbe22-9168-4dbf-a0be-310da849d63d for instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e on n-h2-854924-5 Aug 30 03:50:06.133968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-95157a96-d996-4a88-9062-a5013a2ef284 req-9316282e-717a-4899-8a8d-1b2efbfc11e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081351 Aug 30 03:50:06.135077 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2434/4772] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:06.522924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:06.536837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:06.544374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:06.545757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf8db671-a43e-4c71-b648-10f6e219cf8c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1792 microversion: 2.20 time: 0.563340 Aug 30 03:50:06.561504 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2339/4773] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:05 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1792 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:50:07.004390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:07.007388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:07.030507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:07.032715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:07.033405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:07.035585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:07.036383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:07.038528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:07.067152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:07.067814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:07.083283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:07.083787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:07.084226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:07.084990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:07.085564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:07.085989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:07.614067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:07.628682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:07.630116 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8159e3f0-e6bb-429f-af61-e62b0946cd70 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1493 microversion: 2.1 time: 0.632032 Aug 30 03:50:07.630759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2435/4774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:06 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1493 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:07.631857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:07.642796 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2cb18f05-f354-4a74-b2c5-83d6c8d60cf7 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1501 microversion: 2.1 time: 0.579657 Aug 30 03:50:07.657380 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2340/4775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:07 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1501 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:07.669643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:07.670183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:07.676989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:07.677566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:07.677948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:07.679223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:07.679668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:07.680088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:07.713719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'flavor' on Instance uuid 65cf4560-2c13-4df2-b7f5-f378b4d79590 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:50:07.849398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:08.112337 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f939ead-a96d-4a24-bcd2-80d7be47a244 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590/action" status: 202 len: 0 microversion: 2.1 time: 0.446113 Aug 30 03:50:08.113668 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2436/4776] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:50:07 2022] POST /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:50:08.125170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:08.126062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:08.140571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:08.141594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:08.142503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:08.143772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:08.145636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:08.146838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:08.528280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:08.539116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64c2924c-f661-48aa-a2fa-1148fb594d55 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.419394 Aug 30 03:50:08.544188 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2341/4777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:08 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:08.665111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:08.667812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:08.686691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:08.689284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:08.691671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:08.692664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:08.693523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:08.694256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.020193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:09.038161 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-402ac308-871f-4ec8-a2fa-78ac237b51ce tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1499 microversion: 2.1 time: 0.389695 Aug 30 03:50:09.057322 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2437/4778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:08 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1499 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:09.065038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:09.065583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:09.072788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:09.074483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:09.074951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.075691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:09.076157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:09.076662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.171906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:50:09.330421 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-526d798a-d13e-404d-b1b8-267167120978 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 204 len: 0 microversion: 2.1 time: 0.268972 Aug 30 03:50:09.331525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2342/4779] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:50:09 2022] DELETE /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:50:09.339662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:09.340362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:09.357582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:09.358077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:09.358513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.359335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:09.359914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:09.360341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.567155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:09.568595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:09.579419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:09.596233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:09.596849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.597733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:09.601151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:09.602015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:09.859861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:09.929568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b2712a9-e642-477d-adac-6e88a3f7a2e1 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.591780 Aug 30 03:50:09.930179 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2438/4780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:09 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:09.944603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:09.963435 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ef90164-d262-4e56-89ec-744a251e891e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.399037 Aug 30 03:50:09.964754 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2343/4781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:09 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:10.957876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:10.962152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:10.978466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:10.981012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:10.981729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:10.982688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:10.985415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:10.986049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:10.986964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:10.987730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:11.027139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:11.037473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:11.038046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:11.049629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:11.050202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:11.050656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:11.573397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:11.587045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-35600f1e-fb36-498b-9276-0bcd4243e55b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.636679 Aug 30 03:50:11.589793 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2439/4782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:10 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:11.663802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:11.676059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a62b20c-de36-4606-82b1-2a500a84f240 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.693965 Aug 30 03:50:11.677224 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2344/4783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:10 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:12.619659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:12.623291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:12.638316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:12.638971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:12.639517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:12.643041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:12.643917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:12.644454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:12.698655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:12.699300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:12.719994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:12.720496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:12.720936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:12.731940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:12.732496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:12.732949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:13.166409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:13.180615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-079f379a-2770-41ee-8906-888a15c7164b tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1505 microversion: 2.1 time: 0.564958 Aug 30 03:50:13.183706 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2440/4784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:12 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:13.213853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:13.223292 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-71739333-a813-4ab3-8869-e47ebd785067 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.529211 Aug 30 03:50:13.229431 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2345/4785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:12 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:13.528017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5c369ac5-3c37-4f4c-99d1-3827af2a6b14 req-528c60c6-ca4d-41e5-a1d2-1b02e685ac83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19195ad-3496-483f-90bd-723163c6705f", "name": "network-vif-deleted", "tag": "0d637a68-a35c-47fc-b99b-ab15de7d4818"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:13.563854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5c369ac5-3c37-4f4c-99d1-3827af2a6b14 req-528c60c6-ca4d-41e5-a1d2-1b02e685ac83 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:13.570062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5c369ac5-3c37-4f4c-99d1-3827af2a6b14 req-528c60c6-ca4d-41e5-a1d2-1b02e685ac83 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:13.571543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5c369ac5-3c37-4f4c-99d1-3827af2a6b14 req-528c60c6-ca4d-41e5-a1d2-1b02e685ac83 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:13.623907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5c369ac5-3c37-4f4c-99d1-3827af2a6b14 req-528c60c6-ca4d-41e5-a1d2-1b02e685ac83 service nova] Creating event network-vif-deleted:0d637a68-a35c-47fc-b99b-ab15de7d4818 for instance f19195ad-3496-483f-90bd-723163c6705f on n-h2-854924-5 Aug 30 03:50:13.660540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5c369ac5-3c37-4f4c-99d1-3827af2a6b14 req-528c60c6-ca4d-41e5-a1d2-1b02e685ac83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125322 Aug 30 03:50:13.666162 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2441/4786] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:14.201337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:14.202602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:14.214537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:14.216308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:14.217595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:14.218523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:14.220462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:14.222917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:14.262773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:14.265803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:14.314281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:14.314813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:14.315210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:14.315917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:14.316369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:14.316990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:14.330594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:14.331089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:14.331523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:14.332081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lazy-loading 'fault' on Instance uuid f19195ad-3496-483f-90bd-723163c6705f {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:50:14.552798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:14.571054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d550668-43ff-445d-8f46-3a51dad09308 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 200 len: 1303 microversion: 2.1 time: 0.372571 Aug 30 03:50:14.573013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2346/4787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:14 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 1303 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:14.732048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:14.739713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1527f0f0-fa33-4ea0-a970-ce9ad429d47b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.492356 Aug 30 03:50:14.740288 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2442/4788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:14 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:15.600010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:15.613617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: f19195ad-3496-483f-90bd-723163c6705f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:15.627686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:15.628566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:15.632667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:15.633686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:15.640070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:15.640588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:15.667031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] HTTP exception thrown: Instance f19195ad-3496-483f-90bd-723163c6705f could not be found. Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Request method failure captured: Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f HTTP/1.1 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYh3Q0QVM833wE-zer-twSvtGSmxhHgS4ZkRNGgKksMkmkh2N3cMKC5JnKKzMzyn1eqU2emDQXhtT75iNM-lvWEmLl0MknJWgkd1lf_wlYZqbMpy5ytuDDNuZLsF9bNfbRiPcURzoxq9mymzhP7_Jfdk7-0Wifpy08P7jTPby2bUe00 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: a3e7cee69d0d498b8415ecc523013838 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerRescueTestJSON-802621008 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a3e7cee69d0d498b8415ecc523013838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a3e7cee69d0d498b8415ecc523013838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a3e7cee69d0d498b8415ecc523013838", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a3e7cee69d0d498b8415ecc523013838"}]}] Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerRescueTestJSON-802621008 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: a3e7cee69d0d498b8415ecc523013838 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerRescueTestJSON-802621008 Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerRescueTestJSON-802621008-project Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8d8f4bdce76e439188219d1b1b70005a Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerRescueTestJSON-802621008-project Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance f19195ad-3496-483f-90bd-723163c6705f could not be found. Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f19195ad-3496-483f-90bd-723163c6705f'} Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19195ad-3496-483f-90bd-723163c6705f could not be found. Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19195ad-3496-483f-90bd-723163c6705f could not be found. Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:15.669116 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19195ad-3496-483f-90bd-723163c6705f could not be found. Aug 30 03:50:15.675329 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:50:15.678685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Returning 404 to user: Instance f19195ad-3496-483f-90bd-723163c6705f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:50:15.680852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba25db65-f5b6-4565-a4f4-bbcdeb9c7fd2 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f" status: 404 len: 111 microversion: 2.1 time: 0.086649 Aug 30 03:50:15.682520 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2347/4789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:15 2022] GET /compute/v2.1/servers/f19195ad-3496-483f-90bd-723163c6705f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:50:15.692371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:15.692875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:15.728132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:15.728633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:15.733550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:15.734368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:15.734864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:15.735307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:15.763649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:15.764734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:15.773927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:15.775399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:15.776217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:15.780859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:15.781621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:15.782269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:15.829682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:50:16.046054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:16.059928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0dd5f59b-3f5a-40d4-9308-2dc8c0853624 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.300922 Aug 30 03:50:16.062560 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2348/4790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:15 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:16.077950 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10294aeb-3d41-4358-9330-3b0e7f3ecfda tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 204 len: 0 microversion: 2.1 time: 0.386079 Aug 30 03:50:16.079871 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2443/4791] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:50:15 2022] DELETE /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:50:16.091760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:16.096235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:16.120740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:16.121835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:16.122542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:16.124180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:16.124861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:16.126887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:16.316831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-599591968", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "fa4fd9d6-8197-45d8-a3e7-c1d1d2495e2b"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:16.415594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:16.425622 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a4fc87b-33de-4652-843b-8bcb83ca0481 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1491 microversion: 2.1 time: 0.340769 Aug 30 03:50:16.438418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] validate_networks() for [('fa4fd9d6-8197-45d8-a3e7-c1d1d2495e2b', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:50:16.438614 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2444/4792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:16 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1491 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:16.952470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:50:16.953212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:50:16.953856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:50:16.954426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:50:16.954945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:50:16.979359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:16.986429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:16.994339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:16.995574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:16.999407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:16.999976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:17.040011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Getting quotas for project 56b92b416ece443aaf0bae4f039b6d19. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:50:17.047225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Getting quotas for user eabb0a800d7048269ad0b935e944b4e2 and project 56b92b416ece443aaf0bae4f039b6d19. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:50:17.062495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:50:17.065308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:50:17.091566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:17.092179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:17.116598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:17.128297 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb3a2b09-9464-4f1e-9d64-4edc141da5ff tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063433 Aug 30 03:50:17.133693 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2349/4793] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:50:17.140733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-512daa91-4d85-4864-80f0-713230a6b270 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:17.141687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-512daa91-4d85-4864-80f0-713230a6b270 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:17.143020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:17.143926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:17.144694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:17.152258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:17.159895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:17.235512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-512daa91-4d85-4864-80f0-713230a6b270 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:17.244530 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-512daa91-4d85-4864-80f0-713230a6b270 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1224 microversion: 2.1 time: 0.107574 Aug 30 03:50:17.253646 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2350/4794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:17 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:17.449141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:17.450053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:17.460263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:17.464957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:17.465721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:17.466649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:17.469431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:17.470062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:17.488505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:17.502143 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3194fc88-08ca-4033-9db2-0873c891a183 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.415176 Aug 30 03:50:17.503957 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2445/4795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:17 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:17.688523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:17.701675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab662baa-e22c-4fd7-a2eb-9ebf73cfe45a tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1491 microversion: 2.1 time: 0.255998 Aug 30 03:50:17.702650 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2351/4796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:17 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1491 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:18.269458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:18.270540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:18.280602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:18.281500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:18.282292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:18.283083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:18.283613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:18.285067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:18.408273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:18.417540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fcbbf64d-b213-4632-91d1-25f808cb07cc tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1228 microversion: 2.1 time: 0.153043 Aug 30 03:50:18.418338 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2446/4797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:18 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:18.537978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:18.540653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:18.560796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:18.564340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:18.564880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:18.565702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:18.575715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:18.576410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:18.722832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:18.723938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:18.732653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:18.744614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:18.745077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:18.745933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:18.746401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:18.746839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:19.789924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:19.806674 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c91c7bbb-e997-4f85-9829-22c81b3a5d22 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 1.274865 Aug 30 03:50:19.821630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2352/4798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:18 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:19.833480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:19.834136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:19.864144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:19.867344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:19.871188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:19.872216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:19.872861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:19.874991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:20.056442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:20.065658 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4b49745-0dba-4a42-b802-0018d07e9ccb tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1284 microversion: 2.1 time: 0.242771 Aug 30 03:50:20.071317 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2353/4799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:19 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:20.135353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-429d896b-a3f5-4af2-aa8b-7423a57585d5 req-82bf6917-5aa4-46ad-bc50-021d39bc2084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317d996a-0585-4cae-bf2f-81447f90186d", "name": "network-vif-deleted", "tag": "3bbeae90-e629-42d9-b3e6-9717d5b6c717"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:20.155183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d8f4bdce76e439188219d1b1b70005a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e7cee69d0d498b8415ecc523013838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:20.174763 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7fb84916-f031-47ce-b17e-e693632c8d40 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 200 len: 1491 microversion: 2.1 time: 1.452075 Aug 30 03:50:20.176006 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2447/4800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:18 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 1491 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:20.179093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-429d896b-a3f5-4af2-aa8b-7423a57585d5 req-82bf6917-5aa4-46ad-bc50-021d39bc2084 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:20.183192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-429d896b-a3f5-4af2-aa8b-7423a57585d5 req-82bf6917-5aa4-46ad-bc50-021d39bc2084 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:20.184170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-429d896b-a3f5-4af2-aa8b-7423a57585d5 req-82bf6917-5aa4-46ad-bc50-021d39bc2084 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:20.217528 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-429d896b-a3f5-4af2-aa8b-7423a57585d5 req-82bf6917-5aa4-46ad-bc50-021d39bc2084 service nova] Creating event network-vif-deleted:3bbeae90-e629-42d9-b3e6-9717d5b6c717 for instance 317d996a-0585-4cae-bf2f-81447f90186d on n-h1-854924-5 Aug 30 03:50:20.236728 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-429d896b-a3f5-4af2-aa8b-7423a57585d5 req-82bf6917-5aa4-46ad-bc50-021d39bc2084 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105901 Aug 30 03:50:20.237973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2354/4801] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:50:20.828142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:20.829110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:20.838011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:20.839209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:20.839866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:20.841615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:20.842305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:20.843034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:21.098138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:21.100664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:21.128174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:21.128701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:21.137781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:21.137781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:21.139574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:21.144625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:21.204671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:21.223681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5edfe8b-e056-49e5-b310-6d9c2d38f337 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.399507 Aug 30 03:50:21.232649 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2448/4802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:20 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:21.253985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:21.264966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] [instance: 317d996a-0585-4cae-bf2f-81447f90186d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:21.283759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:21.288071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:21.289804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:21.291289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:21.293294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:21.293953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:21.310914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] HTTP exception thrown: Instance 317d996a-0585-4cae-bf2f-81447f90186d could not be found. Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Request method failure captured: Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d HTTP/1.1 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYh3Q0QVM833wE-zer-twSvtGSmxhHgS4ZkRNGgKksMkmkh2N3cMKC5JnKKzMzyn1eqU2emDQXhtT75iNM-lvWEmLl0MknJWgkd1lf_wlYZqbMpy5ytuDDNuZLsF9bNfbRiPcURzoxq9mymzhP7_Jfdk7-0Wifpy08P7jTPby2bUe00 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: a3e7cee69d0d498b8415ecc523013838 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueTestJSON-802621008 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a3e7cee69d0d498b8415ecc523013838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a3e7cee69d0d498b8415ecc523013838"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a3e7cee69d0d498b8415ecc523013838", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a3e7cee69d0d498b8415ecc523013838"}]}] Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueTestJSON-802621008 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: a3e7cee69d0d498b8415ecc523013838 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueTestJSON-802621008 Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueTestJSON-802621008-project Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8d8f4bdce76e439188219d1b1b70005a Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueTestJSON-802621008-project Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 317d996a-0585-4cae-bf2f-81447f90186d could not be found. Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '317d996a-0585-4cae-bf2f-81447f90186d'} Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317d996a-0585-4cae-bf2f-81447f90186d could not be found. Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317d996a-0585-4cae-bf2f-81447f90186d could not be found. Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:21.313165 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317d996a-0585-4cae-bf2f-81447f90186d could not be found. Aug 30 03:50:21.319991 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:21.322580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] Returning 404 to user: Instance 317d996a-0585-4cae-bf2f-81447f90186d could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:50:21.323938 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ef22bad-c06c-4323-8cca-90b9e5ff0803 tempest-ServerRescueTestJSON-802621008 tempest-ServerRescueTestJSON-802621008-project] 10.222.0.30 "GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d" status: 404 len: 111 microversion: 2.1 time: 0.089735 Aug 30 03:50:21.325557 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2449/4803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:21 2022] GET /compute/v2.1/servers/317d996a-0585-4cae-bf2f-81447f90186d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:50:21.731855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:21.749910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67a11053-2bfd-4b4b-bd88-aaf7d99ca82f tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1282 microversion: 2.1 time: 0.660689 Aug 30 03:50:21.751088 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2355/4804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:21 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1282 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:22.277295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:22.280669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:22.303968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:22.314260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:22.316421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:22.317408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:22.344510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:22.344960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:22.772592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:22.773843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:22.799220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:22.799746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:22.800203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:22.800935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:22.807545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:22.810807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:22.847291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:22.864442 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b77d85fe-701e-4e81-a027-dd9a7dcec31e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.611715 Aug 30 03:50:22.893961 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2450/4805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:22 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:23.558225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:23.583435 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40fe46a4-f011-4d98-987d-dc5e4f731f69 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.815723 Aug 30 03:50:23.592757 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2356/4806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:22 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:23.901606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:23.903105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:23.924857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:23.931982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:23.932579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:23.935007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:23.940571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:23.941805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:24.336367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:24.345286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:24.360410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e00109a-db91-475f-9ddc-03f8117c3040 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.473388 Aug 30 03:50:24.361694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2451/4807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:23 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:24.574788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6fe97653-aa42-458b-b806-ca6a1aff63ec req-46b74abd-5fde-4850-9715-48241cda8500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a111fec9-f310-40d9-9e2a-03e89387caab", "tag": "80e9d324-7207-4206-a4dc-3d1e52e3bd5f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:24.599484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6fe97653-aa42-458b-b806-ca6a1aff63ec req-46b74abd-5fde-4850-9715-48241cda8500 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:24.600062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6fe97653-aa42-458b-b806-ca6a1aff63ec req-46b74abd-5fde-4850-9715-48241cda8500 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:24.601002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6fe97653-aa42-458b-b806-ca6a1aff63ec req-46b74abd-5fde-4850-9715-48241cda8500 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:24.614387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:24.614995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:24.645164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:24.645704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:24.646360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:24.647826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:24.650217 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6fe97653-aa42-458b-b806-ca6a1aff63ec req-46b74abd-5fde-4850-9715-48241cda8500 service nova] Creating event network-changed:80e9d324-7207-4206-a4dc-3d1e52e3bd5f for instance a111fec9-f310-40d9-9e2a-03e89387caab on n-h1-854924-5 Aug 30 03:50:24.650902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:24.651496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:24.663886 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6fe97653-aa42-458b-b806-ca6a1aff63ec req-46b74abd-5fde-4850-9715-48241cda8500 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297494 Aug 30 03:50:24.666943 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2357/4808] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:50:25.145588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:25.163681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54821d84-435f-44e1-b185-c22211f1b4b4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.548614 Aug 30 03:50:25.164357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2452/4809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:24 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:25.396796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:25.397759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:25.417556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:25.418903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:25.421511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:25.424076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:25.424870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:25.427384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:25.932396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:25.953651 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0f3491be-8d17-4015-ad72-7ad6c47055a6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.572413 Aug 30 03:50:25.957394 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2358/4810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:25 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:26.184612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:26.185232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:26.192263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:26.192702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:26.197539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:26.198408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:26.198859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:26.201466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:26.511020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:26.534961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e690629-7fe2-4d1e-a19c-4409e5bc8531 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.354059 Aug 30 03:50:26.536292 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2453/4811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:26 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:26.977381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:26.978315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:26.986420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:26.993677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:26.995374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:26.996093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:26.997044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:26.999001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:27.000237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:27.026242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:27.034229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:27.241104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:27.265465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:27.275664 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-551c02ed-43c0-4144-a33b-cda7c794658b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.302999 Aug 30 03:50:27.276985 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2359/4812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:26 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:27.555501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:27.556122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:27.564345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:27.573071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:27.577638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:27.578441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:27.581141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:27.581627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:27.582055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:28.007694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:28.017141 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76697911-3a11-4d49-a162-4c7857c598a5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.465748 Aug 30 03:50:28.030054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2454/4813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:27 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:28.296202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:28.296860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:28.307443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:28.309099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:28.309585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:28.313860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:28.314341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:28.314839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:28.683834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:28.695254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20bc36fd-1d2e-46b4-a2cd-2814d5612f21 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.402965 Aug 30 03:50:28.701067 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2360/4814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:28 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:29.046652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:29.047991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:29.062755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:29.064173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:29.064946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:29.065978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:29.067162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:29.067843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:29.254472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:29.262948 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9a9d3ef-a13f-405c-ad08-aa2ee90b9f40 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.220572 Aug 30 03:50:29.277085 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2455/4815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:29 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:29.716705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:29.717964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:29.731559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:29.732294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:29.732914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:29.733983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:29.734624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:29.735358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:29.960987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:29.972910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1be8fc6a-e28d-4de6-8c30-c6d008aaff3b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.260145 Aug 30 03:50:29.991088 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2361/4816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:29 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:30.286681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:30.288287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:30.303959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:30.305643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:30.306327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:30.307494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:30.308137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:30.309449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:30.569216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:30.581573 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-934abd28-8d83-4257-970a-4f70d3f726b9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.300396 Aug 30 03:50:30.582948 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2456/4817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:30 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:30.999678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:31.000914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:31.014924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:31.017461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:31.018434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:31.023301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:31.023811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:31.024248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:31.431438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:31.443437 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-483ae35a-2f2f-48c4-911d-2ebc299c5f4c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.447561 Aug 30 03:50:31.447167 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2362/4818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:30 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:31.604570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:31.607590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:31.630066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:31.644663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:31.645191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:31.648471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:31.649887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:31.650402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:31.681502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-524cdbc7-7d1c-4e89-be0d-ec4450038c63 req-024ed50a-cb04-4424-a2b3-1ee2d6e2c205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a111fec9-f310-40d9-9e2a-03e89387caab", "name": "network-vif-plugged", "status": "completed", "tag": "80e9d324-7207-4206-a4dc-3d1e52e3bd5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:31.700300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-524cdbc7-7d1c-4e89-be0d-ec4450038c63 req-024ed50a-cb04-4424-a2b3-1ee2d6e2c205 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:31.701088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-524cdbc7-7d1c-4e89-be0d-ec4450038c63 req-024ed50a-cb04-4424-a2b3-1ee2d6e2c205 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:31.701746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-524cdbc7-7d1c-4e89-be0d-ec4450038c63 req-024ed50a-cb04-4424-a2b3-1ee2d6e2c205 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:31.727197 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-524cdbc7-7d1c-4e89-be0d-ec4450038c63 req-024ed50a-cb04-4424-a2b3-1ee2d6e2c205 service nova] Creating event network-vif-plugged:80e9d324-7207-4206-a4dc-3d1e52e3bd5f for instance a111fec9-f310-40d9-9e2a-03e89387caab on n-h1-854924-5 Aug 30 03:50:31.739282 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-524cdbc7-7d1c-4e89-be0d-ec4450038c63 req-024ed50a-cb04-4424-a2b3-1ee2d6e2c205 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409708 Aug 30 03:50:31.740610 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2457/4819] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:50:32.455760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:32.468863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:32.469705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:32.479899 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c404c834-bd9b-4a8a-a2a0-51b131e42b3e tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.875450 Aug 30 03:50:32.495870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:32.496482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:32.497059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:32.497358 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2363/4820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:31 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:32.499567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:32.500244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:32.500873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:32.811796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:32.830531 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fba61ee5-0a82-4d0f-9801-4c43f167ee1d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.366800 Aug 30 03:50:32.831291 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2458/4821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:32 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:33.500281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:33.501483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:33.515006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:33.515343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:33.515798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:33.526442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:33.526937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:33.529654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:33.787280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:33.796241 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1fbe3f12-3a40-4135-be38-71a3b024d6c9 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1324 microversion: 2.1 time: 0.299186 Aug 30 03:50:33.797091 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2364/4822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:33 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:33.852122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:33.852755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:33.859930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:33.860425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:33.860877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:33.861617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:33.862363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:33.862966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:34.125085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:34.135613 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fee8f5b-a795-49f7-a321-00befaeef075 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1507 microversion: 2.1 time: 0.287327 Aug 30 03:50:34.157865 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2459/4823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:33 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:34.816381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:34.817048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:34.836556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:34.837401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:34.838026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:34.838938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:34.839553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:34.840154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.077945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:35.096891 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-44c34acf-3172-481c-b909-21e47028f220 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1521 microversion: 2.1 time: 0.284351 Aug 30 03:50:35.117744 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2365/4824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:34 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:35.127169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:35.127757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:35.135749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.136626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.137264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.138359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.138988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.139652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.164434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:35.165047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:35.171888 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] HTTP exception thrown: Instance is not a member of specified network Aug 30 03:50:35.173892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.174598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.175251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.176195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.176855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.177542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Request method failure captured: Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab/ips/invalid HTTP/1.1 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYj3ONX6gUpNBmN980TyvJzm3yMZhzof2yccAXCz2TsROXUqBw10yEQt7RGipwPrqv_LblE9MAlRqerCop7YwsYHm3hDVpn-u_ZUqz9rqFv3qsEYibdXGRNp6Jpq1Gsj2Sp2matYqE5lkwMk4Q53pJdE_Zo21bF9CmsHZ4xhSVe-c24 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 56b92b416ece443aaf0bae4f039b6d19 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/56b92b416ece443aaf0bae4f039b6d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/56b92b416ece443aaf0bae4f039b6d19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_56b92b416ece443aaf0bae4f039b6d19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/56b92b416ece443aaf0bae4f039b6d19"}]}] Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 56b92b416ece443aaf0bae4f039b6d19 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerAddressesNegativeTestJSON-1363991671-project Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: eabb0a800d7048269ad0b935e944b4e2 Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1363991671-project Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance is not a member of specified network Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': 'a111fec9-f310-40d9-9e2a-03e89387caab', 'id': 'invalid'} Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 30 03:50:35.182224 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.218640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:50:35.236924 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa70f246-0b4f-491d-8ae9-640fe2c30400 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.113546 Aug 30 03:50:35.237896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2460/4825] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:50:35 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab/ips/invalid => generated 91 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:50:35.249874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99549690-285a-45ff-b302-b2e55d6129a4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:35.250598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-99549690-285a-45ff-b302-b2e55d6129a4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Failed to fetch instance by id 999 {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 03:50:35.251963 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-99549690-285a-45ff-b302-b2e55d6129a4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] HTTP exception thrown: Instance 999 could not be found. Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99549690-285a-45ff-b302-b2e55d6129a4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Request method failure captured: Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYj3ONX6gUpNBmN980TyvJzm3yMZhzof2yccAXCz2TsROXUqBw10yEQt7RGipwPrqv_LblE9MAlRqerCop7YwsYHm3hDVpn-u_ZUqz9rqFv3qsEYibdXGRNp6Jpq1Gsj2Sp2matYqE5lkwMk4Q53pJdE_Zo21bF9CmsHZ4xhSVe-c24 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 56b92b416ece443aaf0bae4f039b6d19 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/56b92b416ece443aaf0bae4f039b6d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/56b92b416ece443aaf0bae4f039b6d19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_56b92b416ece443aaf0bae4f039b6d19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/56b92b416ece443aaf0bae4f039b6d19"}]}] Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 56b92b416ece443aaf0bae4f039b6d19 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerAddressesNegativeTestJSON-1363991671-project Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: eabb0a800d7048269ad0b935e944b4e2 Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1363991671-project Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 999 could not be found. Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': '999'} Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 03:50:35.253629 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:35.260977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99549690-285a-45ff-b302-b2e55d6129a4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:50:35.264035 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99549690-285a-45ff-b302-b2e55d6129a4 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019361 Aug 30 03:50:35.267264 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2461/4826] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 03:50:35 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:50:35.278086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:35.281749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:35.305530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.306217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.306858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.307748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.308368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.309230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.350469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:50:35.439214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:35.448902 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3f008e4-80b3-4c13-ba75-c5b20b0d7c86 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1528 microversion: 2.1 time: 0.288642 Aug 30 03:50:35.450071 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2366/4827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:35 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:35.487417 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd46ebcf-1b0c-4f3f-913e-aec4d242268a tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 204 len: 0 microversion: 2.1 time: 0.213100 Aug 30 03:50:35.488436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2462/4828] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:50:35 2022] DELETE /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:50:35.503108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:35.506648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:35.520623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.521484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.521484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.525587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:35.526286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:35.528157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:35.837437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:35.849988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-113bf04f-e218-4b3c-85fa-0897cf9148d8 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1527 microversion: 2.1 time: 0.356155 Aug 30 03:50:35.851681 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2367/4829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:35 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:36.472367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:36.473084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:36.483506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:36.484072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:36.484427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:36.485126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:36.485609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:36.486032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:36.867270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:36.871887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:36.873211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:36.877957 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb744714-ab46-4e59-8fb1-23c18ead1715 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1528 microversion: 2.1 time: 0.410934 Aug 30 03:50:36.885880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:36.888958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:36.889664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:36.890581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:36.892908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:36.893848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:36.897668 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2463/4830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:36 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1528 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:37.241148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:37.253177 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d400412-f644-4166-ac35-25532c063634 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1527 microversion: 2.1 time: 0.385743 Aug 30 03:50:37.276267 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2368/4831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:36 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1527 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:37.555612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:37.556485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:37.578122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:37.579603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:37.583727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:37.588213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:37.591507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:37.594068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:37.694183 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-87bc3bea-5961-485f-8ef5-9ff410ac4cdb tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/ips" status: 200 len: 144 microversion: 2.1 time: 0.143552 Aug 30 03:50:37.702435 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2464/4832] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:50:37 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/ips => generated 144 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:37.907825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:37.908527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:37.938931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:37.943669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:37.949801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:37.950625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:37.951114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:37.951560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:38.226004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1019859366", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:38.343463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] validate_networks() for [('2699ddea-22c6-4560-ac67-4af572dab1eb', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:50:38.737810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:38.751327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0d25cec-00bb-4cb6-a7cf-c3e3caecf755 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1528 microversion: 2.1 time: 0.850870 Aug 30 03:50:38.752643 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2369/4833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:37 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1528 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:38.761260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:38.766594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:38.785293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:38.790285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:38.791041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:38.791987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:38.793492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:38.795585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.014285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:40.028415 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-22b1f437-e782-45ec-817d-1753f916e9b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1527 microversion: 2.1 time: 1.274395 Aug 30 03:50:40.029212 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2370/4834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:38 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1527 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:40.046502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-68599396-b343-4b53-8cc3-59e4ff7e0313 req-9fcfd76e-e4bf-4e76-9c91-6a1009a38134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cf4560-2c13-4df2-b7f5-f378b4d79590", "name": "network-vif-plugged", "status": "completed", "tag": "1d13d08c-1ed0-44a0-928e-e5429314f323"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:40.076893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-68599396-b343-4b53-8cc3-59e4ff7e0313 req-9fcfd76e-e4bf-4e76-9c91-6a1009a38134 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.085162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-68599396-b343-4b53-8cc3-59e4ff7e0313 req-9fcfd76e-e4bf-4e76-9c91-6a1009a38134 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.102746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-68599396-b343-4b53-8cc3-59e4ff7e0313 req-9fcfd76e-e4bf-4e76-9c91-6a1009a38134 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.140759 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-68599396-b343-4b53-8cc3-59e4ff7e0313 req-9fcfd76e-e4bf-4e76-9c91-6a1009a38134 service nova] Creating event network-vif-plugged:1d13d08c-1ed0-44a0-928e-e5429314f323 for instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 on n-h1-854924-5 Aug 30 03:50:40.154441 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-68599396-b343-4b53-8cc3-59e4ff7e0313 req-9fcfd76e-e4bf-4e76-9c91-6a1009a38134 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122859 Aug 30 03:50:40.155294 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2371/4835] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:40.190356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:40.190963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:40.200723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.201490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.202264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.205623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.209688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.210353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.282581 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e83aa68e-431d-4b90-b112-6a49a3922c78 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments/73f88747-c3d7-49fc-becc-8f2184da296c" status: 200 len: 194 microversion: 2.20 time: 0.111428 Aug 30 03:50:40.283659 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2372/4836] 10.222.0.30 () {60 vars in 1454 bytes} [Tue Aug 30 03:50:40 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments/73f88747-c3d7-49fc-becc-8f2184da296c => generated 194 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:40.326496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:40.332727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:40.359609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.361372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.361826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.368306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.368815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.369265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.387655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:50:40.389052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:50:40.389619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:50:40.390034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:50:40.390451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:50:40.501075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.501075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.501075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.567607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.567607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.567607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.637688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Getting quotas for project acfb3daea2dd4fb284f55b8c7cc30887. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:50:40.654936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Getting quotas for user eb0567a32cb44424ac6c76970f3740e7 and project acfb3daea2dd4fb284f55b8c7cc30887. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:50:40.689461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:50:40.698480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:50:40.762784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:40.771221 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9bd48e6-1bc3-4e74-859f-a80668eb46b7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.674800 Aug 30 03:50:40.772199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69b03153-0682-478d-ae07-1337abddd6e3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.456702 Aug 30 03:50:40.772956 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2465/4837] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:50:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:50:40.786351 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2373/4838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:40 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:40.786924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a8909a4b-8fc0-49dd-8ac0-e20f83fe0ceb req-8dde3648-df60-4c8c-bddd-c1e0b5b007ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a111fec9-f310-40d9-9e2a-03e89387caab", "name": "network-vif-deleted", "tag": "80e9d324-7207-4206-a4dc-3d1e52e3bd5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:40.792200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:40.792885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:40.799369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.800037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.800619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.801496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.802091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.802663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.809108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a8909a4b-8fc0-49dd-8ac0-e20f83fe0ceb req-8dde3648-df60-4c8c-bddd-c1e0b5b007ab service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:40.809764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a8909a4b-8fc0-49dd-8ac0-e20f83fe0ceb req-8dde3648-df60-4c8c-bddd-c1e0b5b007ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:40.810307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a8909a4b-8fc0-49dd-8ac0-e20f83fe0ceb req-8dde3648-df60-4c8c-bddd-c1e0b5b007ab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:40.849077 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a8909a4b-8fc0-49dd-8ac0-e20f83fe0ceb req-8dde3648-df60-4c8c-bddd-c1e0b5b007ab service nova] Creating event network-vif-deleted:80e9d324-7207-4206-a4dc-3d1e52e3bd5f for instance a111fec9-f310-40d9-9e2a-03e89387caab on n-h1-854924-5 Aug 30 03:50:40.862537 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a8909a4b-8fc0-49dd-8ac0-e20f83fe0ceb req-8dde3648-df60-4c8c-bddd-c1e0b5b007ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079644 Aug 30 03:50:40.863261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2466/4839] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:40.887542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b11f14e-7e78-40d9-a5ba-509e0802624a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:40.888432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b11f14e-7e78-40d9-a5ba-509e0802624a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:40.919997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lazy-loading 'services' on Instance uuid afa19e79-3638-4c08-ab26-f3b68068e3e0 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:50:41.098028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9b11f14e-7e78-40d9-a5ba-509e0802624a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:41.120417 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b11f14e-7e78-40d9-a5ba-509e0802624a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1223 microversion: 2.1 time: 0.250204 Aug 30 03:50:41.124708 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2467/4840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:40 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1223 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:41.129797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:41.137011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:41.167411 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a9aa6425-9da6-4d3a-b419-bb72619a4b01 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments/73f88747-c3d7-49fc-becc-8f2184da296c" status: 202 len: 0 microversion: 2.20 time: 0.379716 Aug 30 03:50:41.170834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.174337 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2374/4841] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Aug 30 03:50:40 2022] DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments/73f88747-c3d7-49fc-becc-8f2184da296c => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:50:41.176068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.180841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.191302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:41.194573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.195897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:41.196274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.198035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.213471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.220183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.220901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.229418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.231632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.232305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.292103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.293544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.297257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.297971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lazy-loading 'fault' on Instance uuid a111fec9-f310-40d9-9e2a-03e89387caab {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:50:41.367588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:41.368597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb0a800d7048269ad0b935e944b4e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b92b416ece443aaf0bae4f039b6d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:41.388252 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-41128c52-5080-474f-ab74-61bf0b3c87b5 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 200 len: 1314 microversion: 2.1 time: 0.260794 Aug 30 03:50:41.390088 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2468/4842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:41 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:41.416268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b849346-bfcd-4cd5-a64c-7baf259dc1a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.225010 Aug 30 03:50:41.417087 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2375/4843] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:41 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:41.801707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:41.801707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:41.815690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "072c7d16-be30-4b07-be13-43f360bc21d8"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:41.819555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:41.821771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.822282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.822855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.823718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.824360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.825099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.846550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.847939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.848402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:41.852199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:41.852678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:41.866469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.173018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:42.182301 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4c2494e4-243a-43e5-931d-5355a0e20194 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.387479 Aug 30 03:50:42.194195 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2469/4844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:41 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:42.208665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:42.209382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:42.227326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:42.227834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:42.228275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.228988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:42.229476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:42.229907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.439287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:42.448771 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bf8c36fc-6adb-4ff0-bd0f-95b12cc870c5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1219 microversion: 2.1 time: 0.253061 Aug 30 03:50:42.453203 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2470/4845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:42 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:42.462150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:42.464200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] [instance: a111fec9-f310-40d9-9e2a-03e89387caab] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:42.479377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:42.482016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:42.482623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.484540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:42.496526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:42.502087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.505619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:42.552235 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] HTTP exception thrown: Instance a111fec9-f310-40d9-9e2a-03e89387caab could not be found. Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Request method failure captured: Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab HTTP/1.1 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYj3ONX6gUpNBmN980TyvJzm3yMZhzof2yccAXCz2TsROXUqBw10yEQt7RGipwPrqv_LblE9MAlRqerCop7YwsYHm3hDVpn-u_ZUqz9rqFv3qsEYibdXGRNp6Jpq1Gsj2Sp2matYqE5lkwMk4Q53pJdE_Zo21bF9CmsHZ4xhSVe-c24 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 56b92b416ece443aaf0bae4f039b6d19 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/56b92b416ece443aaf0bae4f039b6d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/56b92b416ece443aaf0bae4f039b6d19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_56b92b416ece443aaf0bae4f039b6d19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/56b92b416ece443aaf0bae4f039b6d19"}]}] Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 56b92b416ece443aaf0bae4f039b6d19 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1363991671 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerAddressesNegativeTestJSON-1363991671-project Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: eabb0a800d7048269ad0b935e944b4e2 Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1363991671-project Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a111fec9-f310-40d9-9e2a-03e89387caab could not be found. Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a111fec9-f310-40d9-9e2a-03e89387caab'} Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a111fec9-f310-40d9-9e2a-03e89387caab could not be found. Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a111fec9-f310-40d9-9e2a-03e89387caab could not be found. Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:42.554257 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a111fec9-f310-40d9-9e2a-03e89387caab could not be found. Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] Returning 404 to user: Instance a111fec9-f310-40d9-9e2a-03e89387caab could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-91badc59-b127-485c-b3b6-57bd1ed10626 tempest-ServerAddressesNegativeTestJSON-1363991671 tempest-ServerAddressesNegativeTestJSON-1363991671-project] 10.222.0.30 "GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab" status: 404 len: 111 microversion: 2.1 time: 0.101370 Aug 30 03:50:42.558236 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2471/4846] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:42 2022] GET /compute/v2.1/servers/a111fec9-f310-40d9-9e2a-03e89387caab => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:50:42.578730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:42.581252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:42.611252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:42.611760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:42.612202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.612994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:42.613376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:42.613970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:42.688400 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af828a78-8a0c-4e73-bf8d-cd36d4484464 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130330 Aug 30 03:50:42.689308 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2472/4847] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:42 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:42.727782 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-383ee119-c9c6-4fa7-9d09-d960a7eaab53 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917768 Aug 30 03:50:42.731534 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2376/4848] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:50:41 2022] POST /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:43.209885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:43.210678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:43.234754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:43.240924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:43.241964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:43.245312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:43.247372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:43.250929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:43.494881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:43.498720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:43.523233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:43.524032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:43.524663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:43.525692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:43.527281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:43.527932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:43.794049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:43.813014 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e079949e-beba-46ae-ba7c-93d4b98f29c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1281 microversion: 2.1 time: 0.340668 Aug 30 03:50:43.813679 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2377/4849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:43 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1281 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:43.838016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:43.848354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:43.863942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:43.882201 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-069b0e00-ac53-4735-b603-2d04caf9e016 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.677405 Aug 30 03:50:43.883243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:43.885040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:43.888956 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2473/4850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:43 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:43.889118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:43.890519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:43.890993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:43.897719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:43.987164 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cec242a6-5a9e-4de1-a061-6d6e45430557 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165409 Aug 30 03:50:43.988152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2378/4851] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:43 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:44.834631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:44.835420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:44.863773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:44.864691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:44.869702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:44.870561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:44.875862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:44.876650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:44.909207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:44.909935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:44.921858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:44.922359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:44.922802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:44.932322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:44.932837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:44.933298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:45.284461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:45.300570 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72e12995-49fa-48ac-8b0b-393fb6ca269d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1281 microversion: 2.1 time: 0.470347 Aug 30 03:50:45.301527 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2474/4852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:44 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1281 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:45.317915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:45.320690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:45.350925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:45.358007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:45.359603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:45.360530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:45.362994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:45.369190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:45.476455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71a81350-d2d2-4410-bb63-6deea7e0f449 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.173630 Aug 30 03:50:45.489111 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2475/4853] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:45 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:45.511410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:45.521457 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42ea9f27-f204-4c1c-b1f6-21847165dcc1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.621424 Aug 30 03:50:45.538064 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2379/4854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:44 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:46.324476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:46.325083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:46.340535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:46.350124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:46.350775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:46.351689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:46.352341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:46.352916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:46.502071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:46.504242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:46.532492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:46.539774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:46.544691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:46.545876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:46.546375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:46.546826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:46.696411 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a3d84cf6-2ca2-4815-8fef-095cc98ab233 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191668 Aug 30 03:50:46.704620 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2380/4855] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:46 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:46.729526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:46.732709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:46.748404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:46.749274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:46.749950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:46.750900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:46.758037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:46.768406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:46.769591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:46.771514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52346610-b5f9-417c-96c0-8e22a0a252cb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.450750 Aug 30 03:50:46.776833 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2476/4856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:46 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:47.036602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:47.053870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-486aa916-66f7-4023-b94c-91cd8e2b9dcf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.347664 Aug 30 03:50:47.055787 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2381/4857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:46 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:47.710276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:47.717085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:47.747458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:47.748335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:47.749260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:47.750237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:47.750901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:47.751524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:47.796788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:47.798109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:47.807012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:47.808065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:47.808808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:47.809821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:47.810639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:47.811283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:47.832174 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-57ee4e5e-25b7-461f-947c-e61de52eccfd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122062 Aug 30 03:50:47.834089 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2477/4858] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:47 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:48.077947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:48.078806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:48.111621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:48.114294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:48.130021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:48.139163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:48.139663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:48.140115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:48.186705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:48.203170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a98f298-520e-4301-8e75-9403a71e9c7d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.410358 Aug 30 03:50:48.203708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2382/4859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:47 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:48.540153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:48.548655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c20d67d3-b199-49c6-ad9e-335545bda6ee tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.474401 Aug 30 03:50:48.560465 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2478/4860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:48 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:48.845517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:48.848164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:48.906898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:48.908007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:48.908671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:48.915263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:48.922134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:48.924131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:49.075873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66866cdd-3f39-4a0a-9374-3fbfb397df9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.234959 Aug 30 03:50:49.077367 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2383/4861] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:48 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:49.233287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:49.234478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:49.246496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-770c071c-ab8d-489a-8c0b-8b6a0d79a4e7 req-3833a31d-26c9-48fe-853f-11c3055710c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:49.278875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:49.279679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:49.281445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:49.285955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:49.286979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-770c071c-ab8d-489a-8c0b-8b6a0d79a4e7 req-3833a31d-26c9-48fe-853f-11c3055710c4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:49.287673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:49.288466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-770c071c-ab8d-489a-8c0b-8b6a0d79a4e7 req-3833a31d-26c9-48fe-853f-11c3055710c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:49.289078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:49.289711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-770c071c-ab8d-489a-8c0b-8b6a0d79a4e7 req-3833a31d-26c9-48fe-853f-11c3055710c4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:49.318668 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-770c071c-ab8d-489a-8c0b-8b6a0d79a4e7 req-3833a31d-26c9-48fe-853f-11c3055710c4 service nova] Creating event network-changed:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:50:49.330992 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-770c071c-ab8d-489a-8c0b-8b6a0d79a4e7 req-3833a31d-26c9-48fe-853f-11c3055710c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088590 Aug 30 03:50:49.332161 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2384/4862] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:49.582866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:49.583690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:49.603508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:49.611040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:49.611040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:49.611845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:49.612416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:49.613050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:49.658486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:49.668975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dce845de-03c4-494b-8a0c-057c3b609aed tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.440535 Aug 30 03:50:49.677689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2479/4863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:49 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:49.894919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:49.907958 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e76a2496-9d83-4d5e-a830-392608fbe3fb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.329581 Aug 30 03:50:49.908555 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2385/4864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:49 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:50.090230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:50.093161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:50.124111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:50.134178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:50.134862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:50.135803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:50.146169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:50.147393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:50.256632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2e01fbd-4a82-4d41-8919-ba0a9d207d64 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.169612 Aug 30 03:50:50.268495 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2480/4865] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:50 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:50.697932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:50.698541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:50.715300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:50.715798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:50.716247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:50.716950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:50.728590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:50.729253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:50.929118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:50.929766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:50.932735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:50.945381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:50.945892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:50.946333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:50.947043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:50.947492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:50.947917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:51.104943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:51.554574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:51.568137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cbafbec3-e2d6-49fa-96e2-b6af928dd25d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.872097 Aug 30 03:50:51.570584 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2386/4866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:50 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:51.588539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:51.591321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:51.608366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:51.609084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:51.609951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:51.610872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:51.611526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:51.612148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:51.650714 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4912f069-64a3-4bd7-8ba0-82e3b2a34ecd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078696 Aug 30 03:50:51.652044 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2387/4867] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:51 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:51.874918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:51.888838 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06872092-cb63-476e-96af-5b93a8131229 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.964013 Aug 30 03:50:51.889452 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2481/4868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:50 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:52.595575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:52.596374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:52.609167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:52.616296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:52.617915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:52.618656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:52.625320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:52.633709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:52.664758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:52.670150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:52.701747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:52.702241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:52.708196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:52.709055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:52.709566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:52.710000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:52.821496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b1e1dff-51af-4814-b3e7-6b098d0042bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161609 Aug 30 03:50:52.828109 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2482/4869] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:52 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:52.919758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:52.920459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:52.962555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:52.963274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:52.963737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:52.965004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:52.965496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:52.965932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:53.460411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:53.468564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b701d19-1d23-4888-9467-65df4c17c2e7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.881853 Aug 30 03:50:53.469296 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2388/4870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:52 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:53.617594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:53.626232 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5feee4dc-c470-457f-88cd-6d3a5dfbe196 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.718913 Aug 30 03:50:53.626807 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2483/4871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:52 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:53.834945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:53.837393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:53.878357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:53.878357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:53.878357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:53.878357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:53.878357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:53.878357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:54.065478 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-991d72fd-91ba-4332-9b5c-cee2f4958c6e tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.234584 Aug 30 03:50:54.066332 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2389/4872] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:53 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:50:54.496205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:54.497368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:54.519793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:54.528521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:54.529047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:54.529796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:54.532648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:54.535681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:54.652623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:54.653650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:54.667029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:54.670024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:54.670726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:54.671656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:54.682055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:54.682718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:55.064362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:55.075894 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f099187-779a-4812-b283-52d494e24612 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.427126 Aug 30 03:50:55.097593 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2390/4873] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:54 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:55.109658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:55.120056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:55.139329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:55.140005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:55.141492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:55.144668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:55.145315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:55.147989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:55.154445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:55.169414 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78479414-1d5d-4f8c-86b2-e2ab6d37f5d7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.676855 Aug 30 03:50:55.185779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2484/4874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:54 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:55.227664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:55.236762 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e575748f-6361-4887-acbf-3978a2fbd61d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.137705 Aug 30 03:50:55.238231 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2391/4875] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:50:55 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:55.529461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:55.530855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:55.545806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:55.546327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:55.546773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:55.547489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:55.548681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:55.549077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:55.630393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:50:55.883849 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d88ef6e2-47f6-44ca-b831-2446b58067c2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 204 len: 0 microversion: 2.20 time: 0.358013 Aug 30 03:50:55.884884 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2485/4876] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:50:55 2022] DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:50:55.902534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:55.903545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:55.914670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:55.919663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:55.920166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:55.933600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:55.938477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:55.942625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:56.132055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:56.132773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:56.159644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:56.160224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:56.160685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:56.161664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:56.162407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:56.162845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:56.470335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:56.490892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:56.492959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:56.496576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7fe79c08-3113-4db6-b363-6d012acf715d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.607292 Aug 30 03:50:56.500297 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2392/4877] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:55 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:50:56.517388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:56.520894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:56.539665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:56.541860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:56.544678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:56.545676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:56.556641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:56.557305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:56.597568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:56.601219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:56.609242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-843e3512-aa62-4cf2-a713-634e624e8596 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.505069 Aug 30 03:50:56.609993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2486/4878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:56 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:50:56.816968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:56.829724 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7d1aee52-a39b-4f4b-aa0a-624a329155f3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.320671 Aug 30 03:50:56.829724 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2393/4879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:56 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:57.524018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:57.532343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:57.579603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:57.581207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:57.585623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:57.591110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:57.591837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:57.592822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:57.635387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:57.635387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:57.654606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=70 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:57.656235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:57.681725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:57.682195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:57.688424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:57.688956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:57.689429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:58.358165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:58.404768 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-930e86f2-6e85-4fc4-882e-c0c6fe4280f0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.776162 Aug 30 03:50:58.424333 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2394/4880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:57 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:58.433576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:58.446442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:58.447397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:58.456963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:58.457861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:58.458625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:58.459709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:58.460383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:58.461047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:58.483366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:58.502950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:58.508632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9cf7f06f-b2a3-46e6-94a7-1d658ac755e5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.985242 Aug 30 03:50:58.509219 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2487/4881] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:57 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:50:58.549377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d6902326-47e7-41a3-91dd-cc1d61db25c9 req-1dab86c5-2754-4be1-8e9b-1060f73d26b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "name": "network-vif-plugged", "status": "completed", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:50:58.596021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:50:58.606165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d6902326-47e7-41a3-91dd-cc1d61db25c9 req-1dab86c5-2754-4be1-8e9b-1060f73d26b9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:58.609061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d6902326-47e7-41a3-91dd-cc1d61db25c9 req-1dab86c5-2754-4be1-8e9b-1060f73d26b9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:58.623118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d6902326-47e7-41a3-91dd-cc1d61db25c9 req-1dab86c5-2754-4be1-8e9b-1060f73d26b9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:58.700463 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d6902326-47e7-41a3-91dd-cc1d61db25c9 req-1dab86c5-2754-4be1-8e9b-1060f73d26b9 service nova] Creating event network-vif-plugged:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:50:58.709540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d6902326-47e7-41a3-91dd-cc1d61db25c9 req-1dab86c5-2754-4be1-8e9b-1060f73d26b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184945 Aug 30 03:50:58.710415 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2488/4882] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:50:58.950300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:50:58.968138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bcfa246-f95f-4024-859c-2b0d785bde2f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1323 microversion: 2.1 time: 0.541944 Aug 30 03:50:58.968795 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2395/4883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:58 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1323 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:50:59.434645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:59.437950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:59.467931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:59.470735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:59.475908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:59.478616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:59.484837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:59.487792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:59.539314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:50:59.539924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:50:59.556973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:59.561948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:59.562622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:50:59.566607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:50:59.572239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:50:59.574411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:00.276926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:00.292574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6351909c-ce4f-4d4d-8e09-57da71c74643 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.864020 Aug 30 03:51:00.293502 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2489/4884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:50:59 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:00.367362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:00.398066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:00.403717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:00.409019 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0855daf5-fb2c-42ba-863e-76930453502d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1720 microversion: 2.20 time: 0.873943 Aug 30 03:51:00.409926 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2396/4885] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:50:59 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1720 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:51:00.432643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:00.433270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:00.471236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:00.471710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:00.472149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:00.479281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:00.479781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:00.480224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:00.880218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bdaa9265-575b-4ca1-b3fd-bee2f54cc163 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] Calling method '.version_select at 0x7f897b16a8b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:01.008003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:01.020235 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3f0a050-b249-4ad1-8720-8780b64cabab tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1519 microversion: 2.1 time: 0.601944 Aug 30 03:51:01.029916 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2397/4886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:00 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1519 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:01.035540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f4acbca1-1f1b-4f5a-8969-c87151626e29 req-a05161e0-cb36-4c2f-94f1-41b2e1ae1d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa19e79-3638-4c08-ab26-f3b68068e3e0", "name": "network-vif-deleted", "tag": "b65704a2-8fa3-470b-a90e-e999bff81fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:01.044014 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bdaa9265-575b-4ca1-b3fd-bee2f54cc163 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.747682 Aug 30 03:51:01.050021 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2490/4887] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:51:00 2022] GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0/defaults => generated 371 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:01.056189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f4acbca1-1f1b-4f5a-8969-c87151626e29 req-a05161e0-cb36-4c2f-94f1-41b2e1ae1d7b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.056830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f4acbca1-1f1b-4f5a-8969-c87151626e29 req-a05161e0-cb36-4c2f-94f1-41b2e1ae1d7b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.057569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f4acbca1-1f1b-4f5a-8969-c87151626e29 req-a05161e0-cb36-4c2f-94f1-41b2e1ae1d7b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.085187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:01.097093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:01.146268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f4acbca1-1f1b-4f5a-8969-c87151626e29 req-a05161e0-cb36-4c2f-94f1-41b2e1ae1d7b service nova] Creating event network-vif-deleted:b65704a2-8fa3-470b-a90e-e999bff81fbb for instance afa19e79-3638-4c08-ab26-f3b68068e3e0 on n-h2-854924-5 Aug 30 03:51:01.160939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.162796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.163711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.164683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.165558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.166077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.175595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f4acbca1-1f1b-4f5a-8969-c87151626e29 req-a05161e0-cb36-4c2f-94f1-41b2e1ae1d7b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148076 Aug 30 03:51:01.178099 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2398/4888] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:01.199057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c97caff4-5260-441c-89a0-ab56647620b7 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] Calling method '.version_select at 0x7f897a6c6e50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:01.270035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lazy-loading 'flavor' on Instance uuid b2b410ff-2493-429d-b9cd-8c32887bbc95 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:51:01.391942 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c97caff4-5260-441c-89a0-ab56647620b7 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0" status: 200 len: 371 microversion: 2.1 time: 0.212311 Aug 30 03:51:01.407788 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2399/4889] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:51:01 2022] GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0 => generated 371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:01.413417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:01.417636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:01.424457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.425147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.425800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.426713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.427422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.428553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.526592 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-665b3ee1-ac24-4ab0-9969-c1bfe1e77486 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action" status: 200 len: 32 microversion: 2.1 time: 0.470585 Aug 30 03:51:01.527575 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2491/4890] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:51:01 2022] POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:51:01.535963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-570010d8-b3d1-4c5b-82da-705b2d2f9d57 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] Calling method '.version_select at 0x7f8983af11f0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:01.752704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:01.787624 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2953ed25-7d38-499d-925d-c20109f67708 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.377410 Aug 30 03:51:01.788263 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2400/4891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:01 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:01.858975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:01.859610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:01.866296 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-570010d8-b3d1-4c5b-82da-705b2d2f9d57 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.336844 Aug 30 03:51:01.878237 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2492/4892] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 03:51:01 2022] GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0/defaults => generated 371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:01.898406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.901538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:01.902646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.904215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:01.907608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.912535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.916484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.920293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.935104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.938795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.944541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:01.952524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:01.964314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:01.965122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:02.072766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:02.081505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:02.082431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:02.083183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lazy-loading 'fault' on Instance uuid afa19e79-3638-4c08-ab26-f3b68068e3e0 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:51:02.237250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:02.252275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:02.270306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:02.272909 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5148e91-540e-440f-b4e7-1041d6371783 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 200 len: 1370 microversion: 2.20 time: 0.483474 Aug 30 03:51:02.278170 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2401/4893] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:01 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:02.301076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5495df00-1e3e-4f0e-9454-8cc6d03fbc7f tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] Calling method '.version_select at 0x7f897a6c61f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:02.561742 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5495df00-1e3e-4f0e-9454-8cc6d03fbc7f tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0" status: 200 len: 371 microversion: 2.1 time: 0.282557 Aug 30 03:51:02.564393 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2402/4894] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 03:51:02 2022] GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0 => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:02.585459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-43003350-cb42-48b4-89da-09104acc06b9 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] Calling method '.version_select at 0x7f897b006550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:02.731970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:02.744543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8453416e-c942-47d5-b648-c75080e8ff6b tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.875486 Aug 30 03:51:02.752533 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2493/4895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:01 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:02.803069 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-43003350-cb42-48b4-89da-09104acc06b9 tempest-QuotasTestJSON-1506081541 tempest-QuotasTestJSON-1506081541-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0?user_id=c5ed96552a284e6c916181ed3e6eea74" status: 200 len: 371 microversion: 2.1 time: 0.221689 Aug 30 03:51:02.806589 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2403/4896] 10.222.0.30 () {58 vars in 1323 bytes} [Tue Aug 30 03:51:02 2022] GET /compute/v2.1/os-quota-sets/237357fd804046319fead176fcaafef0?user_id=c5ed96552a284e6c916181ed3e6eea74 => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:02.818270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:02.821935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:02.847311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:02.848590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:02.852004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:02.853789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:02.855722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:02.856118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:03.312924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:03.313856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:03.349060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:03.352575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:03.355354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:03.362318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:03.362794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:03.363231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:03.410366 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] HTTP exception thrown: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Request method failure captured: Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 HTTP/1.1 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYgved6A0hVom8OjJ8QKEogVr7zs_5O10GTdL_eWDBXqZ5FvRKXJHk7G0dEG9EXucj41Wkm-60LFByutrXjJocC7CvAi91yhEWr8zFrL7D5qci3CdE3CKBGIs9_XLv78R6IFIChTwWxReUClNoceO4IjRXydYl1DZlkpSF6gky1WrVM Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25b753382d1b4cf09d36b653b90e6b50", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}] Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: b529d546df364eeca6e6665c76242906 Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'afa19e79-3638-4c08-ab26-f3b68068e3e0'} Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:03.412991 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:51:03.418980 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:03.426448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Returning 404 to user: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:51:03.429881 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7ed0c67e-cf39-476c-a51b-4b2139b643d8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 404 len: 111 microversion: 2.20 time: 0.130337 Aug 30 03:51:03.433131 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2404/4897] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:03 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:51:03.450136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d942ad1f-6449-4433-be51-d259ed5f64b9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '.version_select at 0x7f897bd28f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:03.511751 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d942ad1f-6449-4433-be51-d259ed5f64b9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807011676" status: 204 len: 0 microversion: 2.20 time: 0.073345 Aug 30 03:51:03.521536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2405/4898] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Aug 30 03:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807011676 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 03:51:03.774540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:03.775990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:03.798354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:03.798859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:03.799313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:03.800136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:03.800590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:03.813976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:04.356921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:04.377385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-332b0263-05ad-412d-b6a4-cf4016d9724d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 1.562759 Aug 30 03:51:04.378646 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2494/4899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:02 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:05.403767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:05.404599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:05.423292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:05.430042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:05.430196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:05.430956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:05.431430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:05.431873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:05.475181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:05.486996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd33b16c-e9e6-40f8-999a-a85e80e6d62f tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 1.718577 Aug 30 03:51:05.490156 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2406/4900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:03 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:06.127619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd97f825-1923-49c6-b2da-1334323f987c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'create', calling method: .version_select at 0x7f897a6c60d0>, body: {"keypair": {"name": "tempest-keypair-1636256811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADoZ4pYwSsbKQlhzFHBP6AlIjO7GGf4if/A5qq2343qyKfzI6CRPsYFsag6idEmGEP2ZfGJ+TGGVi4hgoMtthOtH/Fk+W3Nci1jwDwz3iSt4BIuu5C0zR1HiYCM6Xdatg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:06.150119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-cd97f825-1923-49c6-b2da-1334323f987c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:51:06.158179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-cd97f825-1923-49c6-b2da-1334323f987c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for user b529d546df364eeca6e6665c76242906 and project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:51:06.205610 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd97f825-1923-49c6-b2da-1334323f987c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.087870 Aug 30 03:51:06.226622 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2407/4901] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:51:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:51:06.312260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:06.326007 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8b819460-6504-40ac-bc48-b91bc80290ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.927829 Aug 30 03:51:06.339872 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2495/4902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:05 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:06.516953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:06.522246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:06.533862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:06.535437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:06.535437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:06.535971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:06.547806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:06.548659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:07.035746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:07.045643 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c47f7073-dafe-4d24-8c33-c7340c913a0e tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.533131 Aug 30 03:51:07.056205 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2408/4903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:06 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:07.349756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:07.350397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:07.361325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:07.370069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:07.370743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:07.381451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:07.387352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:07.388397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:07.730120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:07.742155 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ac5dd41-a278-4365-82d5-aab2c86b77dc tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.397861 Aug 30 03:51:07.744762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2496/4904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:07 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:07.768181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c65676cd-3ad5-4ab8-86f1-9fc092c17db1 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Action: 'create', calling method: .version_select at 0x7f897ad43280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-463843855", "metadata": {"Type": "work"}}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:08.071341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:08.073479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:08.085858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:08.088199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:08.088713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:08.091492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:08.093028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:08.093495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:08.320226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:08.331669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1903af1b-acdb-4ef5-80fb-e6b88addeeac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.267607 Aug 30 03:51:08.349775 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2497/4905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:08 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:08.720640 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c65676cd-3ad5-4ab8-86f1-9fc092c17db1 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.297004 Aug 30 03:51:08.729337 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2409/4906] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 03:51:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1298 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 03:51:08.735187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-979ef7c0-45da-4435-b735-ccbfdff65815 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f897a5d1d30>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:08.765612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:08.766647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:08.782512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:08.786754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:08.787538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:08.788424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:08.789580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:08.790653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:08.930249 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-979ef7c0-45da-4435-b735-ccbfdff65815 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 352 microversion: 2.1 time: 0.198724 Aug 30 03:51:08.930846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2498/4907] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:08 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:09.206005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:09.216385 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de474478-2548-463b-bd99-e00bb5b97d8d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.456116 Aug 30 03:51:09.222400 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2410/4908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:08 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:09.367268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:09.368316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:09.392631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:09.395457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:09.396138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:09.397018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:09.397666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:09.398259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:09.679755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:09.694410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a4221e8-0c3c-476e-a1c7-262e74e14c74 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.333267 Aug 30 03:51:09.695814 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2499/4909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:09 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:09.776012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1401665833", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2284a504-b8bb-4fc4-a795-1cf53ac3c40c"}], "security_groups": [{"name": "tempest-securitygroup--157130090"}], "key_name": "tempest-keypair-1636256811", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:09.944669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c783739-c73c-4cfb-be31-049be3a655ea tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f898121de50>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:10.114883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] validate_networks() for [('2284a504-b8bb-4fc4-a795-1cf53ac3c40c', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:51:10.166291 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4c783739-c73c-4cfb-be31-049be3a655ea tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 353 microversion: 2.1 time: 0.225640 Aug 30 03:51:10.173783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2500/4910] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:09 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 353 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:51:10.179708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-75a9494c-4184-47ae-a549-a231e69cef29 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f8983b10160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:10.293838 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-75a9494c-4184-47ae-a549-a231e69cef29 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 353 microversion: 2.1 time: 0.118625 Aug 30 03:51:10.302318 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2501/4911] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:10 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:10.304866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:10.305757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:10.313868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:10.314364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:10.314818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:10.315504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:10.319225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:10.319594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:10.628485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:10.651364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3fb7029-3897-424d-bd85-3e284c737619 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.355397 Aug 30 03:51:10.682192 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2502/4912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:10 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:10.692500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6fc2ff03-900d-4d2a-a324-14a8b531c149 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f897b1465e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:10.842338 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6fc2ff03-900d-4d2a-a324-14a8b531c149 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 202 len: 0 microversion: 2.1 time: 0.158670 Aug 30 03:51:10.843325 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2503/4913] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:51:10 2022] DELETE /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:51:10.850944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:10.851901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:10.875301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:10.876382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:10.878666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:10.879622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:10.881648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:10.882678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:11.350885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:11.363277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:51:11.363768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:51:11.364166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:51:11.364601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:51:11.365023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:51:11.367000 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-14a5da0a-3e47-4f6a-a399-3ba201c952c8 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.518718 Aug 30 03:51:11.368349 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2504/4914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:10 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:11.373549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-686400ff-d2b3-41eb-b529-4bf9328d387d tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f8983b10af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:11.389708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:11.390207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:11.390649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:11.391387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:11.391846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:11.392276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:11.479657 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-686400ff-d2b3-41eb-b529-4bf9328d387d tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 352 microversion: 2.1 time: 0.109920 Aug 30 03:51:11.480228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2505/4915] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:11 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:11.492763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:51:11.508496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Getting quotas for user b529d546df364eeca6e6665c76242906 and project 25b753382d1b4cf09d36b653b90e6b50. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:51:11.539589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:51:11.546267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:51:11.655703 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af48568e-6ecc-4c3f-a47e-928af665641f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.890291 Aug 30 03:51:11.672198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2411/4916] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 03:51:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:51:11.685450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-161ba18b-c031-4069-a4a9-9ef8cc4324b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:11.686066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-161ba18b-c031-4069-a4a9-9ef8cc4324b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:11.687447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:11.688181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:11.710348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:11.710917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:11.711456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:11.712274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:11.712836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:11.713445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:11.991579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-161ba18b-c031-4069-a4a9-9ef8cc4324b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:12.014225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-161ba18b-c031-4069-a4a9-9ef8cc4324b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:12.016696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-161ba18b-c031-4069-a4a9-9ef8cc4324b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:12.022548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-161ba18b-c031-4069-a4a9-9ef8cc4324b4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1282 microversion: 2.20 time: 0.342561 Aug 30 03:51:12.034985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2506/4917] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:11 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1282 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:12.197101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:12.213852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f546abde-1d13-4b0d-acfd-0ae931fb8b91 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1523 microversion: 2.1 time: 0.531574 Aug 30 03:51:12.214291 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2412/4918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:11 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:12.388551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:12.391113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:12.401872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:12.402576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:12.403221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:12.404156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:12.404786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:12.405430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:12.501939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e735b511-6059-4973-b98c-abbe1515ce04 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f897b006f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:12.596487 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e735b511-6059-4973-b98c-abbe1515ce04 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 352 microversion: 2.1 time: 0.106632 Aug 30 03:51:12.597781 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2413/4919] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:12 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:12.744630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:12.756049 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d785322-74f2-4d94-88d9-d94b37e27bee tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.371428 Aug 30 03:51:12.759015 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2507/4920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:12 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:13.051914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:13.052725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:13.066496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:13.067078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:13.067566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:13.068513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:13.069091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:13.069661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:13.234716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:13.235532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:13.257933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:13.258435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:13.258879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:13.259586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:13.272986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:13.273482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:13.312862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:13.325760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:13.327967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:13.331272 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a0e8d6e-b55e-4a13-a0c4-9d2defc13c1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1334 microversion: 2.20 time: 0.281961 Aug 30 03:51:13.334033 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2414/4921] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:13 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:13.612365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9bc5bec2-d1cc-4c8b-87d0-c559e191caa3 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f897b0064c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:13.733154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9bc5bec2-d1cc-4c8b-87d0-c559e191caa3 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 352 microversion: 2.1 time: 0.125417 Aug 30 03:51:13.740536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2415/4922] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:13 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:13.760987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:13.774580 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-771d3c08-53aa-4d5b-bbf9-035c3355c967 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1505 microversion: 2.1 time: 0.544137 Aug 30 03:51:13.779775 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2508/4923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:13 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:13.780290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:13.781376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:13.790679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:13.795058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:13.795515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:13.800780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:13.801716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:13.802837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:14.163976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:14.175546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6830122b-6b6e-4890-87b6-8134f81a6689 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.399402 Aug 30 03:51:14.180363 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2416/4924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:13 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:14.397670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:14.398288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:14.413466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:14.413961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:14.416105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:14.416829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:14.417292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:14.417749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:14.552595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:14.561278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:14.563050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:14.564458 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17646179-6fd4-4956-87b3-8584cb4dc0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1340 microversion: 2.20 time: 0.185353 Aug 30 03:51:14.565631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2509/4925] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:14 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:14.748053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-320cd3b6-5aec-4e3f-b582-ba575e34484c tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f897bd115e0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:14.801208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:14.802227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:14.812738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:14.815233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:14.817055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:14.820118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:14.820910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:14.822333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:14.834447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:14.859723 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-320cd3b6-5aec-4e3f-b582-ba575e34484c tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 200 len: 352 microversion: 2.1 time: 0.117133 Aug 30 03:51:14.861068 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2417/4926] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:14 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:15.199459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:15.200361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:15.217827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:15.222522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:15.230240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:15.235029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:15.236923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e36fa27d-0f2d-4a21-9e30-76af4162f440 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1505 microversion: 2.1 time: 0.439658 Aug 30 03:51:15.237555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:15.242256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:15.242969 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2510/4927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:14 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:15.243482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:15.586372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:15.591069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:15.592391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:15.600985 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0584004b-6cad-40b3-805a-bd26c7bb201a tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.402680 Aug 30 03:51:15.602539 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2418/4928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:15 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:15.622109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:15.626522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:15.628695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:15.634894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:15.635551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:15.636135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:15.861910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:15.875272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81245d89-f87d-4d8b-8b10-a10b2b2134c7 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Calling method '.version_select at 0x7f897ae3b310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:15.889270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:15.890794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:15.892150 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-73fd4117-f51c-4905-83f0-5387e64933f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.305522 Aug 30 03:51:15.893211 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2511/4929] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:15 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:15.948773 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-81245d89-f87d-4d8b-8b10-a10b2b2134c7 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] HTTP exception thrown: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81245d89-f87d-4d8b-8b10-a10b2b2134c7 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Request method failure captured: Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 HTTP/1.1 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYkryaP6mO0NL-nh95Y5raCCVYYjFO5eqIIWZm2u4NRbSeb1Oseod3EXEsYvwyC3QMbTBQsxHQh0aoQBS3WYgGfCyOcpLG91qrEabUfkWTJtdDV0S1gJ5PhOdLt3MSql8hytqJ5T74G0aZVQ3z0D3qRGbQqPJg6hgrRetNCM6Gc0XHc Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 534a417c718e46cf8c47203975ff4836 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesGetTestJSON-221651474 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/534a417c718e46cf8c47203975ff4836"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/534a417c718e46cf8c47203975ff4836"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_534a417c718e46cf8c47203975ff4836", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/534a417c718e46cf8c47203975ff4836"}]}] Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesGetTestJSON-221651474 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 534a417c718e46cf8c47203975ff4836 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesGetTestJSON-221651474 Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesGetTestJSON-221651474-project Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 61be9c9b524d4edda61412ac2a5ad54a Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesGetTestJSON-221651474-project Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: exception: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '647cda2b-4047-4156-8c55-08db3f329fc3'} Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. (HTTP 404) (Request-ID: req-2b6ace31-e3af-4873-9a74-37801d2b9375) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 03:51:15.978571 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. Aug 30 03:51:15.983008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:15.987030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81245d89-f87d-4d8b-8b10-a10b2b2134c7 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] Returning 404 to user: Volume 647cda2b-4047-4156-8c55-08db3f329fc3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:51:15.988272 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-81245d89-f87d-4d8b-8b10-a10b2b2134c7 tempest-VolumesGetTestJSON-221651474 tempest-VolumesGetTestJSON-221651474-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3" status: 404 len: 109 microversion: 2.1 time: 0.117141 Aug 30 03:51:15.989391 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2419/4930] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:51:15 2022] GET /compute/v2.1/os-volumes/647cda2b-4047-4156-8c55-08db3f329fc3 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:51:16.267501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:16.271965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:16.281103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:16.285014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:16.285889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:16.287404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:16.292695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:16.293475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:16.627268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:16.628171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:16.642035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:16.644438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:16.648340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:16.649203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:16.649803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:16.654292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:16.660487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:16.920985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:16.945293 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-019fdf88-1ca1-4ce2-b6b8-ad018fa6bdbe tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1505 microversion: 2.1 time: 0.679938 Aug 30 03:51:16.962788 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2512/4931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:16 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:16.972715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:16.977202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:17.005029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:17.009885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:17.010529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:17.011680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:17.027120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:17.027557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:17.420103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:17.431695 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9f3fe36-5569-41e6-beaa-6e38af2b1676 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.809326 Aug 30 03:51:17.432302 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2420/4932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:16 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:17.459340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b8274ccf-ff07-4642-93ab-240983d5fdf4 req-acdbe6f7-b0d4-4999-a60f-2567f19ff376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cf4560-2c13-4df2-b7f5-f378b4d79590", "name": "network-vif-unplugged", "status": "completed", "tag": "1d13d08c-1ed0-44a0-928e-e5429314f323"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:17.486946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b8274ccf-ff07-4642-93ab-240983d5fdf4 req-acdbe6f7-b0d4-4999-a60f-2567f19ff376 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:17.487960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b8274ccf-ff07-4642-93ab-240983d5fdf4 req-acdbe6f7-b0d4-4999-a60f-2567f19ff376 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:17.488621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b8274ccf-ff07-4642-93ab-240983d5fdf4 req-acdbe6f7-b0d4-4999-a60f-2567f19ff376 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:17.503019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.server_external_events [req-b8274ccf-ff07-4642-93ab-240983d5fdf4 req-acdbe6f7-b0d4-4999-a60f-2567f19ff376 service nova] Unable to find a host for instance 65cf4560-2c13-4df2-b7f5-f378b4d79590. Dropping event network-vif-unplugged {{(pid=122167) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 03:51:17.504139 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b8274ccf-ff07-4642-93ab-240983d5fdf4 req-acdbe6f7-b0d4-4999-a60f-2567f19ff376 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056345 Aug 30 03:51:17.505271 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2421/4933] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 03:51:17.666637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:17.682491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:17.684134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:17.685473 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17dd3ac5-8b65-4a97-99ba-4becd400e6b7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.729962 Aug 30 03:51:17.692371 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2513/4934] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:16 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:17.742364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f392092d-8205-479a-b6b2-9f6e99d8b5ec req-9940e83c-a465-4cee-bdba-1dcb305cf441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:17.775983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f392092d-8205-479a-b6b2-9f6e99d8b5ec req-9940e83c-a465-4cee-bdba-1dcb305cf441 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:17.776587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f392092d-8205-479a-b6b2-9f6e99d8b5ec req-9940e83c-a465-4cee-bdba-1dcb305cf441 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:17.782321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f392092d-8205-479a-b6b2-9f6e99d8b5ec req-9940e83c-a465-4cee-bdba-1dcb305cf441 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:17.842529 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f392092d-8205-479a-b6b2-9f6e99d8b5ec req-9940e83c-a465-4cee-bdba-1dcb305cf441 service nova] Creating event network-changed:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:51:17.857368 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f392092d-8205-479a-b6b2-9f6e99d8b5ec req-9940e83c-a465-4cee-bdba-1dcb305cf441 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123392 Aug 30 03:51:17.859602 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2422/4935] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:51:17.976152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:17.977306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:17.998619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:17.999991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.000847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.002008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.002676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.003310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.026863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:18.031702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:18.064901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.066957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.069512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.070560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.071611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.072804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.136406 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80bf3edb-415e-40f4-a685-43137f085e8c tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123302 Aug 30 03:51:18.143577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2423/4936] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:51:18 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:18.150213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:18.151278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:18.158490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.159390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.160336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.161477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.163332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.164107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.204938 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6f3dd4e6-5851-4724-8f96-5895689bac84 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/072c7d16-be30-4b07-be13-43f360bc21d8" status: 200 len: 194 microversion: 2.1 time: 0.059729 Aug 30 03:51:18.207206 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2424/4937] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Aug 30 03:51:18 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/072c7d16-be30-4b07-be13-43f360bc21d8 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:18.324592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:18.353990 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-280ec720-0aef-48bf-8b09-86c21996bdde tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 200 len: 1448 microversion: 2.1 time: 0.386216 Aug 30 03:51:18.361666 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2514/4938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:17 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 1448 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:18.383684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:18.384726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:18.399890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.401590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.402058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.402948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.403423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.405033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.444367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:51:18.455161 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Working on deleting snapshot 322bfa3d-4885-43c3-a9e4-0785a566ce03 from shelved instance... Aug 30 03:51:18.464909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:18.465562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:18.476385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.476898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.477363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.478082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.488489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.490529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.861434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:18.877296 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-311ab436-2fcc-4bb7-883f-93bda55de0f1 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.427870 Aug 30 03:51:18.879885 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2515/4939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:18 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:18.891482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:18.892401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:18.911139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.914617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.915233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:18.916106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:18.918321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:18.919642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:19.286524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:19.296370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:19.305240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:19.306480 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f3498ed-5f34-464d-a2cf-5cf27884d5e3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.425583 Aug 30 03:51:19.307067 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2516/4940] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:18 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:19.904907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:19.906409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:19.929603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:19.929875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Doing local delete in cell 381d13c5-c82a-413a-b812-f2cf3864a4b6(cell1) {{(pid=122167) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 03:51:19.930895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:19.931453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:19.932444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:19.932693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:19.933327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:19.934578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:19.934982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:19.940287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:19.941615 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 03:51:19.951050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] deallocate_for_instance() {{(pid=122167) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 03:51:20.427676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:20.452341 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5e54963-df96-42c4-b269-1daeda62c6c4 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.552498 Aug 30 03:51:20.453599 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2517/4941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:19 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:20.458959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:20.466927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:20.473520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:20.478430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:20.479125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:20.480013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:20.480623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:20.481319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:20.870142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:20.912365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:20.914072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:20.916548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31418902-f526-49ec-b0fe-986b68c5e1b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.461663 Aug 30 03:51:20.937307 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2518/4942] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:20 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:21.125541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f497af2b-dbd9-439a-92f1-b9f51b008d93"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:21.133132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:21.148625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:21.149231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:21.149598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:21.150299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:21.150763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:21.151188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:21.269864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Updating instance_info_cache with network_info: [] {{(pid=122167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:51:21.442872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:21.533777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=18 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:21.698862 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80f60123-84da-4783-9b71-8cb2df8f6167 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "POST /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591161 Aug 30 03:51:21.699907 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2519/4943] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:51:21 2022] POST /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:21.708853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c357e511-0885-4314-924d-21e3fb968c3b req-0d23eb8b-e2a5-46e6-88a5-b3a632ba8612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65cf4560-2c13-4df2-b7f5-f378b4d79590", "name": "network-vif-deleted", "tag": "1d13d08c-1ed0-44a0-928e-e5429314f323"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:21.747341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c357e511-0885-4314-924d-21e3fb968c3b req-0d23eb8b-e2a5-46e6-88a5-b3a632ba8612 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:21.753372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c357e511-0885-4314-924d-21e3fb968c3b req-0d23eb8b-e2a5-46e6-88a5-b3a632ba8612 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:21.754039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c357e511-0885-4314-924d-21e3fb968c3b req-0d23eb8b-e2a5-46e6-88a5-b3a632ba8612 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:21.815217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.server_external_events [req-c357e511-0885-4314-924d-21e3fb968c3b req-0d23eb8b-e2a5-46e6-88a5-b3a632ba8612 service nova] Unable to find a host for instance 65cf4560-2c13-4df2-b7f5-f378b4d79590. Dropping event network-vif-deleted {{(pid=122168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 03:51:21.816426 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c357e511-0885-4314-924d-21e3fb968c3b req-0d23eb8b-e2a5-46e6-88a5-b3a632ba8612 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.115191 Aug 30 03:51:21.838433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2520/4944] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 138 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 03:51:21.843352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:21.844097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:21.877545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:21.877959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:21.878906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:21.879593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:21.880752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:21.888036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:22.006483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:22.190676 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54b0bd05-55df-4f4d-95b8-3635d7f4747d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 204 len: 0 microversion: 2.1 time: 3.813131 Aug 30 03:51:22.191930 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2425/4945] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:51:18 2022] DELETE /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 0 bytes in 3815 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:51:22.203267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:22.203896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:22.212509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:22.220477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:22.220985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:22.221479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:22.222206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:22.222665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:22.223092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:22.236990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:22.249764 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c8169be-d074-4cf2-aaf9-23ac153d672c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.409751 Aug 30 03:51:22.250787 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2521/4946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:21 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:22.257290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:22.260162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:22.269897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:22.271091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:22.271745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:22.272717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:22.273509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:22.274676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:22.324604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 HTTP/1.1 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '65cf4560-2c13-4df2-b7f5-f378b4d79590'} Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:22.326626 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:51:22.330854 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:51:22.333033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:51:22.334913 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b585c704-1a5e-4cb7-a308-eb4b4bbf1427 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 404 len: 111 microversion: 2.1 time: 0.082109 Aug 30 03:51:22.341411 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2522/4947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:22 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:51:22.595044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1043756307", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:22.729454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:51:22.739220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:22.762407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:22.774608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:22.780154 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a0456af-f34a-4857-8640-7b9dbf09ea20 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.587139 Aug 30 03:51:22.781676 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2426/4948] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:22 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:23.275208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:23.276342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:23.286743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:23.287998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:23.288716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:23.289679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:23.290305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:23.290932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:23.778196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:23.793670 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00ca0816-474e-4fe4-b831-dd563ce18c69 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.519790 Aug 30 03:51:23.796475 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2427/4949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:23 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:23.828210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:23.829795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:23.840061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:23.844196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:23.844841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:23.845708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:23.846259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:23.846856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:24.380952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:24.401192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:24.407349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:24.408779 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a33270cb-1351-41b1-94a3-79775245db1a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.584524 Aug 30 03:51:24.416224 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2428/4950] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:23 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:24.459365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:51:24.461212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:51:24.462361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:51:24.463523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:51:24.464237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:51:24.486063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:24.487296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:24.488844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:24.492289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:24.495546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:24.497519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:24.545603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:51:24.554438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:51:24.571210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:51:24.574782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:51:24.637762 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-586e03f8-9c54-43c7-982b-292eed305974 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051194 Aug 30 03:51:24.639175 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2523/4951] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:51:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:51:24.651826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfae1b24-b2dc-4f60-8011-c93911d1a3aa tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:24.651826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfae1b24-b2dc-4f60-8011-c93911d1a3aa tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:24.815811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfae1b24-b2dc-4f60-8011-c93911d1a3aa tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:24.816541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:24.816779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:24.825684 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfae1b24-b2dc-4f60-8011-c93911d1a3aa tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1215 microversion: 2.1 time: 0.179212 Aug 30 03:51:24.834025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:24.834528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:24.834972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:24.836339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:24.836802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:24.837225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:24.847371 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2429/4952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:24 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:25.112710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:25.124817 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ffee891-f36f-468d-8bb6-c0d7b67a0ec5 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.312498 Aug 30 03:51:25.138730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2524/4953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:24 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:25.444889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-83ac49e2-cd50-41d8-95e1-a004a8d9bc2e req-88929f0f-f174-464b-94ad-fcfb5a91449f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "name": "network-vif-plugged", "status": "completed", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:25.447646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:25.448676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:25.471358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:25.473561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:25.473973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-83ac49e2-cd50-41d8-95e1-a004a8d9bc2e req-88929f0f-f174-464b-94ad-fcfb5a91449f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:25.475259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:25.475814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-83ac49e2-cd50-41d8-95e1-a004a8d9bc2e req-88929f0f-f174-464b-94ad-fcfb5a91449f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:25.477255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-83ac49e2-cd50-41d8-95e1-a004a8d9bc2e req-88929f0f-f174-464b-94ad-fcfb5a91449f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:25.479302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:25.480220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:25.481925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:25.538782 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-83ac49e2-cd50-41d8-95e1-a004a8d9bc2e req-88929f0f-f174-464b-94ad-fcfb5a91449f service nova] Creating event network-vif-plugged:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:51:25.558906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-83ac49e2-cd50-41d8-95e1-a004a8d9bc2e req-88929f0f-f174-464b-94ad-fcfb5a91449f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120138 Aug 30 03:51:25.564564 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2525/4954] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:25.844051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:25.854807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:25.856870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:25.873444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:25.875042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:25.876218 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8639c28d-f180-449a-b131-482a38f38410 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.445487 Aug 30 03:51:25.884733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:25.885240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:25.885706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:25.887068 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2430/4955] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:25 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:25.887279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:25.888476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:25.889499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:26.043555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:26.051362 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39f1bd05-babb-4cd1-92d0-0bb339e7d72b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1211 microversion: 2.1 time: 0.200569 Aug 30 03:51:26.052870 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2526/4956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:25 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1211 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:26.149592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:26.150815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:26.160718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:26.161763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:26.162382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:26.163166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:26.163547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:26.163979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:26.466854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:26.485187 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa7844b2-25d9-40bb-a7e4-26acd79478a9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.341158 Aug 30 03:51:26.501059 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2431/4957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:26 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:26.903550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:26.913628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:26.931985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:26.936664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:26.937646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:26.940255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:26.941249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:26.943398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:27.073476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:27.074472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:27.094047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:27.094812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:27.095457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:27.099244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:27.099736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:27.100166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:27.296533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:27.299234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:27.306729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40f2dd67-ae31-4766-91e0-8698cdbcfa4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1267 microversion: 2.1 time: 0.237812 Aug 30 03:51:27.313947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:27.327646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:27.328646 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2432/4958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:27 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:27.335021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:27.336542 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c6127f9-1f90-4dcc-ad28-8e7887057419 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1407 microversion: 2.20 time: 0.437373 Aug 30 03:51:27.340413 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2527/4959] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:26 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:51:27.511684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:27.512878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:27.522607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:27.523452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:27.524214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:27.525130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:27.526301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:27.526946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:27.836151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:27.858824 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1887c850-39b5-4578-ae7c-f738200ec47d tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.353402 Aug 30 03:51:27.859756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2433/4960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:27 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:28.351641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:28.352834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:28.365586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:28.368521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:28.381980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:28.383508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:28.387260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:28.387700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:28.388211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:28.388595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:28.389006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:28.389631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:28.390065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:28.391215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:28.393338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:28.394501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:28.454463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:29.113701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:29.134569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:29.136876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:29.147685 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e53c0a80-80f9-4b8e-9acb-7cd57761e0e4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1598 microversion: 2.20 time: 0.786492 Aug 30 03:51:29.150013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2434/4961] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:51:28 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1598 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:51:29.178452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:29.181222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:29.201839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:29.202593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:29.203244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:29.216777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:29.217556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:29.218409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:29.222112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:29.237645 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8f5e1f19-51d5-4ee9-9458-48c90880530c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 0.888814 Aug 30 03:51:29.239022 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2528/4962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:28 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:29.244194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:29.246020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:29.260646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:29.261610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:29.271802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:29.274829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:29.277007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:29.282012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:29.613511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:29.629524 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bdfa7388-64f7-4bff-b96b-c0bc29100a65 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.470219 Aug 30 03:51:29.630977 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2435/4963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:29 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:29.647135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ca3f9b2-b1d6-4627-a6f1-e8eb27812193 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.406577 Aug 30 03:51:29.651762 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2529/4964] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:51:29 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-interface => generated 285 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:51:30.260083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:30.260984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:30.273768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:30.279933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:30.292948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:30.294172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:30.294883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:30.295992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:30.656283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:30.656941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:30.659177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:30.691414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:30.691916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:30.695510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:30.697194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:30.701897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:30.703222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:31.527654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:31.545493 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7df1528e-fa90-4fca-85bd-c5e87ba2b9dd tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 1.290053 Aug 30 03:51:31.549370 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2436/4965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:30 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:31.563352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a7f86dd4-16e4-44b2-b9cd-c7caba44afa1 req-1aa707e4-546a-4e07-8b1c-58e471067dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceed52f1-027d-462b-bf29-fa6f14d6d16e", "tag": "0a3e86a7-b495-457b-a284-cf3ef21047da"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:31.595241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7f86dd4-16e4-44b2-b9cd-c7caba44afa1 req-1aa707e4-546a-4e07-8b1c-58e471067dae service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:31.599062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7f86dd4-16e4-44b2-b9cd-c7caba44afa1 req-1aa707e4-546a-4e07-8b1c-58e471067dae service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:31.599957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7f86dd4-16e4-44b2-b9cd-c7caba44afa1 req-1aa707e4-546a-4e07-8b1c-58e471067dae service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:31.668860 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a7f86dd4-16e4-44b2-b9cd-c7caba44afa1 req-1aa707e4-546a-4e07-8b1c-58e471067dae service nova] Creating event network-changed:0a3e86a7-b495-457b-a284-cf3ef21047da for instance ceed52f1-027d-462b-bf29-fa6f14d6d16e on n-h1-854924-5 Aug 30 03:51:31.686173 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a7f86dd4-16e4-44b2-b9cd-c7caba44afa1 req-1aa707e4-546a-4e07-8b1c-58e471067dae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133575 Aug 30 03:51:31.689082 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2437/4966] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:31.771013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:31.791519 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ef8484e8-f152-4686-b809-b6de231409fb tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 1.139958 Aug 30 03:51:31.794431 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2530/4967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:30 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:32.585108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:32.591468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:32.620504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:32.621187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:32.622051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:32.624903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:32.625575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:32.628344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:32.816104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:32.816754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:32.836214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:32.839246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:32.841712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:32.845898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:32.847363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:32.849251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:33.005444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:33.018286 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e5d37d5-49f5-440d-896a-240314a04823 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 0.438687 Aug 30 03:51:33.027145 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2438/4968] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:32 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:33.032325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-af12aa87-5ea5-4f5e-8aa8-702493c10bd7 req-47b7c727-f53b-4147-87ec-19a76c72f8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:33.061159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-af12aa87-5ea5-4f5e-8aa8-702493c10bd7 req-47b7c727-f53b-4147-87ec-19a76c72f8de service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:33.063434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-af12aa87-5ea5-4f5e-8aa8-702493c10bd7 req-47b7c727-f53b-4147-87ec-19a76c72f8de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:33.065604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-af12aa87-5ea5-4f5e-8aa8-702493c10bd7 req-47b7c727-f53b-4147-87ec-19a76c72f8de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:33.095037 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-af12aa87-5ea5-4f5e-8aa8-702493c10bd7 req-47b7c727-f53b-4147-87ec-19a76c72f8de service nova] Creating event network-changed:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:51:33.110262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-af12aa87-5ea5-4f5e-8aa8-702493c10bd7 req-47b7c727-f53b-4147-87ec-19a76c72f8de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080611 Aug 30 03:51:33.112876 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2439/4969] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:33.229780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:33.258743 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ccc252d8-687f-4529-842f-2e386833bd89 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1525 microversion: 2.1 time: 0.447123 Aug 30 03:51:33.260071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2531/4970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:32 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1525 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:34.045872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:34.047404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:34.064727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:34.068483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:34.070507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:34.071442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:34.075732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:34.077810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:34.280370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:34.281687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:34.319753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:34.320506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:34.321138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:34.322080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:34.322707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:34.323291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:34.527715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:34.564752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:34.780859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:34.798758 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5315719d-12f6-43fa-9a03-e557139eab2a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 0.753227 Aug 30 03:51:34.800065 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2440/4971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:34 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:34.882263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:34.892278 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28a77da3-a842-4a41-80f5-22ecbc5c0fb7 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1505 microversion: 2.1 time: 0.615768 Aug 30 03:51:34.897771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2532/4972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:34 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:34.920885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46466873-f4b1-4c2d-8670-5c60f5d720b9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'create', calling method: .version_select at 0x7f897a6a9310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-477863098", "description": "tempest-description-256093867"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:34.934444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:35.824096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:35.827110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:35.836410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:35.838778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:35.839544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:35.840570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:35.841932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:35.842681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:36.112031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46466873-f4b1-4c2d-8670-5c60f5d720b9 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.197168 Aug 30 03:51:36.113519 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2441/4973] 10.222.0.30 () {60 vars in 1180 bytes} [Tue Aug 30 03:51:34 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:36.126617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-477863098"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:36.127958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:36.142976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:36.149160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:36.149817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:36.150736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:36.151347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:36.152056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:36.396639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:36.410935 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1431c16-37c7-4207-8d88-ba6ec73717bb tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 0.592251 Aug 30 03:51:36.412104 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2533/4974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:35 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:36.686112 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.network.security_group_api [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Adding security group e4f47e04-36e1-4374-8ccb-ca1ce7b4b192 to port fc8934e7-b135-4755-8f3c-331c62a21a39 Aug 30 03:51:37.288325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a323ed7-42c4-4635-b1c5-484d01a41220 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action" status: 202 len: 0 microversion: 2.1 time: 1.164842 Aug 30 03:51:37.289301 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2442/4975] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:51:36 2022] POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:51:37.305723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-477863098"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:37.308236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:37.316790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d4e1a279-1c4c-48fc-b77b-276d3e8fb30e req-a1ac43c7-5d1d-4454-9375-a8b6b379ed54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:37.323388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:37.324133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:37.324826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:37.325806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:37.326480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:37.327153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:37.335205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d4e1a279-1c4c-48fc-b77b-276d3e8fb30e req-a1ac43c7-5d1d-4454-9375-a8b6b379ed54 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:37.335693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d4e1a279-1c4c-48fc-b77b-276d3e8fb30e req-a1ac43c7-5d1d-4454-9375-a8b6b379ed54 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:37.336489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d4e1a279-1c4c-48fc-b77b-276d3e8fb30e req-a1ac43c7-5d1d-4454-9375-a8b6b379ed54 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:37.399872 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d4e1a279-1c4c-48fc-b77b-276d3e8fb30e req-a1ac43c7-5d1d-4454-9375-a8b6b379ed54 service nova] Creating event network-changed:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:51:37.406337 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d4e1a279-1c4c-48fc-b77b-276d3e8fb30e req-a1ac43c7-5d1d-4454-9375-a8b6b379ed54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094250 Aug 30 03:51:37.407748 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2443/4976] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:37.435325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:37.436135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:37.449536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:37.449536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:37.450691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:37.452353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:37.454107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:37.456650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:37.940551 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Removing security group e4f47e04-36e1-4374-8ccb-ca1ce7b4b192 from port fc8934e7-b135-4755-8f3c-331c62a21a39 Aug 30 03:51:38.167948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:38.179159 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af02a035-1c0e-4d7e-aaed-a86996521e76 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 0.748842 Aug 30 03:51:38.179765 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2444/4977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:37 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:38.277845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-63cc7d0e-d808-45af-94f8-bc2f2b894a70 req-68670124-0174-4428-b7c3-8a221f1b428b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceed52f1-027d-462b-bf29-fa6f14d6d16e", "name": "network-vif-plugged", "status": "completed", "tag": "0a3e86a7-b495-457b-a284-cf3ef21047da"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:38.334063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-63cc7d0e-d808-45af-94f8-bc2f2b894a70 req-68670124-0174-4428-b7c3-8a221f1b428b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:38.343123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-63cc7d0e-d808-45af-94f8-bc2f2b894a70 req-68670124-0174-4428-b7c3-8a221f1b428b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:38.350049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-63cc7d0e-d808-45af-94f8-bc2f2b894a70 req-68670124-0174-4428-b7c3-8a221f1b428b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:38.414354 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-63cc7d0e-d808-45af-94f8-bc2f2b894a70 req-68670124-0174-4428-b7c3-8a221f1b428b service nova] Creating event network-vif-plugged:0a3e86a7-b495-457b-a284-cf3ef21047da for instance ceed52f1-027d-462b-bf29-fa6f14d6d16e on n-h1-854924-5 Aug 30 03:51:38.431584 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-63cc7d0e-d808-45af-94f8-bc2f2b894a70 req-68670124-0174-4428-b7c3-8a221f1b428b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158247 Aug 30 03:51:38.432206 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2445/4978] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:39.204534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:39.206381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:39.234285 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2d08ffb-27fa-4790-a79d-b777cd198af6 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action" status: 202 len: 0 microversion: 2.1 time: 1.940577 Aug 30 03:51:39.239567 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2534/4979] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:51:37 2022] POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action => generated 0 bytes in 1942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:51:39.244995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01c40a48-0754-4d23-ae6f-dd6d72fb83d2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'create', calling method: .version_select at 0x7f897b146940>, body: {"pool": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:39.263259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:39.265754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:39.267744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:39.271106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:39.275661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:39.276928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:40.759590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:40.780615 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-402996e3-6ee1-4067-9630-842983d5eec1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1315 microversion: 2.1 time: 1.581383 Aug 30 03:51:40.794569 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2446/4980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:39 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1315 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:40.812120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7688b84c-678e-47df-90b2-ad56edd5a9b5 req-8bfe40ca-567c-440d-9860-696b30a11faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:40.853629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7688b84c-678e-47df-90b2-ad56edd5a9b5 req-8bfe40ca-567c-440d-9860-696b30a11faa service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:40.854419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7688b84c-678e-47df-90b2-ad56edd5a9b5 req-8bfe40ca-567c-440d-9860-696b30a11faa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:40.857613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7688b84c-678e-47df-90b2-ad56edd5a9b5 req-8bfe40ca-567c-440d-9860-696b30a11faa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:40.909088 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7688b84c-678e-47df-90b2-ad56edd5a9b5 req-8bfe40ca-567c-440d-9860-696b30a11faa service nova] Creating event network-changed:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:51:40.939128 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7688b84c-678e-47df-90b2-ad56edd5a9b5 req-8bfe40ca-567c-440d-9860-696b30a11faa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142119 Aug 30 03:51:40.939804 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2447/4981] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:41.813726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:41.815605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:41.841641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:41.841641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:41.841641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:41.842285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:41.844873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:41.845941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:42.131775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:42.143203 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3b268dd-77bc-4543-b767-e2e81cb4b11a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1502 microversion: 2.1 time: 0.341435 Aug 30 03:51:42.144034 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2448/4982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:41 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:42.173202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94cb9274-a940-4640-a333-7ff00956ae08 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:42.191429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94cb9274-a940-4640-a333-7ff00956ae08 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:42.194080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94cb9274-a940-4640-a333-7ff00956ae08 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:42.194698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94cb9274-a940-4640-a333-7ff00956ae08 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:42.248298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94cb9274-a940-4640-a333-7ff00956ae08 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Going to try to stop instance {{(pid=122167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 03:51:42.346493 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94cb9274-a940-4640-a333-7ff00956ae08 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e/action" status: 202 len: 0 microversion: 2.1 time: 0.185528 Aug 30 03:51:42.351087 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2449/4983] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:51:42 2022] POST /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:51:42.366492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:42.370343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:42.390348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:42.391673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:42.392387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:42.394669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:42.396831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:42.397498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:42.993209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:43.004007 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d20b576d-def7-4878-b836-14642f701bb5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.648271 Aug 30 03:51:43.022513 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2450/4984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:42 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:43.034143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:43.037723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:43.045584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.046331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.050963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.052554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.053203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.053691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.134065 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb9e0f1e-21d6-4598-bb70-15ae9dbf420a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.110205 Aug 30 03:51:43.134937 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2451/4985] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:51:43 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:43.282615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:43.283104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:43.299095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.299591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.300795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.301579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.302036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.302460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.360442 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-048cb712-fb49-4825-9f73-c2c1a0971dfa tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/072c7d16-be30-4b07-be13-43f360bc21d8" status: 200 len: 194 microversion: 2.1 time: 0.084331 Aug 30 03:51:43.362367 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2452/4986] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Aug 30 03:51:43 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/072c7d16-be30-4b07-be13-43f360bc21d8 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:43.364366 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01c40a48-0754-4d23-ae6f-dd6d72fb83d2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.123175 Aug 30 03:51:43.365248 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2535/4987] 10.222.0.30 () {60 vars in 1170 bytes} [Tue Aug 30 03:51:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:43.377884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.49"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:43.381963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:43.389302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.389824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.390526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.391232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.391680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.392358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.404137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:43.407544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:43.428282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "refresh_cache-b2b410ff-2493-429d-b9cd-8c32887bbc95" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:51:43.428969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquired lock "refresh_cache-b2b410ff-2493-429d-b9cd-8c32887bbc95" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:51:43.429812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.432290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.433157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.435747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:43.436455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:43.437042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:43.469386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:43.642919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lazy-loading 'services' on Instance uuid fba4d32e-9a76-4cca-8994-bdedcee1eb8e {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:51:43.824556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9bd6ff78-64fe-4a4c-8feb-867fa7d278cc tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/072c7d16-be30-4b07-be13-43f360bc21d8" status: 202 len: 0 microversion: 2.1 time: 0.454663 Aug 30 03:51:43.830001 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2453/4988] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:51:43 2022] DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/072c7d16-be30-4b07-be13-43f360bc21d8 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:51:44.045255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:44.047606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:44.064030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:44.065451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:44.069868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:44.071434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:44.074190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:44.074862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:44.586999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:44.596046 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a9952a0-66dc-4f95-a458-1885e71663c0 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.555483 Aug 30 03:51:44.610185 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2454/4989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:44 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:45.623523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:45.625045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:45.626536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Building network info cache for instance {{(pid=122168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:51:45.640188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:45.641598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:45.643663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:45.644881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:45.648443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:45.649642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:46.063022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:46.082348 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5544edc0-f2f7-47ad-9024-8aca8709f4f4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.464437 Aug 30 03:51:46.086770 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2455/4990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:45 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:46.127377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-70b44ed6-b36c-4f3f-b7ac-ea2f4aeede02 req-e2c51bb1-d722-48b6-a626-14536466dc2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:46.158991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-70b44ed6-b36c-4f3f-b7ac-ea2f4aeede02 req-e2c51bb1-d722-48b6-a626-14536466dc2c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:46.162056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-70b44ed6-b36c-4f3f-b7ac-ea2f4aeede02 req-e2c51bb1-d722-48b6-a626-14536466dc2c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:46.163899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-70b44ed6-b36c-4f3f-b7ac-ea2f4aeede02 req-e2c51bb1-d722-48b6-a626-14536466dc2c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:46.184781 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-70b44ed6-b36c-4f3f-b7ac-ea2f4aeede02 req-e2c51bb1-d722-48b6-a626-14536466dc2c service nova] Creating event network-changed:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:51:46.207767 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-70b44ed6-b36c-4f3f-b7ac-ea2f4aeede02 req-e2c51bb1-d722-48b6-a626-14536466dc2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114285 Aug 30 03:51:46.230120 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2456/4991] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:47.112199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:47.113062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:47.124594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:47.126891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:47.130646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:47.131912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:47.132898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:47.133474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:47.994664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:48.002750 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c764d0aa-726c-4e17-96fb-dd2a47c5da50 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.895569 Aug 30 03:51:48.003340 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2457/4992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:47 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:48.011482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Updating instance_info_cache with network_info: [{"id": "fc8934e7-b135-4755-8f3c-331c62a21a39", "address": "fa:16:3e:ed:45:fc", "network": {"id": "2699ddea-22c6-4560-ac67-4af572dab1eb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1825504855-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "acfb3daea2dd4fb284f55b8c7cc30887", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfc8934e7-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:51:48.054729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Releasing lock "refresh_cache-b2b410ff-2493-429d-b9cd-8c32887bbc95" {{(pid=122168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:51:48.056179 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f1fd1f6-4f5b-4b91-8e6b-24890396cbac tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action" status: 202 len: 0 microversion: 2.1 time: 4.682630 Aug 30 03:51:48.058822 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2536/4993] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:51:43 2022] POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action => generated 0 bytes in 4686 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 30 03:51:48.068070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.49"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:48.329696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:48.339552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:48.340297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:48.341681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:48.343413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:48.345041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:48.346280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:48.716552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "refresh_cache-b2b410ff-2493-429d-b9cd-8c32887bbc95" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 03:51:48.717058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquired lock "refresh_cache-b2b410ff-2493-429d-b9cd-8c32887bbc95" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 03:51:49.025402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:49.026019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:49.050884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:49.051434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:49.051885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:49.052668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:49.053070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:49.053520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:49.559125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:49.577976 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-449cbf6a-b1a6-434f-9a8c-ef82d756a414 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.557697 Aug 30 03:51:49.581958 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2537/4994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:49 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:49.847582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Building network info cache for instance {{(pid=122167) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 03:51:49.890230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4def707f-4533-48e7-b561-926798cf70d9 req-85179420-81b4-4c91-9532-ea34a6b7394f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:49.916556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4def707f-4533-48e7-b561-926798cf70d9 req-85179420-81b4-4c91-9532-ea34a6b7394f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:49.920502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4def707f-4533-48e7-b561-926798cf70d9 req-85179420-81b4-4c91-9532-ea34a6b7394f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:49.921867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4def707f-4533-48e7-b561-926798cf70d9 req-85179420-81b4-4c91-9532-ea34a6b7394f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:49.940702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4def707f-4533-48e7-b561-926798cf70d9 req-85179420-81b4-4c91-9532-ea34a6b7394f service nova] Creating event network-changed:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:51:49.959569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4def707f-4533-48e7-b561-926798cf70d9 req-85179420-81b4-4c91-9532-ea34a6b7394f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073100 Aug 30 03:51:49.960730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2538/4995] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:51:50.615688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:50.616477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:50.630082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:50.630677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:50.631185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:50.631967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:50.635794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:50.636327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:51.150829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:51.174206 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-deb914b6-4033-4842-97db-4de7465f8e00 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.559759 Aug 30 03:51:51.178621 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2539/4996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:50 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:51.495945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Updating instance_info_cache with network_info: [{"id": "fc8934e7-b135-4755-8f3c-331c62a21a39", "address": "fa:16:3e:ed:45:fc", "network": {"id": "2699ddea-22c6-4560-ac67-4af572dab1eb", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1825504855-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "acfb3daea2dd4fb284f55b8c7cc30887", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfc8934e7-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 03:51:51.513403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Releasing lock "refresh_cache-b2b410ff-2493-429d-b9cd-8c32887bbc95" {{(pid=122167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 03:51:51.514515 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce202153-8e30-4cab-b2f9-dcfba6044592 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action" status: 202 len: 0 microversion: 2.1 time: 3.451551 Aug 30 03:51:51.519525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2458/4997] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:51:48 2022] POST /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95/action => generated 0 bytes in 3454 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 03:51:51.531722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b971cc64-9d8c-491f-aac2-1e41adfd6690 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '.version_select at 0x7f8983b10af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:52.196028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:52.198271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:52.231114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:52.231612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:52.232080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:52.233870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:52.235974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:52.236828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:52.810939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:52.831141 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00175f3a-df6d-4de3-aca3-28d4757ac116 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.638901 Aug 30 03:51:52.832388 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2459/4998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:52 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:52.839465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:52.839958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:52.855215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=68 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:52.868826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:52.869657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:52.870481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:52.871630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:52.872247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:52.873109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:52.922110 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7506bd11-b8c3-4154-be36-8cbfa3e75f87 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/f497af2b-dbd9-439a-92f1-b9f51b008d93" status: 200 len: 194 microversion: 2.1 time: 0.087740 Aug 30 03:51:52.929957 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2460/4999] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Aug 30 03:51:52 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/f497af2b-dbd9-439a-92f1-b9f51b008d93 => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:52.943972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:52.944516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:52.954244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:52.954798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:52.957662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:52.962010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:52.962303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:52.963014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:53.007593 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b971cc64-9d8c-491f-aac2-1e41adfd6690 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/46fe3611-5eae-43ed-8009-f7cd4b95a667" status: 202 len: 0 microversion: 2.1 time: 1.483287 Aug 30 03:51:53.008187 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2540/5000] 10.222.0.30 () {58 vars in 1263 bytes} [Tue Aug 30 03:51:51 2022] DELETE /compute/v2.1/os-floating-ips/46fe3611-5eae-43ed-8009-f7cd4b95a667 => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:51:53.019582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6978ba21-bdaa-4f90-b972-61fb03dc24f0 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '.version_select at 0x7f8983af15e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:53.147867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lazy-loading 'services' on Instance uuid fba4d32e-9a76-4cca-8994-bdedcee1eb8e {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:51:53.356735 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3b1a931-b207-4046-990e-d2eb28cf09ad tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/f497af2b-dbd9-439a-92f1-b9f51b008d93" status: 202 len: 0 microversion: 2.1 time: 0.421418 Aug 30 03:51:53.357854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2461/5001] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:51:52 2022] DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments/f497af2b-dbd9-439a-92f1-b9f51b008d93 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:51:53.483710 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6978ba21-bdaa-4f90-b972-61fb03dc24f0 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e4f47e04-36e1-4374-8ccb-ca1ce7b4b192" status: 202 len: 0 microversion: 2.1 time: 0.467745 Aug 30 03:51:53.485748 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2541/5002] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 03:51:53 2022] DELETE /compute/v2.1/os-security-groups/e4f47e04-36e1-4374-8ccb-ca1ce7b4b192 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:51:53.493817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:53.494672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:53.508559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:53.512007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:53.512829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:53.514111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:53.514911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:53.517070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:53.579156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:51:53.760012 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8caeef80-52f4-4778-b8c4-48acd0236022 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 204 len: 0 microversion: 2.1 time: 0.269579 Aug 30 03:51:53.762218 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2462/5003] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:51:53 2022] DELETE /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:51:53.778375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:53.783082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:53.800945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:53.807608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:53.809889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:53.812343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:53.815781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:53.817135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:53.857586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:53.859539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:53.872821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:53.876146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:53.877158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:53.881895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:53.882406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:53.885745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:54.163096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:54.178255 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4fc2f83d-1400-40b4-9edb-5ec07b24031f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.323886 Aug 30 03:51:54.178897 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2463/5004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:53 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:54.193050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:54.202633 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4743a98b-ff46-40f4-8823-08247c41214c tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1511 microversion: 2.1 time: 0.431175 Aug 30 03:51:54.203205 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2542/5005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:53 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:55.202593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:55.203772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:55.212365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:55.213095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:55.213741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:55.214577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:55.215187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:55.215757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:55.223872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:55.225055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:55.252317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:55.255154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:55.255976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:55.260098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:55.262907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:55.263576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:55.684063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:55.694057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6605302d-b582-4348-99ab-1c7e4f157576 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1511 microversion: 2.1 time: 0.473757 Aug 30 03:51:55.694719 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2543/5006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:55 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:51:55.721180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:55.731882 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ba2bd67-0e31-43ba-a8de-990349628ea5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.536563 Aug 30 03:51:55.733491 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2464/5007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:55 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:56.715827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:56.717181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:56.728209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:56.732676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:56.734914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:56.736814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:56.740457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:56.741705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:56.761729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:56.761729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:56.773837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:56.778056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:56.778548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:56.779292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:56.779754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:56.780180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:57.522006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:57.534372 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dbee9ee-87b2-4ce9-9ffb-f415ea4bb950 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.783507 Aug 30 03:51:57.535235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2465/5008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:56 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:57.565960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb0567a32cb44424ac6c76970f3740e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfb3daea2dd4fb284f55b8c7cc30887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:57.581467 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-20ca48cc-b8d7-4809-afb5-42298e2047a2 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 200 len: 1511 microversion: 2.1 time: 0.869477 Aug 30 03:51:57.582070 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2544/5009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:56 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 1511 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:57.919394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a09b3ecd-7033-4547-907d-025ece45c0e6 req-0185cac7-8f6d-4178-9a66-458acde56d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b410ff-2493-429d-b9cd-8c32887bbc95", "name": "network-vif-deleted", "tag": "fc8934e7-b135-4755-8f3c-331c62a21a39"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:51:57.931348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a09b3ecd-7033-4547-907d-025ece45c0e6 req-0185cac7-8f6d-4178-9a66-458acde56d67 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:57.932083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a09b3ecd-7033-4547-907d-025ece45c0e6 req-0185cac7-8f6d-4178-9a66-458acde56d67 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:57.932669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a09b3ecd-7033-4547-907d-025ece45c0e6 req-0185cac7-8f6d-4178-9a66-458acde56d67 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:57.965575 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a09b3ecd-7033-4547-907d-025ece45c0e6 req-0185cac7-8f6d-4178-9a66-458acde56d67 service nova] Creating event network-vif-deleted:fc8934e7-b135-4755-8f3c-331c62a21a39 for instance b2b410ff-2493-429d-b9cd-8c32887bbc95 on n-h2-854924-5 Aug 30 03:51:57.974651 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a09b3ecd-7033-4547-907d-025ece45c0e6 req-0185cac7-8f6d-4178-9a66-458acde56d67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060270 Aug 30 03:51:57.976518 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2466/5010] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:51:58.561888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:58.563274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:58.586711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:58.588902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:58.590399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:58.591283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:58.592763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:58.594251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:58.606196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:58.606618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=78,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:58.607047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] [instance: b2b410ff-2493-429d-b9cd-8c32887bbc95] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:58.621578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:58.622088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:58.622536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:58.623456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:58.624073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:58.626751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:58.643798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:51:58.671403 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] HTTP exception thrown: Instance b2b410ff-2493-429d-b9cd-8c32887bbc95 could not be found. Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Request method failure captured: Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 HTTP/1.1 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYkNwCtb4TiYQiM1AK0eb4p_QqUc57le4sTYKiCbcKjAdyWJ7UtykOViyOSPgHbQxBlBcDJfNWbDC-KsoOvRGFSoqNzP2q0DMZNO3JoQyPPpNpCETw2FtaLWn4n0TMOzZfg7e1utgCIsEsA4xJVSXHkphsp4FUBEijIsrHgkAq2lYdk Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: acfb3daea2dd4fb284f55b8c7cc30887 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-399547572 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/acfb3daea2dd4fb284f55b8c7cc30887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/acfb3daea2dd4fb284f55b8c7cc30887"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_acfb3daea2dd4fb284f55b8c7cc30887", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/acfb3daea2dd4fb284f55b8c7cc30887"}]}] Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-399547572 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: acfb3daea2dd4fb284f55b8c7cc30887 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-399547572 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerRescueTestJSONUnderV235-399547572-project Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: eb0567a32cb44424ac6c76970f3740e7 Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-399547572-project Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance b2b410ff-2493-429d-b9cd-8c32887bbc95 could not be found. Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'b2b410ff-2493-429d-b9cd-8c32887bbc95'} Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b410ff-2493-429d-b9cd-8c32887bbc95 could not be found. Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b410ff-2493-429d-b9cd-8c32887bbc95 could not be found. Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:58.683393 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b410ff-2493-429d-b9cd-8c32887bbc95 could not be found. Aug 30 03:51:58.687169 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:51:58.689498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] Returning 404 to user: Instance b2b410ff-2493-429d-b9cd-8c32887bbc95 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:51:58.690573 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8653880-7456-4d69-ae48-e2fe0a3726c3 tempest-ServerRescueTestJSONUnderV235-399547572 tempest-ServerRescueTestJSONUnderV235-399547572-project] 10.222.0.30 "GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95" status: 404 len: 111 microversion: 2.1 time: 0.089429 Aug 30 03:51:58.691647 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2467/5011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:58 2022] GET /compute/v2.1/servers/b2b410ff-2493-429d-b9cd-8c32887bbc95 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:51:58.840645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:51:58.851922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-531c2f9e-78ba-4b67-b9a3-48904cd47b98 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.296231 Aug 30 03:51:58.853085 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2545/5012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:58 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:51:59.874237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:51:59.875187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:51:59.899523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:59.902372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:59.905103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:51:59.907953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:51:59.909483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:51:59.912018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:00.185451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:00.196602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ce1d8531-1f4a-406d-bf08-9d2d880c5a38 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.327060 Aug 30 03:52:00.199465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2468/5013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:51:59 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:01.219873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:01.220487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:01.226770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=26 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:01.228606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:01.229314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:01.230020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:01.231032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:01.231454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:01.232185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:01.514604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:01.527045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5c36d66d-69af-4bd9-a5b9-11b6ce9b1882 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.310967 Aug 30 03:52:01.528147 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2546/5014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:01 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:02.549838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:02.550453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:02.562555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:02.565793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:02.568101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:02.569391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:02.570901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:02.572658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:02.836338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:02.851023 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7914647c-f553-4d4e-a943-a6d5a7413048 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.305194 Aug 30 03:52:02.851803 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2469/5015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:02 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:03.872409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:03.873029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:03.880844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:03.881793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:03.882352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:03.883565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:03.884253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:03.884890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:04.068477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:04.078641 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67fd0558-66b6-4978-a22b-18537ae60dae tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.209991 Aug 30 03:52:04.080789 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2547/5016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:03 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:04.689383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:04.705872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:04.716319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:04.716830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:04.720752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:04.721573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:04.726854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:04.728493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:04.846162 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b87a028-2703-471e-a7f6-b92d8ec9b545 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.159806 Aug 30 03:52:04.848435 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2470/5017] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:52:04 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:52:05.101891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:05.102772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:05.108459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:05.111062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:05.113274 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 03:52:05.114210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.114343 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 03:52:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments (ip 10.222.0.30) !!! Aug 30 03:52:05.118094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.119262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.120187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.120889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.121773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.141386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.143127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.143835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.148469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.151515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.155009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.234147 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d0fe9b20-db1b-4588-8ea5-440ec81ec9a0 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149914 Aug 30 03:52:05.235539 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2548/5018] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:52:05 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:52:05.317846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:05.318669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:05.354878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.375225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.377407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.384207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.385092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.386916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.463477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:52:05.608037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:05.625454 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-992699bf-afd3-4a39-bf17-1f69c8213d70 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.526218 Aug 30 03:52:05.637742 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2471/5019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:05 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:05.650377 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1abe01a9-59a1-43c5-a1be-52da998275fe tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 204 len: 0 microversion: 2.1 time: 0.330621 Aug 30 03:52:05.657124 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2549/5020] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:05 2022] DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:52:05.667311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:05.668146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:05.675225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.675701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.676186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.677710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:05.678183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:05.678799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:05.950778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:05.962746 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-56ee8c6c-5487-48fd-ba38-c8c7d41be8f9 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1671 microversion: 2.1 time: 0.300018 Aug 30 03:52:05.965246 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2472/5021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:05 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1671 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:06.653857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:06.653857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:06.664214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:06.667750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:06.668395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:06.669290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:06.674310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:06.674972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:06.973405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:06.990151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:06.991743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:07.003415 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc93e9c0-4ab6-4f62-8ec4-ce377771c9c1 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1512 microversion: 2.1 time: 0.358227 Aug 30 03:52:07.022754 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2550/5022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:06 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:07.024363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:07.025085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:07.025878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:07.027539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:07.028330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:07.029490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:07.458624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:07.485863 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af41430d-e48f-48ba-b4ee-9b29c2cb672d tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1671 microversion: 2.1 time: 0.499314 Aug 30 03:52:07.487289 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2473/5023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:06 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1671 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:08.027926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:08.028542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:08.042492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:08.043313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:08.043943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:08.045057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:08.047853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:08.048495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:08.508849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:08.509722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:08.546393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:08.546929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:08.547507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:08.548587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:08.550909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:08.553940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:08.663929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:08.688813 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9a409898-6a7d-4d16-a57d-0bf955b4639b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1489 microversion: 2.1 time: 0.663257 Aug 30 03:52:08.709026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2551/5024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:08 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1489 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:08.729575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:08.730892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:08.759529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:08.768170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:08.774606 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16b0454c-72cd-4d71-b373-426fc091df51 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1604 microversion: 2.1 time: 0.270580 Aug 30 03:52:08.776251 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2474/5025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:08 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1604 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:08.777175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:08.782153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:08.787390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:08.788308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:08.788908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:08.902307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:52:09.116409 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d612ebeb-be5b-4ef2-b05b-27f35b850c4b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 204 len: 0 microversion: 2.1 time: 0.404477 Aug 30 03:52:09.118698 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2552/5026] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:08 2022] DELETE /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:52:09.126893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:09.127509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:09.146970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:09.147743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:09.148439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:09.149310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:09.152286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:09.152918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:09.798191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:09.798971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:09.812421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:09.812954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:09.813425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:09.814162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:09.814614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:09.820043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:10.255486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:10.266378 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49d1c337-efd2-40b4-b865-72ea6a04e76a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1604 microversion: 2.1 time: 0.473607 Aug 30 03:52:10.285111 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2553/5027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:09 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1604 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:10.508053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-32c849c4-5664-41ae-b0f6-c2a64a2f00ac req-77643bfe-0ebd-4ef2-a48c-fa9530f1a498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba4d32e-9a76-4cca-8994-bdedcee1eb8e", "name": "network-vif-deleted", "tag": "c1bbbe22-9168-4dbf-a0be-310da849d63d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:10.525937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:10.536757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69284344-a2e5-4e9e-9220-46c158bcc745 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1495 microversion: 2.1 time: 1.413717 Aug 30 03:52:10.543450 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2475/5028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:09 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1495 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:10.546322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-32c849c4-5664-41ae-b0f6-c2a64a2f00ac req-77643bfe-0ebd-4ef2-a48c-fa9530f1a498 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:10.549773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-32c849c4-5664-41ae-b0f6-c2a64a2f00ac req-77643bfe-0ebd-4ef2-a48c-fa9530f1a498 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:10.558046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-32c849c4-5664-41ae-b0f6-c2a64a2f00ac req-77643bfe-0ebd-4ef2-a48c-fa9530f1a498 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:10.605892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-32c849c4-5664-41ae-b0f6-c2a64a2f00ac req-77643bfe-0ebd-4ef2-a48c-fa9530f1a498 service nova] Creating event network-vif-deleted:c1bbbe22-9168-4dbf-a0be-310da849d63d for instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e on n-h2-854924-5 Aug 30 03:52:10.617081 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-32c849c4-5664-41ae-b0f6-c2a64a2f00ac req-77643bfe-0ebd-4ef2-a48c-fa9530f1a498 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113091 Aug 30 03:52:10.619661 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2554/5029] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:52:11.292822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:11.293641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:11.322968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:11.327156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:11.328794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:11.330639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:11.340904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:11.343103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:11.476926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:11.478219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:11.479254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:11.480790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lazy-loading 'fault' on Instance uuid fba4d32e-9a76-4cca-8994-bdedcee1eb8e {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:52:11.562028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:11.562898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:11.574886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:11.583097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:11.586073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:11.593506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:11.594157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:11.594712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:11.775078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51986d3cb9614471bce790af1e6be2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ccee9310d244210867a17f0d093c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:11.813819 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-09b1f0df-22ab-489c-8550-2e0ddcf542bf tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 200 len: 1327 microversion: 2.1 time: 0.524420 Aug 30 03:52:11.821175 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2476/5030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:11 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 1327 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:11.960818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:11.969494 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12c5f100-2b84-4b0c-97e8-e89d25c0454e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1453 microversion: 2.1 time: 0.412092 Aug 30 03:52:11.975425 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2555/5031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:11 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1453 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:12.678451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e1b5093f-dd56-4e19-9866-a4b0856359e5 req-73fd0208-7a65-4c2b-ba95-c243ea9b5c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceed52f1-027d-462b-bf29-fa6f14d6d16e", "name": "network-vif-deleted", "tag": "0a3e86a7-b495-457b-a284-cf3ef21047da"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:12.712030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e1b5093f-dd56-4e19-9866-a4b0856359e5 req-73fd0208-7a65-4c2b-ba95-c243ea9b5c32 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:12.712526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e1b5093f-dd56-4e19-9866-a4b0856359e5 req-73fd0208-7a65-4c2b-ba95-c243ea9b5c32 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:12.712965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e1b5093f-dd56-4e19-9866-a4b0856359e5 req-73fd0208-7a65-4c2b-ba95-c243ea9b5c32 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:12.746101 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e1b5093f-dd56-4e19-9866-a4b0856359e5 req-73fd0208-7a65-4c2b-ba95-c243ea9b5c32 service nova] Creating event network-vif-deleted:0a3e86a7-b495-457b-a284-cf3ef21047da for instance ceed52f1-027d-462b-bf29-fa6f14d6d16e on n-h1-854924-5 Aug 30 03:52:12.762296 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e1b5093f-dd56-4e19-9866-a4b0856359e5 req-73fd0208-7a65-4c2b-ba95-c243ea9b5c32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089610 Aug 30 03:52:12.768353 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2477/5032] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:52:12.844073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:12.844845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:12.856305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:12.858470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:12.859148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:12.870661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:12.871396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:12.872301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:12.919738 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] HTTP exception thrown: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Request method failure captured: Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e HTTP/1.1 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfqOxGvJIyD11qN793mFIKA4isSZ8dhEynAuoqQnQzxbNqD_xFozIZ9C-mFASEGolD3Ckd0QqvUpB3fd2iSOSX_k792UN4D9BUl6ne5gz7FNvU786QgbMbNQkV1I9C9OcVzTa56Qztbw2-t6jsCBaXuGQZXP_dud4Ru0gGZ-1T9_IQ Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1ccee9310d244210867a17f0d093c18e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}] Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 51986d3cb9614471bce790af1e6be2df Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'fba4d32e-9a76-4cca-8994-bdedcee1eb8e'} Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:12.924098 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:12.929336 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:12.931890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Returning 404 to user: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:12.932905 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b9bc098-95b6-427f-95d4-fe9450feb677 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 404 len: 111 microversion: 2.1 time: 0.092713 Aug 30 03:52:12.938486 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2556/5033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:12 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:12.944002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-01bfd488-a7ca-424a-9741-c34c08982d6a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '.version_select at 0x7f897a662b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:12.993277 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-01bfd488-a7ca-424a-9741-c34c08982d6a tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802331843" status: 202 len: 0 microversion: 2.1 time: 0.050287 Aug 30 03:52:12.995409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:12.996126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:12.997631 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2478/5034] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802331843 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:52:13.009442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:13.010301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:13.011778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:13.012618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:13.017875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:13.018509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:13.098144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:13.105312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:13.108919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:13.109740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'fault' on Instance uuid ceed52f1-027d-462b-bf29-fa6f14d6d16e {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:52:13.219270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:13.229854 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b78fc1b-4297-46f3-a8b8-a9fe9a35fe0f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 200 len: 1305 microversion: 2.1 time: 0.236851 Aug 30 03:52:13.251441 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2557/5035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:12 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 1305 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:14.267664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:14.268426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:14.304229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:14.304758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:14.309036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:14.316016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:14.317961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:14.320043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:14.351934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e HTTP/1.1 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'ceed52f1-027d-462b-bf29-fa6f14d6d16e'} Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:14.355043 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:14.359506 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:14.362067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:14.365276 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-79142fcc-a953-40b9-9762-f4e7b8c27425 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 404 len: 111 microversion: 2.1 time: 0.102727 Aug 30 03:52:14.367116 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2479/5036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:14 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:14.606955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-897123660", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b84074f5-a647-4fad-92ef-b14acda3cc9c"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:14.700353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] validate_networks() for [('b84074f5-a647-4fad-92ef-b14acda3cc9c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:52:15.849404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:52:15.850875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:52:15.851563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:52:15.852254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:52:15.852906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:52:15.867590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:15.868407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:15.869038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:15.870313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:15.870983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:15.871618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:15.898669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:52:15.907503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Getting quotas for user 337b71d69dc44a4a8535d9b50970a257 and project 85252a708aa04c8ea67e99cd5371cda6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:52:15.926746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:52:15.932027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:52:16.044970 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1057529-d8f8-4346-a0d9-7edc5fdab9ce tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441755 Aug 30 03:52:16.046300 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2558/5037] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:52:16.057293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b88a7d6-36e6-46da-aa63-703756a1a3b9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:16.058106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b88a7d6-36e6-46da-aa63-703756a1a3b9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:16.216039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b88a7d6-36e6-46da-aa63-703756a1a3b9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:16.229807 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b88a7d6-36e6-46da-aa63-703756a1a3b9 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1214 microversion: 2.1 time: 0.176794 Aug 30 03:52:16.230500 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2480/5038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:16 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:17.253288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:17.255636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:17.277621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-123816761", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:17.307309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:17.307823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:17.310668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:17.311493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:17.314607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:17.317250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:17.412587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] validate_networks() for [('07d29dc9-8f29-4ac8-8930-7202444edbb4', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:52:17.548783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:17.557902 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dc74b156-5acf-4217-9ffe-473bfc884560 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1210 microversion: 2.1 time: 0.308529 Aug 30 03:52:17.564907 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2481/5039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:17 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1210 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:18.569548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:52:18.569968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:52:18.570442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:52:18.570854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:52:18.571263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:52:18.589305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:18.590894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:18.596154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:18.599382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:18.601685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:18.607372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:18.607681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:18.607854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:18.608467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:18.608869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:18.609613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:18.612036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:18.613444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:18.614160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:18.677099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for project 443099fa08af4020bb1ff6703de1123b. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:52:18.693856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for user 893eddb05e4349f1ae6c8242647a52c6 and project 443099fa08af4020bb1ff6703de1123b. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:52:18.714085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:52:18.716727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:52:18.825007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:18.835023 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e0c4aeff-4c2b-40a1-b98f-a61b35cc4f56 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1272 microversion: 2.1 time: 0.250205 Aug 30 03:52:18.838669 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2482/5040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:18 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:18.847049 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9b4676e-f322-4a37-9db4-9bd4f458a1db tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.075265 Aug 30 03:52:18.847766 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2559/5041] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:52:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:52:18.862759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c88909d2-62fa-4da4-8c5f-f671ca2d2d3e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:18.864781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c88909d2-62fa-4da4-8c5f-f671ca2d2d3e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:18.982403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c88909d2-62fa-4da4-8c5f-f671ca2d2d3e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:18.993681 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c88909d2-62fa-4da4-8c5f-f671ca2d2d3e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1221 microversion: 2.1 time: 0.138088 Aug 30 03:52:19.001524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2483/5042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:18 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:19.072181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-220128915", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:19.227739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] validate_networks() for [('07d29dc9-8f29-4ac8-8930-7202444edbb4', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:52:19.855797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:19.858945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:19.887553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:19.888426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:19.893154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:19.895479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:19.897755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:19.901003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:20.394162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:20.407652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe7f4e3a-dd7a-4809-a683-6b1e7cce86a3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1272 microversion: 2.1 time: 0.555526 Aug 30 03:52:20.424028 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2484/5043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:19 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1272 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:20.988824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:52:20.990204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:52:20.991093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:52:20.991724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:52:20.992355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:52:21.008603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:21.009443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:21.010399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:21.012315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:21.015843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:21.020116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:21.154115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for project 443099fa08af4020bb1ff6703de1123b. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:52:21.173981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for user 893eddb05e4349f1ae6c8242647a52c6 and project 443099fa08af4020bb1ff6703de1123b. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:52:21.235580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:52:21.238390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:52:21.435556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:21.437047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:21.442363 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7482f799-3cae-4af7-9ce5-022d4d810bd4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.374070 Aug 30 03:52:21.443853 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2560/5044] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:52:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:52:21.464043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08f31766-d4ed-47f8-b157-0267136e1a97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:21.465137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08f31766-d4ed-47f8-b157-0267136e1a97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:21.486788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:21.490422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:21.491283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:21.492737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:21.493716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:21.497635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:21.755789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08f31766-d4ed-47f8-b157-0267136e1a97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:21.791258 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08f31766-d4ed-47f8-b157-0267136e1a97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1221 microversion: 2.1 time: 0.340446 Aug 30 03:52:21.831233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2561/5045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:21 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1221 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:22.543305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:22.559361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32c10f5b-0feb-4839-b655-a604c17e66a4 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 1.129925 Aug 30 03:52:22.561519 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2485/5046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:21 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:22.822473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:22.826953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:22.856533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:22.856911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:22.857372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:22.858074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:22.864731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:22.866251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:22.930987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:23.313964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:23.334208 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5443e8e-618f-44d1-868d-91a3b28a7e40 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1217 microversion: 2.1 time: 0.519773 Aug 30 03:52:23.337098 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2562/5047] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:22 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1217 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:23.589466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:23.590340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:23.616940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:23.622945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:23.623547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:23.627814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:23.630995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:23.632469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:23.633498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:24.362283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:24.364567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:24.389285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:24.395114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:24.399414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:24.403032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:24.405542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:24.406392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:24.660323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:24.674926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81dfdfec-ea4c-4204-80cd-960c65ae03b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1279 microversion: 2.1 time: 0.318792 Aug 30 03:52:24.676648 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2563/5048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:24 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1279 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:24.818203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:24.841676 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-884e048b-d0a1-4470-975c-11b085e1091b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 1.253129 Aug 30 03:52:24.866235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2486/5049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:23 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:25.701659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:25.702888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:25.720144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:25.724682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:25.727286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:25.729041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:25.746681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:25.747514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:25.863968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:25.865123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:25.886230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:25.887738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:25.888185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:25.893103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:25.893612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:25.894055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:26.465067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:26.484092 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ddcac695-383f-4066-8858-04e075145efe tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1279 microversion: 2.1 time: 0.788979 Aug 30 03:52:26.484981 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2564/5050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:25 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1279 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:26.823006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0effe27b-eeec-49a4-870c-053098a72d5d req-fb3cf05c-5265-48c8-a0df-cb100022dff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45618bb0-802a-4ad1-89bd-789fce53f7d1", "tag": "6be35fed-490a-409f-bad2-a411cc374dbd"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:26.862621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0effe27b-eeec-49a4-870c-053098a72d5d req-fb3cf05c-5265-48c8-a0df-cb100022dff6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:26.863169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0effe27b-eeec-49a4-870c-053098a72d5d req-fb3cf05c-5265-48c8-a0df-cb100022dff6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:26.863604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0effe27b-eeec-49a4-870c-053098a72d5d req-fb3cf05c-5265-48c8-a0df-cb100022dff6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:26.916922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0effe27b-eeec-49a4-870c-053098a72d5d req-fb3cf05c-5265-48c8-a0df-cb100022dff6 service nova] Creating event network-changed:6be35fed-490a-409f-bad2-a411cc374dbd for instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 on n-h2-854924-5 Aug 30 03:52:26.932948 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0effe27b-eeec-49a4-870c-053098a72d5d req-fb3cf05c-5265-48c8-a0df-cb100022dff6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113613 Aug 30 03:52:26.938577 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2565/5051] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:52:27.506200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:27.506926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:27.523139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:27.526066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:27.529314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:27.530460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:27.530949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:27.531386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:28.846675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:28.856229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-487d9ddc-6711-4125-8289-8ee861a4b87f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 1.355009 Aug 30 03:52:28.891794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2566/5052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:27 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:28.990660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:29.152445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:29.167055 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c33f2ddb-71af-4a61-a84d-23e8d2645e96 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 3.307836 Aug 30 03:52:29.186722 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2487/5053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:25 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 3328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:29.643760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-aa9b6f05-547c-4480-8b1d-b5a5109d04ba req-9bf2ff9a-864d-4869-8e94-01d976df5a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e65a105-1bf1-470f-96aa-5c1230c8feb2", "tag": "d0cfdb73-9146-43b6-801e-e49974e2ed0a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:29.664140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:29.666650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-aa9b6f05-547c-4480-8b1d-b5a5109d04ba req-9bf2ff9a-864d-4869-8e94-01d976df5a20 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:29.666650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-aa9b6f05-547c-4480-8b1d-b5a5109d04ba req-9bf2ff9a-864d-4869-8e94-01d976df5a20 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:29.667052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-aa9b6f05-547c-4480-8b1d-b5a5109d04ba req-9bf2ff9a-864d-4869-8e94-01d976df5a20 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:29.694784 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-aa9b6f05-547c-4480-8b1d-b5a5109d04ba req-9bf2ff9a-864d-4869-8e94-01d976df5a20 service nova] Creating event network-changed:d0cfdb73-9146-43b6-801e-e49974e2ed0a for instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 on n-h2-854924-5 Aug 30 03:52:29.702078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-aa9b6f05-547c-4480-8b1d-b5a5109d04ba req-9bf2ff9a-864d-4869-8e94-01d976df5a20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060961 Aug 30 03:52:29.709756 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2567/5054] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:52:29.900633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:29.901892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:29.935533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:29.936040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:29.937792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:29.944794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:29.945426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:29.945876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:29.973637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:30.149867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d140937d-53de-49ae-994a-5b5ef3f24807 req-d7ac1b4a-4b71-4b83-80ea-924346f270a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107047cd-b29d-4755-bbba-a93485e564c3", "tag": "f4e5dd2d-5ed0-4cfe-96ca-33d12713de10"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:30.171855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d140937d-53de-49ae-994a-5b5ef3f24807 req-d7ac1b4a-4b71-4b83-80ea-924346f270a7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:30.173402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d140937d-53de-49ae-994a-5b5ef3f24807 req-d7ac1b4a-4b71-4b83-80ea-924346f270a7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:30.174380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d140937d-53de-49ae-994a-5b5ef3f24807 req-d7ac1b4a-4b71-4b83-80ea-924346f270a7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:30.245422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d140937d-53de-49ae-994a-5b5ef3f24807 req-d7ac1b4a-4b71-4b83-80ea-924346f270a7 service nova] Creating event network-changed:f4e5dd2d-5ed0-4cfe-96ca-33d12713de10 for instance 107047cd-b29d-4755-bbba-a93485e564c3 on n-h1-854924-5 Aug 30 03:52:30.251744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d140937d-53de-49ae-994a-5b5ef3f24807 req-d7ac1b4a-4b71-4b83-80ea-924346f270a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107493 Aug 30 03:52:30.252703 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2568/5055] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:52:30.269571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:30.270570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:30.278653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:30.288224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:30.288925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:30.289936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:30.290601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:30.291245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:30.525824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:30.525824 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38efe368-a4f9-4970-beb7-5e026fdfc817 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.627045 Aug 30 03:52:30.549713 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2488/5056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:29 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:30.785318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:30.793260 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9319f461-9b52-4655-a052-730841e1eb14 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 0.539009 Aug 30 03:52:30.793854 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2569/5057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:30 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:31.543275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:31.543903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:31.556934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:31.557457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:31.557901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:31.558604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:31.559057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:31.559478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:31.816196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:31.817056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:31.828631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:31.831107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=20 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:31.832600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:31.834874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:31.840138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:31.841137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:31.843462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:31.843909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:31.908089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:31.924084 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-449e2422-271e-4446-80ec-ceb973457f52 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.384507 Aug 30 03:52:31.942842 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2489/5058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:31 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:32.215570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:32.237227 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-655bad2b-fbf5-4743-970c-3819ab435ec2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 0.424902 Aug 30 03:52:32.259108 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2570/5059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:31 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:32.823230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:32.824412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:32.838924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:32.839424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:32.842775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:32.843537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:32.848929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:32.849415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:32.907244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] HTTP exception thrown: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Request method failure captured: Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e HTTP/1.1 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYfqOxGvJIyD11qN793mFIKA4isSZ8dhEynAuoqQnQzxbNqD_xFozIZ9C-mFASEGolD3Ckd0QqvUpB3fd2iSOSX_k792UN4D9BUl6ne5gz7FNvU786QgbMbNQkV1I9C9OcVzTa56Qztbw2-t6jsCBaXuGQZXP_dud4Ru0gGZ-1T9_IQ Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1ccee9310d244210867a17f0d093c18e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}] Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 51986d3cb9614471bce790af1e6be2df Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'fba4d32e-9a76-4cca-8994-bdedcee1eb8e'} Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:32.916414 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Returning 404 to user: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:32.920772 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b38fda88-9e95-4ccb-b62a-84c7b59a9162 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 404 len: 111 microversion: 2.1 time: 0.099336 Aug 30 03:52:32.924745 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2490/5060] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:32 2022] DELETE /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:32.929012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:32.929649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: fba4d32e-9a76-4cca-8994-bdedcee1eb8e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:32.940271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:32.943669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:32.944307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:32.950134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:32.950765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:32.951346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:32.951848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:32.955927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:32.980166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:32.980712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:32.981279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:32.982141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:32.983601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] HTTP exception thrown: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Request method failure captured: Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e HTTP/1.1 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfqOxGvJIyD11qN793mFIKA4isSZ8dhEynAuoqQnQzxbNqD_xFozIZ9C-mFASEGolD3Ckd0QqvUpB3fd2iSOSX_k792UN4D9BUl6ne5gz7FNvU786QgbMbNQkV1I9C9OcVzTa56Qztbw2-t6jsCBaXuGQZXP_dud4Ru0gGZ-1T9_IQ Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1ccee9310d244210867a17f0d093c18e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}] Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 51986d3cb9614471bce790af1e6be2df Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'fba4d32e-9a76-4cca-8994-bdedcee1eb8e'} Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:32.987350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. Aug 30 03:52:32.991075 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:32.992458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:32.993153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:32.994249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Returning 404 to user: Instance fba4d32e-9a76-4cca-8994-bdedcee1eb8e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:32.997604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e8936168-ab39-4b3b-b2c5-db5bd080ebae tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e" status: 404 len: 111 microversion: 2.1 time: 0.072592 Aug 30 03:52:32.998941 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2571/5061] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:32 2022] GET /compute/v2.1/servers/fba4d32e-9a76-4cca-8994-bdedcee1eb8e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:52:33.268004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:33.269827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:33.289036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:33.289471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:33.290094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:33.290988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:33.291540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:33.292633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:33.627604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:33.647916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-faefdfd7-e792-4402-8c0c-3c33b433de0d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.703326 Aug 30 03:52:33.651204 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2491/5062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:32 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:34.267408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:34.280369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c2243aa-4a3a-41f6-ae9a-6d033ba27cf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 1.016904 Aug 30 03:52:34.295498 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2572/5063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:33 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:34.669697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:34.670319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:34.691089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:34.691737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:34.692549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:34.692946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:34.693441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:34.693875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:35.260519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:35.272824 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-158c6b0b-e4a7-4423-b02c-6793049daa28 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.607833 Aug 30 03:52:35.305247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:35.308474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:35.311837 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2492/5064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:34 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:35.335285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:35.337032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:35.338506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:35.344215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:35.354941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:35.359009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:35.549685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:35.561757 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a604d37-71e2-49bc-a1b2-6adcd3efab51 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 0.261768 Aug 30 03:52:35.562614 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2573/5065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:35 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:36.317112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:36.317774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:36.331004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:36.331505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:36.337231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:36.344005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:36.344005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:36.344005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:36.708744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:36.710121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:36.720724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:36.723109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:36.725913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:36.727163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:36.729955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:36.730393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:36.733579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:36.741420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17fe4cdf-8f54-4e4c-8eb8-2d24d7b1c4a3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.428360 Aug 30 03:52:36.746533 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2574/5066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:36 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:36.759564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:36.761199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:36.783214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:36.785900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:36.787562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:36.797888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:36.797888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:36.797888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:36.818105 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f318c03f-171b-42b5-aecb-27fca231edc7 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/ips" status: 200 len: 150 microversion: 2.20 time: 0.706061 Aug 30 03:52:36.825739 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2493/5067] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Aug 30 03:52:36 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/ips => generated 150 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:52:37.038584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:37.051090 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb429895-9cf1-4070-8972-c56b49de592a tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 0.302808 Aug 30 03:52:37.051921 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2575/5068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:36 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:37.765215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:37.765961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:37.777513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:37.779699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:37.781122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:37.782321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:37.784252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:37.785946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:38.059413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:38.071688 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e552bb3a-e302-4efe-a033-05702a15f2c1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.310715 Aug 30 03:52:38.075709 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2494/5069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:37 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:38.086716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:38.092278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:38.141865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:38.143930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:38.146642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:38.147858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:38.150663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:38.152764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:38.419265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:38.442335 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5027b5c-7e8b-4a1d-a28a-241e3bce7555 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 0.372498 Aug 30 03:52:38.442982 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2576/5070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:38 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:38.469088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7cd9a0dd-c1bf-45c4-9e68-9d5d8eddef52 req-a0198963-7f50-4479-b73b-69c4bbee0e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45618bb0-802a-4ad1-89bd-789fce53f7d1", "name": "network-vif-plugged", "status": "completed", "tag": "6be35fed-490a-409f-bad2-a411cc374dbd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:38.492843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7cd9a0dd-c1bf-45c4-9e68-9d5d8eddef52 req-a0198963-7f50-4479-b73b-69c4bbee0e64 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:38.493329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7cd9a0dd-c1bf-45c4-9e68-9d5d8eddef52 req-a0198963-7f50-4479-b73b-69c4bbee0e64 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:38.505430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7cd9a0dd-c1bf-45c4-9e68-9d5d8eddef52 req-a0198963-7f50-4479-b73b-69c4bbee0e64 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:38.551334 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7cd9a0dd-c1bf-45c4-9e68-9d5d8eddef52 req-a0198963-7f50-4479-b73b-69c4bbee0e64 service nova] Creating event network-vif-plugged:6be35fed-490a-409f-bad2-a411cc374dbd for instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 on n-h2-854924-5 Aug 30 03:52:38.576301 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7cd9a0dd-c1bf-45c4-9e68-9d5d8eddef52 req-a0198963-7f50-4479-b73b-69c4bbee0e64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112123 Aug 30 03:52:38.576938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2495/5071] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:52:39.108279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:39.108892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:39.136795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:39.137714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:39.141037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:39.143291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:39.145107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:39.149130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:39.474356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:39.475662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:39.491319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:39.493147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:39.493873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:39.498961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:39.499644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:39.501923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:39.625766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:39.644587 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d74c1de9-05e8-40e4-869d-b97dfcf9b6d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.540776 Aug 30 03:52:39.657828 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2577/5072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:39 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:39.921187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:39.945108 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cbf49384-45f0-4b16-91f4-7e8ab703cd9f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1314 microversion: 2.1 time: 0.479625 Aug 30 03:52:39.947469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2496/5073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:39 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:40.670667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:40.670667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:40.676154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:40.676648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:40.677081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:40.686051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:40.686680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:40.686986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:40.977914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:40.980134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:40.984889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:40.993329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:40.994591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:40.995251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:40.995534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5f1f3b6e-4d6e-45f2-84a2-da53f0fcb9ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.334084 Aug 30 03:52:41.000744 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2578/5074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:40 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:41.013449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.014007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.014460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.167490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107047cd-b29d-4755-bbba-a93485e564c3", "name": "network-vif-plugged", "status": "completed", "tag": "f4e5dd2d-5ed0-4cfe-96ca-33d12713de10"}, {"server_uuid": "0e65a105-1bf1-470f-96aa-5c1230c8feb2", "name": "network-vif-plugged", "status": "completed", "tag": "d0cfdb73-9146-43b6-801e-e49974e2ed0a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:41.186078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.186562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.187001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.219460 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] Creating event network-vif-plugged:f4e5dd2d-5ed0-4cfe-96ca-33d12713de10 for instance 107047cd-b29d-4755-bbba-a93485e564c3 on n-h1-854924-5 Aug 30 03:52:41.219900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] Creating event network-vif-plugged:d0cfdb73-9146-43b6-801e-e49974e2ed0a for instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 on n-h2-854924-5 Aug 30 03:52:41.230887 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-da288e92-835f-403a-bc79-1143177d7752 req-f4e22362-0f2d-465c-ba59-14aa043e210c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070057 Aug 30 03:52:41.231889 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2579/5075] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:52:41.276608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:41.292092 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0444609-504d-47e8-b970-a15eb708482b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1500 microversion: 2.1 time: 0.323611 Aug 30 03:52:41.297943 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2497/5076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:40 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1500 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:41.343243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:41.344039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:41.355010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.358607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.359340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.362498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.364525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:41.364955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:41.365072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.365608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.375473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.382127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.386221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.387020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.387498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.388030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.466741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'flavor' on Instance uuid 45618bb0-802a-4ad1-89bd-789fce53f7d1 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:52:41.515746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lazy-loading 'flavor' on Instance uuid c881790b-d38b-4dee-85e3-4d6a1b35e10f {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:52:41.637815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:41.660510 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ed1aa99-7ae7-437f-ab39-d962c8a89cc3 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "POST /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1/action" status: 202 len: 0 microversion: 2.1 time: 0.325179 Aug 30 03:52:41.661184 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2580/5077] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:52:41 2022] POST /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:52:41.672310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:41.678989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:41.709675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.712790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.713430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.714343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.714963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.715899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.732515 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] HTTP exception thrown: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Request method failure captured: Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b HTTP/1.1 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfqOxGvJIyD11qN793mFIKA4isSZ8dhEynAuoqQnQzxbNqD_xFozIZ9C-mFASEGolD3Ckd0QqvUpB3fd2iSOSX_k792UN4D9BUl6ne5gz7FNvU786QgbMbNQkV1I9C9OcVzTa56Qztbw2-t6jsCBaXuGQZXP_dud4Ru0gGZ-1T9_IQ Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1ccee9310d244210867a17f0d093c18e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}] Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 51986d3cb9614471bce790af1e6be2df Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7271fb16-3136-46c9-8b26-e981c6391d9b'} Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:41.734261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Returning 404 to user: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5bec469-1822-4cf8-9778-3d1a3e8598da tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 404 len: 111 microversion: 2.1 time: 0.073074 Aug 30 03:52:41.740514 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2581/5078] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:41 2022] DELETE /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:41.741744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:41.741930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:41.748871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.750203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.752317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:41.753398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:41.754018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:41.754632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.001503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:42.016533 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71e71b2f-0b49-4520-be6f-5e5d36f40022 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1508 microversion: 2.1 time: 0.279331 Aug 30 03:52:42.022530 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2582/5079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:41 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:42.037611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:42.038239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] [instance: 7271fb16-3136-46c9-8b26-e981c6391d9b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:42.050589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:42.051397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:42.051589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.056279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:42.057985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:42.058917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.075136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] HTTP exception thrown: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Request method failure captured: Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b HTTP/1.1 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYfqOxGvJIyD11qN793mFIKA4isSZ8dhEynAuoqQnQzxbNqD_xFozIZ9C-mFASEGolD3Ckd0QqvUpB3fd2iSOSX_k792UN4D9BUl6ne5gz7FNvU786QgbMbNQkV1I9C9OcVzTa56Qztbw2-t6jsCBaXuGQZXP_dud4Ru0gGZ-1T9_IQ Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1ccee9310d244210867a17f0d093c18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1ccee9310d244210867a17f0d093c18e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1ccee9310d244210867a17f0d093c18e"}]}] Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 1ccee9310d244210867a17f0d093c18e Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2051960319 Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 51986d3cb9614471bce790af1e6be2df Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeTestJSON-2051960319-project Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7271fb16-3136-46c9-8b26-e981c6391d9b'} Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:42.077017 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. Aug 30 03:52:42.083946 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:42.084915 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32510dee-384b-40ff-84e6-10047fdef2e1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/action" status: 202 len: 0 microversion: 2.20 time: 0.719944 Aug 30 03:52:42.086672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] Returning 404 to user: Instance 7271fb16-3136-46c9-8b26-e981c6391d9b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:42.087584 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2498/5080] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:52:41 2022] POST /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:52:42.087973 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc535fa9-ded9-4ab8-8de3-8f1d163da237 tempest-AttachVolumeTestJSON-2051960319 tempest-AttachVolumeTestJSON-2051960319-project] 10.222.0.30 "GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b" status: 404 len: 111 microversion: 2.1 time: 0.063920 Aug 30 03:52:42.088687 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2583/5081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:42 2022] GET /compute/v2.1/servers/7271fb16-3136-46c9-8b26-e981c6391d9b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:42.097709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:42.098573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:42.106521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:42.107410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:42.108920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.109891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:42.110991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:42.112182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.114535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:42.122380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:42.147105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:42.152100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:42.153660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.154626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:42.155284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:42.155923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:42.401457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:42.460343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:42.485526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:42.496237 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0ed74da-bb21-4cef-802f-d001f0114593 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.403003 Aug 30 03:52:42.499869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2584/5082] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:42 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:42.512793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:42.534025 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7c2dde3-2719-4199-b504-3c475a361872 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1321 microversion: 2.1 time: 0.440296 Aug 30 03:52:42.552559 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2499/5083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:42 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:43.046089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:43.046827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:43.066438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.066958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.067410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.077141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.082950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.083494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.426143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:43.438171 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f70d70e-ac88-41c5-b950-dd74ed180bf2 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1491 microversion: 2.1 time: 0.396208 Aug 30 03:52:43.439541 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2585/5084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:43 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1491 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:43.463494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:43.464310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:43.478234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.478995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.480022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.484567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.487069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.489233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.543772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:43.544676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:43.562681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.564816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.567364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.569266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.570831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.574507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.602142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:52:43.824879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec7fff86-928f-43a5-bff4-842fb4ed767b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 204 len: 0 microversion: 2.1 time: 0.365180 Aug 30 03:52:43.826606 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2500/5085] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:43 2022] DELETE /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:52:43.840290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:43.841800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:43.857028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.857842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.858739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.859651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:43.860465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:43.861058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:43.922438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:43.935913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:43.938778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:43.941482 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c902b65-e221-4d75-91ca-81de25620c14 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.413584 Aug 30 03:52:43.955310 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2586/5086] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:43 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:43.978523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:43.982307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:44.001643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.002607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.003392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:44.004966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.005673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.006380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:44.132878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:44.150441 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-224781ff-2a74-4ee4-a941-02850a3cc4b1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1515 microversion: 2.1 time: 0.322230 Aug 30 03:52:44.161700 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2501/5087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:43 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:44.180122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:44.183362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:44.195094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.195603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.196049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:44.196775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.197231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.197697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:44.250381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'flavor' on Instance uuid 0e65a105-1bf1-470f-96aa-5c1230c8feb2 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:52:44.293809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:44.422389 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-abb75791-45ae-4eb6-84f0-3ca90e100c30 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action" status: 200 len: 32 microversion: 2.1 time: 0.250973 Aug 30 03:52:44.428375 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2502/5088] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:52:44 2022] POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:52:44.453899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:44.454880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:44.476651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.477703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.478154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:44.478882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.479337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.481867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:44.551117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:44.565176 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2ff14bc-330a-415c-8315-1f5a4a407b05 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1497 microversion: 2.1 time: 0.603648 Aug 30 03:52:44.566481 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2587/5089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:43 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1497 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:44.882196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:44.893451 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1c377cf-3dd8-4c24-80b9-7dc0d57da375 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.463939 Aug 30 03:52:44.898697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2503/5090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:44 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:44.977622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:44.978742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:44.997560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:44.998779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:44.999817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:45.003997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:45.004963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:45.007886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:45.546117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:45.556763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:45.558230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:45.559422 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7dc4203-612b-4bce-9853-a8670b1ca8ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.588960 Aug 30 03:52:45.559993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2588/5091] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:44 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:45.589865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:45.591099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:45.599442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:45.600222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:45.601409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:45.602432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:45.603061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:45.603650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:45.922714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:45.923896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:45.954201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:45.955545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:45.959392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:45.962786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:45.964578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:45.966063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:46.467433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:46.472105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:46.498924 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bc085fc-6dba-4f08-93d3-3613aecfd905 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1497 microversion: 2.1 time: 0.912838 Aug 30 03:52:46.500741 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1dabc9d2-5da5-4908-bfb3-b3d8982f924b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.584100 Aug 30 03:52:46.501151 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2504/5092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:45 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1497 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:46.516628 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2589/5093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:45 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:46.598201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:46.601498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:46.621672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:46.622386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:46.623030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:46.624410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:46.625911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:46.627603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:46.734048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d4299016-2188-4225-8269-63ba1956aef3 req-a9b1c2f9-c69d-441d-8ddb-fc50bd8304ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45618bb0-802a-4ad1-89bd-789fce53f7d1", "name": "network-vif-deleted", "tag": "6be35fed-490a-409f-bad2-a411cc374dbd"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:46.763349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4299016-2188-4225-8269-63ba1956aef3 req-a9b1c2f9-c69d-441d-8ddb-fc50bd8304ff service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:46.765430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4299016-2188-4225-8269-63ba1956aef3 req-a9b1c2f9-c69d-441d-8ddb-fc50bd8304ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:46.766213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4299016-2188-4225-8269-63ba1956aef3 req-a9b1c2f9-c69d-441d-8ddb-fc50bd8304ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:46.780936 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d4299016-2188-4225-8269-63ba1956aef3 req-a9b1c2f9-c69d-441d-8ddb-fc50bd8304ff service nova] Creating event network-vif-deleted:6be35fed-490a-409f-bad2-a411cc374dbd for instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 on n-h2-854924-5 Aug 30 03:52:46.789706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d4299016-2188-4225-8269-63ba1956aef3 req-a9b1c2f9-c69d-441d-8ddb-fc50bd8304ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070454 Aug 30 03:52:46.791145 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2590/5094] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:52:47.528481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:47.529513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:47.556397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:47.556921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:47.558216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:47.560786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:47.563647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:47.565230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:47.719547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:47.720061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:47.720507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:47.722734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lazy-loading 'fault' on Instance uuid 45618bb0-802a-4ad1-89bd-789fce53f7d1 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:52:48.037988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b71d69dc44a4a8535d9b50970a257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85252a708aa04c8ea67e99cd5371cda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:48.054160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7642b66c-19af-4bf5-b85d-fd217ebfff0e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 200 len: 1304 microversion: 2.1 time: 0.537647 Aug 30 03:52:48.055608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2591/5095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:47 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 1304 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:48.069416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:48.070264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:48.077501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:48.078262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:48.078868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:48.079741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:48.080442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:48.081030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:48.210485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:48.219645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:48.226186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:48.228127 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27512d2a-e45c-44eb-8c38-988b8d0ff066 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 1.639499 Aug 30 03:52:48.232039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2505/5096] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:46 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:48.355903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:48.367584 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bcbdec92-320c-48b2-b01a-ff8501403bf6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.309344 Aug 30 03:52:48.382521 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2592/5097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:48 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:49.078080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.086584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.101612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.106370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.109110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.111488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.113270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.116692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.160937 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 HTTP/1.1 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '45618bb0-802a-4ad1-89bd-789fce53f7d1'} Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.163239 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.167987 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.169931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:49.170972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6f964f5-5cdb-497c-81c6-d9a0897a1f3d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 404 len: 111 microversion: 2.1 time: 0.098774 Aug 30 03:52:49.171729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2506/5098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:49 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:49.183241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.183740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.203203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.203963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.204729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.205483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.205942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.206405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.237294 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 HTTP/1.1 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '45618bb0-802a-4ad1-89bd-789fce53f7d1'} Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:49.255124 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:49.261998 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74e43774-4ac8-4fd0-9775-d4459384364c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 404 len: 111 microversion: 2.1 time: 0.078062 Aug 30 03:52:49.263648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.263648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.267859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.270435 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2593/5099] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:49 2022] DELETE /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:49.273621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.275648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.275767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.276212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 45618bb0-802a-4ad1-89bd-789fce53f7d1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.276465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.277262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.279564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.308715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.309293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.309652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.310355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.310879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.311216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.364255 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 HTTP/1.1 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '45618bb0-802a-4ad1-89bd-789fce53f7d1'} Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.365862 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 45618bb0-802a-4ad1-89bd-789fce53f7d1 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:49.370609 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-550484dd-0526-4ef5-ba19-45cf93e1f84b tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1" status: 404 len: 111 microversion: 2.1 time: 0.095792 Aug 30 03:52:49.377074 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2594/5100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:49 2022] GET /compute/v2.1/servers/45618bb0-802a-4ad1-89bd-789fce53f7d1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:49.382694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.383204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.415060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.416671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.419281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.421744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.422287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.422726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.474697 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e HTTP/1.1 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'ceed52f1-027d-462b-bf29-fa6f14d6d16e'} Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:49.476607 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.480430 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.482499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:49.483444 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-268b3fe8-9fd2-4d8b-b80d-05745241a077 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 404 len: 111 microversion: 2.1 time: 0.105261 Aug 30 03:52:49.484032 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2595/5101] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:49 2022] DELETE /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:49.513901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.519225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.531785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.536604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.537418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.539350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.540113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.541494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.796719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:49.814666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:49.816165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:49.827376 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c509acc4-5fd1-4f11-95c0-e503a7f3189d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.563819 Aug 30 03:52:49.846861 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2507/5102] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:49 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:49.868213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.869280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: ceed52f1-027d-462b-bf29-fa6f14d6d16e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.887391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.888084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.888681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.889614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.891305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.891885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.940441 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e HTTP/1.1 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'ceed52f1-027d-462b-bf29-fa6f14d6d16e'} Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:49.942350 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance ceed52f1-027d-462b-bf29-fa6f14d6d16e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a4faef43-1f85-4c7d-a921-81e62fa001bf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e" status: 404 len: 111 microversion: 2.1 time: 0.095646 Aug 30 03:52:49.946275 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2508/5103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:49 2022] GET /compute/v2.1/servers/ceed52f1-027d-462b-bf29-fa6f14d6d16e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:49.958070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:49.958804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:49.971204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.972536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.992138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:49.992954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:49.996196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:49.996735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.040312 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 HTTP/1.1 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '65cf4560-2c13-4df2-b7f5-f378b4d79590'} Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:50.042594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.048700 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.055380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:50.068641 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-209d2624-82ff-4cd0-bbdc-6eb800491d43 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.569057 Aug 30 03:52:50.069238 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2596/5104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:49 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:50.094238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:50.106116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3853f067-054d-4050-9c7f-040a00e1297d tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 404 len: 111 microversion: 2.1 time: 0.153528 Aug 30 03:52:50.113233 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2509/5105] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:49 2022] DELETE /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:50.117065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:50.118849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 65cf4560-2c13-4df2-b7f5-f378b4d79590] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:50.134078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.134586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.135010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.135718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.136179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.136604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.164934 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 HTTP/1.1 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '65cf4560-2c13-4df2-b7f5-f378b4d79590'} Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.166550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 65cf4560-2c13-4df2-b7f5-f378b4d79590 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:50.171202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ecc28848-373d-4579-8a3c-c9f36502195c tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590" status: 404 len: 111 microversion: 2.1 time: 0.054830 Aug 30 03:52:50.176932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:50.177468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:50.188171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.188670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.189111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.189850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.190309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.190796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.196860 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2597/5106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:50 2022] GET /compute/v2.1/servers/65cf4560-2c13-4df2-b7f5-f378b4d79590 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:52:50.258347 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 HTTP/1.1 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'fbf3b2af-8c10-4657-baf0-7fefa16f1ae5'} Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:50.261293 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.265998 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.269614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:50.273888 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a716307-d8e0-4336-816a-1ab503aa8431 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 404 len: 111 microversion: 2.1 time: 0.099643 Aug 30 03:52:50.284109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:50.284827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: fbf3b2af-8c10-4657-baf0-7fefa16f1ae5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:50.290855 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2510/5107] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:50 2022] DELETE /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:50.294397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.300259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.302606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.304943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.318585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.319159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.352568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 HTTP/1.1 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'fbf3b2af-8c10-4657-baf0-7fefa16f1ae5'} Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.356590 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.360313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:50.361133 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d4b3dfb-ad3f-41b8-b8c8-3817464ed6cf tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5" status: 404 len: 111 microversion: 2.1 time: 0.081800 Aug 30 03:52:50.364813 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2598/5108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:50 2022] GET /compute/v2.1/servers/fbf3b2af-8c10-4657-baf0-7fefa16f1ae5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:52:50.373046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a075a87e-ace9-4b17-af35-6d805246541f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:50.373698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a075a87e-ace9-4b17-af35-6d805246541f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:50.384312 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-a075a87e-ace9-4b17-af35-6d805246541f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a075a87e-ace9-4b17-af35-6d805246541f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 HTTP/1.1 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '17c0d5a5-2fcb-4014-b434-ac08e07feee7'} Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.386027 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.390623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a075a87e-ace9-4b17-af35-6d805246541f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:50.391942 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a075a87e-ace9-4b17-af35-6d805246541f tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7" status: 404 len: 111 microversion: 2.1 time: 0.022897 Aug 30 03:52:50.392603 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2511/5109] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:50 2022] DELETE /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:50.401569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36b2251f-17d0-4251-9a34-37af8c8af718 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:50.402458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36b2251f-17d0-4251-9a34-37af8c8af718 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 17c0d5a5-2fcb-4014-b434-ac08e07feee7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:50.409754 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-36b2251f-17d0-4251-9a34-37af8c8af718 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36b2251f-17d0-4251-9a34-37af8c8af718 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 HTTP/1.1 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '17c0d5a5-2fcb-4014-b434-ac08e07feee7'} Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:50.411951 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:50.415746 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:50.415746 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:50.415746 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:50.415746 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. Aug 30 03:52:50.415746 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:50.417660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36b2251f-17d0-4251-9a34-37af8c8af718 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 17c0d5a5-2fcb-4014-b434-ac08e07feee7 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:50.421610 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36b2251f-17d0-4251-9a34-37af8c8af718 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7" status: 404 len: 111 microversion: 2.1 time: 0.023855 Aug 30 03:52:50.422439 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2599/5110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:50 2022] GET /compute/v2.1/servers/17c0d5a5-2fcb-4014-b434-ac08e07feee7 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:50.855003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:50.855871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:50.865479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.865982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.866426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:50.867132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:50.867592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:50.868033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:51.090947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:51.091580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:51.108491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:51.108956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:51.109446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:51.110203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:51.123766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:51.124626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:51.603925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:51.616194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71af2c4f-6e26-434c-8c1c-299e1786874d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.527529 Aug 30 03:52:51.616810 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2600/5111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:51 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:51.626300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:51.646019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:51.653161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:51.654758 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee623a5a-2fb0-4aad-b3e0-ea41689daf58 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.804464 Aug 30 03:52:51.660255 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2512/5112] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:50 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:52.646804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:52.648127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:52.666835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:52.670514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:52.671151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:52.672036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:52.674153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:52.675634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:52.688078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:52.689801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:52.718409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:52.719013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:52.719471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:52.720224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:52.720692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:52.721128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:53.465302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:53.476162 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40bc646c-afa0-4607-9046-e28da0b0271e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.833520 Aug 30 03:52:53.479570 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2601/5113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:52 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:53.525262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:53.536863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:53.539041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:53.540276 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b4fcc59-4709-4a08-84d6-c7270d88a28f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.856305 Aug 30 03:52:53.540846 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2513/5114] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:52 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:52:54.499703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:54.500635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:54.513647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:54.514999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:54.516709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:54.517704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:54.519660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:54.524411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:54.563491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:54.567237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:54.573024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:54.586484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:54.605261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:54.606711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:54.614105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:54.614890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:54.615560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:55.212154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:55.223423 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea3319c8-e5cf-4aa7-a6d6-c6930183c908 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.726819 Aug 30 03:52:55.225494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2602/5115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:54 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:52:55.414474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:55.427934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:55.429756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:55.441066 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4db559a9-72a3-499c-85f7-ab0da20ced1d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1743 microversion: 2.20 time: 0.881399 Aug 30 03:52:55.441715 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2514/5116] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:54 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1743 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:52:56.020457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6c07d9e-389e-4e90-94c2-0db1e51c497b tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Action: 'create', calling method: .version_select at 0x7f897b530940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-790871522", "metadata": {"Type": "work"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6c07d9e-389e-4e90-94c2-0db1e51c497b tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Request method failure captured: Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 121 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYmXIlR_QBERsD_UJvOXRFpbahEOa9dTBkvo2nw61f0ljLIK729E4o5N_tEnv_kwt1lnXodudu8ujqsCdAypqSK2q79NF7jtURBUbUClV4QEX0b-KXQ4m1Cu7uCn4KlwaGIYWojuhhoLCw1kpi3TqPVLc_1YjtRDZf0eyPAAA6DOuSU Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_89afeb83ae9446198292a58fdd0392af", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}] Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 6cc563b0963c40708582e30a9f8fe47f Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-790871522", "metadata": {"Type": "work"}}} Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-790871522', 'metadata': {'Type': 'work'}}}} Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:52:56.037703 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 03:52:56.043587 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.046747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6c07d9e-389e-4e90-94c2-0db1e51c497b tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:56.047882 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c6c07d9e-389e-4e90-94c2-0db1e51c497b tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.655457 Aug 30 03:52:56.049542 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2603/5117] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 03:52:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 657 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:52:56.058938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcd9f9e0-835c-475b-9b0c-eb8272513e15 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Action: 'create', calling method: .version_select at 0x7f897a670670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1838902274", "metadata": {"Type": "work"}}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcd9f9e0-835c-475b-9b0c-eb8272513e15 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Request method failure captured: Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 120 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYmXIlR_QBERsD_UJvOXRFpbahEOa9dTBkvo2nw61f0ljLIK729E4o5N_tEnv_kwt1lnXodudu8ujqsCdAypqSK2q79NF7jtURBUbUClV4QEX0b-KXQ4m1Cu7uCn4KlwaGIYWojuhhoLCw1kpi3TqPVLc_1YjtRDZf0eyPAAA6DOuSU Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_89afeb83ae9446198292a58fdd0392af", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}] Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 6cc563b0963c40708582e30a9f8fe47f Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1838902274", "metadata": {"Type": "work"}}} Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1838902274', 'metadata': {'Type': 'work'}}}} Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi '0' Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:52:56.063563 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.068698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcd9f9e0-835c-475b-9b0c-eb8272513e15 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:56.070489 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fcd9f9e0-835c-475b-9b0c-eb8272513e15 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015654 Aug 30 03:52:56.073970 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2515/5118] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 03:52:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:52:56.082976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-049170ca-f18c-41fe-b1c9-3051d6832bbf tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Action: 'create', calling method: .version_select at 0x7f897b7b2ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1112077537", "metadata": {"Type": "work"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-049170ca-f18c-41fe-b1c9-3051d6832bbf tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Request method failure captured: Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 119 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYmXIlR_QBERsD_UJvOXRFpbahEOa9dTBkvo2nw61f0ljLIK729E4o5N_tEnv_kwt1lnXodudu8ujqsCdAypqSK2q79NF7jtURBUbUClV4QEX0b-KXQ4m1Cu7uCn4KlwaGIYWojuhhoLCw1kpi3TqPVLc_1YjtRDZf0eyPAAA6DOuSU Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_89afeb83ae9446198292a58fdd0392af", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}] Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 6cc563b0963c40708582e30a9f8fe47f Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1112077537", "metadata": {"Type": "work"}}} Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1112077537', 'metadata': {'Type': 'work'}}}} Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi '' Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 03:52:56.090683 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 03:52:56.095468 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.096349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-049170ca-f18c-41fe-b1c9-3051d6832bbf tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:56.099484 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-049170ca-f18c-41fe-b1c9-3051d6832bbf tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020373 Aug 30 03:52:56.103504 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2604/5119] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 03:52:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 03:52:56.114629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20297485-3689-4e9b-8a6f-bdc905dea213 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Calling method '.version_select at 0x7f897a6a9ee0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:56.162855 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-20297485-3689-4e9b-8a6f-bdc905dea213 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] HTTP exception thrown: Volume tempest-invalid-1960940201 could not be found. Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20297485-3689-4e9b-8a6f-bdc905dea213 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Request method failure captured: Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1960940201 HTTP/1.1 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYmXIlR_QBERsD_UJvOXRFpbahEOa9dTBkvo2nw61f0ljLIK729E4o5N_tEnv_kwt1lnXodudu8ujqsCdAypqSK2q79NF7jtURBUbUClV4QEX0b-KXQ4m1Cu7uCn4KlwaGIYWojuhhoLCw1kpi3TqPVLc_1YjtRDZf0eyPAAA6DOuSU Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_89afeb83ae9446198292a58fdd0392af", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}] Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 6cc563b0963c40708582e30a9f8fe47f Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: exception: Volume tempest-invalid-1960940201 could not be found. Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'tempest-invalid-1960940201'} Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1960940201 could not be found. (HTTP 404) (Request-ID: req-b1f767da-e4e0-48d0-8ad1-58b68597a2d3) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:52:56.165223 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1960940201 could not be found. Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1960940201 could not be found. Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1960940201 could not be found. Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20297485-3689-4e9b-8a6f-bdc905dea213 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Returning 404 to user: Volume tempest-invalid-1960940201 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20297485-3689-4e9b-8a6f-bdc905dea213 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1960940201" status: 404 len: 99 microversion: 2.1 time: 0.057852 Aug 30 03:52:56.174173 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2516/5120] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:52:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1960940201 => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:52:56.183186 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9e8cc325-fa0e-4af0-b93f-660a74e4404d tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004694 Aug 30 03:52:56.188385 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2605/5121] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 30 03:52:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 03:52:56.194756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccf9d44c-db10-4660-b78b-5c67166d3799 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004856 Aug 30 03:52:56.200016 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2517/5122] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 03:52:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 03:52:56.205294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f20764b2-8a53-4630-bdcb-6dd11da44707 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Calling method '.version_select at 0x7f897b5305e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:56.247347 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f20764b2-8a53-4630-bdcb-6dd11da44707 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] HTTP exception thrown: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f20764b2-8a53-4630-bdcb-6dd11da44707 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Request method failure captured: Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-volumes/e9309187-c80b-4336-95b9-0a89cd23cc2f HTTP/1.1 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYmXIlR_QBERsD_UJvOXRFpbahEOa9dTBkvo2nw61f0ljLIK729E4o5N_tEnv_kwt1lnXodudu8ujqsCdAypqSK2q79NF7jtURBUbUClV4QEX0b-KXQ4m1Cu7uCn4KlwaGIYWojuhhoLCw1kpi3TqPVLc_1YjtRDZf0eyPAAA6DOuSU Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_89afeb83ae9446198292a58fdd0392af", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}] Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 6cc563b0963c40708582e30a9f8fe47f Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: exception: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e9309187-c80b-4336-95b9-0a89cd23cc2f'} Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. (HTTP 404) (Request-ID: req-eb33e5a1-858f-47e4-9fc3-91eaa2e372e6) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 03:52:56.250794 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.255307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f20764b2-8a53-4630-bdcb-6dd11da44707 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Returning 404 to user: Volume e9309187-c80b-4336-95b9-0a89cd23cc2f could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:56.257685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:56.257685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:56.257833 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f20764b2-8a53-4630-bdcb-6dd11da44707 tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/e9309187-c80b-4336-95b9-0a89cd23cc2f" status: 404 len: 109 microversion: 2.1 time: 0.054306 Aug 30 03:52:56.259893 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2606/5123] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 03:52:56 2022] DELETE /compute/v2.1/os-volumes/e9309187-c80b-4336-95b9-0a89cd23cc2f => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:56.270721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3acefaa4-e2ae-4826-a808-19d6ac480d0d tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Calling method '.version_select at 0x7f8983af1af0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:56.272799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:56.275735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:56.277798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:56.280182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:56.281987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:56.285204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:56.346667 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3acefaa4-e2ae-4826-a808-19d6ac480d0d tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] HTTP exception thrown: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3acefaa4-e2ae-4826-a808-19d6ac480d0d tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Request method failure captured: Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/os-volumes/f9fc376b-56ce-4f09-b0d4-a66b2b93391d HTTP/1.1 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYmXIlR_QBERsD_UJvOXRFpbahEOa9dTBkvo2nw61f0ljLIK729E4o5N_tEnv_kwt1lnXodudu8ujqsCdAypqSK2q79NF7jtURBUbUClV4QEX0b-KXQ4m1Cu7uCn4KlwaGIYWojuhhoLCw1kpi3TqPVLc_1YjtRDZf0eyPAAA6DOuSU Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/89afeb83ae9446198292a58fdd0392af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_89afeb83ae9446198292a58fdd0392af", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/89afeb83ae9446198292a58fdd0392af"}]}] Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 89afeb83ae9446198292a58fdd0392af Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesNegativeTest-40590478 Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 6cc563b0963c40708582e30a9f8fe47f Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesNegativeTest-40590478-project Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: exception: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f9fc376b-56ce-4f09-b0d4-a66b2b93391d'} Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. (HTTP 404) (Request-ID: req-a2445a51-f93c-4b7e-881c-f50ac2ca11a1) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 03:52:56.349550 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. Aug 30 03:52:56.353279 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:56.361950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3acefaa4-e2ae-4826-a808-19d6ac480d0d tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] Returning 404 to user: Volume f9fc376b-56ce-4f09-b0d4-a66b2b93391d could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:56.363642 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3acefaa4-e2ae-4826-a808-19d6ac480d0d tempest-VolumesNegativeTest-40590478 tempest-VolumesNegativeTest-40590478-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f9fc376b-56ce-4f09-b0d4-a66b2b93391d" status: 404 len: 109 microversion: 2.1 time: 0.101379 Aug 30 03:52:56.364217 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2607/5124] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 03:52:56 2022] GET /compute/v2.1/os-volumes/f9fc376b-56ce-4f09-b0d4-a66b2b93391d => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:56.468430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:56.470201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:56.486486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:56.491344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:56.494531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:56.498703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:56.500010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:56.501551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:56.599215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:52:57.126075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:57.140383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:57.147471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:57.148843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:57.153331 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01d12e99-10c1-4996-9221-f30d50b1d5a5 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1743 microversion: 2.20 time: 0.686177 Aug 30 03:52:57.154463 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2608/5125] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:56 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1743 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:52:57.176622 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40926e88-d42e-46e2-b3f2-3c69e8d275a2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.932443 Aug 30 03:52:57.177406 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2518/5126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:56 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:57.402324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:57.402944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:57.423332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.433752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.434419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.435255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.435803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.436350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.470060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 HTTP/1.1 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e0782294-915e-4d7b-b41a-e77ce446b232'} Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:57.478493 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-90ab7583-b9b3-479d-bb8d-466e0403cef6 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 404 len: 111 microversion: 2.1 time: 0.082824 Aug 30 03:52:57.482879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2609/5127] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:57 2022] DELETE /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:57.489783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:57.490707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: e0782294-915e-4d7b-b41a-e77ce446b232] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:57.498357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.499124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.499809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.500701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.501337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.502156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.522126 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 HTTP/1.1 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e0782294-915e-4d7b-b41a-e77ce446b232'} Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.526716 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. Aug 30 03:52:57.530612 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.533249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance e0782294-915e-4d7b-b41a-e77ce446b232 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:57.535612 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42e1d77f-06ae-4902-8bf5-93ed1fcef3c5 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232" status: 404 len: 111 microversion: 2.1 time: 0.050158 Aug 30 03:52:57.536809 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2519/5128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:57 2022] GET /compute/v2.1/servers/e0782294-915e-4d7b-b41a-e77ce446b232 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:57.544354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:57.544959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:57.558448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.559015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.559532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.560315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.560848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.561357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.594662 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce HTTP/1.1 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '74cec778-c0a3-466d-97b1-e7608b1e13ce'} Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:57.596422 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.600221 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.602074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:57.603136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9470961-15cf-472b-8d1a-0ff80caf1f1e tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 404 len: 111 microversion: 2.1 time: 0.062675 Aug 30 03:52:57.604209 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2610/5129] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:52:57 2022] DELETE /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:52:57.613041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:57.613947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] [instance: 74cec778-c0a3-466d-97b1-e7608b1e13ce] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:57.621916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.622639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.623310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.624227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:57.624892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:57.625688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:57.644280 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] HTTP exception thrown: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Request method failure captured: Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce HTTP/1.1 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYhNu74HHddomrCciEzX6XK-fJr1atqccUseGbUufXbgNsPpUviB5XgQiD9VIUhVjp9Qh_55yjHyqSdYPgzosEuY1x9ubKp6JDpNR41bkFreiOJ-489HnTh7vUAoP5mqH8RBpVRLJYAkTVRdXfQIg9RFEvf6FS5XCeKacMWNBi7yQNU Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85252a708aa04c8ea67e99cd5371cda6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85252a708aa04c8ea67e99cd5371cda6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85252a708aa04c8ea67e99cd5371cda6"}]}] Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 85252a708aa04c8ea67e99cd5371cda6 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1930599322 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 337b71d69dc44a4a8535d9b50970a257 Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1930599322-project Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '74cec778-c0a3-466d-97b1-e7608b1e13ce'} Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:52:57.657231 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] Returning 404 to user: Instance 74cec778-c0a3-466d-97b1-e7608b1e13ce could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c43e3d84-c665-4947-a3bc-d47cadf703e8 tempest-DeleteServersTestJSON-1930599322 tempest-DeleteServersTestJSON-1930599322-project] 10.222.0.30 "GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce" status: 404 len: 111 microversion: 2.1 time: 0.051805 Aug 30 03:52:57.662193 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2520/5130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:57 2022] GET /compute/v2.1/servers/74cec778-c0a3-466d-97b1-e7608b1e13ce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:52:58.180438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:58.181069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:58.198389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:52:58.199015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:52:58.209679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:58.210176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:58.210612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:58.211329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:58.211783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:58.212212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:58.216672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:58.217575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:58.218609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:58.219251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:58.219721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:58.220144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:59.135916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:59.145917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d85c260-6fb8-4402-b004-40f453aa0677 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.952094 Aug 30 03:52:59.151908 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2521/5131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:52:58 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:52:59.152702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:59.166095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:59.171261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2116a046-2b97-4a2b-88de-7c14aeb4d26b req-434704f4-c24d-4ce9-9ed4-6cdb6594b4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "name": "network-vif-plugged", "status": "completed", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:52:59.186467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:52:59.190791 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4d81c2fa-74ce-4b67-b68c-87dc92ee985f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1743 microversion: 2.20 time: 1.016608 Aug 30 03:52:59.213582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2611/5132] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:52:58 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1743 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:52:59.242482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2116a046-2b97-4a2b-88de-7c14aeb4d26b req-434704f4-c24d-4ce9-9ed4-6cdb6594b4ad service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:52:59.246547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2116a046-2b97-4a2b-88de-7c14aeb4d26b req-434704f4-c24d-4ce9-9ed4-6cdb6594b4ad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:52:59.256722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2116a046-2b97-4a2b-88de-7c14aeb4d26b req-434704f4-c24d-4ce9-9ed4-6cdb6594b4ad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:52:59.294472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2116a046-2b97-4a2b-88de-7c14aeb4d26b req-434704f4-c24d-4ce9-9ed4-6cdb6594b4ad service nova] Creating event network-vif-plugged:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:52:59.333449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2116a046-2b97-4a2b-88de-7c14aeb4d26b req-434704f4-c24d-4ce9-9ed4-6cdb6594b4ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179214 Aug 30 03:52:59.342379 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2522/5133] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:53:00.179769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:00.181237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:00.201712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:00.208299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:00.208896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:00.209646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:00.210126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:00.210688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:00.228009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:00.229754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:00.250224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:00.256232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:00.257884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:00.258825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:00.259470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:00.260163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:01.065463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:01.078465 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab693fbd-921d-49f0-8936-a5780db082b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.903847 Aug 30 03:53:01.084040 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2612/5134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:00 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:01.177306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:01.191823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:01.193565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:01.195988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-97f52f83-57d6-44c0-9cff-aa49dc669954 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.972669 Aug 30 03:53:01.216963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2523/5135] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:00 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:02.108267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:02.108887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:02.139372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=84 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:02.140876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:02.141379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:02.142066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:02.144773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:02.154118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:02.154568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:02.226248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:02.227462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:02.242312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:02.242670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:02.243066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:02.243711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:02.244166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:02.244593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:02.655119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:02.670956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d9fe01e-ba90-4944-86ad-4e8f0a53907b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.570704 Aug 30 03:53:02.677636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2613/5136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:02 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:02.696617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:02.715669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:02.717176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:02.732318 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c08968f-7b43-4aaa-a4d2-a6d5b0d90095 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.511198 Aug 30 03:53:02.753125 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2524/5137] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:02 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:03.703024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:03.703673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:03.711938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:03.712426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:03.725810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:03.730785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:03.731297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:03.731747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:03.770034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:03.771694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:03.779541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:03.780335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:03.780967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:03.782200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:03.783011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:03.785308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:04.458563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:04.474326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:04.476193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:04.486008 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b36bcf1-df75-453e-9974-8c24000e46f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.712333 Aug 30 03:53:04.487140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2525/5138] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:03 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:04.523259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:04.534980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1992a9f-e0da-4ea9-baa6-9048de456b56 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.836284 Aug 30 03:53:04.546408 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2614/5139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:03 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:05.517052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:05.518637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:05.540745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:05.541250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:05.541723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:05.542604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:05.543067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:05.543506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:05.573100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:05.574514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:05.576977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:05.586903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:05.593790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:05.594877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:05.596164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:05.598186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:05.600285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:05.825889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:05.844610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:05.847400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:05.848803 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-22e98f76-a6d2-4e52-92f7-d2a21cfed5ec tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.337954 Aug 30 03:53:05.849578 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2526/5140] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:05 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:05.995388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:06.009963 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16b3be85-2e7f-4a7f-82fb-4697ff6b55bc tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.445419 Aug 30 03:53:06.011768 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2615/5141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:05 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:06.881439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:06.882084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:06.912570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:06.913736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:06.914182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:06.918776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:06.921046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:06.922977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:07.038294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:07.039180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:07.077373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:07.077373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:07.077373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:07.108730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:07.110423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:07.111545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:07.778576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:07.808416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:07.811170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:07.821230 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae1db52e-f3d8-4603-ae80-7db99f687e34 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.949579 Aug 30 03:53:07.832284 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2527/5142] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:06 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:07.995159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:08.007059 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edc339d9-cc34-4704-a8a3-14979e7c034b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.972264 Aug 30 03:53:08.009154 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2616/5143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:07 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:08.857660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:08.858679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:08.878474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:08.880988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:08.881842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:08.885116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:08.887065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:08.887610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:09.029552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:09.030975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:09.052591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:09.053620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:09.055598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:09.057657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:09.060495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:09.062352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:09.477513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:09.500558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:09.504490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:09.508145 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad2f093d-1367-4862-a024-5b4272ee5f55 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.655050 Aug 30 03:53:09.509328 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2528/5144] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:08 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:09.562310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:09.592774 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-557b0402-96e1-4032-946a-fb9d245ec1e3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.567928 Aug 30 03:53:09.597109 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2617/5145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:09 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:10.549039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:10.550369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:10.558034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:10.559208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:10.559879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:10.560800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:10.561487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:10.562123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:10.617318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:10.618730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:10.627319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:10.628305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:10.628969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:10.630169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:10.630847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:10.631491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:10.853274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:10.867589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:10.873241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:10.877163 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7413f56-bef8-4c4b-a6ee-d111b59aa2f1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.347528 Aug 30 03:53:10.879461 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2529/5146] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:10 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:10.956287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:10.971406 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-55a9546f-2618-4a16-a6e3-d71d78e89bb3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.358116 Aug 30 03:53:10.972750 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2618/5147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:10 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:11.907230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:11.907845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:11.918446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:11.923010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:11.930047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:11.933639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:11.934319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:11.936638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:11.992464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:11.993162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:12.012797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:12.013297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:12.013776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:12.014491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:12.014953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:12.015381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:12.822919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:12.838073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:12.844894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:12.850081 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c45c8b1-6966-4bd6-8d8f-93b8527185ff tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.946722 Aug 30 03:53:12.856276 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2530/5148] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:11 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:12.919296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:12.937859 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aca4655b-9e2f-4dec-bce1-d3d1a57df4b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.948595 Aug 30 03:53:12.942338 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2619/5149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:11 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:13.886850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:13.887786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:13.910999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:13.911521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:13.911965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:13.917310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:13.918865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:13.920342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:14.665284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1766990024", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "3f44d8f7-9100-4bac-8404-bf7b59a005d2"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:14.811591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:14.829309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:14.838382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] validate_networks() for [('3f44d8f7-9100-4bac-8404-bf7b59a005d2', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:53:14.847154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:14.852809 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fcf3cd79-22b8-4da2-872e-30109c0fab2d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.971265 Aug 30 03:53:14.857887 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2620/5150] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:13 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:14.876515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:14.877145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:14.895671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:14.897228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:14.898021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:14.899193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:14.899799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:14.900560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:15.651295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:15.660001 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a428c59-316a-4134-bb30-3bd8209706d4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 0.800763 Aug 30 03:53:15.660545 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2621/5151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:14 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:15.884268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:15.885939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:15.896907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:15.898432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:15.899132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:15.902437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:15.903181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:15.903813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:16.464666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:16.482450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:16.485868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:16.492875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f2b93f6-87cd-4263-a6ee-e56e3f27cce8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.612631 Aug 30 03:53:16.497493 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2622/5152] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:15 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:16.685550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:16.686513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:16.708834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:16.710007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:16.710781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:16.722123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:16.722899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:16.728134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:17.790279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:53:17.792159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:53:17.793753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:53:17.794498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:53:17.795139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:53:17.808771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:17.809451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:17.810171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:17.811098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:17.811725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:17.812303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:17.840999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Getting quotas for project 080220e0697f4793acf37d4541ada215. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:53:17.848776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Getting quotas for user b2ee080bfaaa43c2b20240bc2d6e492d and project 080220e0697f4793acf37d4541ada215. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:53:17.867057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:53:17.871948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:53:17.964389 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1d2763e-8b0a-4674-b852-ba04a3ebc552 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.112067 Aug 30 03:53:17.965655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2531/5153] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:53:17.970848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:17.972500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:17.983430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:17.984752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:17.985489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:17.988271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:17.990230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:17.992205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:18.245846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:18.275427 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cfce3ab8-9d11-431d-b142-4cb0135a53ec tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 1.585351 Aug 30 03:53:18.293744 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2623/5154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:16 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:18.293744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b101cdb5-8ac5-4b5b-820c-7423007fea18 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:18.293744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b101cdb5-8ac5-4b5b-820c-7423007fea18 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:18.725861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b101cdb5-8ac5-4b5b-820c-7423007fea18 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:18.742598 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b101cdb5-8ac5-4b5b-820c-7423007fea18 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1215 microversion: 2.1 time: 0.457185 Aug 30 03:53:18.752602 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2624/5155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:18 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1215 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:18.819027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:18.827766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:18.829220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:18.871499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-45454049-fad5-489a-8db0-b0b1d41e4faa tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.901154 Aug 30 03:53:18.893730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2532/5156] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:17 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:19.306160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:19.306769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:19.318915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:19.319314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:19.322470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:19.323204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:19.323710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:19.325279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:19.776611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:19.777328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:19.799718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:19.805634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:19.806335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:19.812866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:19.813592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:19.815430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:20.166434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:20.187204 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-202c1c22-2149-479f-95f3-e87b593cd623 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1267 microversion: 2.1 time: 0.417667 Aug 30 03:53:20.192688 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2533/5157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:19 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1267 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:20.215614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:20.223234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:20.241734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:20.244331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:20.245261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:20.269010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:20.277409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:20.278377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:20.477845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:20.491628 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-acc43ab1-ff45-4e96-85b5-0cfccbd188d3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1521 microversion: 2.1 time: 1.189395 Aug 30 03:53:20.507483 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2625/5158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:19 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1521 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:21.196265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:21.212687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:21.213312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:21.220005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:21.222453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:21.223397 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0be4cfb4-9401-4921-be46-b595a4dfac18 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 1.027060 Aug 30 03:53:21.234100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:21.234692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:21.235149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:21.238234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:21.238745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:21.239199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:21.246684 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2534/5159] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:20 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:21.522505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:21.523711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:21.539599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:21.540518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:21.541215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:21.542988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:21.545080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:21.545818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:21.589651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:21.600437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c94d2f5a-d4ef-4d9d-9bcc-2177792dee49 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1273 microversion: 2.1 time: 0.391491 Aug 30 03:53:21.625645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2626/5160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:21 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:22.272143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:22.272792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:22.292997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:22.293557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:22.293998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:22.294710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:22.295168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:22.295608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:22.384154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:23.234246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:23.250776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a84872af-c94e-4556-ad5f-4ae767b0e803 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1501 microversion: 2.1 time: 1.733496 Aug 30 03:53:23.251621 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2535/5161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:21 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1501 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:23.268542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:23.275670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:23.295851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:23.300996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:23.301738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:23.310537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:23.311405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:23.312013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:23.426619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:23.442999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:23.449918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:23.452078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-180345d1-9772-43f7-bf82-7676b70fea57 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 1.185024 Aug 30 03:53:23.456909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2627/5162] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:22 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:23.469652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:23.470447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:23.482940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:23.485197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:23.486621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:23.489698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:23.490391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:23.491043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:23.938342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:23.955284 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7d8836f-d3ba-4419-b8aa-b6b87a24ff83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1514 microversion: 2.1 time: 0.496840 Aug 30 03:53:23.955945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2628/5163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:23 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:23.979324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e02b663e-64b7-48df-9d35-9d2c87772473 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:23.982898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e02b663e-64b7-48df-9d35-9d2c87772473 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:23.990003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:24.005286 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e02b663e-64b7-48df-9d35-9d2c87772473 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Instance d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2 could not be found. Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e02b663e-64b7-48df-9d35-9d2c87772473 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2/action HTTP/1.1 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 14 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: {"rescue": {}} Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2 could not be found. Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd2087c9b-9cef-4aca-8558-4fcb0fcf5ed2', 'body': {'rescue': {}}} Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2 could not be found. Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2 could not be found. Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:24.022964 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:24.028005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:53:24.028005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:53:24.028005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:53:24.028005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:53:24.028005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2 could not be found. Aug 30 03:53:24.028005 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:24.028616 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-95d11fc1-61e8-4640-ac37-be1102b703ec tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.773299 Aug 30 03:53:24.029056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e02b663e-64b7-48df-9d35-9d2c87772473 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 404 to user: Instance d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:53:24.030064 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e02b663e-64b7-48df-9d35-9d2c87772473 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2/action" status: 404 len: 111 microversion: 2.1 time: 0.055313 Aug 30 03:53:24.032617 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2629/5164] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:23 2022] POST /compute/v2.1/servers/d2087c9b-9cef-4aca-8558-4fcb0fcf5ed2/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:53:24.055335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:24.056502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:24.065833 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2536/5165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:23 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:24.072332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:24.073663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:24.075275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:24.078232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:24.078977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:24.082211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:24.293158 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ba6183b-c30c-4379-889e-f5f061ea5a94 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action" status: 202 len: 0 microversion: 2.1 time: 0.243587 Aug 30 03:53:24.294419 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2630/5166] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:24 2022] POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:53:24.311912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:24.312549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:24.323541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:24.324045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:24.324486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:24.325222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:24.330719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:24.331634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:24.480662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:24.481440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:24.496393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:24.496905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:24.497369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:24.498126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:24.498562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:24.498993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:24.969373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:24.985843 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-96f57caa-c0ad-4c74-9665-44292ff89359 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1519 microversion: 2.1 time: 0.681041 Aug 30 03:53:24.989282 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2537/5167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:24 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1519 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:25.052714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:25.053903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:25.056390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:25.091973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:25.095960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:25.096778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:25.097861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:25.101383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:25.102168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:25.353494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:25.367681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:25.369396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:25.400270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1df7092d-6b6c-444b-a88f-1cde49f60625 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.923684 Aug 30 03:53:25.417960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2631/5168] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:24 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:25.926143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:25.939482 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7913e37-4a2d-457b-83f2-2045b4789409 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.891267 Aug 30 03:53:25.941517 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2538/5169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:25 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:26.014004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:26.014760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:26.041379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.053756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.055023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.056147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.083503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.088088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.426246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:26.427510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:26.458994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.462822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.463573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.465724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.466460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.468994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.689382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:26.720730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e048458f-6d13-462d-9090-e094727f051e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1499 microversion: 2.1 time: 0.710977 Aug 30 03:53:26.721393 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2632/5170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:26 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1499 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:26.760719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:26.783023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:26.805018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.808100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.808756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.814099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.814605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.824052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.879313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:26.897057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:26.898556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:26.907980 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c1f1b52-957b-4f93-b634-c75a0420b307 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.486432 Aug 30 03:53:26.914219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'flavor' on Instance uuid 107047cd-b29d-4755-bbba-a93485e564c3 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:53:26.926084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2539/5171] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:26 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:26.963589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:26.964825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:26.972995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.974015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.974602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:26.976409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:26.977263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:26.977919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.005614 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Cannot 'rescue' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state paused Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action HTTP/1.1 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 14 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: {"rescue": {}} Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'rescue' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state paused Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '107047cd-b29d-4755-bbba-a93485e564c3', 'body': {'rescue': {}}} Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 107047cd-b29d-4755-bbba-a93485e564c3 in vm_state paused. Cannot rescue while the instance is in this state. Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state paused Aug 30 03:53:27.008167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state paused Aug 30 03:53:27.015733 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:27.019391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 409 to user: Cannot 'rescue' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state paused {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:53:27.024444 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8449034f-63b2-4ce3-a282-89af2479a687 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action" status: 409 len: 144 microversion: 2.1 time: 0.282649 Aug 30 03:53:27.029860 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2633/5172] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:26 2022] POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action => generated 144 bytes in 288 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:53:27.047926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:27.056040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:27.083696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:27.085048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:27.085748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.086830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:27.087819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:27.088457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.254785 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7bc8bdef-27cb-4695-ad1b-a26495418556 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action" status: 202 len: 0 microversion: 2.1 time: 0.222287 Aug 30 03:53:27.259109 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2634/5173] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:27 2022] POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:53:27.307552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:27.308300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:27.336310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:27.337282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:27.338060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.339080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:27.339728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:27.340575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.663891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:27.710583 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b6bd53d-2a8c-4f8e-8d7a-5644b6a3c580 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.720532 Aug 30 03:53:27.722682 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2540/5174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:26 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:27.942056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:27.942664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:27.953875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:27.958102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:27.969846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:27.976512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:27.978974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:27.981492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.983231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:27.984171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:27.985907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bfdfdca3-72a7-433a-b4f7-3f37bfc75422 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1506 microversion: 2.1 time: 0.708343 Aug 30 03:53:27.986604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:27.992340 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2635/5175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:27 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:28.689281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:28.716461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:28.725478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:28.737560 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db1b5256-872d-4490-b336-19ce8163bb66 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.799373 Aug 30 03:53:28.739945 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2541/5176] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:27 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:28.758677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:28.759299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:28.762564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:28.781157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:28.783735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:28.784337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:28.789634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:28.790304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:28.790893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:29.008519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:29.009466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:29.031865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:29.032463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:29.034142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:29.036106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:29.042740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:29.043345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:29.402261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:29.412433 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9059b988-8d61-41ef-bf44-95d6026cc2ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.657589 Aug 30 03:53:29.413023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2636/5177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:28 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:29.466323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:29.475509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e9883c1-5013-4cb0-a5a2-868708e53691 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1514 microversion: 2.1 time: 0.471638 Aug 30 03:53:29.492796 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2542/5178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:29 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:29.640552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a59abd43-7fe0-4e69-9197-55d96d09734c req-e628bd74-1337-45b4-87a5-b4e594da8a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86dd778-b4f1-4d96-8a7c-59db2f145a9c", "tag": "8ce0750d-622b-4a9f-8289-6ea27ae4b4d9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:29.670237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a59abd43-7fe0-4e69-9197-55d96d09734c req-e628bd74-1337-45b4-87a5-b4e594da8a0e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:29.671121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a59abd43-7fe0-4e69-9197-55d96d09734c req-e628bd74-1337-45b4-87a5-b4e594da8a0e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:29.682809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a59abd43-7fe0-4e69-9197-55d96d09734c req-e628bd74-1337-45b4-87a5-b4e594da8a0e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:29.724439 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a59abd43-7fe0-4e69-9197-55d96d09734c req-e628bd74-1337-45b4-87a5-b4e594da8a0e service nova] Creating event network-changed:8ce0750d-622b-4a9f-8289-6ea27ae4b4d9 for instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c on n-h2-854924-5 Aug 30 03:53:29.739073 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a59abd43-7fe0-4e69-9197-55d96d09734c req-e628bd74-1337-45b4-87a5-b4e594da8a0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102495 Aug 30 03:53:29.742013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2637/5179] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:53:29.772089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:29.773627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:29.796836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:29.798569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:29.799372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:29.804029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:29.805325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:29.808315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:30.205388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:30.208453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:30.222966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:30.224946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:30.226885 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f60542d-6593-4064-a2bc-b8a63d9dcc2a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1738 microversion: 2.20 time: 0.461824 Aug 30 03:53:30.231198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2543/5180] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:29 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:30.435821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:30.436923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:30.459020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:30.459537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:30.459990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:30.460716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:30.461180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:30.470048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:31.016756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:31.032141 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-38ac2252-3d65-487a-ae06-bef8caa9a6d4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.598101 Aug 30 03:53:31.040053 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2638/5181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:30 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:31.260442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:31.260959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:31.280679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:31.281949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:31.283179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:31.284662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:31.286360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:31.287393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.060455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:32.061086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:32.079498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.079934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.080391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.081153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.081643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.082074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.496988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:32.500638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:32.507663 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16daded0-444c-4942-a8cb-a455d066edac tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.451635 Aug 30 03:53:32.513076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:32.513582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2639/5182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:32 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:32.515757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:32.517217 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-baec7c79-aaeb-42af-8a16-7de191ec02a9 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1720 microversion: 2.20 time: 1.262824 Aug 30 03:53:32.518923 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2544/5183] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:31 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1720 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:32.524458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:32.527754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:32.529757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=56 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:32.549246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.549993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.550631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.551925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.552402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.552843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.595029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'flavor' on Instance uuid 107047cd-b29d-4755-bbba-a93485e564c3 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:53:32.717484 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-070ae2be-80d1-4efe-898c-9e43cc16e82a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action" status: 200 len: 32 microversion: 2.1 time: 0.190605 Aug 30 03:53:32.718255 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2640/5184] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:32 2022] POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:53:32.733072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:32.738548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:32.746891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.749533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.750385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.753727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.754444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.755193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.876141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5f69c924-37e7-4e15-a4d9-da780b208259 req-3ed74f97-41b3-4dc3-be98-de6bc0aa165a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "name": "network-vif-unplugged", "status": "completed", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:32.916135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f69c924-37e7-4e15-a4d9-da780b208259 req-3ed74f97-41b3-4dc3-be98-de6bc0aa165a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:32.919298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f69c924-37e7-4e15-a4d9-da780b208259 req-3ed74f97-41b3-4dc3-be98-de6bc0aa165a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:32.920070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f69c924-37e7-4e15-a4d9-da780b208259 req-3ed74f97-41b3-4dc3-be98-de6bc0aa165a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:32.948996 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5f69c924-37e7-4e15-a4d9-da780b208259 req-3ed74f97-41b3-4dc3-be98-de6bc0aa165a service nova] Creating event network-vif-unplugged:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:53:32.954954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5f69c924-37e7-4e15-a4d9-da780b208259 req-3ed74f97-41b3-4dc3-be98-de6bc0aa165a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100849 Aug 30 03:53:32.957328 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2641/5185] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:53:33.016693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:33.026707 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5c6cc4c-8e1a-4ed7-9b7c-78a1051bbd41 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.301463 Aug 30 03:53:33.027893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2545/5186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:32 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:33.537790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:33.538810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:33.542065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:33.544217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:33.555042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:33.560534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:33.560959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:33.562391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:33.563058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:33.563977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:33.564558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:33.566283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:33.567801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:33.568426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:33.572001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:33.572721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:33.632981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:33.955460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:33.968815 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d4d6607-62a9-41ad-8a06-844e51947216 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.436220 Aug 30 03:53:33.969466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2642/5187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:33 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:33.982556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:33.996212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:33.997943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:33.999615 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d79d983b-273e-43da-90c7-8a703be6a239 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1720 microversion: 2.20 time: 0.461379 Aug 30 03:53:34.013371 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2546/5188] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:33 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1720 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:34.048948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:34.050270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:34.066078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:34.067091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:34.067599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:34.068704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:34.069385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:34.071299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:34.788360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:34.797655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6297178d-7b32-4e48-a115-80067ccf7e83 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.753155 Aug 30 03:53:34.798339 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2643/5189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:34 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:35.000062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:35.000944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:35.017654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.018719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.021337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.025598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.026095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.030887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:35.032571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:35.033706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.043993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.046983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.050707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.051876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.056983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.057699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.765269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:35.782941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:35.785240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:35.787454 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5c4ca58-f8b2-4127-beac-e34cafd6b353 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1663 microversion: 2.20 time: 0.762843 Aug 30 03:53:35.788664 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2644/5190] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:35 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1663 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:35.820148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e29dc7e-66a4-471a-a978-6bc7dffd8433"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:35.830009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:35.836578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:35.847928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8ccacd6-f7ef-40d1-ac35-87401bb012e8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.861206 Aug 30 03:53:35.850448 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2547/5191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:34 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:35.853168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.854023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.854631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.855343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.855826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.856251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.867694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:35.873252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:35.895354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.896627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.900277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:35.902202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:35.903665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:35.906437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:36.388956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:36.404500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-153559bf-007c-48b8-adf8-ec9c7e467c75 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.550695 Aug 30 03:53:36.406787 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2548/5192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:35 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:36.688852 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5206c900-8d24-45e0-a1ea-4aac6312af8d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.877401 Aug 30 03:53:36.690839 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2645/5193] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Aug 30 03:53:35 2022] POST /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-volume_attachments => generated 188 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:53:36.870823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:36.871524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:36.885601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:36.885812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:36.888443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:36.890706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:36.892134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:36.896487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:36.916466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:36.917777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:36.932605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:36.936143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:36.938074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:36.938994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:36.940256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:36.941856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:37.320744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:37.331035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-784fd05d-a67f-4c77-a67f-fe4217ccfc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 0.463400 Aug 30 03:53:37.331630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2549/5194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:36 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:37.446872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:37.449753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:37.493129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:37.493675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:37.494124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:37.498282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:37.498819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:37.501369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:37.516185 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c969dcc-6574-45d7-951c-fd527c1af013 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-volume_attachments/4e29dc7e-66a4-471a-a978-6bc7dffd8433" status: 202 len: 0 microversion: 2.20 time: 0.605187 Aug 30 03:53:37.520608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2646/5195] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Aug 30 03:53:36 2022] DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-volume_attachments/4e29dc7e-66a4-471a-a978-6bc7dffd8433 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:53:37.636281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:37.637201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:37.656773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:37.659459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:37.660174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:37.663310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:37.664219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:37.664843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:37.856185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122168) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 03:53:38.032720 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16dcdea6-a03d-416e-9b57-887b0f252e19 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "POST /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/action" status: 202 len: 0 microversion: 2.20 time: 0.396363 Aug 30 03:53:38.038153 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2647/5196] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 03:53:37 2022] POST /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:53:38.065811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:38.071043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:38.097886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:38.099352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:38.101323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:38.104307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:38.107428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:38.110233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:38.628611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:38.648581 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1061be3-9ee1-4977-9e4e-348cf38e3402 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 1.213202 Aug 30 03:53:38.657496 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2550/5197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:37 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:38.660427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:38.663071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:38.692322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:38.695563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:38.696288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:38.700053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:38.700719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:38.701806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:38.725201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:38.746556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:38.748259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:38.756313 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5ab0cf99-0562-4190-b53d-14e5d7d8bb0d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1671 microversion: 2.20 time: 0.710431 Aug 30 03:53:38.757191 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2648/5198] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:38 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1671 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:38.781173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9d30a9a4-19a9-4cc9-bc1d-0622c312baf3 req-22a32309-47cb-4d40-a85e-e67985b365b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86dd778-b4f1-4d96-8a7c-59db2f145a9c", "name": "network-vif-plugged", "status": "completed", "tag": "8ce0750d-622b-4a9f-8289-6ea27ae4b4d9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:38.816847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9d30a9a4-19a9-4cc9-bc1d-0622c312baf3 req-22a32309-47cb-4d40-a85e-e67985b365b9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:38.823502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9d30a9a4-19a9-4cc9-bc1d-0622c312baf3 req-22a32309-47cb-4d40-a85e-e67985b365b9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:38.824214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9d30a9a4-19a9-4cc9-bc1d-0622c312baf3 req-22a32309-47cb-4d40-a85e-e67985b365b9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:38.865877 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9d30a9a4-19a9-4cc9-bc1d-0622c312baf3 req-22a32309-47cb-4d40-a85e-e67985b365b9 service nova] Creating event network-vif-plugged:8ce0750d-622b-4a9f-8289-6ea27ae4b4d9 for instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c on n-h2-854924-5 Aug 30 03:53:38.872827 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9d30a9a4-19a9-4cc9-bc1d-0622c312baf3 req-22a32309-47cb-4d40-a85e-e67985b365b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100931 Aug 30 03:53:38.874181 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2649/5199] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:53:39.682836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:39.685203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:39.696260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:39.697785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:39.698572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:39.699672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:39.701244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:39.702799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:40.178898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:40.192798 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9372bd2f-23b5-4eb0-8f89-41965eaeca4f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1315 microversion: 2.1 time: 1.541156 Aug 30 03:53:40.196303 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2551/5200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:38 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1315 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:40.219239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:40.219827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:40.237569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:40.239674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:40.240297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:40.246243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:40.248864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:40.249693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:40.848470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:40.877009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-48efc252-4607-4218-8eb6-392d712b15ae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 1.186782 Aug 30 03:53:40.877855 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2650/5201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:39 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:40.918392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:40.930631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:40.933181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:40.942628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ff7cdc98-dff6-449a-9bd7-028052a80f5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1671 microversion: 2.20 time: 0.742388 Aug 30 03:53:40.944596 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2552/5202] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:40 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1671 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:41.219197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:41.220008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:41.234080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:41.235721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:41.237591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:41.240163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:41.243520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:41.245009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:41.623954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:41.655733 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a478b5c0-e747-4ae3-96aa-74a6721579ee tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1502 microversion: 2.1 time: 0.443639 Aug 30 03:53:41.659717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2651/5203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:41 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1502 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:41.681915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:41.683569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:41.699685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:41.702889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:41.703515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:41.705078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:41.706491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:41.708624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:41.901962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:41.902592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:41.911446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:41.912282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:41.912956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:41.914249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:41.914941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:41.916003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:41.981485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:42.004254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32a83f37-6f2e-4c0e-b6aa-697ad01be27e tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1502 microversion: 2.1 time: 0.324549 Aug 30 03:53:42.004802 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2553/5204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:41 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:42.025092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:42.026255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:42.045923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:42.046897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:42.047594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:42.049525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:42.051853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:42.053801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:42.802158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:42.812234 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1fe066e-b3a4-4a3a-a497-db5a03356043 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.916469 Aug 30 03:53:42.816082 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2652/5205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:41 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:42.830968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:42.831863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:42.845426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:42.846408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:42.846856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:42.847593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:42.849606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:42.856655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:42.881569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:42.897571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:42.899356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:42.906602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cdc1b6e1-92f7-4344-960d-c7d63abc07cd tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.899244 Aug 30 03:53:42.907538 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2554/5206] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:42 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:42.915989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:42.940787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lazy-loading 'flavor' on Instance uuid c86dd778-b4f1-4d96-8a7c-59db2f145a9c {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:53:43.098904 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c66c9080-d731-4829-962e-ce5b9952eca5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.278621 Aug 30 03:53:43.114100 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2653/5207] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:42 2022] POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:53:43.122280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:43.122897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:43.131305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:43.136929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:43.137415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:43.140152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:43.140666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:43.141117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:43.510576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:43.519146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab0436c2-59d6-486f-8125-4072514a31c5 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1510 microversion: 2.1 time: 0.400795 Aug 30 03:53:43.519836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2555/5208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:43 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:43.843032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:43.843992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:43.860508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:43.861215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:43.861717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:43.863427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:43.863971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:43.865463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:43.941315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:43.943243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:43.962447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:43.965552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:43.966191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:43.967675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:43.968298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:43.968877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:44.214001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:44.228313 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b40450a5-458a-424e-b72e-3db5fa76a6ea tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.392584 Aug 30 03:53:44.236847 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2654/5209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:43 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:44.542597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:44.545465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:44.556291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:44.567423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:44.568025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:44.572295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:44.574945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:44.578795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:44.800630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:44.811616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:44.813461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:44.815244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-72056b2f-4f80-4a8b-bc53-c717ad4df216 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.881117 Aug 30 03:53:44.816253 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2556/5210] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:43 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:45.265153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:45.268686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:45.282672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:45.283655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:45.284097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:45.284807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:45.285490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:45.286264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:45.633610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:45.662916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1433802-638a-44b1-9981-22fa290fbe9f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.415950 Aug 30 03:53:45.670574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2557/5211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:45 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:45.844822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:45.846780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:45.864707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:45.865582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:45.867114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:45.868611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:45.871111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:45.873241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:45.932801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:45.951107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-84822186-3dcd-4456-a34c-dce44f92f909 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1493 microversion: 2.1 time: 1.414840 Aug 30 03:53:45.965763 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2655/5212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:44 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1493 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:45.981309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:45.989592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:46.022307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:46.024788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:46.025431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:46.030332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:46.032476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:46.042022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:46.187814 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3a1bb40-478b-458a-9dfb-34a109ecff90 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.213912 Aug 30 03:53:46.188826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2656/5213] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:45 2022] POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:53:46.197533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:46.198250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:46.219086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:46.219584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:46.220044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:46.221651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:46.222177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:46.222745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:46.674215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:46.697682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:46.699252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:46.720509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5a738fe-51eb-4089-b613-2d71252714c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.881282 Aug 30 03:53:46.723741 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2558/5214] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:45 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:46.750610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:46.758060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:46.784789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:46.799973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:46.800548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:46.808101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:46.808860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:46.809928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:46.853270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:46.867635 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01202918-1a8c-440d-8749-4234fb9d9eed tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1499 microversion: 2.1 time: 0.674140 Aug 30 03:53:46.871355 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2657/5215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:46 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1499 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:47.122713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:47.134722 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af3fc35e-713f-408b-8769-90f2275df4a8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.407673 Aug 30 03:53:47.137227 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2559/5216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:46 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:47.750093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:47.750730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:47.768402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:47.771629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:47.772934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:47.775082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:47.784471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:47.784720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:47.899832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:47.901076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:47.915038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:47.938103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:47.939292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:47.949718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:47.955119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:47.957186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:48.062043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:49.465307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:49.478323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:49.497159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:49.501788 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67876e3c-b1a2-4fd5-9225-111d17f0a4ed tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.754344 Aug 30 03:53:49.505404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2658/5217] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:47 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:49.511223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:49.544448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:49.568029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:49.572014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:49.592903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:49.593919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:49.594501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:49.595041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:49.800519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:49.809111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae049d34-2562-49f4-a72c-91069a516eaa tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1499 microversion: 2.1 time: 1.914480 Aug 30 03:53:49.817128 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2560/5218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:47 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1499 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:50.231965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:50.247278 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b1ff6ae3-424f-4e31-8a0c-4e2518adc3ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.739695 Aug 30 03:53:50.248420 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2659/5219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:49 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:50.532827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:50.533684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:50.549865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:50.550619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:50.552310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:50.553189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:50.554470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:50.554911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:50.842156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:50.842889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:50.854858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:50.855362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:50.866633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:50.874587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:50.878326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:50.878961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:51.156226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:51.170190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:51.173590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:51.178221 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-251c9b51-6aac-4aa6-8604-ce4ba8c82450 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.649852 Aug 30 03:53:51.180603 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2561/5220] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:50 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:51.278783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:51.279948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:51.301862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:51.305231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:51.307722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:51.311142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:51.311932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:51.315419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:51.572616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:51.589523 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ffe259c-56fe-4069-a5ba-bc60a42bbeb6 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1499 microversion: 2.1 time: 0.744932 Aug 30 03:53:51.606814 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2660/5221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:50 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1499 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:51.885079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:51.894788 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-131193b7-25ca-4cbf-8750-69e7f26ad7e1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.626852 Aug 30 03:53:51.895377 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2562/5222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:51 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:52.204532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:52.206080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:52.222530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:52.223030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:52.223475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:52.224195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:52.224651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:52.225081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:52.622036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:52.623335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:52.648899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:52.649608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:52.650317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:52.651208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:52.657017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:52.657732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:53.451430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:53.464905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:53.475014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:53.481108 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-897c9aad-a6d7-409e-92fa-e0bde1a295e2 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.280677 Aug 30 03:53:53.481731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2661/5223] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:52 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:53.533622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:53.535772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:53.557876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:53.558381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:53.558835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:53.559531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:53.559982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:53.560404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:53.660767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:53.680440 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-640e5b1a-61de-4eae-9e33-a6bd82cb39c4 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1502 microversion: 2.1 time: 1.069600 Aug 30 03:53:53.687746 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2563/5224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:52 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1502 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:53.707733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:53.708272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:53.749742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:53.750256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:53.750697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:53.751404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:53.751918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:53.765336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:53.855661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lazy-loading 'flavor' on Instance uuid c86dd778-b4f1-4d96-8a7c-59db2f145a9c {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:53:54.125996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4ab3a12c-df70-468c-9862-55f2fc01fa3b tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.421443 Aug 30 03:53:54.132717 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2564/5225] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:53 2022] POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:53:54.146502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:54.149274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:54.166585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:54.168815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:54.172857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:54.174856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:54.177938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:54.178638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:54.378343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:54.395830 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2dd7c9bb-86ce-44cc-9f7e-54ef7764b2c5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1500 microversion: 2.1 time: 0.887734 Aug 30 03:53:54.396447 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2662/5226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:53 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1500 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:54.419156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "636837e9-6153-4f14-b903-9663a3cefc88"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:54.429172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:54.451388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:54.455852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:54.458834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:54.459810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:54.462334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:54.465097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:54.558471 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Cannot 'attach_volume' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state rescued Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/os-volume_attachments HTTP/1.1 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 74 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: {"volumeAttachment": {"volumeId": "636837e9-6153-4f14-b903-9663a3cefc88"}} Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'attach_volume' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state rescued Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': '107047cd-b29d-4755-bbba-a93485e564c3', 'body': {'volumeAttachment': {'volumeId': '636837e9-6153-4f14-b903-9663a3cefc88'}}} Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 107047cd-b29d-4755-bbba-a93485e564c3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 03:53:54.565489 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state rescued Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state rescued Aug 30 03:53:54.569611 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:53:54.574215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 409 to user: Cannot 'attach_volume' instance 107047cd-b29d-4755-bbba-a93485e564c3 while it is in vm_state rescued {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:53:54.575321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-659de987-1255-4ae4-89ac-99b171ba7a86 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.162726 Aug 30 03:53:54.579800 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2663/5227] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:53:54 2022] POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/os-volume_attachments => generated 152 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 03:53:54.591881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:54.604345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:54.626040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:54.627459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:54.628213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:54.635454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:54.644914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:54.648566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:54.947237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:54.962967 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0eedafb-faaa-4bd6-9130-319bfb399bb8 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1510 microversion: 2.1 time: 0.828447 Aug 30 03:53:54.963564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2565/5228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:54 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1510 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:55.007441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:55.009011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:55.024832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:55.025368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:55.031012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:55.031773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:55.032337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:55.032772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:55.186880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:55.201264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:55.206279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:55.214565 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc799cfb-a895-4dfc-8268-bbe53931a8b8 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.633270 Aug 30 03:53:55.229835 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2664/5229] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:54 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:55.297680 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3adf213c-5a8a-4a46-a586-eeadb42cba74 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action" status: 202 len: 0 microversion: 2.1 time: 0.309703 Aug 30 03:53:55.304855 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2566/5230] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:54 2022] POST /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:53:55.310114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:55.310934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:55.327344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:55.328068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:55.328594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:55.329494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:55.330739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:55.331277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:55.989774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:55.990505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:56.005160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=58 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:56.044655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:56.045174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:56.045661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:56.046386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:56.046849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:56.059379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:56.134632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:56.156658 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-525621dc-d0da-41fe-8435-7f307387e5b4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1508 microversion: 2.1 time: 0.851092 Aug 30 03:53:56.159798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2665/5231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:55 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1508 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:53:56.246916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:56.247913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:56.272134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:56.273430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:56.274368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:56.275776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:56.276480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:56.277148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:56.815806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:56.826468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e094e08-d9bb-49fd-9eb0-da451f194a8f tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1493 microversion: 2.1 time: 0.840215 Aug 30 03:53:56.827098 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2567/5232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:55 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1493 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:56.850176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:53:56.851886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:56.872487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:56.872992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:56.873464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:56.888783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:56.889440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:56.898015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:57.148757 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd1a413d-a537-46fa-b67a-c4e37f8a7958 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.295481 Aug 30 03:53:57.150471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2568/5233] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:53:56 2022] POST /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:53:57.168024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:57.168921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:57.207521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:57.209772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:57.210712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:57.215104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:57.215761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:57.216375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:57.403473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:57.413373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:57.425335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:57.437141 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8bfe8103-83fd-4d51-a3d7-70e066e603f6 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.198447 Aug 30 03:53:57.450345 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2666/5234] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:56 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:53:57.459772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:57.466239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:57.490627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:57.491130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:57.491575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:57.492316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:57.492760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:57.493190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:58.367740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:58.383156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:53:58.412534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45db45e6-2b2b-4bd7-b565-4649468237ac tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1508 microversion: 2.1 time: 0.960685 Aug 30 03:53:58.415065 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2667/5235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:57 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1508 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:58.480208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:58.492891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:58.501185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:58.538273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c2b0d1c9-8f08-4cf6-8e4a-d72a8a6f10ab tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1499 microversion: 2.1 time: 1.384143 Aug 30 03:53:58.545451 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2569/5236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:57 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1499 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:53:58.548108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:58.548652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:58.563103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:58.563971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:58.565472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:58.566029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:59.213033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:59.231271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:59.237538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:53:59.248361 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dfd598fc-4970-42b4-bdd1-a7832bced1ae tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.772561 Aug 30 03:53:59.253310 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2668/5237] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:53:58 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:53:59.436591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:59.437280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:59.459162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:59.459686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:59.461860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:59.462618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:59.468344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:59.469084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:59.566071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:53:59.567619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:53:59.597649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:59.602353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:59.606349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:53:59.609892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:53:59.614014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:53:59.620553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:00.965416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:00.980288 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d35e8a8-4f26-4329-970c-b6a194a300e6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1508 microversion: 2.1 time: 1.543238 Aug 30 03:54:00.996082 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2570/5238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:59 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1508 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:01.012477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:01.013971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:01.021118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:01.025007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:01.025007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:01.025007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:01.025831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:01.026509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:01.054475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:01.063567 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-127f27bc-1b37-4a64-a88b-aa005b54a576 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1499 microversion: 2.1 time: 1.503326 Aug 30 03:54:01.070505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2669/5239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:53:59 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1499 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:01.409691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:01.421708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:01.433890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:01.435976 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b20b41d4-6d30-45e4-84bc-ee0e6ef7f7b1 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.436506 Aug 30 03:54:01.464391 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2571/5240] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:00 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:02.005574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:02.010396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:02.035023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:02.035837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:02.041293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:02.043786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:02.044601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:02.046619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:02.099263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:02.100543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:02.107121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:02.109914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:02.116897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:02.121099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:02.121885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:02.122522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:03.029459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:03.043726 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4404ffcf-0567-40b7-9242-95869609d8b8 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1514 microversion: 2.1 time: 1.042245 Aug 30 03:54:03.059090 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2670/5241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:02 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1514 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:03.068961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:03.069616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:03.092378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:03.097052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:03.097589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:03.098636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:03.101885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:03.102588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:03.104231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:03.113835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:03.126324 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5ab0cdd-bb8f-49f3-9579-2820667a3ccd tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1499 microversion: 2.1 time: 1.037978 Aug 30 03:54:03.137774 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2572/5242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:02 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1499 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:03.522218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:03.542856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:03.544329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:03.551366 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-46aff6ab-6179-4190-a9ec-1e90c2062b5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.485793 Aug 30 03:54:03.552407 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2671/5243] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:03 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:04.154934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:04.156237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:04.171202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:04.174917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:04.177826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:04.179210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:04.179688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:04.180475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:04.228132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:04.575679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:04.577058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:04.601318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:04.605309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:04.606742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:04.608746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:04.610580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:04.612325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:04.904865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:04.920711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b22234aa-6516-4f12-8200-d45cc35f894a tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1502 microversion: 2.1 time: 0.767921 Aug 30 03:54:04.925993 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2573/5244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:04 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1502 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:04.950377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:04.951819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:04.978041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:04.979006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:04.980864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:04.982533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:04.984523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:04.990520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:05.106678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:54:05.216885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:05.238838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:05.246401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:05.253514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c6fbbc31-a397-4f75-9bfc-7febaa896c5f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.678005 Aug 30 03:54:05.255336 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2672/5245] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:04 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:05.364289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69d26275-a77a-4a22-b631-164d21322fa1 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 204 len: 0 microversion: 2.1 time: 0.418307 Aug 30 03:54:05.367722 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2574/5246] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:54:04 2022] DELETE /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:54:05.377653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:05.378686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:05.391935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:05.393807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:05.394338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:05.398415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:05.401337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:05.401948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:05.730332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:05.746003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3250e3f-4817-4c2f-b77b-960fab2be908 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1508 microversion: 2.1 time: 0.373483 Aug 30 03:54:05.756524 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2673/5247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:05 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:06.215406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c5e5eb5-4df9-458b-9df0-bbd20d7fac6e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'create', calling method: .version_select at 0x7f897a6c9550>, body: {"keypair": {"name": "tempest-keypair-979865208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD81SNh8IRNGf4TBJvK8oTO5M+fWFdXvrEoV1BnvbCeLDiqGJET2RTaAXydmIAwVZ+lUnDltU+J4iRzaHXTnvgGOb/Su5dyqRL2nF0VuU+oQAimL8DzPrARdSXnrhb6D5A=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:06.271973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0c5e5eb5-4df9-458b-9df0-bbd20d7fac6e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for project 443099fa08af4020bb1ff6703de1123b. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:54:06.280282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:06.281053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:06.294047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:06.295760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:06.296489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:06.299642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:06.300598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:06.300739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0c5e5eb5-4df9-458b-9df0-bbd20d7fac6e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for user 893eddb05e4349f1ae6c8242647a52c6 and project 443099fa08af4020bb1ff6703de1123b. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:54:06.302229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:06.372079 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c5e5eb5-4df9-458b-9df0-bbd20d7fac6e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161092 Aug 30 03:54:06.373001 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2575/5248] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 03:54:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:06.767587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:06.768441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:06.787795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:06.796460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:06.797181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:06.798135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:06.799315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:06.799920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:07.143233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:07.166092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:07.170698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:07.176057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08218c0e-5db6-4aff-9838-36e45b9a5d9f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.899614 Aug 30 03:54:07.179016 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2674/5249] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:06 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:07.243426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:07.255024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-354f0999-e667-4508-a97c-0bde7dd22ae3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1508 microversion: 2.1 time: 0.491599 Aug 30 03:54:07.282454 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2576/5250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:06 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1508 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:08.206620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:08.207255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:08.247685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:08.258448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:08.266206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:08.269492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:08.272819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:08.273520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:08.283743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:08.284951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:08.301117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:08.301838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:08.302433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:08.303332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:08.307131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:08.307360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:09.346644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:09.363748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:09.368689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:09.371226 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e65a251f-5e84-4324-99e0-de33f7ab4507 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.170942 Aug 30 03:54:09.376347 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2675/5251] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:08 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:09.523581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ee080bfaaa43c2b20240bc2d6e492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080220e0697f4793acf37d4541ada215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:09.533610 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-256e0cf6-af4e-4ff5-a842-64650535dc58 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 200 len: 1508 microversion: 2.1 time: 1.253662 Aug 30 03:54:09.549928 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2577/5252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:08 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 1508 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:09.631334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4d008024-9d30-4670-862d-3c7ae6b41a1b req-9e10cd6f-c520-4990-a39d-738a02f10c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86dd778-b4f1-4d96-8a7c-59db2f145a9c", "name": "network-vif-deleted", "tag": "8ce0750d-622b-4a9f-8289-6ea27ae4b4d9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:09.672428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d008024-9d30-4670-862d-3c7ae6b41a1b req-9e10cd6f-c520-4990-a39d-738a02f10c47 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:09.672934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d008024-9d30-4670-862d-3c7ae6b41a1b req-9e10cd6f-c520-4990-a39d-738a02f10c47 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:09.675739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d008024-9d30-4670-862d-3c7ae6b41a1b req-9e10cd6f-c520-4990-a39d-738a02f10c47 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:09.727961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4d008024-9d30-4670-862d-3c7ae6b41a1b req-9e10cd6f-c520-4990-a39d-738a02f10c47 service nova] Creating event network-vif-deleted:8ce0750d-622b-4a9f-8289-6ea27ae4b4d9 for instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c on n-h2-854924-5 Aug 30 03:54:09.754287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4d008024-9d30-4670-862d-3c7ae6b41a1b req-9e10cd6f-c520-4990-a39d-738a02f10c47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128189 Aug 30 03:54:09.755637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2676/5253] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:10.402397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:10.403252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:10.412853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:10.420272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:10.421008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:10.422561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:10.425148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:10.426324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:10.564749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:10.565531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] [instance: c86dd778-b4f1-4d96-8a7c-59db2f145a9c] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:10.578827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:10.580437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:10.581872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:10.590739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:10.591550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:10.592191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:10.634891 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] HTTP exception thrown: Instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c could not be found. Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Request method failure captured: Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c HTTP/1.1 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYmjmjLMXKcR1t-lRebVJZQeVdhrpGZhlsTuX3vI1ySRuOs1eI8Q_F7KqC7OLsNvLt1laWgL4DDxDsBTzWKLAJuuDet6F6QWVSTqKHETdrOgMu70pryzwR2eW7oBoNx1zqw5eaP63UlJz9QXL6mEZErb4Q39CYGBICOzNqqsJEx3J8U Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 080220e0697f4793acf37d4541ada215 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestServerAdvancedOps-453980398 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/080220e0697f4793acf37d4541ada215"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/080220e0697f4793acf37d4541ada215"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_080220e0697f4793acf37d4541ada215", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/080220e0697f4793acf37d4541ada215"}]}] Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestServerAdvancedOps-453980398 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 080220e0697f4793acf37d4541ada215 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestServerAdvancedOps-453980398 Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestServerAdvancedOps-453980398-project Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b2ee080bfaaa43c2b20240bc2d6e492d Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestServerAdvancedOps-453980398-project Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c could not be found. Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c86dd778-b4f1-4d96-8a7c-59db2f145a9c'} Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c could not be found. Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c could not be found. Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:54:10.636850 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c could not be found. Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:54:10.642912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] Returning 404 to user: Instance c86dd778-b4f1-4d96-8a7c-59db2f145a9c could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:54:10.645622 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6d394a0-8e6a-4218-ab38-15fe2b0cc8a3 tempest-TestServerAdvancedOps-453980398 tempest-TestServerAdvancedOps-453980398-project] 10.222.0.30 "GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c" status: 404 len: 111 microversion: 2.1 time: 0.086554 Aug 30 03:54:10.647031 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2677/5254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:10 2022] GET /compute/v2.1/servers/c86dd778-b4f1-4d96-8a7c-59db2f145a9c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:54:11.642645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:11.652612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:11.656079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:11.657309 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-95267cd4-55fc-44c3-9b74-50bb70a0bd24 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.260047 Aug 30 03:54:11.665409 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2578/5255] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:10 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:12.702646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:12.705724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:12.737440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:12.740676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:12.745899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:12.748071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:12.752445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:12.755194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:13.151406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:13.163874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:13.165697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:13.168063 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6ba12b74-b0b7-4ea0-956d-99d65ca4e08d tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.474849 Aug 30 03:54:13.193962 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2678/5256] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:12 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:13.880645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1423030407", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07d29dc9-8f29-4ac8-8930-7202444edbb4"}], "security_groups": [{"name": "tempest-securitygroup--1367144563"}], "key_name": "tempest-keypair-979865208", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:14.208684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:14.209492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:14.224035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:14.227364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:14.229783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:14.230797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:14.233031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:14.235687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:14.248859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] validate_networks() for [('07d29dc9-8f29-4ac8-8930-7202444edbb4', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:54:15.521641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:15.536413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:15.541586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:15.548042 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5ecfe7c-c605-4941-a13c-89cd39fc1540 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.343567 Aug 30 03:54:15.562234 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2679/5257] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:14 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:15.572783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5eeab92d-9841-42e2-b091-8b4efb3b1a7d req-54f411ad-59b3-4d60-8869-2ccac654b09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "name": "network-vif-plugged", "status": "completed", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:15.597971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5eeab92d-9841-42e2-b091-8b4efb3b1a7d req-54f411ad-59b3-4d60-8869-2ccac654b09f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:15.601512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5eeab92d-9841-42e2-b091-8b4efb3b1a7d req-54f411ad-59b3-4d60-8869-2ccac654b09f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:15.602152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5eeab92d-9841-42e2-b091-8b4efb3b1a7d req-54f411ad-59b3-4d60-8869-2ccac654b09f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:15.637062 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5eeab92d-9841-42e2-b091-8b4efb3b1a7d req-54f411ad-59b3-4d60-8869-2ccac654b09f service nova] Creating event network-vif-plugged:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:54:15.648980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5eeab92d-9841-42e2-b091-8b4efb3b1a7d req-54f411ad-59b3-4d60-8869-2ccac654b09f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084985 Aug 30 03:54:15.652071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2680/5258] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:16.322917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:16.576301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:16.577225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:16.599105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:16.605702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:16.606401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:16.608202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:16.609920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:16.615391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:17.737412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:54:17.739233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:54:17.739726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:54:17.740174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:54:17.741373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:54:17.773014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:17.775034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:17.776995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:17.779083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:17.782638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:17.784154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:17.842839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for project 443099fa08af4020bb1ff6703de1123b. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:54:17.857076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Getting quotas for user 893eddb05e4349f1ae6c8242647a52c6 and project 443099fa08af4020bb1ff6703de1123b. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:54:17.895906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:54:17.905009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:54:18.014941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:18.027056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:18.037285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:18.039236 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f1e6eb7-203b-47e2-898d-f115252d1626 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 1.467782 Aug 30 03:54:18.040307 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2681/5259] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:16 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:18.042871 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7ce6532-2860-4214-a7c5-4d9ee4ca75b7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.167018 Aug 30 03:54:18.044275 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2579/5260] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:54:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 4170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:54:18.060635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e306279d-cf80-422e-bd7d-442d5f0284a9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:18.062777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e306279d-cf80-422e-bd7d-442d5f0284a9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:18.253848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e306279d-cf80-422e-bd7d-442d5f0284a9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:18.264066 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e306279d-cf80-422e-bd7d-442d5f0284a9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1245 microversion: 2.1 time: 0.208153 Aug 30 03:54:18.265149 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2682/5261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:18 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1245 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:19.072364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:19.073138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:19.102672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:19.107342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:19.112024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:19.115766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:19.118007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:19.121027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:19.285809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5feae4e8-c6bb-498b-b5e8-89a5bac56016 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:19.287072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5feae4e8-c6bb-498b-b5e8-89a5bac56016 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:19.609457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5feae4e8-c6bb-498b-b5e8-89a5bac56016 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:19.636603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5feae4e8-c6bb-498b-b5e8-89a5bac56016 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1245 microversion: 2.1 time: 0.354175 Aug 30 03:54:19.641753 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2683/5262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:19 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1245 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:19.790069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:19.801870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:19.818559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:19.831468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-74d9d475-df92-407b-9bf3-54913c8da375 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.763659 Aug 30 03:54:19.843966 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2580/5263] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:19 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:20.662829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:20.664186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:20.679238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:20.682459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:20.685324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:20.686755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:20.688877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:20.690276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:20.856815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:20.857584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:20.864895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:20.878194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:20.878969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:20.880624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:20.881534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:20.894646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:21.045328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:21.057849 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8616ce26-364c-434d-aab5-6b14ab8955b9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1305 microversion: 2.1 time: 0.398874 Aug 30 03:54:21.058434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2684/5264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:20 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1305 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:21.504343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:21.515170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:21.525231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:21.527499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7311d45b-4d20-4648-9283-8c74a7e45d96 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1729 microversion: 2.20 time: 0.674874 Aug 30 03:54:21.533813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2581/5265] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:20 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1729 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:54:21.591770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:21.593659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:21.594152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:21.594691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:21.595485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:21.596358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:21.598489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:21.660930 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d0e19823-6766-40d9-8710-4519f7e34e37 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.601433 Aug 30 03:54:21.662824 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2685/5266] 10.222.0.30 () {58 vars in 1185 bytes} [Tue Aug 30 03:54:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:21.833211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1530205230", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "availability_zone": "nova:n-h2-854924-5", "networks": [{"uuid": "777feff9-865c-446e-a998-d077901dae1e"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:21.993846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] validate_networks() for [('777feff9-865c-446e-a998-d077901dae1e', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:54:22.089692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:22.091278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:22.116503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:22.117919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:22.120337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:22.122962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:22.125950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:22.127259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:23.430420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:23.445327 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0061f44-e57f-401e-b392-e40174684905 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1371 microversion: 2.1 time: 1.361332 Aug 30 03:54:23.450157 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2686/5267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:22 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1371 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:23.461317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:23.462876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:23.478522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:23.479285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:23.479936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:23.488477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:23.489718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:23.490466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:23.970936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:23.984864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:23.986797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:23.990391 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1d3528c-e13f-406c-906b-8fcccfc1d320 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1716 microversion: 2.20 time: 0.538538 Aug 30 03:54:23.991090 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2687/5268] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:23 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1716 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:24.009680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:54:24.010259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:54:24.013641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:54:24.014396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:54:24.014957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:54:24.036661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:24.037164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:24.037642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:24.038374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:24.044117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:24.044857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:24.095041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Getting quotas for project e0945d2dda60463c9941432b3ace4f09. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:54:24.105842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Getting quotas for user 4940a80de346498ca649a692c3e0d6a6 and project e0945d2dda60463c9941432b3ace4f09. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:54:24.146276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:54:24.162008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:54:24.275796 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9be3fee1-6940-4781-860c-441ddabc6a49 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.447323 Aug 30 03:54:24.282428 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2582/5269] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:54:24.294108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f03e4fa-8e94-4b84-85dd-c473293c2d66 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:24.295560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f03e4fa-8e94-4b84-85dd-c473293c2d66 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:24.470282 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f03e4fa-8e94-4b84-85dd-c473293c2d66 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1329 microversion: 2.1 time: 0.180905 Aug 30 03:54:24.473965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:24.474566 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2688/5270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:24 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1329 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:24.474706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:24.495745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:24.496315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:24.496771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:24.497548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:24.499988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:24.500451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:24.956059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3d3b47bf-9b44-4197-928a-2e1d068bf9ab req-6566ce72-f571-447c-89e4-1c08c5fead69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f428005-e509-4fc2-b4ad-4c2866af18c3", "tag": "be31e482-29d9-4dab-8538-41f3620ca02e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:24.979110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d3b47bf-9b44-4197-928a-2e1d068bf9ab req-6566ce72-f571-447c-89e4-1c08c5fead69 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:24.980007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d3b47bf-9b44-4197-928a-2e1d068bf9ab req-6566ce72-f571-447c-89e4-1c08c5fead69 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:24.981233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d3b47bf-9b44-4197-928a-2e1d068bf9ab req-6566ce72-f571-447c-89e4-1c08c5fead69 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:25.021307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3d3b47bf-9b44-4197-928a-2e1d068bf9ab req-6566ce72-f571-447c-89e4-1c08c5fead69 service nova] Creating event network-changed:be31e482-29d9-4dab-8538-41f3620ca02e for instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 on n-h2-854924-5 Aug 30 03:54:25.035748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3d3b47bf-9b44-4197-928a-2e1d068bf9ab req-6566ce72-f571-447c-89e4-1c08c5fead69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088683 Aug 30 03:54:25.038234 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2689/5271] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:25.493848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:25.495230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:25.513150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:25.515819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:25.516483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:25.517572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:25.520857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:25.521528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:25.879263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:25.887675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f2e6554d-62f5-4c63-9ffd-dbb2deda76eb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1371 microversion: 2.1 time: 1.418142 Aug 30 03:54:25.888265 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2583/5272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:24 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1371 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:26.087211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:26.092039 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b327e52-3b50-4d3f-bfdf-061211a0ddd3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1338 microversion: 2.1 time: 0.602825 Aug 30 03:54:26.096716 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2690/5273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:25 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1338 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:26.917153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:26.917802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:26.937483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:26.945195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:26.945736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:26.946185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:26.946896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:26.953466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:26.955166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:27.118688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:27.119844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:27.135045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:27.138220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:27.139140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:27.141910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:27.143114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:27.143715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:27.439669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-122e43ec-6669-4cbf-834a-dd1af03be786 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1424 microversion: 2.1 time: 0.324831 Aug 30 03:54:27.453373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2691/5274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:27 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1424 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:27.657189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:27.676132 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33836ea3-51c8-4063-b453-1e18f2e8cf01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1371 microversion: 2.1 time: 0.762695 Aug 30 03:54:27.677279 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2584/5275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:26 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1371 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:28.465823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:28.466449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:28.482820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:28.483352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:28.483808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:28.484538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:28.485017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:28.485475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:28.697522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:28.698877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:28.713583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:28.721059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:28.724590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:28.725687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:28.728630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:28.729320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:28.796115 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8416c3d0-413c-44d4-8dcf-94b15548677d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.333832 Aug 30 03:54:28.805383 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2692/5276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:28 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:29.331861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:29.357484 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-690b9a57-5ade-4f42-a3fe-0da67cee2d1d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1371 microversion: 2.1 time: 0.663580 Aug 30 03:54:29.359702 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2585/5277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:28 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1371 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:29.828284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:29.833211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:29.860653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:29.875105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:29.875608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:29.880784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:29.882862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:29.883532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:30.383610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:30.385185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:30.397122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:30.399851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:30.401767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:30.404210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:30.405578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:30.406810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:30.625042 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5431928b-926d-4b97-815f-19d175e11584 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.801674 Aug 30 03:54:30.629289 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2693/5278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:29 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:30.642923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b8995eb6-eb8c-482b-ad4a-42a580ce4476 req-baf64cab-f2f0-4f3a-89fd-e18f3647dc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc7d50e-0ae5-46d6-a123-81df27045a0d", "tag": "7608886c-19c1-44f0-84d1-c7d86af074df"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:30.668035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b8995eb6-eb8c-482b-ad4a-42a580ce4476 req-baf64cab-f2f0-4f3a-89fd-e18f3647dc73 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:30.671049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b8995eb6-eb8c-482b-ad4a-42a580ce4476 req-baf64cab-f2f0-4f3a-89fd-e18f3647dc73 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:30.674959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b8995eb6-eb8c-482b-ad4a-42a580ce4476 req-baf64cab-f2f0-4f3a-89fd-e18f3647dc73 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:30.702782 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b8995eb6-eb8c-482b-ad4a-42a580ce4476 req-baf64cab-f2f0-4f3a-89fd-e18f3647dc73 service nova] Creating event network-changed:7608886c-19c1-44f0-84d1-c7d86af074df for instance ebc7d50e-0ae5-46d6-a123-81df27045a0d on n-h2-854924-5 Aug 30 03:54:30.738512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b8995eb6-eb8c-482b-ad4a-42a580ce4476 req-baf64cab-f2f0-4f3a-89fd-e18f3647dc73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105056 Aug 30 03:54:30.740514 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2694/5279] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:31.045627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:31.060793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c8904088-ce00-4b08-93b9-1ee641a52c83 req-76a3e077-2814-4f2a-ae22-396393aa99ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f428005-e509-4fc2-b4ad-4c2866af18c3", "name": "network-vif-plugged", "status": "completed", "tag": "be31e482-29d9-4dab-8538-41f3620ca02e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:31.075216 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dcc6491c-7ead-4a3c-ae40-f1dc98aabdae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1371 microversion: 2.1 time: 0.695655 Aug 30 03:54:31.096463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2586/5280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:30 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1371 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:31.108283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c8904088-ce00-4b08-93b9-1ee641a52c83 req-76a3e077-2814-4f2a-ae22-396393aa99ca service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:31.108926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c8904088-ce00-4b08-93b9-1ee641a52c83 req-76a3e077-2814-4f2a-ae22-396393aa99ca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:31.109489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c8904088-ce00-4b08-93b9-1ee641a52c83 req-76a3e077-2814-4f2a-ae22-396393aa99ca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:31.123610 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c8904088-ce00-4b08-93b9-1ee641a52c83 req-76a3e077-2814-4f2a-ae22-396393aa99ca service nova] Creating event network-vif-plugged:be31e482-29d9-4dab-8538-41f3620ca02e for instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 on n-h2-854924-5 Aug 30 03:54:31.133003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c8904088-ce00-4b08-93b9-1ee641a52c83 req-76a3e077-2814-4f2a-ae22-396393aa99ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096677 Aug 30 03:54:31.133874 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2695/5281] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:54:31.654833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:31.656089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:31.672159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:31.674438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:31.675318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:31.682465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:31.683734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:31.685016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:31.980744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-185444b7-efa0-4811-b7ab-9ce50fd5385d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.331233 Aug 30 03:54:31.982981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2587/5282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:31 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:32.127332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:32.129030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:32.150042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:32.153011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:32.166068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:32.166648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:32.176178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:32.177929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:32.181823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:32.535477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:32.550074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bbe92021-cb1e-41ff-bfce-44c203604623 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1371 microversion: 2.1 time: 0.442508 Aug 30 03:54:32.551414 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2696/5283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:32 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1371 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:33.004690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:33.005946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:33.031439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:33.033992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:33.034438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:33.038919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:33.039939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:33.040540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:33.375815 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3cc435ce-a55c-4148-9f23-f46b2a6a1527 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.375346 Aug 30 03:54:33.377000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2588/5284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:32 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:33.575440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:33.577171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:33.583234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=60 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:33.596059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:33.596574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:33.597035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:33.597787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:33.598251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:33.598687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:34.159573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:34.172051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70e838a0-973b-4929-a2af-ca1e8c2d9704 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1564 microversion: 2.1 time: 0.601437 Aug 30 03:54:34.173367 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2697/5285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:33 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1564 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:34.199107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:34.200786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:34.211588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:34.212898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:34.216026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:34.221947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:34.223382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:34.224966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:34.227078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:34.229078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:34.400958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:34.405866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:34.431865 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-986060ef-b4ab-40fc-9efb-cf6579d3eab5 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238748 Aug 30 03:54:34.432047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:34.433370 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2589/5286] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:54:34 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:34.435735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:34.436326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:34.437791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:34.439718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:34.440136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:34.480421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:34.803512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6a142c9-4227-4106-8473-a65f28f73c88 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.408234 Aug 30 03:54:34.804207 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2698/5287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:34 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:35.826076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:35.827624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:35.836502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:35.837422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:35.838130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:35.839094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:35.839801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:35.840645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:35.845717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:36.590748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-26b76327-fd6b-4c39-9c6b-d4e3e90be7bb req-76d99019-05c4-4b44-8e04-7f52808cc81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f428005-e509-4fc2-b4ad-4c2866af18c3", "tag": "be31e482-29d9-4dab-8538-41f3620ca02e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:36.619114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-26b76327-fd6b-4c39-9c6b-d4e3e90be7bb req-76d99019-05c4-4b44-8e04-7f52808cc81d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:36.621483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-26b76327-fd6b-4c39-9c6b-d4e3e90be7bb req-76d99019-05c4-4b44-8e04-7f52808cc81d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:36.622964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-26b76327-fd6b-4c39-9c6b-d4e3e90be7bb req-76d99019-05c4-4b44-8e04-7f52808cc81d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:36.667145 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d80ac3c-685a-41a4-a29e-9542197a3f05 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.846096 Aug 30 03:54:36.670140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2590/5288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:35 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:36.688875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-26b76327-fd6b-4c39-9c6b-d4e3e90be7bb req-76d99019-05c4-4b44-8e04-7f52808cc81d service nova] Creating event network-changed:be31e482-29d9-4dab-8538-41f3620ca02e for instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 on n-h2-854924-5 Aug 30 03:54:36.695748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-26b76327-fd6b-4c39-9c6b-d4e3e90be7bb req-76d99019-05c4-4b44-8e04-7f52808cc81d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110243 Aug 30 03:54:36.699783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2699/5289] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:54:37.183806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9337ed1e-2adf-4541-aa1d-f38e6c20c5bb req-c6bc0743-3682-42a9-bb7c-dd89d8432e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc7d50e-0ae5-46d6-a123-81df27045a0d", "name": "network-vif-plugged", "status": "completed", "tag": "7608886c-19c1-44f0-84d1-c7d86af074df"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:37.208586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9337ed1e-2adf-4541-aa1d-f38e6c20c5bb req-c6bc0743-3682-42a9-bb7c-dd89d8432e18 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:37.211812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9337ed1e-2adf-4541-aa1d-f38e6c20c5bb req-c6bc0743-3682-42a9-bb7c-dd89d8432e18 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:37.212560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9337ed1e-2adf-4541-aa1d-f38e6c20c5bb req-c6bc0743-3682-42a9-bb7c-dd89d8432e18 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:37.246983 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9337ed1e-2adf-4541-aa1d-f38e6c20c5bb req-c6bc0743-3682-42a9-bb7c-dd89d8432e18 service nova] Creating event network-vif-plugged:7608886c-19c1-44f0-84d1-c7d86af074df for instance ebc7d50e-0ae5-46d6-a123-81df27045a0d on n-h2-854924-5 Aug 30 03:54:37.259900 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9337ed1e-2adf-4541-aa1d-f38e6c20c5bb req-c6bc0743-3682-42a9-bb7c-dd89d8432e18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093849 Aug 30 03:54:37.262040 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2591/5290] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:54:37.692462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:37.693188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:37.727313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:37.727839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:37.729578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:37.731913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:37.736042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:37.737337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:38.343804 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b3791c3-5eea-4cf8-ab5c-8979f5f1e365 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1464 microversion: 2.1 time: 0.656596 Aug 30 03:54:38.344756 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2700/5291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:37 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1464 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:39.366083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:39.366796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:39.408562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:39.409115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:39.411286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:39.412081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:39.412551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:39.412987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:40.062717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0d42e46-55bb-4f17-81c4-c785b5db7547 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1649 microversion: 2.1 time: 0.700006 Aug 30 03:54:40.104625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:40.105993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:40.111143 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2592/5292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:39 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1649 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:40.114667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:40.117701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:40.121686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:40.126054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:40.127533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:40.128274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:40.749796 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70755347-3b51-4681-84a9-ada3ba436edb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1649 microversion: 2.1 time: 0.647648 Aug 30 03:54:40.754408 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2701/5293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:40 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1649 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:40.773596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:40.774899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:40.783117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:40.784049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:40.784708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:40.785668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:40.786345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:40.787009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:41.257083 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a4465ab4-c22f-4e36-8c35-5d6743b96f9a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1649 microversion: 2.1 time: 0.487505 Aug 30 03:54:41.274066 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2593/5294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:40 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1649 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:41.552931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-118954950", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "availability_zone": "nova:n-h1-854924-5", "networks": [{"uuid": "777feff9-865c-446e-a998-d077901dae1e"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:41.677605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] validate_networks() for [('777feff9-865c-446e-a998-d077901dae1e', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:54:42.803854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:54:42.804908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:54:42.806377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:54:42.806961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:54:42.807540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:54:42.832757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:42.833482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:42.834200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:42.835650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:42.836273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:42.841238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:42.896428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Getting quotas for project e0945d2dda60463c9941432b3ace4f09. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:54:42.904218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Getting quotas for user 4940a80de346498ca649a692c3e0d6a6 and project e0945d2dda60463c9941432b3ace4f09. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:54:42.931806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:54:42.935248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:54:43.002919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37460680-9522-4b6e-a222-0f4ec27c258d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456437 Aug 30 03:54:43.004626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2702/5295] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:54:43.027007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f126a534-0f4b-4206-a512-661bba58aff4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:43.030662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f126a534-0f4b-4206-a512-661bba58aff4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:43.238957 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f126a534-0f4b-4206-a512-661bba58aff4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1328 microversion: 2.1 time: 0.220245 Aug 30 03:54:43.259137 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2594/5296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:43 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1328 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:44.268099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c66bbb88-8872-4b0f-88f2-7dfe10f13c55 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:44.271245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c66bbb88-8872-4b0f-88f2-7dfe10f13c55 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:44.517910 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c66bbb88-8872-4b0f-88f2-7dfe10f13c55 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1328 microversion: 2.1 time: 0.245000 Aug 30 03:54:44.518876 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2703/5297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:44 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1328 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:45.553892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:45.554834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:45.569643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:45.580835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:45.583622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:45.584549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:45.585203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:45.589564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:45.722597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f11e1c39-f126-4e79-acf6-37ebca1a8eb5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1415 microversion: 2.1 time: 0.171329 Aug 30 03:54:45.723378 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2595/5298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:45 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1415 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:46.489686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98128688-c1e4-4dd3-9e2a-f4ae09aab20f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Action: 'create', calling method: .version_select at 0x7f897be11940>, body: {"keypair": {"name": "tempest-keypair-49900241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9/Wpe1eO5zm88AqlsK5qDpZ0r00rcLAbi8iVRvE/xEHlJyfYlB4FbxHLo9aW8RqG/utL65QXJ4SCzM4ocSoK8u32PATodqgpv4KdTxEDO6M2Y4quPfjlvsmQanKgZgkw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:46.520724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-98128688-c1e4-4dd3-9e2a-f4ae09aab20f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Getting quotas for project 90eab31f60e34f6483f85eaa04fe1439. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:54:46.539430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-98128688-c1e4-4dd3-9e2a-f4ae09aab20f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Getting quotas for user 189c6e8abfdc4bff98b8197516648856 and project 90eab31f60e34f6483f85eaa04fe1439. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:54:46.615964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98128688-c1e4-4dd3-9e2a-f4ae09aab20f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.133899 Aug 30 03:54:46.624012 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2704/5299] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 03:54:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 03:54:46.744629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:46.746114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:46.763207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:46.764026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:46.765079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:46.766243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:46.767293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:46.768429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:47.119576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ebf32ae8-6352-4308-a54c-819bdfcb717b tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1421 microversion: 2.1 time: 0.378649 Aug 30 03:54:47.120898 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2596/5300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:46 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1421 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:48.147884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:48.149370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:48.155953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:48.156777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:48.157983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:48.158947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:48.159633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:48.160271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:48.710543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2f7b40e-124a-4da8-beab-a9fe89dfa6a3 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.569204 Aug 30 03:54:48.712055 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2705/5301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:48 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:49.731806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:49.732423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:49.752586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:49.754003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:49.758527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:49.759936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:49.760631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:49.761264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:50.179264 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e739667-0d88-4853-b281-90b824cf9a7d tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.451034 Aug 30 03:54:50.180166 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2597/5302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:49 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:50.412398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-79f855b9-9e0b-49ca-9397-fe03a5abbdc3 req-b335fb0b-e11a-4d74-839d-f2db2efc02a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b5adca-f5cd-4e4b-88f8-c422ec0a49e5", "tag": "5311720a-6855-4a13-a025-2e461a1bebdc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:50.437147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-79f855b9-9e0b-49ca-9397-fe03a5abbdc3 req-b335fb0b-e11a-4d74-839d-f2db2efc02a6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:50.437929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-79f855b9-9e0b-49ca-9397-fe03a5abbdc3 req-b335fb0b-e11a-4d74-839d-f2db2efc02a6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:50.442951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-79f855b9-9e0b-49ca-9397-fe03a5abbdc3 req-b335fb0b-e11a-4d74-839d-f2db2efc02a6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:50.454866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-79f855b9-9e0b-49ca-9397-fe03a5abbdc3 req-b335fb0b-e11a-4d74-839d-f2db2efc02a6 service nova] Creating event network-changed:5311720a-6855-4a13-a025-2e461a1bebdc for instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 on n-h1-854924-5 Aug 30 03:54:50.462791 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-79f855b9-9e0b-49ca-9397-fe03a5abbdc3 req-b335fb0b-e11a-4d74-839d-f2db2efc02a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055611 Aug 30 03:54:50.463833 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2706/5303] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:51.209191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1296828574", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f70c565e-ea91-40ef-bc00-2b98e0ff05cf"}, {"port": "c3247ab7-8a1d-4c06-bbd1-0c13981a2ff6", "tag": "port-1"}, {"port": "cba8fb2e-9127-4001-a88a-fa2c2a531b21", "tag": "port-2"}, {"uuid": "9e50dd4a-a2d1-4c98-a6a2-b20ae6a89448", "tag": "net-1"}, {"uuid": "9e50dd4a-a2d1-4c98-a6a2-b20ae6a89448"}, {"uuid": "8659fc42-12b4-423b-b163-5181e57d6b4f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8659fc42-12b4-423b-b163-5181e57d6b4f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4fa12784-a6bb-450f-a118-85010370b5b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b15c58ff-df43-49c9-b7cd-5c41ac4c2bc2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "279fedd3-0251-4886-9ba2-ad5259557ec1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--998610122"}], "key_name": "tempest-keypair-49900241", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:51.210333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:51.210983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:51.223029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:51.225667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:51.226119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:51.226839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:51.227297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:51.227910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:51.379683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] validate_networks() for [('f70c565e-ea91-40ef-bc00-2b98e0ff05cf', None, None, None, None, None), (None, None, 'c3247ab7-8a1d-4c06-bbd1-0c13981a2ff6', None, None, None), (None, None, 'cba8fb2e-9127-4001-a88a-fa2c2a531b21', None, None, None), ('9e50dd4a-a2d1-4c98-a6a2-b20ae6a89448', None, None, None, None, None), ('9e50dd4a-a2d1-4c98-a6a2-b20ae6a89448', None, None, None, None, None), ('8659fc42-12b4-423b-b163-5181e57d6b4f', '10.2.2.100', None, None, None, None), ('8659fc42-12b4-423b-b163-5181e57d6b4f', '10.2.2.200', None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:54:51.528071 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-14cd7416-3d40-4819-82dc-9891f74ee25f tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.331763 Aug 30 03:54:51.546577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2598/5304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:51 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:52.558598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:52.558598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:52.568499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:52.569004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:52.569614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:52.570527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:52.571089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:52.571585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:52.871060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:52.970926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e38151fb-deb7-473d-9b4d-cf212fe1e466 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.418527 Aug 30 03:54:52.973943 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2599/5305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:52 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:53.995290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:53.995941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:53.997916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:54.007668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:54.008172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:54.008642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:54.009390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:54.009822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:54.010315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:54.447457 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b058b8e1-8f71-4883-bcd2-a2deb2d5b48a tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.454711 Aug 30 03:54:54.448465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2600/5306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:53 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:55.443380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:54:55.444321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:54:55.446239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:54:55.447031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:54:55.448349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:54:55.465241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:55.466420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:55.467905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:55.469259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:55.471020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:55.472234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:55.473409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:55.480468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:55.481392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:55.482008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:55.482876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:55.483505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:55.484074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:55.487196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:55.562779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Getting quotas for project 90eab31f60e34f6483f85eaa04fe1439. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:54:55.578243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Getting quotas for user 189c6e8abfdc4bff98b8197516648856 and project 90eab31f60e34f6483f85eaa04fe1439. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:54:55.752523 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2cabb954-07f4-4704-8ee2-41cedc106682 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.284377 Aug 30 03:54:55.753895 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2601/5307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:55 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:55.948312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:54:55.952417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4fa12784-a6bb-450f-a118-85010370b5b8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b15c58ff-df43-49c9-b7cd-5c41ac4c2bc2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='279fedd3-0251-4886-9ba2-ad5259557ec1',volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:54:56.528229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b4b44af-1821-4a36-a657-c5553e66426a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.323149 Aug 30 03:54:56.529864 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2707/5308] 10.222.0.30 () {62 vars in 1189 bytes} [Tue Aug 30 03:54:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 5326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 03:54:56.540596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07e8108d-a372-449a-be5f-d089c8c6f325 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:56.541857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-07e8108d-a372-449a-be5f-d089c8c6f325 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:56.775581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:56.777821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:56.794289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:56.795543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:56.797915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:56.798805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:56.799377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:56.801609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:56.945927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-07e8108d-a372-449a-be5f-d089c8c6f325 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:56.954872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-07e8108d-a372-449a-be5f-d089c8c6f325 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:56.957158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-07e8108d-a372-449a-be5f-d089c8c6f325 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:56.959111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-07e8108d-a372-449a-be5f-d089c8c6f325 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1284 microversion: 2.32 time: 0.422470 Aug 30 03:54:56.959894 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2602/5309] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:56 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:57.223959 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b5843ea-4d3d-4156-a7de-512e8711f023 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.453657 Aug 30 03:54:57.224775 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2708/5310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:56 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:54:57.375102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3b9fdca3-90f0-43bf-afbd-2cde7dc3eea2 req-cc5310c7-0c48-4b9f-9fea-1482dfd278c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b5adca-f5cd-4e4b-88f8-c422ec0a49e5", "name": "network-vif-plugged", "status": "completed", "tag": "5311720a-6855-4a13-a025-2e461a1bebdc"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:54:57.393321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=42 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:57.410287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3b9fdca3-90f0-43bf-afbd-2cde7dc3eea2 req-cc5310c7-0c48-4b9f-9fea-1482dfd278c0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:57.410826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3b9fdca3-90f0-43bf-afbd-2cde7dc3eea2 req-cc5310c7-0c48-4b9f-9fea-1482dfd278c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:57.411200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3b9fdca3-90f0-43bf-afbd-2cde7dc3eea2 req-cc5310c7-0c48-4b9f-9fea-1482dfd278c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:57.451733 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3b9fdca3-90f0-43bf-afbd-2cde7dc3eea2 req-cc5310c7-0c48-4b9f-9fea-1482dfd278c0 service nova] Creating event network-vif-plugged:5311720a-6855-4a13-a025-2e461a1bebdc for instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 on n-h1-854924-5 Aug 30 03:54:57.463663 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3b9fdca3-90f0-43bf-afbd-2cde7dc3eea2 req-cc5310c7-0c48-4b9f-9fea-1482dfd278c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091995 Aug 30 03:54:57.465728 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2603/5311] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:54:57.983328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:57.984116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:57.997798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:58.002575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:58.003363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:58.004550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:58.010277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:58.010739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:58.074044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=73 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:54:58.252364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:58.253071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:58.267069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:58.268289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:58.268953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:58.269584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:58.270476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:58.271090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:58.271675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:58.279931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:58.285713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:58.289652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5cef535b-d4c7-419d-8c04-e54669504fa8 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1526 microversion: 2.32 time: 0.308208 Aug 30 03:54:58.290741 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2709/5312] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:57 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1526 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:58.664537 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe99d49a-e7d6-4a27-adee-44d3214f6cfd tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1463 microversion: 2.1 time: 0.416177 Aug 30 03:54:58.677405 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2604/5313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:58 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1463 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:54:59.324638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:59.325617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:59.343996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:59.344609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:59.345130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:59.345874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:59.346333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:59.346761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:59.642124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:59.652326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:59.662381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:54:59.666996 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e103067a-7129-4dff-a71c-63445af8ec09 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1592 microversion: 2.32 time: 0.354294 Aug 30 03:54:59.667798 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2710/5314] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:54:59 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1592 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:54:59.692549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:54:59.693169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:54:59.708978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:59.709822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:59.710414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:54:59.711495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:54:59.712111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:54:59.712715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.022979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-871fb79c-a3c7-4c11-a39a-3ca5defbba91 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1648 microversion: 2.1 time: 0.337376 Aug 30 03:55:00.025981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2605/5315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:54:59 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1648 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:00.048540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:00.049720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:00.078357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:00.079386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:00.079832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.080546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:00.081006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:00.081457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.379511 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0897d9f-c61e-466d-b5a7-4f06e04e2137 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1648 microversion: 2.1 time: 0.334471 Aug 30 03:55:00.381964 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2711/5316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:00 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1648 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:00.411883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:00.412742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:00.422728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:00.423245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:00.434076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.434951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:00.435431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:00.435899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.696418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:00.697704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:00.711071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:00.711943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:00.716311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.717584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:00.718462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:00.719119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:00.979485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:01.008076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:01.009875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:01.011277 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d33fa5e4-cb85-4d8a-ac29-c076cbe116bd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1592 microversion: 2.32 time: 0.319134 Aug 30 03:55:01.011885 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2712/5317] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:00 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1592 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:55:01.393485 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a953d4d0-6c6c-4169-9739-3ffd78d69f92 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1648 microversion: 2.1 time: 0.985197 Aug 30 03:55:01.394567 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2606/5318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:00 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1648 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:01.417548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:01.423565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:01.447888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:01.448597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:01.449301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:01.450411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:01.453182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:01.454858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:01.510914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:55:01.743563 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba187453-1d3d-4eca-91f7-877a98e0d4d6 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 204 len: 0 microversion: 2.1 time: 0.329678 Aug 30 03:55:01.747732 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2713/5319] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:55:01 2022] DELETE /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:55:01.757054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:01.757714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:01.767194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:01.779433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:01.784010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:01.786527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:01.787193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:01.789307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:02.039959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:02.040740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:02.054190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:02.054752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:02.055202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:02.055935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:02.056392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:02.056814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:02.686531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:02.708000 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-da4aba3e-6316-4449-970d-fe6372128c32 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1654 microversion: 2.1 time: 0.953055 Aug 30 03:55:02.726833 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2607/5320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:01 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1654 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:02.726938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:02.726938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:02.726938 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6733e3d2-231c-4fde-b40c-868bbfa22b5c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1659 microversion: 2.32 time: 0.682578 Aug 30 03:55:02.734952 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2714/5321] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:02 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1659 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:03.749042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:03.751694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:03.752386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:03.756228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:03.774439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:03.776161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:03.779039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:03.779622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:03.782432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:03.788062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:03.788615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:03.788867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:03.789067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:03.789546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:03.789823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:03.790274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:03.790701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:04.500410 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f26a4671-d8e3-4f11-b72d-6fb202695239 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1654 microversion: 2.1 time: 0.762913 Aug 30 03:55:04.502203 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2608/5322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:03 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1654 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:04.555244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:04.573378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:04.578838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:04.580044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4de6a50-9fc5-46e9-addd-9a29dd7bf0ca tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1705 microversion: 2.32 time: 0.836924 Aug 30 03:55:04.582030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2715/5323] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:03 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1705 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:05.526213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:05.526952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:05.545068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:05.550247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:05.550896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:05.553132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:05.553699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:05.554142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:05.609287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:05.610312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:05.642186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:05.647862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=18 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:05.655426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:05.658015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:05.660049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:05.662490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:05.663172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:05.664585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:06.489727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:06.498529 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66b8284f-7712-4d51-8662-a25a86165602 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 200 len: 1612 microversion: 2.1 time: 0.978554 Aug 30 03:55:06.504356 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2609/5324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:05 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 1612 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:06.517975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-12310fb1-c74c-41dc-a794-21f46a980b5d req-61243152-96e9-4284-a436-c164782eeff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b5adca-f5cd-4e4b-88f8-c422ec0a49e5", "name": "network-vif-deleted", "tag": "5311720a-6855-4a13-a025-2e461a1bebdc"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:06.541908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-12310fb1-c74c-41dc-a794-21f46a980b5d req-61243152-96e9-4284-a436-c164782eeff9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:06.542497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-12310fb1-c74c-41dc-a794-21f46a980b5d req-61243152-96e9-4284-a436-c164782eeff9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:06.542821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-12310fb1-c74c-41dc-a794-21f46a980b5d req-61243152-96e9-4284-a436-c164782eeff9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:06.576674 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-12310fb1-c74c-41dc-a794-21f46a980b5d req-61243152-96e9-4284-a436-c164782eeff9 service nova] Creating event network-vif-deleted:5311720a-6855-4a13-a025-2e461a1bebdc for instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 on n-h1-854924-5 Aug 30 03:55:06.592759 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-12310fb1-c74c-41dc-a794-21f46a980b5d req-61243152-96e9-4284-a436-c164782eeff9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085232 Aug 30 03:55:06.594139 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2610/5325] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:07.028387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:07.051381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:07.055559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:07.058641 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ea617f5-6da6-4195-b5d8-cb92eb589e1e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1705 microversion: 2.32 time: 1.455307 Aug 30 03:55:07.066900 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2716/5326] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:05 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1705 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:07.519531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:07.531394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:07.533470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:07.562517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:07.571574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:07.578267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:07.579343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:07.580041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:07.580711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:07.681595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] HTTP exception thrown: Instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 could not be found. Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Request method failure captured: Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 HTTP/1.1 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYnsQFGKjSeJEzLWdXHyCKTSxWBzSmAtNaPqQsxTQWCU_JnnhuvsaEFFBbJCmtuJ7bzvRZBCuxACttlBMAZKBoa8_H8B0XE4ZeFCFfowX6hPogHri13ti0EnBYbkKG2ItJUqZ1cK1RQA93URI85teCrbGhbFAsG-eJz_rkxAF9VL7rk Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e0945d2dda60463c9941432b3ace4f09 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestServerMultinode-1705189752 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0945d2dda60463c9941432b3ace4f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e0945d2dda60463c9941432b3ace4f09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e0945d2dda60463c9941432b3ace4f09", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0945d2dda60463c9941432b3ace4f09"}]}] Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestServerMultinode-1705189752 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e0945d2dda60463c9941432b3ace4f09 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestServerMultinode-1705189752 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestServerMultinode-1705189752-project-admin Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4940a80de346498ca649a692c3e0d6a6 Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestServerMultinode-1705189752-project-admin Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 could not be found. Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '24b5adca-f5cd-4e4b-88f8-c422ec0a49e5'} Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 could not be found. Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 could not be found. Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:07.717115 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 could not be found. Aug 30 03:55:07.721862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:07.722334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Returning 404 to user: Instance 24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:07.728761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2f2ade21-4836-403f-8035-70fa2accd145 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5" status: 404 len: 111 microversion: 2.1 time: 0.208577 Aug 30 03:55:07.735534 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2611/5327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:07 2022] GET /compute/v2.1/servers/24b5adca-f5cd-4e4b-88f8-c422ec0a49e5 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:55:07.744153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:07.744838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:07.777434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:07.778322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:07.779442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:07.781729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:07.784602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:07.785506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:07.853914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:55:08.090375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:08.092517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:08.105092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:08.110995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:08.111687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:08.112633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:08.113105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:08.116494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:08.153250 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f564cfcd-dde1-4088-80e5-398f34ed7aaa tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 204 len: 0 microversion: 2.1 time: 0.412821 Aug 30 03:55:08.158710 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2717/5328] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:55:07 2022] DELETE /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:55:08.164709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:08.170108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:08.183360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:08.186270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:08.186946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:08.193574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:08.196983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:08.197805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:08.957956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:08.968904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:08.975130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:08.976347 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd7b389e-b79c-43d8-8bb9-6ac881b139d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1751 microversion: 2.32 time: 0.891796 Aug 30 03:55:08.980897 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2612/5329] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:08 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1751 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:09.394482 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01bc7fc2-eb23-46a7-bacc-f6ac6c941adb tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1655 microversion: 2.1 time: 1.230959 Aug 30 03:55:09.399493 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2718/5330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:08 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1655 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:10.000225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:10.000916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:10.032889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:10.033690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:10.033822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:10.042417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:10.043131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:10.043780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:10.420162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:10.421453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:10.440557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:10.441395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:10.442029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:10.442928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:10.443601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:10.444366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:10.502325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:10.519033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:10.521178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:10.522497 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-695978f9-8b5b-461e-b99e-aea1de06b504 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1751 microversion: 2.32 time: 0.526212 Aug 30 03:55:10.523398 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2613/5331] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:09 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1751 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:10.776915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13687827-870b-424b-8064-7c8fcb24b3d5 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1655 microversion: 2.1 time: 0.360538 Aug 30 03:55:10.789365 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2719/5332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:10 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1655 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:11.067927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fff9f7e-fb94-4604-97a5-15139abe8a1c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:11.079261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:11.103667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:11.104173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:11.104621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:11.105353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:11.105797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:11.106232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:11.549571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:11.550195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:11.574647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:11.575164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:11.575611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:11.576343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:11.577105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:11.577269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:11.605736 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77c296b2-639b-4d42-a520-08479126ed11 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543824 Aug 30 03:55:11.623805 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2614/5333] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:55:11 2022] POST /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:11.810662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:11.811296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:11.836076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:11.836584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:11.837031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:11.837782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:11.838247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:11.838680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:13.009092 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fad5c3e2-ca62-4435-80f8-06c02ffbe0b4 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 200 len: 1655 microversion: 2.1 time: 1.202465 Aug 30 03:55:13.014428 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2615/5334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:11 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 1655 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:13.439335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-88343118-299f-4c34-9def-76b36b7d3b1a req-b05266cb-fbe3-45b5-89c3-b734a420afab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc7d50e-0ae5-46d6-a123-81df27045a0d", "name": "network-vif-deleted", "tag": "7608886c-19c1-44f0-84d1-c7d86af074df"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:13.468811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-88343118-299f-4c34-9def-76b36b7d3b1a req-b05266cb-fbe3-45b5-89c3-b734a420afab service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:13.469565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-88343118-299f-4c34-9def-76b36b7d3b1a req-b05266cb-fbe3-45b5-89c3-b734a420afab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:13.469825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-88343118-299f-4c34-9def-76b36b7d3b1a req-b05266cb-fbe3-45b5-89c3-b734a420afab service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:13.524036 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-88343118-299f-4c34-9def-76b36b7d3b1a req-b05266cb-fbe3-45b5-89c3-b734a420afab service nova] Creating event network-vif-deleted:7608886c-19c1-44f0-84d1-c7d86af074df for instance ebc7d50e-0ae5-46d6-a123-81df27045a0d on n-h2-854924-5 Aug 30 03:55:13.549619 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-88343118-299f-4c34-9def-76b36b7d3b1a req-b05266cb-fbe3-45b5-89c3-b734a420afab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.485510 Aug 30 03:55:13.567303 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2616/5335] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:55:13.586016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:13.602762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:13.603736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:13.604925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9f51699-f242-497c-b4f0-418054d53273 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1797 microversion: 2.32 time: 2.059671 Aug 30 03:55:13.625927 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2720/5336] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:11 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1797 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:14.052507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:14.058121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] [instance: ebc7d50e-0ae5-46d6-a123-81df27045a0d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:14.069909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:14.074839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:14.075348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:14.076183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:14.076655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:14.077140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:14.127382 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] HTTP exception thrown: Instance ebc7d50e-0ae5-46d6-a123-81df27045a0d could not be found. Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Request method failure captured: Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d HTTP/1.1 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYnsQFGKjSeJEzLWdXHyCKTSxWBzSmAtNaPqQsxTQWCU_JnnhuvsaEFFBbJCmtuJ7bzvRZBCuxACttlBMAZKBoa8_H8B0XE4ZeFCFfowX6hPogHri13ti0EnBYbkKG2ItJUqZ1cK1RQA93URI85teCrbGhbFAsG-eJz_rkxAF9VL7rk Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: e0945d2dda60463c9941432b3ace4f09 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestServerMultinode-1705189752 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0945d2dda60463c9941432b3ace4f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e0945d2dda60463c9941432b3ace4f09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e0945d2dda60463c9941432b3ace4f09", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0945d2dda60463c9941432b3ace4f09"}]}] Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestServerMultinode-1705189752 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: e0945d2dda60463c9941432b3ace4f09 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestServerMultinode-1705189752 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestServerMultinode-1705189752-project-admin Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4940a80de346498ca649a692c3e0d6a6 Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestServerMultinode-1705189752-project-admin Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance ebc7d50e-0ae5-46d6-a123-81df27045a0d could not be found. Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'ebc7d50e-0ae5-46d6-a123-81df27045a0d'} Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc7d50e-0ae5-46d6-a123-81df27045a0d could not be found. Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc7d50e-0ae5-46d6-a123-81df27045a0d could not be found. Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:14.129089 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc7d50e-0ae5-46d6-a123-81df27045a0d could not be found. Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:14.133304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] Returning 404 to user: Instance ebc7d50e-0ae5-46d6-a123-81df27045a0d could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:14.146957 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-325a0f80-1ae8-4411-a49f-c95586365d25 tempest-TestServerMultinode-1705189752 tempest-TestServerMultinode-1705189752-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d" status: 404 len: 111 microversion: 2.1 time: 0.092062 Aug 30 03:55:14.162540 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2617/5337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:14 2022] GET /compute/v2.1/servers/ebc7d50e-0ae5-46d6-a123-81df27045a0d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:55:14.633932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:14.634570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:14.654450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:14.655019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:14.656367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:14.657175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:14.660565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:14.661134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:15.422225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:15.442914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:15.447186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:15.452920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-385ec3fc-13fe-417e-9b5c-9a44063542f7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1843 microversion: 2.32 time: 0.823379 Aug 30 03:55:15.457003 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2721/5338] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:14 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1843 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:16.102792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5e0e969c-12d2-4efe-b3c8-b8b3941abbbe req-f9093ec2-c35f-432d-95b7-66fe69310605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:16.124865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5e0e969c-12d2-4efe-b3c8-b8b3941abbbe req-f9093ec2-c35f-432d-95b7-66fe69310605 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:16.125989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5e0e969c-12d2-4efe-b3c8-b8b3941abbbe req-f9093ec2-c35f-432d-95b7-66fe69310605 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:16.126498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5e0e969c-12d2-4efe-b3c8-b8b3941abbbe req-f9093ec2-c35f-432d-95b7-66fe69310605 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:16.155705 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5e0e969c-12d2-4efe-b3c8-b8b3941abbbe req-f9093ec2-c35f-432d-95b7-66fe69310605 service nova] Creating event network-changed:5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:16.166089 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5e0e969c-12d2-4efe-b3c8-b8b3941abbbe req-f9093ec2-c35f-432d-95b7-66fe69310605 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068391 Aug 30 03:55:16.184733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2618/5339] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:16.479786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:16.480983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:16.494631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:16.498724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:16.499543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:16.500599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:16.501754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:16.507426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:16.542918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:17.549148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:17.560013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:17.567202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:17.576094 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4841f5fe-cf13-48b9-88a8-1c87e431d773 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1843 microversion: 2.32 time: 1.100625 Aug 30 03:55:17.576954 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2722/5340] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:16 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1843 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:18.288055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-567b2870-ea5d-482a-87d5-a421be1b9822 req-c1da7a05-7457-44ae-b9ac-0c0e75e478b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "c3247ab7-8a1d-4c06-bbd1-0c13981a2ff6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:18.304179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-567b2870-ea5d-482a-87d5-a421be1b9822 req-c1da7a05-7457-44ae-b9ac-0c0e75e478b8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:18.304179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-567b2870-ea5d-482a-87d5-a421be1b9822 req-c1da7a05-7457-44ae-b9ac-0c0e75e478b8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:18.304657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-567b2870-ea5d-482a-87d5-a421be1b9822 req-c1da7a05-7457-44ae-b9ac-0c0e75e478b8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:18.331874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-567b2870-ea5d-482a-87d5-a421be1b9822 req-c1da7a05-7457-44ae-b9ac-0c0e75e478b8 service nova] Creating event network-changed:c3247ab7-8a1d-4c06-bbd1-0c13981a2ff6 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:18.336976 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-567b2870-ea5d-482a-87d5-a421be1b9822 req-c1da7a05-7457-44ae-b9ac-0c0e75e478b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053011 Aug 30 03:55:18.345690 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2619/5341] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:18.604136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:18.604759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:18.621086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:18.621874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:18.622782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:18.623250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:18.623704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:18.624427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:19.159195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:19.173764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:19.175189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:19.182289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb0e93b9-aea2-4a7f-b018-403e2dac2934 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1864 microversion: 2.32 time: 0.582015 Aug 30 03:55:19.183251 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2723/5342] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:18 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1864 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:20.212069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:20.212706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:20.231232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:20.233659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:20.236319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:20.239121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:20.240551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:20.241176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:21.062345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a0dfaef2-96a1-482b-bc9a-c3ebb76b7f85 req-43ed72f8-465d-4fe3-b69d-4bce4594becb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "cba8fb2e-9127-4001-a88a-fa2c2a531b21"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:21.096757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a0dfaef2-96a1-482b-bc9a-c3ebb76b7f85 req-43ed72f8-465d-4fe3-b69d-4bce4594becb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:21.098701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a0dfaef2-96a1-482b-bc9a-c3ebb76b7f85 req-43ed72f8-465d-4fe3-b69d-4bce4594becb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:21.099349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a0dfaef2-96a1-482b-bc9a-c3ebb76b7f85 req-43ed72f8-465d-4fe3-b69d-4bce4594becb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:21.147098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a0dfaef2-96a1-482b-bc9a-c3ebb76b7f85 req-43ed72f8-465d-4fe3-b69d-4bce4594becb service nova] Creating event network-changed:cba8fb2e-9127-4001-a88a-fa2c2a531b21 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:21.161768 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a0dfaef2-96a1-482b-bc9a-c3ebb76b7f85 req-43ed72f8-465d-4fe3-b69d-4bce4594becb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101887 Aug 30 03:55:21.163647 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2724/5343] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:21.742336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:21.761020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:21.769589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:21.771755 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68e764f2-6027-4d32-a1ea-9587cef48d0c tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 1.566370 Aug 30 03:55:21.775979 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2620/5344] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:20 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:22.802638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:22.804177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:22.811905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:22.819475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:22.820289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:22.821274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:22.821927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:22.823025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:23.475497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:23.487135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:23.489127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:23.489791 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cde249d6-afc0-4300-ab9e-9004386cbc99 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 0.694223 Aug 30 03:55:23.500535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2725/5345] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:22 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:24.397203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c828cf59-42d6-47ad-aa74-296600fd40ae req-e4c72318-ff3e-46f7-a093-6e6a68460eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "cc199761-2a7f-468d-baab-243aded35f64"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:24.439031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c828cf59-42d6-47ad-aa74-296600fd40ae req-e4c72318-ff3e-46f7-a093-6e6a68460eb9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:24.442191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c828cf59-42d6-47ad-aa74-296600fd40ae req-e4c72318-ff3e-46f7-a093-6e6a68460eb9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:24.446588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c828cf59-42d6-47ad-aa74-296600fd40ae req-e4c72318-ff3e-46f7-a093-6e6a68460eb9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:24.478825 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c828cf59-42d6-47ad-aa74-296600fd40ae req-e4c72318-ff3e-46f7-a093-6e6a68460eb9 service nova] Creating event network-changed:cc199761-2a7f-468d-baab-243aded35f64 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:24.488362 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c828cf59-42d6-47ad-aa74-296600fd40ae req-e4c72318-ff3e-46f7-a093-6e6a68460eb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335365 Aug 30 03:55:24.491133 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2621/5346] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:24.518365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:24.519158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:24.530460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:24.531448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:24.533487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:24.534380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:24.535004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:24.535839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:24.987344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:25.005796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:25.011137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:25.012649 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d4237b1d-4aad-40cb-940f-745ddeabd44a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 0.498794 Aug 30 03:55:25.012965 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2726/5347] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:24 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:26.036065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:26.038004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:26.049618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:26.050358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:26.051062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:26.052001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:26.052669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:26.053367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:26.525576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-be3ad5ea-b1b2-4e65-aff4-a1f92813dc0f req-5f30ba37-db06-421c-9dc1-742d3a5cf47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "b2017978-ce51-472b-98e1-2aee34743484"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:26.547512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:26.579940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-be3ad5ea-b1b2-4e65-aff4-a1f92813dc0f req-5f30ba37-db06-421c-9dc1-742d3a5cf47a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:26.581797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-be3ad5ea-b1b2-4e65-aff4-a1f92813dc0f req-5f30ba37-db06-421c-9dc1-742d3a5cf47a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:26.582217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:26.583688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-be3ad5ea-b1b2-4e65-aff4-a1f92813dc0f req-5f30ba37-db06-421c-9dc1-742d3a5cf47a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:26.589079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:26.594000 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-272e8a8c-4ba6-43bc-9ec6-917cc6002192 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 0.562162 Aug 30 03:55:26.599010 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2622/5348] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:26 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:26.616801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-be3ad5ea-b1b2-4e65-aff4-a1f92813dc0f req-5f30ba37-db06-421c-9dc1-742d3a5cf47a service nova] Creating event network-changed:b2017978-ce51-472b-98e1-2aee34743484 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:26.642974 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-be3ad5ea-b1b2-4e65-aff4-a1f92813dc0f req-5f30ba37-db06-421c-9dc1-742d3a5cf47a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125214 Aug 30 03:55:26.643891 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2727/5349] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:27.626077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:27.627742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:27.632926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=40 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:27.647778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:27.648295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:27.649002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:27.655355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:27.655861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:27.656895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:27.994120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:28.026525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:28.032622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:28.038521 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-87293b61-4db3-4c56-8528-8e3a6f059c3b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 0.416147 Aug 30 03:55:28.039425 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2623/5350] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:27 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:28.131191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:28.133466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:28.154011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.154519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.155036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:28.155662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.156118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.156572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:28.256970 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3fbb91cb-9c74-4a6a-9e88-aa83c609947f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.132017 Aug 30 03:55:28.257992 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2728/5351] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 03:55:28 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:28.393475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:28.394097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:28.421238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.422071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.422885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:28.423978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.427826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.429445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:28.482514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:55:28.640083 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-831ef1df-81b3-4afd-9d40-2b05afeb96bf tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 204 len: 0 microversion: 2.20 time: 0.251365 Aug 30 03:55:28.644261 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2624/5352] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:55:28 2022] DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:55:28.650500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:28.651636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:28.663127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.663623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.664691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:28.668456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.668945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.669411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:28.942644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-598c63b0-2d97-4dce-982a-6713b20e91d9 req-aafb2053-b754-4f37-9bef-3e68555d6250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "2d2bf36c-3152-475c-aa2e-46819c7e1bd8"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:28.983971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-598c63b0-2d97-4dce-982a-6713b20e91d9 req-aafb2053-b754-4f37-9bef-3e68555d6250 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:28.984499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-598c63b0-2d97-4dce-982a-6713b20e91d9 req-aafb2053-b754-4f37-9bef-3e68555d6250 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:28.984937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-598c63b0-2d97-4dce-982a-6713b20e91d9 req-aafb2053-b754-4f37-9bef-3e68555d6250 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:29.041957 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-598c63b0-2d97-4dce-982a-6713b20e91d9 req-aafb2053-b754-4f37-9bef-3e68555d6250 service nova] Creating event network-changed:2d2bf36c-3152-475c-aa2e-46819c7e1bd8 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:29.054854 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-598c63b0-2d97-4dce-982a-6713b20e91d9 req-aafb2053-b754-4f37-9bef-3e68555d6250 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129214 Aug 30 03:55:29.058043 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2625/5353] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:29.073777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:29.077460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:29.096692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:29.098046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:29.098464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:29.100559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:29.102312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:29.104195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:29.133746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:29.143781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:29.154726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:29.162480 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96b94fc5-76a2-4fb4-9c88-3bda46dda734 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.516083 Aug 30 03:55:29.178259 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2729/5354] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:28 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:29.634279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:29.653241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:29.662582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:29.668887 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d48efb8-a402-40b4-99ad-02de05db1f7a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 0.602939 Aug 30 03:55:29.690299 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2626/5355] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:29 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:30.193546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:30.194151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:30.211560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:30.212060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:30.212504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:30.213218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:30.213725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:30.214144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:30.438955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:30.441422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:30.463996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:30.465661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:30.470062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:30.471428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:30.472125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:30.475779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:30.541637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'flavor' on Instance uuid 4f428005-e509-4fc2-b4ad-4c2866af18c3 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:55:30.701371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:30.728506 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32a9f539-7b3f-4843-bea5-84dccf8f4363 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/action" status: 200 len: 32 microversion: 2.1 time: 0.294196 Aug 30 03:55:30.735839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2627/5356] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:55:30 2022] POST /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:55:30.744984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:30.746253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:30.805095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:30.806424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:30.807218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:30.852644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:30.853856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:30.855431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:31.556284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:31.567599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:31.569056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:31.570295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-093b8fbe-7b67-47f2-8d5d-e781fd87df2c tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 1.385015 Aug 30 03:55:31.572903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:31.583772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:31.585249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:31.599220 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2730/5357] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:30 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:31.603772 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f5a21824-d07e-44cc-aab0-ce7fffaa6732 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1885 microversion: 2.32 time: 0.847613 Aug 30 03:55:31.604263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:31.604793 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2628/5358] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:30 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1885 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:31.604925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:31.625977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:31.626748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:31.627188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:31.627909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:31.628368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:31.628803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:31.946923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b03442e9-b8db-4a44-9a28-2d27f98d0cb7 req-679501ff-bf76-40ea-bce2-dfcf7742634c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "5947e6f6-473a-49fb-a115-2fe1bbbd5e50"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:31.978497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b03442e9-b8db-4a44-9a28-2d27f98d0cb7 req-679501ff-bf76-40ea-bce2-dfcf7742634c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:31.979160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b03442e9-b8db-4a44-9a28-2d27f98d0cb7 req-679501ff-bf76-40ea-bce2-dfcf7742634c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:31.979788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b03442e9-b8db-4a44-9a28-2d27f98d0cb7 req-679501ff-bf76-40ea-bce2-dfcf7742634c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:32.004329 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b03442e9-b8db-4a44-9a28-2d27f98d0cb7 req-679501ff-bf76-40ea-bce2-dfcf7742634c service nova] Creating event network-changed:5947e6f6-473a-49fb-a115-2fe1bbbd5e50 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:55:32.018380 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b03442e9-b8db-4a44-9a28-2d27f98d0cb7 req-679501ff-bf76-40ea-bce2-dfcf7742634c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075020 Aug 30 03:55:32.019606 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2629/5359] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:55:32.598230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:32.599207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:32.605678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:32.606375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:32.606969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:32.607826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:32.608433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:32.622019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:32.786535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:32.796603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-23d6232a-68a4-4062-bdac-6a62cdda8196 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 1.196152 Aug 30 03:55:32.797526 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2731/5360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:31 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:32.803148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:32.803956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:32.810544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:32.811296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:32.811954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:32.813521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:32.814147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:32.814722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:33.535393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:33.545971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:33.551787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:33.565203 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd5628dc-afa7-4dd1-810b-eb5f1b61b905 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1722 microversion: 2.20 time: 0.971193 Aug 30 03:55:33.567162 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2630/5361] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:32 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1722 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:33.711118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:33.736227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:33.745745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:33.747245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-572d08ba-3de2-416b-a720-f51a5fb42715 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.948268 Aug 30 03:55:33.747997 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2732/5362] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:32 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:33.822703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:33.824047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:33.826363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:33.840289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4271bdcf-a655-4849-ba17-92208a7f944e req-85b20209-77c6-4943-9d5e-386eca6dcb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "name": "network-vif-unplugged", "status": "completed", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:33.862790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:33.867609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4271bdcf-a655-4849-ba17-92208a7f944e req-85b20209-77c6-4943-9d5e-386eca6dcb79 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:33.867846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:33.868596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4271bdcf-a655-4849-ba17-92208a7f944e req-85b20209-77c6-4943-9d5e-386eca6dcb79 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:33.869257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4271bdcf-a655-4849-ba17-92208a7f944e req-85b20209-77c6-4943-9d5e-386eca6dcb79 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:33.885906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:33.890770 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4271bdcf-a655-4849-ba17-92208a7f944e req-85b20209-77c6-4943-9d5e-386eca6dcb79 service nova] Creating event network-vif-unplugged:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:55:33.891005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:33.891305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:33.891764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:33.925602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4271bdcf-a655-4849-ba17-92208a7f944e req-85b20209-77c6-4943-9d5e-386eca6dcb79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.356522 Aug 30 03:55:33.926804 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2631/5363] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:34.589683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:34.595845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:34.597320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:34.608205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:34.608471 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-422ad33b-6572-4b0f-ad50-e060a5ddc5c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.790210 Aug 30 03:55:34.609143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:34.621930 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2733/5364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:33 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:34.623952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:34.627682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:34.628491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:34.628998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:34.748000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:34.772693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:34.773313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:34.775690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:34.778467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:34.780979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f31c075d-c546-4148-85fd-fec848a849c4 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1655 microversion: 2.20 time: 0.191641 Aug 30 03:55:34.782774 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2632/5365] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:34 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1655 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:34.794888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:34.795598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:34.796268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:34.797188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:34.797941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:34.798529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:35.633941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:35.634913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:35.656700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:35.657219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:35.657688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:35.658403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:35.659010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:35.659439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:35.714763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:35.744228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:35.746519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:35.752496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab46bd75-6b81-487e-aa57-065caf71c208 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.983421 Aug 30 03:55:35.754923 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2734/5366] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:34 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:55:35.808094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:35.809171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:35.823101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:35.823684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:35.824235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:35.825717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:35.826476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:35.827615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:36.022395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:36.040123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:36.045086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b529d546df364eeca6e6665c76242906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b753382d1b4cf09d36b653b90e6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:36.047293 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6e871e80-2c70-425c-8557-c1c217b31ea3 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 200 len: 1655 microversion: 2.20 time: 0.243907 Aug 30 03:55:36.050792 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2735/5367] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:35 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:55:36.061721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1243bf04-6735-4062-b410-566ddedbc7b9 req-f7cfa5b7-e160-4c24-aa4e-34d313afd9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c881790b-d38b-4dee-85e3-4d6a1b35e10f", "name": "network-vif-deleted", "tag": "d2ac9ea5-3154-44ac-af13-90de94b91628"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:55:36.088126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1243bf04-6735-4062-b410-566ddedbc7b9 req-f7cfa5b7-e160-4c24-aa4e-34d313afd9e1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:36.089918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1243bf04-6735-4062-b410-566ddedbc7b9 req-f7cfa5b7-e160-4c24-aa4e-34d313afd9e1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:36.090794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1243bf04-6735-4062-b410-566ddedbc7b9 req-f7cfa5b7-e160-4c24-aa4e-34d313afd9e1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:36.124345 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1243bf04-6735-4062-b410-566ddedbc7b9 req-f7cfa5b7-e160-4c24-aa4e-34d313afd9e1 service nova] Creating event network-vif-deleted:d2ac9ea5-3154-44ac-af13-90de94b91628 for instance c881790b-d38b-4dee-85e3-4d6a1b35e10f on n-h1-854924-5 Aug 30 03:55:36.146914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1243bf04-6735-4062-b410-566ddedbc7b9 req-f7cfa5b7-e160-4c24-aa4e-34d313afd9e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092714 Aug 30 03:55:36.148290 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2736/5368] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:55:36.350143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:36.361631 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aaa5364f-fb50-4594-b383-d9edb7c5130a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.730447 Aug 30 03:55:36.365539 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2633/5369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:35 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:36.780901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:36.782337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:36.804582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:36.813821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:36.814807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:36.818625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:36.821144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:36.821144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:37.099791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:37.101087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:37.111816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:37.112836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:37.113676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:37.115513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:37.116484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:37.117214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:37.147238 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] HTTP exception thrown: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Request method failure captured: Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f HTTP/1.1 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYgved6A0hVom8OjJ8QKEogVr7zs_5O10GTdL_eWDBXqZ5FvRKXJHk7G0dEG9EXucj41Wkm-60LFByutrXjJocC7CvAi91yhEWr8zFrL7D5qci3CdE3CKBGIs9_XLv78R6IFIChTwWxReUClNoceO4IjRXydYl1DZlkpSF6gky1WrVM Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25b753382d1b4cf09d36b653b90e6b50", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}] Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: b529d546df364eeca6e6665c76242906 Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c881790b-d38b-4dee-85e3-4d6a1b35e10f'} Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:37.153616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:37.158751 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:37.161035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Returning 404 to user: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:37.163520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0451b1d0-e83b-423b-b369-6d4cef490a5a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 404 len: 111 microversion: 2.20 time: 0.083815 Aug 30 03:55:37.166884 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2634/5370] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:37 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:55:37.179988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-caf2fb08-a5c3-47af-a1b0-2cbad177cb8f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '.version_select at 0x7f897ab55af0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:37.234470 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-caf2fb08-a5c3-47af-a1b0-2cbad177cb8f tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636256811" status: 204 len: 0 microversion: 2.20 time: 0.063644 Aug 30 03:55:37.237709 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2635/5371] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 30 03:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636256811 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:55:37.386864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:37.387814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:37.403624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:37.404440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:37.405176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:37.406143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:37.406770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:37.407368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:37.602029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:37.620721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:37.624188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:37.626001 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3203524b-4794-42ad-b561-197969e076ab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.850658 Aug 30 03:55:37.626569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2737/5372] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:36 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:37.965121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:37.981200 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c989bd3a-9421-4e6e-a39c-be1804b34bbb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.597514 Aug 30 03:55:37.983996 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2636/5373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:37 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:38.652332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:38.652941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:38.666144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:38.675175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:38.675821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:38.676877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:38.677521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:38.678101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:39.008930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:39.009587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:39.022470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:39.026359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:39.038942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:39.038942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:39.038942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:39.038942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:39.288067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:39.303145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:39.306463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:39.308940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dd6c083e-8342-4128-9137-545623cf126b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.660710 Aug 30 03:55:39.310143 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2738/5374] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:38 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:39.563591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:39.593284 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d2f4bcb-09d4-4922-be5b-00abce7179fb tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.589049 Aug 30 03:55:39.599649 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2637/5375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:39 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:40.337634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:40.338251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:40.347202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:40.347688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:40.348124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:40.348825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:40.349274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:40.352282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:40.623736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:40.625587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:40.640123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:40.640979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:40.641672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:40.642747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:40.644818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:40.645910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:40.976453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:41.006856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:41.008843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:41.010993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-367bd5e8-74ba-4a8e-9ef8-e85ca5d23237 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.676844 Aug 30 03:55:41.030682 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2739/5376] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:40 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:41.248082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:41.260035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bab55d43-714e-4a21-aaa7-706235d9cd81 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.641142 Aug 30 03:55:41.263302 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2638/5377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:40 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:42.036198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:42.036808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:42.047746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:42.048236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:42.048739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:42.051877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:42.052901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:42.056603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:42.284825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:42.295718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:42.311805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:42.312482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:42.312950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:42.313790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:42.314263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:42.314705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:42.716918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:42.727347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:42.738720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:42.740395 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34327ea6-8d56-404b-bad4-30cf8b8ab836 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.708535 Aug 30 03:55:42.741457 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2740/5378] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:42 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:43.103036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:43.118768 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-207a7ca8-559c-4633-9753-2f527bfcf13c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.838408 Aug 30 03:55:43.119683 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2639/5379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:42 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:43.436935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:43.438179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:43.448930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:43.449897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:43.450954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:43.452191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:43.452920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:43.453576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:43.471481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:43.473325 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] HTTP exception thrown: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Request method failure captured: Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f HTTP/1.1 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgved6A0hVom8OjJ8QKEogVr7zs_5O10GTdL_eWDBXqZ5FvRKXJHk7G0dEG9EXucj41Wkm-60LFByutrXjJocC7CvAi91yhEWr8zFrL7D5qci3CdE3CKBGIs9_XLv78R6IFIChTwWxReUClNoceO4IjRXydYl1DZlkpSF6gky1WrVM Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25b753382d1b4cf09d36b653b90e6b50", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}] Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b529d546df364eeca6e6665c76242906 Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'c881790b-d38b-4dee-85e3-4d6a1b35e10f'} Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:43.475309 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.481133 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.483658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Returning 404 to user: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:43.485265 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9499d195-d928-4cb1-adb9-3a55e15f9fcb tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 404 len: 111 microversion: 2.20 time: 0.054849 Aug 30 03:55:43.486525 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2741/5380] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:55:43 2022] DELETE /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:55:43.494494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:43.495175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: c881790b-d38b-4dee-85e3-4d6a1b35e10f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:43.507212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:43.507965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:43.508567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:43.509482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:43.510097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:43.510684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:43.555562 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] HTTP exception thrown: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Request method failure captured: Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f HTTP/1.1 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYgved6A0hVom8OjJ8QKEogVr7zs_5O10GTdL_eWDBXqZ5FvRKXJHk7G0dEG9EXucj41Wkm-60LFByutrXjJocC7CvAi91yhEWr8zFrL7D5qci3CdE3CKBGIs9_XLv78R6IFIChTwWxReUClNoceO4IjRXydYl1DZlkpSF6gky1WrVM Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25b753382d1b4cf09d36b653b90e6b50", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}] Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: b529d546df364eeca6e6665c76242906 Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'c881790b-d38b-4dee-85e3-4d6a1b35e10f'} Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.557523 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. Aug 30 03:55:43.561540 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:55:43.563923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Returning 404 to user: Instance c881790b-d38b-4dee-85e3-4d6a1b35e10f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:43.565057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16c55192-affd-4925-aaf1-c3817227a04a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f" status: 404 len: 111 microversion: 2.20 time: 0.074581 Aug 30 03:55:43.565888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2640/5381] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:43 2022] GET /compute/v2.1/servers/c881790b-d38b-4dee-85e3-4d6a1b35e10f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:55:43.764651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:43.766030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:43.785989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:43.788956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:43.789620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:43.791615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:43.792293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:43.793732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:44.140633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:44.141694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:44.154684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:44.156863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:44.158218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:44.160376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:44.162255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:44.162908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:44.817836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:44.828739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:44.835019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:44.839203 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-677454d2-8f44-4063-9bc3-f6770c27f545 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.079365 Aug 30 03:55:44.839897 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2742/5382] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:43 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:44.968033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:44.988280 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-06762fbe-f95e-4c11-877a-24ec48a57530 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.850774 Aug 30 03:55:45.002438 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2641/5383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:44 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:45.864775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:45.866114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:45.875766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:45.884113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:45.884921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:45.885962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:45.889670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:45.890443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:46.017111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:46.017767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:46.032653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:46.047622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:46.048355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:46.049382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:46.050335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:46.051018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:46.504820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:46.533462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:46.544832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:46.547510 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1e7863b8-3863-4819-a378-c04f87119746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.687794 Aug 30 03:55:46.548306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2743/5384] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:45 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:46.849095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:46.863029 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b39e1b9c-ae2e-42f3-9e94-20c77eb1ffd7 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.851296 Aug 30 03:55:46.865813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2642/5385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:46 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:47.572472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:47.575450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:47.589928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:47.590880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:47.591708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:47.592699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:47.594392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:47.597801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:47.891887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:47.893267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:47.915061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:47.915909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:47.919080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:47.924554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:47.925448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:47.927157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:48.281427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:48.297330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:48.298810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:48.299997 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-094619c8-7979-4d37-8f7f-b7da8e118f45 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.732302 Aug 30 03:55:48.304111 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2744/5386] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:47 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:48.586749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:48.596699 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-556491e0-362d-46a1-861a-613b67ec4b97 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.709778 Aug 30 03:55:48.614637 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2643/5387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:47 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:49.240504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:49.241016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:49.267522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.271289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.271844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.272831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.273548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.275442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.332589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:49.334067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:49.336956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] HTTP exception thrown: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.346861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.347368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Request method failure captured: Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 HTTP/1.1 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgved6A0hVom8OjJ8QKEogVr7zs_5O10GTdL_eWDBXqZ5FvRKXJHk7G0dEG9EXucj41Wkm-60LFByutrXjJocC7CvAi91yhEWr8zFrL7D5qci3CdE3CKBGIs9_XLv78R6IFIChTwWxReUClNoceO4IjRXydYl1DZlkpSF6gky1WrVM Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25b753382d1b4cf09d36b653b90e6b50", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}] Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b529d546df364eeca6e6665c76242906 Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'afa19e79-3638-4c08-ab26-f3b68068e3e0'} Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:49.347606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.352558 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.353426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.353426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.353426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.353426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.359794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Returning 404 to user: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:49.361032 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b80a6374-af94-4f6b-876a-d2a814227773 tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 404 len: 111 microversion: 2.20 time: 0.124359 Aug 30 03:55:49.362076 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2745/5388] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:55:49 2022] DELETE /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:55:49.378215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:49.380625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] [instance: afa19e79-3638-4c08-ab26-f3b68068e3e0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:49.408797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.411620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.412196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.413055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.419068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.420172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.471176 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] HTTP exception thrown: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Request method failure captured: Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 HTTP/1.1 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYgved6A0hVom8OjJ8QKEogVr7zs_5O10GTdL_eWDBXqZ5FvRKXJHk7G0dEG9EXucj41Wkm-60LFByutrXjJocC7CvAi91yhEWr8zFrL7D5qci3CdE3CKBGIs9_XLv78R6IFIChTwWxReUClNoceO4IjRXydYl1DZlkpSF6gky1WrVM Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/25b753382d1b4cf09d36b653b90e6b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_25b753382d1b4cf09d36b653b90e6b50", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/25b753382d1b4cf09d36b653b90e6b50"}]}] Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 25b753382d1b4cf09d36b653b90e6b50 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-685162151 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b529d546df364eeca6e6665c76242906 Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-685162151-project Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'afa19e79-3638-4c08-ab26-f3b68068e3e0'} Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.476660 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. Aug 30 03:55:49.481697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:55:49.483005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] Returning 404 to user: Instance afa19e79-3638-4c08-ab26-f3b68068e3e0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:55:49.490904 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9ca3275f-aa00-4884-879e-418baf85930a tempest-AttachVolumeShelveTestJSON-685162151 tempest-AttachVolumeShelveTestJSON-685162151-project] 10.222.0.30 "GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0" status: 404 len: 111 microversion: 2.20 time: 0.124639 Aug 30 03:55:49.495092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2746/5389] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:49 2022] GET /compute/v2.1/servers/afa19e79-3638-4c08-ab26-f3b68068e3e0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:55:49.622289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:49.623077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:49.637736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.638418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.639152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:49.640210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:49.646097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:49.646885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:50.973913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:50.994574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:50.997188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:50.999288 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4aa0c2d0-1a53-44f2-b161-ba0edb3b7319 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.670578 Aug 30 03:55:51.000192 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2644/5390] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:49 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:55:51.027774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:51.037674 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c7af080-69ff-4ccf-83cf-b536cceb0dc6 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 1.419097 Aug 30 03:55:51.038417 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2747/5391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:49 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:52.027723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:52.028634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:52.041313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:52.044121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:52.049955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:52.051124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:52.052148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:52.053009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:52.060200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:52.061551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:52.085735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:52.104217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:52.104794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:52.105867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:52.107399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:52.109845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:53.199980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:53.214759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:53.219247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:53.221945 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d1e04ab-69a8-4745-b046-89e52f4b8637 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.198714 Aug 30 03:55:53.223788 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2645/5392] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:52 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:53.234864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:53.267493 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-35316ad5-ddf8-4d6c-bd82-bb4f43cbb46b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 1.211241 Aug 30 03:55:53.270299 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2748/5393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:52 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:54.252516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:54.253974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:54.271992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:54.274678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:54.277405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:54.278619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:54.280506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:54.290404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:54.291046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:54.297587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:54.309939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:54.311492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:54.312084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:54.314062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:54.315066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:54.315635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:55.106481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:55.134176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:55.148358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:55.157855 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a84c7528-893b-4407-abe7-b208b1444b95 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.903811 Aug 30 03:55:55.173463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2646/5394] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:54 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:56.082003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:56.110904 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba70865a-9d4d-41b8-bbdc-cf3a9a18cfae tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 1.821022 Aug 30 03:55:56.114049 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2749/5395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:54 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:56.192971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:56.193927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:56.207351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:56.213457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:56.214067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:56.215249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:56.217143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:56.217761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:56.233546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:57.138544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:57.139325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:57.159111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:57.161148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:57.162331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:57.170908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:57.171444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:57.171888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:57.530206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:57.552177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:57.561517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:57.566455 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64cf0814-1c66-4a93-a84d-725a10c56b78 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.383525 Aug 30 03:55:57.567062 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2647/5396] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:56 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:57.984678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:58.046288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7db2ec24-5c1b-4698-978f-c6249055ba01 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.906211 Aug 30 03:55:58.062348 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2750/5397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:57 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:55:58.597185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:58.598395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:58.611898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:55:58.642420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:58.649903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:58.650479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:58.651250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:58.651726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:58.652156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:59.069925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:55:59.070673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:55:59.112175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:59.113626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:59.119269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:59.123327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:55:59.123923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:55:59.125769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:55:59.265857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:59.281609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:59.283232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:59.287482 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-323e1a86-2e4a-48cb-9213-518dc6d9a2bb tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.696409 Aug 30 03:55:59.289059 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2648/5398] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:55:58 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:55:59.458171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:55:59.468912 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2d26d49-cbf5-4b08-bc29-395aef57a332 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.404500 Aug 30 03:55:59.469778 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2751/5399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:55:59 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:55:59.923659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-237628229", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "1aea0b5c-8feb-4a81-a910-486b2fd61538"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:00.114058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] validate_networks() for [('1aea0b5c-8feb-4a81-a910-486b2fd61538', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:56:00.320359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:00.321158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:00.337856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:00.338252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:00.338695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:00.339412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:00.339881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:00.340319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:00.982971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:01.000851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:01.005189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:01.007368 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fad3af17-21e1-4d00-9ff8-2ceaa3916746 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.690856 Aug 30 03:56:01.008834 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2752/5400] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:00 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:56:01.016923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:01.018955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:01.029135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:01.030235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:01.031467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:01.033533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:01.034919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:01.035672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:01.609915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:01.621567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:56:01.622501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:56:01.623054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:56:01.623974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:56:01.625017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:56:01.641770 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ac90fb6-cd19-4620-a495-c4b2833a004a tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1735 microversion: 2.1 time: 0.631533 Aug 30 03:56:01.646091 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2753/5401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:01 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1735 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:01.650652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:01.653041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:01.653522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:01.657665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:01.658156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:01.658755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:01.714639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Getting quotas for project 01caf2f557cb44e6bff0361870bc5166. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:56:01.728760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Getting quotas for user 0ceab3f71bc749d4ac82fdf359799a0d and project 01caf2f557cb44e6bff0361870bc5166. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:56:01.774714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:56:01.777949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:56:01.923506 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26108992-ef56-41a8-b920-235725e5ef2e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006625 Aug 30 03:56:01.932619 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2649/5402] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:56:01.940628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a76c9652-f3ba-4fc2-95aa-1019dc7c54a2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:01.943802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a76c9652-f3ba-4fc2-95aa-1019dc7c54a2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:02.035061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:02.035835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:02.052868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:02.053677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:02.055133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:02.057123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:02.060235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:02.061373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:02.337450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a76c9652-f3ba-4fc2-95aa-1019dc7c54a2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:02.350543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a76c9652-f3ba-4fc2-95aa-1019dc7c54a2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1218 microversion: 2.1 time: 0.417719 Aug 30 03:56:02.356200 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2754/5403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:01 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1218 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:02.671182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:02.672316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:02.683899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:02.684885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:02.684885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:02.685674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:02.686200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:02.686630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:03.238554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:03.257176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:03.276187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:03.282010 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-82c72946-1dbe-4c20-bb55-22284d812618 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.248258 Aug 30 03:56:03.284392 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2650/5404] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:02 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:56:03.376866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:03.378553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:03.391370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:03.392323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:03.394003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:03.396208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:03.398081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:03.398562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:03.399007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:03.408931 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7667e595-f06f-4693-8b6b-a4616c61d4e2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1715 microversion: 2.1 time: 0.741618 Aug 30 03:56:03.413124 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2755/5405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:02 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1715 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:03.569764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:03.597781 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42305007-b09d-4746-9879-df094c39cf99 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1270 microversion: 2.1 time: 0.220676 Aug 30 03:56:03.599951 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2651/5406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:03 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:03.663064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:03.663652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:03.673995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:03.676116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:03.677055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:03.678035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:03.678721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:03.679376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:03.853549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 while it is in vm_state rescued Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments/6fff9f7e-fb94-4604-97a5-15139abe8a1c HTTP/1.1 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'detach_volume' instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 while it is in vm_state rescued Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'server_id': '4f428005-e509-4fc2-b4ad-4c2866af18c3', 'id': '6fff9f7e-fb94-4604-97a5-15139abe8a1c'} Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 while it is in vm_state rescued Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:03.855078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 while it is in vm_state rescued Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 409 to user: Cannot 'detach_volume' instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 while it is in vm_state rescued {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:56:03.859744 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e14d1b6-70d8-496f-8583-d71a8285e4d1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments/6fff9f7e-fb94-4604-97a5-15139abe8a1c" status: 409 len: 152 microversion: 2.1 time: 0.198401 Aug 30 03:56:03.861425 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2756/5407] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:56:03 2022] DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments/6fff9f7e-fb94-4604-97a5-15139abe8a1c => generated 152 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:56:03.869006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:03.869984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:03.903651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:03.906103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:03.906569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:03.907492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:03.907978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:03.908415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:04.076252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d8fe6d1-f80a-44d0-9a69-9075815c55b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/action" status: 202 len: 0 microversion: 2.1 time: 0.209264 Aug 30 03:56:04.080370 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2652/5408] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:56:03 2022] POST /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:56:04.085964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:04.086746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:04.100872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=50 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:04.107816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:04.111226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:04.112045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:04.113810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:04.117004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:04.117940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:04.313689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:04.315016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:04.323690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:04.324416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:04.325048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:04.325945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:04.326785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:04.327625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:04.951923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:04.971400 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e4694639-54d7-45ca-994e-f610600ac88d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1723 microversion: 2.1 time: 0.889739 Aug 30 03:56:04.972086 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2757/5409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:04 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1723 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:04.977608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:04.978229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:04.990679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:04.991419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:04.992034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:04.992988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:04.993554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:05.005123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:05.099975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:05.118565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:05.120165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:05.121482 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69d1956c-e0f1-4333-b446-0f2eb272ac0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.812345 Aug 30 03:56:05.122072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2653/5410] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:04 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:56:05.262701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:05.280801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-14ca2fcc-fc0d-4c91-85fe-9d19de44bb0e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1276 microversion: 2.1 time: 0.307463 Aug 30 03:56:05.284914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2758/5411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:04 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:06.007069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:06.010474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:06.036043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:06.041442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:06.043558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:06.044586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:06.048542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:06.049322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:06.146450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:06.147089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:06.160829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:06.161321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:06.161783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:06.162487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:06.162940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:06.163362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:06.414919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:06.426921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-20bc0db5-d702-4bdb-b983-b1e0575d3151 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1723 microversion: 2.1 time: 0.435508 Aug 30 03:56:06.431921 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2654/5412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:05 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:06.440532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:06.441149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:06.464308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:06.465379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:06.467231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:06.469622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:06.470358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:06.473187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:06.688351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:06.701503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:06.707045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:06.711386 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-698bde54-5fb7-4f45-9730-69c3ff0fd5e3 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.569072 Aug 30 03:56:06.715551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2759/5413] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:06 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:56:06.792499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:06.829547 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4498004d-4ef2-4933-a911-09405ee6e4ea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.391289 Aug 30 03:56:06.835445 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2655/5414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:06 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:07.452463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:07.454044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:07.467450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:07.474380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:07.477679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:07.480943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:07.480943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:07.480943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:07.738909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:07.739534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:07.756934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:07.757454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:07.757900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:07.758612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:07.759070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:07.759497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:08.242965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:08.247033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:08.265643 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1fd5caed-a7af-4229-947a-8f01fc362b54 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1729 microversion: 2.1 time: 0.816361 Aug 30 03:56:08.266776 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2760/5415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:07 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1729 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:08.276602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:08.277229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:08.288625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:08.289129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:08.290179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:08.290899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:08.291501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:08.292061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:08.669615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:08.679351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:08.689174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:08.690360 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0af70d3-ffd1-4916-953a-2588d01d0932 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.955454 Aug 30 03:56:08.698669 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2656/5416] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:07 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:56:08.716320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:08.716856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:08.751445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:08.752022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:08.752369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:08.755495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:08.756173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:08.757704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:08.867118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:08.885037 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b854462b-03d7-4555-b354-357aeab91478 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.616952 Aug 30 03:56:08.891080 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2761/5417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:08 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:08.908713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-dd573e9d-52aa-4e57-802e-c9d67d092bfb req-feec6436-f035-452d-aedd-97375377c6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "cc199761-2a7f-468d-baab-243aded35f64"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:08.953129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dd573e9d-52aa-4e57-802e-c9d67d092bfb req-feec6436-f035-452d-aedd-97375377c6b2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:08.954183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dd573e9d-52aa-4e57-802e-c9d67d092bfb req-feec6436-f035-452d-aedd-97375377c6b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:08.956249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dd573e9d-52aa-4e57-802e-c9d67d092bfb req-feec6436-f035-452d-aedd-97375377c6b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:08.970180 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-51d950a9-ac50-4092-906a-976cc4e9536d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268005 Aug 30 03:56:08.971418 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2657/5418] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 03:56:08 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-interface => generated 284 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:08.990261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-dd573e9d-52aa-4e57-802e-c9d67d092bfb req-feec6436-f035-452d-aedd-97375377c6b2 service nova] Creating event network-vif-plugged:cc199761-2a7f-468d-baab-243aded35f64 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:09.017643 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-dd573e9d-52aa-4e57-802e-c9d67d092bfb req-feec6436-f035-452d-aedd-97375377c6b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121286 Aug 30 03:56:09.023369 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2762/5419] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:09.740930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:09.742021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:09.762331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:09.763547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:09.765480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:09.771901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:09.772700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:09.773494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:09.912158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:09.913126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:09.928783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:09.929293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:09.929748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:09.931086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:09.931736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:09.932805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:10.731098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:10.751908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:10.753434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:10.754680 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48906f04-da83-43a8-8a80-4156591b5511 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.028737 Aug 30 03:56:10.755346 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2658/5420] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:09 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:56:10.828604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:10.842387 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06cec652-63df-4483-b51f-a4066cf9fed3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.930959 Aug 30 03:56:10.844455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2763/5421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:09 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:11.069672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9bf1a999-01e6-4262-9650-0bbf8728516e req-cfd349dc-d1c7-4192-bc15-156098dd9048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "cba8fb2e-9127-4001-a88a-fa2c2a531b21"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:11.080796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9bf1a999-01e6-4262-9650-0bbf8728516e req-cfd349dc-d1c7-4192-bc15-156098dd9048 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:11.081286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9bf1a999-01e6-4262-9650-0bbf8728516e req-cfd349dc-d1c7-4192-bc15-156098dd9048 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:11.081754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9bf1a999-01e6-4262-9650-0bbf8728516e req-cfd349dc-d1c7-4192-bc15-156098dd9048 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:11.119430 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9bf1a999-01e6-4262-9650-0bbf8728516e req-cfd349dc-d1c7-4192-bc15-156098dd9048 service nova] Creating event network-vif-plugged:cba8fb2e-9127-4001-a88a-fa2c2a531b21 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:11.131077 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9bf1a999-01e6-4262-9650-0bbf8728516e req-cfd349dc-d1c7-4192-bc15-156098dd9048 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064944 Aug 30 03:56:11.131705 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2659/5422] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:11.726805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-db74d7aa-1d4a-47ae-ae04-c6cd7b09dd25 req-32577d82-425a-4660-b17d-e5c4c1f24716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea01332-6382-4c5c-a496-e4f68ef93407", "tag": "2523ad39-087e-4ee5-9483-011615ad973c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:11.747230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-db74d7aa-1d4a-47ae-ae04-c6cd7b09dd25 req-32577d82-425a-4660-b17d-e5c4c1f24716 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:11.747230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-db74d7aa-1d4a-47ae-ae04-c6cd7b09dd25 req-32577d82-425a-4660-b17d-e5c4c1f24716 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:11.747230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-db74d7aa-1d4a-47ae-ae04-c6cd7b09dd25 req-32577d82-425a-4660-b17d-e5c4c1f24716 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:11.780339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:11.781072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:11.784650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:11.785333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:11.791612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-db74d7aa-1d4a-47ae-ae04-c6cd7b09dd25 req-32577d82-425a-4660-b17d-e5c4c1f24716 service nova] Creating event network-changed:2523ad39-087e-4ee5-9483-011615ad973c for instance dea01332-6382-4c5c-a496-e4f68ef93407 on n-h1-854924-5 Aug 30 03:56:11.802777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:11.803083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-db74d7aa-1d4a-47ae-ae04-c6cd7b09dd25 req-32577d82-425a-4660-b17d-e5c4c1f24716 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080633 Aug 30 03:56:11.813740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:11.814302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:11.814956 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2764/5423] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:11.815079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:11.815542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:11.815984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:11.875817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:11.878767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:11.887345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:11.888291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:11.889157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:11.892062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:11.892960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:11.893527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:12.348400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:13.034636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:13.047888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:13.053277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:13.054782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:13.055988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9f1eb123-8fd6-4041-93c2-54467bb1d647 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.280195 Aug 30 03:56:13.056635 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2660/5424] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:11 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:56:13.058414 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e8c48a7-a2c4-4642-9497-7a74fd739a93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 1.187592 Aug 30 03:56:13.059171 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2765/5425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:11 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:13.174681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "b2017978-ce51-472b-98e1-2aee34743484"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:13.212646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:13.226497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:13.226677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:13.293456 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] Creating event network-vif-plugged:b2017978-ce51-472b-98e1-2aee34743484 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:13.302715 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] Creating event network-vif-plugged:5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:13.316285 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7ea098f7-d940-4df1-9e09-2d35d3e3d7d1 req-fc0b9e56-930e-483b-afd5-6c0163348a13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.145915 Aug 30 03:56:13.316918 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2661/5426] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:13.871369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f428005-e509-4fc2-b4ad-4c2866af18c3", "tag": "be31e482-29d9-4dab-8538-41f3620ca02e"}, {"name": "network-changed", "server_uuid": "4f428005-e509-4fc2-b4ad-4c2866af18c3", "tag": "be31e482-29d9-4dab-8538-41f3620ca02e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:13.914200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:13.919811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:13.922642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:13.963515 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] Creating event network-changed:be31e482-29d9-4dab-8538-41f3620ca02e for instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 on n-h2-854924-5 Aug 30 03:56:13.966453 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] Creating event network-changed:be31e482-29d9-4dab-8538-41f3620ca02e for instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 on n-h2-854924-5 Aug 30 03:56:13.986075 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a81fb37f-e791-40a0-8e0e-6bd0d756444c req-bb985cfb-1947-4855-8651-85d04e4e288f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118307 Aug 30 03:56:14.025364 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2766/5427] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:14.086937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:14.087776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:14.109734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:14.111877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:14.112009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:14.112643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:14.113099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:14.113880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:14.120609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:14.121859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:14.128168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:14.133555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:14.134482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:14.142617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:14.145726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:14.147068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:15.424094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:15.436988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a898c47b-8c35-4ef9-b1fd-b85d7edb136e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 1.352123 Aug 30 03:56:15.438643 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2767/5428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:14 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:15.465130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "5947e6f6-473a-49fb-a115-2fe1bbbd5e50"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "c3247ab7-8a1d-4c06-bbd1-0c13981a2ff6"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "2d2bf36c-3152-475c-aa2e-46819c7e1bd8"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:15.486942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:15.515802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:15.518414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:15.519199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:15.535957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:15.537531 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-091a73d2-d973-4b66-bd4b-3bba06ca6fab tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 1.456162 Aug 30 03:56:15.545445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:15.545639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2662/5429] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:14 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:56:15.566528 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Creating event network-vif-plugged:5947e6f6-473a-49fb-a115-2fe1bbbd5e50 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:15.566968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Creating event network-vif-plugged:c3247ab7-8a1d-4c06-bbd1-0c13981a2ff6 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:15.567478 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] Creating event network-vif-plugged:2d2bf36c-3152-475c-aa2e-46819c7e1bd8 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:15.587197 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9dfa9dac-98ee-4afa-b0aa-e2da24f7f0ff req-1d828c2c-8be4-41fc-a0dd-f3c8f47f7790 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.131511 Aug 30 03:56:15.587820 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2768/5430] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:16.459427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:16.461101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:16.486585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:16.487176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:16.487769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:16.488353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:16.488818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:16.489253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:16.565854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:16.567891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:16.584687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:16.585539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:16.586300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:16.587496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:16.588132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:16.588729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:17.330679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:17.346688 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dbc3cef7-25f6-4d3f-8c05-fec677f9951d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.889050 Aug 30 03:56:17.376413 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2663/5431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:16 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:17.390670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1841714130", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "77a3d224-5646-4c7b-a3b2-35661656e357", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:17.407425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:17.421850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:17.423759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:17.425229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-83079460-2e2d-4c23-9eeb-a16b612c2e2f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1873 microversion: 2.32 time: 0.864793 Aug 30 03:56:17.438740 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2769/5432] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:16 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1873 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:56:17.536215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:56:18.371392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:18.372011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:18.383022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:18.386137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:18.388575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:18.390886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:18.391606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:18.393615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:18.746126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:18.767314 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac89b3c5-c95c-45e3-a943-8cb4ce927538 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.396649 Aug 30 03:56:18.770669 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2770/5433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:18 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:18.786381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:18.787903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:18.804072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:18.804870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:18.805543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:18.809381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:18.810415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:18.811096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.175620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:56:19.176119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:56:19.176478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:19.177073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:56:19.178723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:56:19.179707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:56:19.203040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:19.204394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:19.205138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.206402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:19.207543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:19.208248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.214037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:19.216187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:19.219352 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ab0a6a6-2d07-4c3c-acee-5ca7a16b756b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2824 microversion: 2.32 time: 0.446411 Aug 30 03:56:19.221559 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2771/5434] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:56:18 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2824 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:56:19.250107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:19.250957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:19.262146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:19.263952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:19.264424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.268147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:19.268637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:19.269076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.290304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:56:19.303275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:56:19.411207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:56:19.414372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77a3d224-5646-4c7b-a3b2-35661656e357',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:56:19.556292 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5bfe00d4-a438-4b02-bffc-c917987b9ea2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.311402 Aug 30 03:56:19.557013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2772/5435] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:56:19 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5/os-interface => generated 1831 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:56:19.743513 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b94b99e-dcaa-4857-90ce-cf2dac84b3ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.365856 Aug 30 03:56:19.748425 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2664/5436] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:56:19.758703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1991b37d-3e73-4644-9f63-3c9bd2c10d56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:19.759314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1991b37d-3e73-4644-9f63-3c9bd2c10d56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:19.789974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:19.791102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:19.802412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:19.806019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:19.807953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.812400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:19.813170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:19.813867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:19.944176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1991b37d-3e73-4644-9f63-3c9bd2c10d56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:19.953599 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1991b37d-3e73-4644-9f63-3c9bd2c10d56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1057 microversion: 2.1 time: 0.198634 Aug 30 03:56:19.961640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2773/5437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:19 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1057 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:20.072346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4b202e88-a389-4bc7-8eb3-86aee9998f7e req-5fc47bd0-adf1-42dd-8fb5-09d75a77799d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea01332-6382-4c5c-a496-e4f68ef93407", "name": "network-vif-plugged", "status": "completed", "tag": "2523ad39-087e-4ee5-9483-011615ad973c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:20.096514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4b202e88-a389-4bc7-8eb3-86aee9998f7e req-5fc47bd0-adf1-42dd-8fb5-09d75a77799d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:20.097006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4b202e88-a389-4bc7-8eb3-86aee9998f7e req-5fc47bd0-adf1-42dd-8fb5-09d75a77799d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:20.098965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4b202e88-a389-4bc7-8eb3-86aee9998f7e req-5fc47bd0-adf1-42dd-8fb5-09d75a77799d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:20.126548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4b202e88-a389-4bc7-8eb3-86aee9998f7e req-5fc47bd0-adf1-42dd-8fb5-09d75a77799d service nova] Creating event network-vif-plugged:2523ad39-087e-4ee5-9483-011615ad973c for instance dea01332-6382-4c5c-a496-e4f68ef93407 on n-h1-854924-5 Aug 30 03:56:20.143849 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4b202e88-a389-4bc7-8eb3-86aee9998f7e req-5fc47bd0-adf1-42dd-8fb5-09d75a77799d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069422 Aug 30 03:56:20.144953 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2774/5438] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:56:20.760898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:20.763483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:20.778644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf3a3f53-449b-4b3f-be28-e0ad5b1dd772 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.990639 Aug 30 03:56:20.787893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2665/5439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:19 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:20.978238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:20.987673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:21.022575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:21.023455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:21.026337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:21.028295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:21.032039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:21.033313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:21.207236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:21.223286 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2471076a-61d1-457e-b491-df54ac0ef7dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1107 microversion: 2.1 time: 0.248432 Aug 30 03:56:21.228997 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2775/5440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:20 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1107 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:21.801335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:21.802528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:21.820324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:21.820819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:21.824953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:21.826347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:21.826837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:21.828106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:22.252737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:22.253435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:22.267969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:22.269641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:22.270089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:22.273690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:22.274223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:22.275124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:22.651086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:22.661918 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b6320f5-c185-4f26-a014-3e9f5bf53a51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1155 microversion: 2.1 time: 0.414186 Aug 30 03:56:22.668103 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2776/5441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:22 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1155 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:22.676018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:22.685752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d498a3e-d5c0-4cd3-9224-5d3f5c952ca5 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1318 microversion: 2.1 time: 0.889476 Aug 30 03:56:22.687558 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2666/5442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:21 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1318 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:23.174102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0148ff70-3c2f-4d76-908b-d8d27848acc2 req-3c3f7197-e5c5-41ec-a106-4e0a41d65bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "tag": "5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:23.194771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0148ff70-3c2f-4d76-908b-d8d27848acc2 req-3c3f7197-e5c5-41ec-a106-4e0a41d65bf9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:23.201013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0148ff70-3c2f-4d76-908b-d8d27848acc2 req-3c3f7197-e5c5-41ec-a106-4e0a41d65bf9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:23.201714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0148ff70-3c2f-4d76-908b-d8d27848acc2 req-3c3f7197-e5c5-41ec-a106-4e0a41d65bf9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:23.234926 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0148ff70-3c2f-4d76-908b-d8d27848acc2 req-3c3f7197-e5c5-41ec-a106-4e0a41d65bf9 service nova] Creating event network-changed:5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:56:23.252153 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0148ff70-3c2f-4d76-908b-d8d27848acc2 req-3c3f7197-e5c5-41ec-a106-4e0a41d65bf9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083090 Aug 30 03:56:23.255683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2777/5443] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:23.692278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:23.692895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:23.708531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:23.709232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:23.722881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:23.723428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:23.723890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:23.724610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:23.731503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:23.732010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:23.732448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:23.733177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:23.734188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:23.738155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:23.738667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:23.741484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:24.082554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:24.126377 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-444e5786-b79d-4df0-94f7-0166289b7eda tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1173 microversion: 2.1 time: 0.435833 Aug 30 03:56:24.127396 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2667/5444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:23 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1173 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:24.644738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:24.657205 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7bed46c1-d292-4ef5-babe-35d587571fad tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1508 microversion: 2.1 time: 0.953453 Aug 30 03:56:24.659945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2778/5445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:23 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1508 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:25.147840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:25.148466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:25.159654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:25.160187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:25.160628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:25.161438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:25.161899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:25.162320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:25.513592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:25.522257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2709659-d362-4f4a-bd7c-7546467fe7d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1173 microversion: 2.1 time: 0.378462 Aug 30 03:56:25.529385 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2668/5446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:25 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1173 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:26.554833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:26.556555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:26.569273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:26.579614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:26.581277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:26.583499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:26.587096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:26.590047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:26.991890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:27.006545 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-92a5c981-e19a-45cf-80e8-6b98a84aed46 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1215 microversion: 2.1 time: 0.454648 Aug 30 03:56:27.020667 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2779/5447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:26 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1215 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:27.516127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7714cc4e-20d0-4ced-8dc1-b0f565668ef7 req-f729cb8e-d928-4485-886e-0c23f0c7eaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ace48c7-fba9-471b-80f0-0e46edae2f58", "tag": "0d17a4a0-da1f-49d1-a9f9-4543beb6b912"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:27.535989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7714cc4e-20d0-4ced-8dc1-b0f565668ef7 req-f729cb8e-d928-4485-886e-0c23f0c7eaac service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:27.540707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7714cc4e-20d0-4ced-8dc1-b0f565668ef7 req-f729cb8e-d928-4485-886e-0c23f0c7eaac service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:27.541174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7714cc4e-20d0-4ced-8dc1-b0f565668ef7 req-f729cb8e-d928-4485-886e-0c23f0c7eaac service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:27.570697 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7714cc4e-20d0-4ced-8dc1-b0f565668ef7 req-f729cb8e-d928-4485-886e-0c23f0c7eaac service nova] Creating event network-changed:0d17a4a0-da1f-49d1-a9f9-4543beb6b912 for instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 on n-h1-854924-5 Aug 30 03:56:27.578256 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7714cc4e-20d0-4ced-8dc1-b0f565668ef7 req-f729cb8e-d928-4485-886e-0c23f0c7eaac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065798 Aug 30 03:56:27.580517 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2669/5448] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:28.029280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:28.031065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:28.047480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:28.048404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:28.049686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:28.052867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:28.053536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:28.053974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:28.593732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:28.602466 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0950b18e-3944-4bb5-bb1d-82f89372ea1b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1215 microversion: 2.1 time: 0.578199 Aug 30 03:56:28.614624 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2780/5449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:28 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1215 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:29.627626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:29.630221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:29.645626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:29.648388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:29.652081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:29.658687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:29.659494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:29.663158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:29.665140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:29.666898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:29.669038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:30.191295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:30.208325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6fd6cf89-fd1c-4ec6-a783-32af5f94d240 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1215 microversion: 2.1 time: 0.583049 Aug 30 03:56:30.223525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2670/5450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:29 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1215 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:31.231314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:31.231933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:31.234910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:31.249381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:31.249889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:31.253839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:31.254589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:31.258799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:31.258799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:31.512316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:31.521285 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0517b0a-4176-4ac1-9b5c-eaadc11574b3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1215 microversion: 2.1 time: 0.294152 Aug 30 03:56:31.533505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2781/5451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:31 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:32.548061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:32.548788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:32.558197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:32.560919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:32.566243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:32.568316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:32.568989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:32.570155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:32.757772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:32.767087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a0d0ebd-1844-4097-9112-8058dfb4a43a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.224567 Aug 30 03:56:32.769217 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2671/5452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:32 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:33.793865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:33.795870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:33.807359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:33.807995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:33.808853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:33.809742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:33.810464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:33.811218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:34.117530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:34.128294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:34.133043 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a84365d4-5518-41a6-b691-02713ff69a6b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.345160 Aug 30 03:56:34.133957 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2782/5453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:33 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:35.156290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:35.157658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:35.167192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:35.167698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:35.168143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:35.168848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:35.174207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:35.174654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:35.493221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:35.511402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc06419a-599d-44e1-b3d8-02cb12ebc05f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.359175 Aug 30 03:56:35.516340 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2672/5454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:35 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:36.540368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:36.541618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:36.551053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=54 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:36.553610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:36.554716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:36.555397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:36.556379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:36.557051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:36.557973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:36.789364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:36.800450 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2571c924-7458-48ae-b0fc-5119487202ca tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.265816 Aug 30 03:56:36.801186 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2783/5455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:36 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:37.822997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:37.823621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:37.841197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:37.843383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:37.844621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:37.846170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:37.848440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:37.849866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:38.137105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:38.148166 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6099f14c-5262-4974-9cf1-863d1bebcb43 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.329185 Aug 30 03:56:38.149434 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2673/5456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:37 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:39.173664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:39.174403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:39.191844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:39.192555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:39.193106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:39.194495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:39.196322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:39.196777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:39.572026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:39.583730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e6254d3f-f394-46ad-a57a-27e181d6eb08 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.414464 Aug 30 03:56:39.586480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2784/5457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:39 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:40.610013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:40.610649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:40.625263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:40.625906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:40.626369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:40.627110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:40.628578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:40.628884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:40.911243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:40.925647 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f37f5af3-f508-4cd8-9a93-626a4edd6425 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.320801 Aug 30 03:56:40.932808 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2674/5458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:40 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:41.953187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:41.954141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:41.983531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:41.984203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:41.984955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:41.985905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:41.986575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:41.987332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:42.277104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:42.288641 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6c2c7b2c-1c69-4585-901a-f3735640722a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.339884 Aug 30 03:56:42.298123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2785/5459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:41 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:42.578596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:42.579119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:42.586541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:42.587043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:42.587785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:42.588684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:42.589567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:42.590167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:42.712277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'services' on Instance uuid 4f428005-e509-4fc2-b4ad-4c2866af18c3 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:56:42.847779 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d13b1440-bbb7-4327-baad-7ea18971813b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments/6fff9f7e-fb94-4604-97a5-15139abe8a1c" status: 202 len: 0 microversion: 2.1 time: 0.273003 Aug 30 03:56:42.849171 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2675/5460] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:56:42 2022] DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments/6fff9f7e-fb94-4604-97a5-15139abe8a1c => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:56:42.869849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:42.874703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:42.883662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:42.884585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:42.885021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:42.886090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:42.887044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:42.887763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:42.931173 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc4c8161-edfc-4cce-9c21-9e501ad22317 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077854 Aug 30 03:56:42.932617 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2786/5461] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:42 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:56:43.313860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:43.314257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:43.322884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:43.323382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:43.323830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:43.324566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:43.324983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:43.329551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:43.602765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:43.619183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-45266883-2337-44f9-80bb-8fafcaab3a0d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.311074 Aug 30 03:56:43.621148 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2676/5462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:43 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:43.944934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:43.947117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:43.977966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:43.982205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:43.983066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8a5202fa-3702-4e35-9a29-8bab542b7b47 req-f0195ab3-62a8-468d-84e6-92be23669ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ace48c7-fba9-471b-80f0-0e46edae2f58", "name": "network-vif-plugged", "status": "completed", "tag": "0d17a4a0-da1f-49d1-a9f9-4543beb6b912"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:43.984456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:43.987207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:43.988990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:43.991450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:44.003288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8a5202fa-3702-4e35-9a29-8bab542b7b47 req-f0195ab3-62a8-468d-84e6-92be23669ced service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:44.003762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8a5202fa-3702-4e35-9a29-8bab542b7b47 req-f0195ab3-62a8-468d-84e6-92be23669ced service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:44.004185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8a5202fa-3702-4e35-9a29-8bab542b7b47 req-f0195ab3-62a8-468d-84e6-92be23669ced service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:44.037582 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8a5202fa-3702-4e35-9a29-8bab542b7b47 req-f0195ab3-62a8-468d-84e6-92be23669ced service nova] Creating event network-vif-plugged:0d17a4a0-da1f-49d1-a9f9-4543beb6b912 for instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 on n-h1-854924-5 Aug 30 03:56:44.063446 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8a5202fa-3702-4e35-9a29-8bab542b7b47 req-f0195ab3-62a8-468d-84e6-92be23669ced service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069223 Aug 30 03:56:44.066375 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2677/5463] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:44.130350 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5dd6e334-0307-47f2-ada7-73af9cd2df03 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188305 Aug 30 03:56:44.133846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2787/5464] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:43 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:44.647493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:44.648197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:44.661826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:44.662334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:44.665904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:44.666861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:44.667214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:44.667645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:45.145201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:45.147907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:45.148934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:45.158527 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6393adc1-97ec-42d3-9e05-9ae02a542971 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1203 microversion: 2.1 time: 0.516366 Aug 30 03:56:45.166689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:45.167306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:45.167876 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2678/5465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:44 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1203 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:45.168434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:45.169884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:45.170481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:45.171380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:45.221761 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-16cf4db8-fc3c-4208-919a-4299bc7bef98 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081221 Aug 30 03:56:45.223002 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2788/5466] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:45 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:46.192074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:46.192831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:46.210428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:46.213812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:46.214564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:46.216318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:46.224485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:46.225458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:46.235667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:46.238791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:46.272154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:46.277175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:46.277954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:46.280382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:46.282408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:46.283204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:46.413248 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a67bfb3-9262-43d9-84dc-b628afccf27b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180129 Aug 30 03:56:46.416329 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2789/5467] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:46 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:56:46.750366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:46.763732 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-491ec14a-3450-478f-a8df-9b3e5b3b7201 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1389 microversion: 2.1 time: 0.575593 Aug 30 03:56:46.766579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2679/5468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:46 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1389 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:46.789058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:46.789885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:46.797486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:46.798339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:46.799015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:46.800117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:46.800987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:46.801684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.206170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:47.236787 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43e1e693-e8b9-4734-a43c-20215643fcbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1389 microversion: 2.1 time: 0.452138 Aug 30 03:56:47.238642 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2790/5469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:46 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1389 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:47.261447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:47.262168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:47.284916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:47.285507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:47.286003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.286734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:47.291031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:47.291518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.428270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:47.431542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:47.484656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:47.487289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:47.488776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.494224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:47.495098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:47.502745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.573762 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80494430-90e3-4bf6-8bbc-4078abaf207d tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150463 Aug 30 03:56:47.579952 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2791/5470] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:47 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:56:47.663970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:47.673085 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f82ca77-3b89-4259-a8c4-75c2ad5b75c8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1389 microversion: 2.1 time: 0.416702 Aug 30 03:56:47.679924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2680/5471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:47 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1389 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:47.703631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:47.706386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:47.719420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:47.721162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:47.723171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.724488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:47.725409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:47.726594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:47.809629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:56:47.986691 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f950e745-96cb-47d5-a8b3-4287b893afcb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 204 len: 0 microversion: 2.1 time: 0.288777 Aug 30 03:56:47.989480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2792/5472] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:56:47 2022] DELETE /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:56:47.999423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:48.000388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:48.015316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:48.016605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:48.018860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:48.020650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:48.023380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:48.024194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:48.414480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:48.431325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-287827d6-9487-49e4-96bd-e5954be4cb17 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1395 microversion: 2.1 time: 0.436811 Aug 30 03:56:48.434998 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2681/5473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:47 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1395 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:48.591405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:48.596055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:48.608940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:48.610713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:48.612871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:48.616697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:48.618397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:48.619107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:48.705910 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-98316221-3c9b-4683-a345-8bfb92ae5869 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122873 Aug 30 03:56:48.710731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2793/5474] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:48 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:49.458741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:49.459354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:49.471270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:49.473707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:49.475773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:49.477402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:49.479297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:49.481929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:49.719403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:49.722911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:49.740761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:49.741634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:49.743035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:49.754289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:49.756475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:49.757032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:49.849720 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-22a655d5-85d1-4b93-a270-08ce89cf0b19 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135113 Aug 30 03:56:49.851098 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2794/5475] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:49 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:50.084838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:50.107735 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab5c55cd-3198-40f6-8207-707e362b869e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1395 microversion: 2.1 time: 0.646930 Aug 30 03:56:50.108417 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2682/5476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:49 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1395 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:50.865939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:50.871388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:50.888581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:50.891535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:50.892110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:50.894595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:50.899145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:50.899713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:50.953226 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc0985b2-8a34-4c1e-bd4e-71725ab0467b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093973 Aug 30 03:56:50.957689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2795/5477] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:50 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:56:51.132614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:51.134572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:51.151630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:51.155345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:51.157054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:51.159519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:51.163393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:51.164254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:51.174945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:51.379598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fb65b072-5d9c-4ebf-a325-8cd539e02ef2 req-06892ddb-1962-4815-b067-c07d7e9d2055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ace48c7-fba9-471b-80f0-0e46edae2f58", "name": "network-vif-deleted", "tag": "0d17a4a0-da1f-49d1-a9f9-4543beb6b912"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:51.393930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:51.443600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68b8ace0-82fd-45d1-b348-3f6afb09e977 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1353 microversion: 2.1 time: 0.313443 Aug 30 03:56:51.452337 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2683/5478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:51 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1353 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:51.452777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fb65b072-5d9c-4ebf-a325-8cd539e02ef2 req-06892ddb-1962-4815-b067-c07d7e9d2055 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:51.454519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fb65b072-5d9c-4ebf-a325-8cd539e02ef2 req-06892ddb-1962-4815-b067-c07d7e9d2055 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:51.458200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fb65b072-5d9c-4ebf-a325-8cd539e02ef2 req-06892ddb-1962-4815-b067-c07d7e9d2055 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:51.529201 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fb65b072-5d9c-4ebf-a325-8cd539e02ef2 req-06892ddb-1962-4815-b067-c07d7e9d2055 service nova] Creating event network-vif-deleted:0d17a4a0-da1f-49d1-a9f9-4543beb6b912 for instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 on n-h1-854924-5 Aug 30 03:56:51.536674 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fb65b072-5d9c-4ebf-a325-8cd539e02ef2 req-06892ddb-1962-4815-b067-c07d7e9d2055 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164483 Aug 30 03:56:51.539779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2796/5479] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:51.966569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:51.969812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:51.983930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:51.984431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:51.988476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:51.989335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:51.989835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:51.990272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.111410 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-760479ce-3c73-4fe0-a94e-c8607a9949f3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148847 Aug 30 03:56:52.118314 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2684/5480] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 03:56:51 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 03:56:52.255645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:52.260507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:52.273635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.274136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.274579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.275550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.276143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.276734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.360736 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Cannot 'reboot' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action HTTP/1.1 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 28 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: {"reboot": {"type": "HARD"}} Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: exception: Cannot 'reboot' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0e65a105-1bf1-470f-96aa-5c1230c8feb2', 'body': {'reboot': {'type': 'HARD'}}} Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:56:52.364873 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.371921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 409 to user: Cannot 'reboot' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:56:52.373703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64a30b6e-09db-4b98-9363-0cd619687bf4 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action" status: 409 len: 145 microversion: 2.1 time: 0.121869 Aug 30 03:56:52.375912 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2797/5481] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:56:52 2022] POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action => generated 145 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:56:52.388015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:52.394664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:52.409765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.410771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.411731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.412871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.414811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.417086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.478072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:52.479088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:52.483470 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Cannot 'rebuild' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action HTTP/1.1 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 65 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: exception: Cannot 'rebuild' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '0e65a105-1bf1-470f-96aa-5c1230c8feb2', 'body': {'rebuild': {'imageRef': 'b40a5c3f-7379-4565-a6da-58a9aabde37c'}}} Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:56:52.485854 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued Aug 30 03:56:52.490962 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:56:52.492171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.493499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 409 to user: Cannot 'rebuild' instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 while it is in vm_state rescued {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:56:52.494448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.494852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fba22921-0ed9-47d9-a201-be105ff59f26 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action" status: 409 len: 146 microversion: 2.1 time: 0.114036 Aug 30 03:56:52.495058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.496180 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2685/5482] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 03:56:52 2022] POST /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2/action => generated 146 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 03:56:52.499227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.499227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.499445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.510481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:52.513128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:52.530694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.536345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.536918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.537954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.538806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.539335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.590850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:56:52.686728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:52.695686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:56:52.719621 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-127b984c-b41d-44ad-94f8-c77369cb17a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1188 microversion: 2.1 time: 0.246707 Aug 30 03:56:52.720213 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2798/5483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:52 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1188 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:52.730940 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94657f4a-fc5f-4d4f-9694-5cfef10a6e4f tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 204 len: 0 microversion: 2.1 time: 0.228087 Aug 30 03:56:52.732388 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2686/5484] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:56:52 2022] DELETE /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:56:52.741696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:52.742745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:52.750872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.751663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.752581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:52.753797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:52.754753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:52.755607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:53.171635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:53.186361 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1679815b-1578-4435-a700-fd50805bf746 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1689 microversion: 2.1 time: 0.445412 Aug 30 03:56:53.187884 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2799/5485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:52 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1689 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:53.509680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f794cae-14d9-44a6-93f0-39def8844bdf", "device": "/dev/sdb"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:53.513793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:53.530837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:53.532186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:53.533242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:53.534954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:53.536037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:53.537123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:53.744651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:53.745855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:53.761832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:53.762702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:53.763411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:53.778306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:53.780863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:53.781626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:53.952906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:53.987242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-20f9726f-7fc8-4877-b12b-7094a99f4427 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1188 microversion: 2.1 time: 0.246861 Aug 30 03:56:53.992144 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2800/5486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:53 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1188 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:54.083105 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ff7e81e-b737-4339-bf2e-a9cd5f491da9 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "POST /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581905 Aug 30 03:56:54.084222 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2687/5487] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:56:53 2022] POST /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:54.224690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:54.225606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:54.231809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:54.232746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:54.233602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:54.234640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:54.235103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:54.235693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:54.533390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:54.543283 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-042dcc9b-6497-4042-bae2-ebaa07294a60 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1689 microversion: 2.1 time: 0.322938 Aug 30 03:56:54.560355 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2801/5488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:54 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1689 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:55.016780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:55.017818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:55.030585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:55.031120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:55.033093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:55.034337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:55.036279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:55.036781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:55.155887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:55.166794 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-63f25cde-1f00-4909-9223-9a5f8310c391 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1188 microversion: 2.1 time: 0.156387 Aug 30 03:56:55.180128 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2688/5489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:55 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:55.568796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:55.569429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:55.581752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:55.582244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:55.582682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:55.583380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:55.583829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:55.584249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:55.846845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:55.859603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-477167b8-dfb0-4b11-800d-9ce6b88d24b2 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1689 microversion: 2.1 time: 0.294922 Aug 30 03:56:55.861737 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2802/5490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:55 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1689 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:56:56.196017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:56.196784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:56.205159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:56.206128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:56.207026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:56.208275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:56.208805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:56.209415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:56.340491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:56.351823 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-54969e01-0126-4ee0-816d-123690699a98 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1188 microversion: 2.1 time: 0.159543 Aug 30 03:56:56.351823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2689/5491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:56 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:56.884470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:56.894482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:56.916342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:56.920320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:56.922439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:56.926265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:56.927169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:56.929234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:57.079054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:57.091355 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbd19d5e-3be1-4e48-aa88-b30a3bba9593 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1621 microversion: 2.1 time: 0.211041 Aug 30 03:56:57.095382 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2803/5492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:56 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1621 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:57.375200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:57.376821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:57.388780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:57.389969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:57.390755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:57.391892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:57.392737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:57.393650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:57.569505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b68ce75d-96d6-445c-8ee6-99a8dfbebdce req-b1e574bf-61f4-4098-9f9b-9de65ebea878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f428005-e509-4fc2-b4ad-4c2866af18c3", "name": "network-vif-deleted", "tag": "be31e482-29d9-4dab-8538-41f3620ca02e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:56:57.604964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b68ce75d-96d6-445c-8ee6-99a8dfbebdce req-b1e574bf-61f4-4098-9f9b-9de65ebea878 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:57.606178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b68ce75d-96d6-445c-8ee6-99a8dfbebdce req-b1e574bf-61f4-4098-9f9b-9de65ebea878 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:57.609445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b68ce75d-96d6-445c-8ee6-99a8dfbebdce req-b1e574bf-61f4-4098-9f9b-9de65ebea878 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:57.656253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b68ce75d-96d6-445c-8ee6-99a8dfbebdce req-b1e574bf-61f4-4098-9f9b-9de65ebea878 service nova] Creating event network-vif-deleted:be31e482-29d9-4dab-8538-41f3620ca02e for instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 on n-h2-854924-5 Aug 30 03:56:57.672435 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b68ce75d-96d6-445c-8ee6-99a8dfbebdce req-b1e574bf-61f4-4098-9f9b-9de65ebea878 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109649 Aug 30 03:56:57.674048 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2804/5493] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:56:57.707086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:57.728598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aeb89ba1-57a9-4c2f-b1e7-38b92394ba6a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1188 microversion: 2.1 time: 0.359263 Aug 30 03:56:57.749538 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2690/5494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:57 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1188 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:58.118178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:58.119475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:58.139627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:58.140689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:58.141229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:58.143234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:58.144203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:58.144705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:58.199530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:58.200460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:58.201203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:58.202037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'fault' on Instance uuid 4f428005-e509-4fc2-b4ad-4c2866af18c3 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:56:58.298496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:58.310901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e0994edb-c1f8-402a-b718-dff17d939ce1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 200 len: 1335 microversion: 2.1 time: 0.199893 Aug 30 03:56:58.319839 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2805/5495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:58 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 1335 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:58.773717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:58.775146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:58.783943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:58.786553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:58.788515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:58.789731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:58.790416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:58.791053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:58.839003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:58.841239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:58.843161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:58.844089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lazy-loading 'fault' on Instance uuid 7ace48c7-fba9-471b-80f0-0e46edae2f58 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:56:58.954528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:56:58.967870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a478973-5c6d-4f88-9e7d-3ac0374c9e56 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 200 len: 1147 microversion: 2.1 time: 0.207484 Aug 30 03:56:58.968974 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2691/5496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:58 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 1147 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:56:59.343309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:59.344529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 4f428005-e509-4fc2-b4ad-4c2866af18c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:56:59.352662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:59.353253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:59.353891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:59.354758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:56:59.355234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:56:59.355856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:56:59.381403 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 could not be found. Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 HTTP/1.1 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 could not be found. Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '4f428005-e509-4fc2-b4ad-4c2866af18c3'} Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 could not be found. Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 could not be found. Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:59.383480 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 could not be found. Aug 30 03:56:59.389596 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:56:59.397721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 404 to user: Instance 4f428005-e509-4fc2-b4ad-4c2866af18c3 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:56:59.402914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6156c378-5094-4141-a3db-ba3e0092d086 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3" status: 404 len: 111 microversion: 2.1 time: 0.060419 Aug 30 03:56:59.402914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2806/5497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:59 2022] GET /compute/v2.1/servers/4f428005-e509-4fc2-b4ad-4c2866af18c3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:56:59.410087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e430c306-c2e6-432d-b72d-8cc50a07345c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '.version_select at 0x7f897b7f5a60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:59.434905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e430c306-c2e6-432d-b72d-8cc50a07345c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979865208" status: 202 len: 0 microversion: 2.1 time: 0.029099 Aug 30 03:56:59.435528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2692/5498] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 03:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979865208 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:56:59.994450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:56:59.996387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 7ace48c7-fba9-471b-80f0-0e46edae2f58] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:00.013197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:00.015632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:00.019138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:00.020308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:00.021140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:00.023195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:00.070916 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 could not be found. Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 HTTP/1.1 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 could not be found. Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7ace48c7-fba9-471b-80f0-0e46edae2f58'} Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 could not be found. Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 could not be found. Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:00.073699 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 could not be found. Aug 30 03:57:00.081024 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:00.085227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 7ace48c7-fba9-471b-80f0-0e46edae2f58 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:57:00.086823 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e1886fa-e9af-4b8a-98f0-aea99b8432aa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58" status: 404 len: 111 microversion: 2.1 time: 0.098438 Aug 30 03:57:00.098706 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2807/5499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:56:59 2022] GET /compute/v2.1/servers/7ace48c7-fba9-471b-80f0-0e46edae2f58 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:57:05.744637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:05.745974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:05.755161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:05.776412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:05.777250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:05.780094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:05.783260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:05.785995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:05.801867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:06.718226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:06.733762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:06.737094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:06.742910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfae0f5a-5acf-4ccb-b1f6-ae8e2d0b2496 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2943 microversion: 2.32 time: 1.002732 Aug 30 03:57:06.743768 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2693/5500] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:57:05 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2943 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:57:06.770716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:06.771828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:06.776671 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 03:57:06.777030 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 03:57:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5/os-interface (ip 10.222.0.30) !!! Aug 30 03:57:06.778236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:06.791395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:06.792146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:06.792864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:06.794061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:06.794692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:06.795374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:07.065217 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b93596c-a028-43d4-a7a2-eee62034dc3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.299000 Aug 30 03:57:07.074636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2808/5501] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 03:57:06 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5/os-interface => generated 1831 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:57:12.435577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1113867246", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "81efd09f-b5ad-4b34-9a60-3ed186253bf5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:12.587809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:57:13.449466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:57:13.450068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:57:13.450344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:57:13.451369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:57:13.451798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:57:13.463100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:13.463854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:13.464899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:13.466304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:13.467512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:13.468172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:13.495312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:57:13.503526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:57:13.518621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:13.519887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:13.534694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:13.535936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:13.536856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:13.540276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:13.540882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:13.541082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:13.578228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:57:13.636048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:57:13.639238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81efd09f-b5ad-4b34-9a60-3ed186253bf5',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:57:13.737281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28bc1d36-167e-460d-a65c-cd05830f1811 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 204 len: 0 microversion: 2.1 time: 0.222671 Aug 30 03:57:13.738286 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2809/5502] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:57:13 2022] DELETE /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:13.748565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:13.749273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:13.766687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:13.767242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:13.767687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:13.768373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:13.770484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:13.773076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:13.940794 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dd101924-c288-4271-ae58-428bc4b70c20 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509375 Aug 30 03:57:13.960765 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2694/5503] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:57:13.967617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2d43a803-f957-448e-b499-c08e2f307fa8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:13.968659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2d43a803-f957-448e-b499-c08e2f307fa8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:14.074703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2d43a803-f957-448e-b499-c08e2f307fa8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:14.079372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:14.082422 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2d43a803-f957-448e-b499-c08e2f307fa8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1057 microversion: 2.1 time: 0.119808 Aug 30 03:57:14.083000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2695/5504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:13 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1057 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:14.087889 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c96c3dfc-7589-4977-8c21-ce03f22ec207 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1507 microversion: 2.1 time: 0.345437 Aug 30 03:57:14.089757 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2810/5505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:13 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:15.107220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:15.107857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:15.113544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:15.114576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:15.120623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:15.120837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:15.121250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:15.121950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:15.122413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:15.123380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:15.130508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:15.131407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:15.132601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:15.134352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:15.136853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:15.137562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:15.303044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:15.321415 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a05b7b95-c48c-4cba-b11f-63a9a4041547 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1099 microversion: 2.1 time: 0.221953 Aug 30 03:57:15.334684 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2811/5506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:15 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1099 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:15.479072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:15.508474 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6184ba4f-6801-47b4-b35d-f4606b74a50e tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1507 microversion: 2.1 time: 0.400499 Aug 30 03:57:15.510979 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2696/5507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:15 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:16.346861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:16.349772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:16.367697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:16.368262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:16.368703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:16.369463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:16.369919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:16.371115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:16.576804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:16.588583 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e6f7ff6b-4369-4790-8f03-3df08fa28eac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1163 microversion: 2.1 time: 0.246616 Aug 30 03:57:16.612520 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2812/5508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:16 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1163 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:16.943850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:16.944561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:16.951844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:16.952587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:16.953197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:16.954126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:16.954746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:16.955337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:17.335786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:17.349352 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-37ca2cb4-25d4-4f49-8b2c-acab3aca3f4c tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1507 microversion: 2.1 time: 0.822545 Aug 30 03:57:17.350347 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2697/5509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:16 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1507 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:17.624259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:17.624953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0599b124-8e73-4922-b937-fefe36f5d242 req-f0e6f19c-9fce-431a-adc0-761a12b8e2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e65a105-1bf1-470f-96aa-5c1230c8feb2", "name": "network-vif-deleted", "tag": "d0cfdb73-9146-43b6-801e-e49974e2ed0a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:17.631214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:17.643643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:17.658763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:17.666040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:17.676403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:17.677217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0599b124-8e73-4922-b937-fefe36f5d242 req-f0e6f19c-9fce-431a-adc0-761a12b8e2a1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:17.677901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:17.678517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:17.679306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0599b124-8e73-4922-b937-fefe36f5d242 req-f0e6f19c-9fce-431a-adc0-761a12b8e2a1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:17.682376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0599b124-8e73-4922-b937-fefe36f5d242 req-f0e6f19c-9fce-431a-adc0-761a12b8e2a1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:17.724121 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0599b124-8e73-4922-b937-fefe36f5d242 req-f0e6f19c-9fce-431a-adc0-761a12b8e2a1 service nova] Creating event network-vif-deleted:d0cfdb73-9146-43b6-801e-e49974e2ed0a for instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 on n-h2-854924-5 Aug 30 03:57:17.761997 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0599b124-8e73-4922-b937-fefe36f5d242 req-f0e6f19c-9fce-431a-adc0-761a12b8e2a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148364 Aug 30 03:57:17.768221 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2813/5510] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:57:17.914145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:17.936986 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9d29b715-8026-488e-b94d-02aa14fd3064 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1173 microversion: 2.1 time: 0.316579 Aug 30 03:57:17.943823 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2698/5511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:17 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1173 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:18.376733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:18.377544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:18.396129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:18.396978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:18.397659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:18.398582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:18.399242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:18.399886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:18.460541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:18.461474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:18.462153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:18.462841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'fault' on Instance uuid 0e65a105-1bf1-470f-96aa-5c1230c8feb2 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:57:18.840020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:18.860146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5ead4101-96be-4bc0-857b-1543c722a7c3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 200 len: 1311 microversion: 2.1 time: 0.484015 Aug 30 03:57:18.869228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2814/5512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:18 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 1311 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:18.964442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:18.965070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:18.982759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:18.983840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:18.984462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:18.985426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:18.986065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:18.986687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:19.046923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:19.646620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:19.661103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b7a6de4-d69a-467b-a801-fb0be0a321d8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1215 microversion: 2.1 time: 0.700807 Aug 30 03:57:19.668674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2699/5513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:18 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1215 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:19.892022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:19.892770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 0e65a105-1bf1-470f-96aa-5c1230c8feb2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:19.908842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:19.910421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:19.911814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:19.913442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:19.914027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:19.914548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:19.956283 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 could not be found. Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 HTTP/1.1 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 could not be found. Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0e65a105-1bf1-470f-96aa-5c1230c8feb2'} Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 could not be found. Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 could not be found. Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:19.958513 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 could not be found. Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 404 to user: Instance 0e65a105-1bf1-470f-96aa-5c1230c8feb2 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:57:19.963503 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39c0deca-6550-4a95-8be4-68e8647582ff tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2" status: 404 len: 111 microversion: 2.1 time: 0.071433 Aug 30 03:57:19.968175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:19.968702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:19.985176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:19.989653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2815/5514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:19 2022] GET /compute/v2.1/servers/0e65a105-1bf1-470f-96aa-5c1230c8feb2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:57:19.997170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:19.999374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:20.001116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:20.008391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:20.010680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:20.105458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:57:20.297398 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e3b54a5b-3700-4079-8abb-d128512fe06b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "DELETE /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 204 len: 0 microversion: 2.1 time: 0.333040 Aug 30 03:57:20.298142 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2700/5515] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:57:19 2022] DELETE /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:20.307261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:20.307885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:20.319756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:20.320275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:20.320726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:20.323468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:20.323957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:20.324402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:20.660769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:20.667722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:20.670459 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-597ead59-937e-4e22-a3aa-11f708789bf3 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.367952 Aug 30 03:57:20.672473 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2816/5516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:20 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:20.690562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:20.691262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:20.708819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:20.709311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:20.709786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:20.710480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:20.711120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:20.711707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:21.123999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:21.133418 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aad90866-217f-405d-a971-c09c39aac495 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1215 microversion: 2.1 time: 0.447020 Aug 30 03:57:21.139287 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2701/5517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:20 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1215 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:21.532566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e9ea9899-9565-4f0a-82e7-f3df377e24f8 req-d3c4408b-aded-425a-a763-6e7a58e68541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666b8c64-d4b4-47ff-840c-2f22985f4b54", "tag": "7693ff8a-4cfc-41f9-9d34-8baaab50b4d5"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:21.556044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e9ea9899-9565-4f0a-82e7-f3df377e24f8 req-d3c4408b-aded-425a-a763-6e7a58e68541 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:21.556935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e9ea9899-9565-4f0a-82e7-f3df377e24f8 req-d3c4408b-aded-425a-a763-6e7a58e68541 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:21.561619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e9ea9899-9565-4f0a-82e7-f3df377e24f8 req-d3c4408b-aded-425a-a763-6e7a58e68541 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:21.586988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e9ea9899-9565-4f0a-82e7-f3df377e24f8 req-d3c4408b-aded-425a-a763-6e7a58e68541 service nova] Creating event network-changed:7693ff8a-4cfc-41f9-9d34-8baaab50b4d5 for instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 on n-h1-854924-5 Aug 30 03:57:21.608034 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e9ea9899-9565-4f0a-82e7-f3df377e24f8 req-d3c4408b-aded-425a-a763-6e7a58e68541 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077366 Aug 30 03:57:21.622132 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2817/5518] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:57:21.692388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:21.693014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:21.741293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:21.746468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:21.751631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:21.754434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:21.755215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:21.758113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:22.125138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:22.140907 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12fa910e-e584-4136-84c1-05d7963b8030 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.452362 Aug 30 03:57:22.144390 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2702/5519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:21 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:22.161230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:22.162200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:22.171143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:22.171721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:22.172386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:22.173217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:22.173929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:22.174867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:22.431554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:22.440865 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3add0b71-e351-4894-9b3c-f400f2595d3a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1215 microversion: 2.1 time: 0.283357 Aug 30 03:57:22.442101 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2818/5520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:22 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:23.164085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:23.164987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:23.173783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:23.174718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:23.175396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:23.176472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:23.177169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:23.177928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:23.463848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:23.464464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:23.475251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:23.476070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:23.476752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:23.477710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:23.478391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:23.479316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:23.479440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:23.580981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:23.596252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03b055aa-5610-44bf-b52d-03973586efb9 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.434557 Aug 30 03:57:23.598036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2703/5521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:23 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:24.050026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:24.066243 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-118159cc-ad12-4883-aebd-71d90edc71e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1215 microversion: 2.1 time: 0.607117 Aug 30 03:57:24.067066 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2819/5522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:23 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1215 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:24.618920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:24.621606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:24.628089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:24.640739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:24.644121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:24.644574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:24.645332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:24.645820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:24.646246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:25.092519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:25.093083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:25.102786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:25.103286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:25.103721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:25.104438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:25.104894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:25.105314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:25.119681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:25.132096 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35e57fba-cde1-4498-8811-c5ec8a32f605 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1520 microversion: 2.1 time: 0.517165 Aug 30 03:57:25.132867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2704/5523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:24 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:25.648574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:25.662133 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac0cf74d-c4a7-4c04-8f16-ac605575cd65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1215 microversion: 2.1 time: 0.572508 Aug 30 03:57:25.664631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2820/5524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:25 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1215 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:25.792076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9779415a-4af0-4d1d-8c4f-1224387c17c1 req-b15bc57c-8fe8-4ba8-91b0-6dda6ed1f8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107047cd-b29d-4755-bbba-a93485e564c3", "name": "network-vif-deleted", "tag": "f4e5dd2d-5ed0-4cfe-96ca-33d12713de10"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:25.832374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9779415a-4af0-4d1d-8c4f-1224387c17c1 req-b15bc57c-8fe8-4ba8-91b0-6dda6ed1f8de service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:25.832867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9779415a-4af0-4d1d-8c4f-1224387c17c1 req-b15bc57c-8fe8-4ba8-91b0-6dda6ed1f8de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:25.833304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9779415a-4af0-4d1d-8c4f-1224387c17c1 req-b15bc57c-8fe8-4ba8-91b0-6dda6ed1f8de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:25.847589 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9779415a-4af0-4d1d-8c4f-1224387c17c1 req-b15bc57c-8fe8-4ba8-91b0-6dda6ed1f8de service nova] Creating event network-vif-deleted:f4e5dd2d-5ed0-4cfe-96ca-33d12713de10 for instance 107047cd-b29d-4755-bbba-a93485e564c3 on n-h1-854924-5 Aug 30 03:57:25.863494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9779415a-4af0-4d1d-8c4f-1224387c17c1 req-b15bc57c-8fe8-4ba8-91b0-6dda6ed1f8de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076201 Aug 30 03:57:25.864111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2705/5525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:57:26.166734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:26.170792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:26.197915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:26.199393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:26.201861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:26.224548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:26.227107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:26.228430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:26.309383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:26.310555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:26.313838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:26.314449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'fault' on Instance uuid 107047cd-b29d-4755-bbba-a93485e564c3 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:57:26.399577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:26.411914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ca49bac-8696-46da-bb4d-f1ec8a16556b tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1311 microversion: 2.1 time: 0.256140 Aug 30 03:57:26.421522 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2821/5526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:26 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:26.687153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:26.687881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:26.703678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:26.706967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:26.707428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:26.709524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:26.712731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:26.713175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.487666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:27.499452 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46963261-f2e7-4db1-9209-e113202e6502 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.816648 Aug 30 03:57:27.508412 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2706/5527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:26 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:27.518849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:27.519701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:27.544276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:27.549121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:27.557505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.561547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:27.562414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:27.565285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.660620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Calling method '.version_select at 0x7f897bcd9ee0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:27.661197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:27.661574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:27.662218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.663274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:27.663753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:27.664216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lazy-loading 'fault' on Instance uuid 107047cd-b29d-4755-bbba-a93485e564c3 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:57:27.664356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.694545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:27.695310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:27.697033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.728658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:27.730196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:27.733081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:27.743845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893eddb05e4349f1ae6c8242647a52c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443099fa08af4020bb1ff6703de1123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:27.749856 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d0c95323-a526-4de9-8683-7984e6ea0439 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724 tempest-PortsAdminExtendedAttrsIpV6TestJSON-247853724-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.391808 Aug 30 03:57:27.760743 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2822/5528] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 03:57:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:57:27.766733 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-444593c0-0de6-44ac-bec5-4b77a425ffb1 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 200 len: 1311 microversion: 2.1 time: 0.256015 Aug 30 03:57:27.767339 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2707/5529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:27 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 1311 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:28.535244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:28.535884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:28.558218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:28.564939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:28.566034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:28.567166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:28.569967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:28.570817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:28.789402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:28.790155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] [instance: 107047cd-b29d-4755-bbba-a93485e564c3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:28.801790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:28.802318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:28.802911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:28.806533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:28.811178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:28.811946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:28.833147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:28.873931 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] HTTP exception thrown: Instance 107047cd-b29d-4755-bbba-a93485e564c3 could not be found. Aug 30 03:57:28.886482 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2fc8001d-e170-4dfc-9d7d-e163b8c73c93 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.355803 Aug 30 03:57:28.895759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2823/5530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:28 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Request method failure captured: Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 HTTP/1.1 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYlwQGDeftpRytUsvWbexWb0Jd1qmCCfexxTgemhWL7MewtizKOg92CRalxA0dbvEhlZa-KJ_2SoQoz2QhcTbLIXtIFRxtENnaGa-HWn3LFoovjy04eBLe2A5ruZyH65Yofxlc7n1knAXYp_U7cXnzEUIjzVwJ1VwxvKDqZ-DOIqhnY Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443099fa08af4020bb1ff6703de1123b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443099fa08af4020bb1ff6703de1123b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443099fa08af4020bb1ff6703de1123b"}]}] Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 443099fa08af4020bb1ff6703de1123b Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-905505732 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 893eddb05e4349f1ae6c8242647a52c6 Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-905505732-project Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 107047cd-b29d-4755-bbba-a93485e564c3 could not be found. Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '107047cd-b29d-4755-bbba-a93485e564c3'} Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 107047cd-b29d-4755-bbba-a93485e564c3 could not be found. Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 107047cd-b29d-4755-bbba-a93485e564c3 could not be found. Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:28.907985 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 107047cd-b29d-4755-bbba-a93485e564c3 could not be found. Aug 30 03:57:28.913616 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:28.916355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] Returning 404 to user: Instance 107047cd-b29d-4755-bbba-a93485e564c3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:57:28.934700 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4bfd580-5681-40ac-a230-ee66b4e8d042 tempest-ServerRescueNegativeTestJSON-905505732 tempest-ServerRescueNegativeTestJSON-905505732-project] 10.222.0.30 "GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3" status: 404 len: 111 microversion: 2.1 time: 0.137238 Aug 30 03:57:28.940750 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2708/5531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:28 2022] GET /compute/v2.1/servers/107047cd-b29d-4755-bbba-a93485e564c3 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:57:29.916066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:29.917394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:29.926022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:29.926797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:29.927436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:29.928385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:29.929113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:29.929894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:30.283644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:30.297875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-407fcfc8-4961-4aa7-8001-9158e66f6ada tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.383714 Aug 30 03:57:30.299172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2824/5532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:29 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:31.327713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:31.331621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:31.350373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:31.350975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:31.354042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:31.355163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:31.355822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:31.356353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:31.618290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:31.631039 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61362f54-a0c4-4cd5-adc7-8f2abba9ce06 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.312786 Aug 30 03:57:31.633981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2709/5533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:31 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:32.659418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:32.659418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:32.673303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:32.673927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:32.674367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:32.675143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:32.675805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:32.676233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:33.123008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:33.133851 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d14c55f-757b-411b-b6c5-069eee5b5727 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.482491 Aug 30 03:57:33.134898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2825/5534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:32 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:34.157242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:34.173142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:34.202110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:34.222401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:34.223303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:34.224286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:34.226831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:34.227503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:34.588943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:34.609086 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a9322bc-9cd5-43c5-aab7-b32d49d14ff2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.457108 Aug 30 03:57:34.622332 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2710/5535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:34 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:35.656533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:35.662439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:35.680341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:35.680849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:35.681290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:35.682026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:35.682500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:35.682927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:35.975141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:35.985385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-473c70e0-4aba-4c35-bd99-fbe41cd86f87 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.338159 Aug 30 03:57:35.986932 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2826/5536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:35 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:36.867196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:36.867727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:36.878475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.902824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:36.907645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:36.910594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:36.912176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:36.913568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:36.913809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:37.015542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:37.016338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:37.023580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:37.026236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:37.027084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:37.027994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:37.029276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:37.030117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:37.030713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:37.053492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lazy-loading 'services' on Instance uuid dea01332-6382-4c5c-a496-e4f68ef93407 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:57:37.210526 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d3d5d678-0be8-4375-8cde-b8d4ed36aa1d tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407/os-volume_attachments/0f794cae-14d9-44a6-93f0-39def8844bdf" status: 202 len: 0 microversion: 2.1 time: 0.348209 Aug 30 03:57:37.212026 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2711/5537] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:57:36 2022] DELETE /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407/os-volume_attachments/0f794cae-14d9-44a6-93f0-39def8844bdf => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 03:57:37.322181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:37.335217 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6483b07-4654-463c-811c-eb5f563c6ed1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.325914 Aug 30 03:57:37.359507 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2827/5538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:37 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:38.273781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666b8c64-d4b4-47ff-840c-2f22985f4b54", "name": "network-vif-plugged", "status": "completed", "tag": "7693ff8a-4cfc-41f9-9d34-8baaab50b4d5"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:38.305014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:38.308374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:38.309118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:38.337924 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] Creating event network-vif-plugged:7693ff8a-4cfc-41f9-9d34-8baaab50b4d5 for instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 on n-h1-854924-5 Aug 30 03:57:38.358748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:38.358748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:38.367284 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098732 Aug 30 03:57:38.370053 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2712/5539] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:57:38.390943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:38.391469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:38.391920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:38.392650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:38.393113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:38.408785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:38.626872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:38.628721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7a0fdca0-470e-4e2b-b2df-7be09433ff57 req-596701d3-7493-4f4e-9854-2e4c33e1c35e service nova] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006146 Aug 30 03:57:38.639463 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2713/5540] 10.222.0.30 () {56 vars in 886 bytes} [Tue Aug 30 03:57:38 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 03:57:38.870948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:38.887186 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-444cea98-924d-4241-a7ff-788acf4f4232 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.534950 Aug 30 03:57:38.901877 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2828/5541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:38 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:39.913098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:39.914046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:39.930127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:39.931992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:39.934483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:39.936007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:39.940906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:39.941684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:40.442222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:40.460993 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3f9206f-ccbf-45cb-9db3-b9fecb7a429d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1203 microversion: 2.1 time: 0.551061 Aug 30 03:57:40.463875 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2714/5542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:39 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1203 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:41.484813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:41.485462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:41.495738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:41.496677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:41.498327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:41.499217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:41.502059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:41.506265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:41.738627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:41.750203 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eea41608-6e76-4f29-961b-bee62d37274f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1390 microversion: 2.1 time: 0.269734 Aug 30 03:57:41.751941 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2829/5543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:41 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:41.775728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:41.776766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:41.786351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:41.787149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:41.789285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:41.790497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:41.791296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:41.791950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:42.154988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:42.175717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd85e6f9-a943-43e4-87d7-cf0f53e87b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1390 microversion: 2.1 time: 0.394197 Aug 30 03:57:42.175717 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2715/5544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:41 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1390 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:42.193110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:42.194116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:42.204816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:42.206585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:42.207162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:42.208626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:42.213923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:42.213923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:42.440044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:42.453900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b06f9454-a047-452c-96ef-eeef4e94e5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1390 microversion: 2.1 time: 0.265389 Aug 30 03:57:42.454676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2830/5545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:42 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1390 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:42.488546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:42.491530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:42.515373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:42.518177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:42.518877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:42.519754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:42.527051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:42.527506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:42.559669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:42.641145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:57:42.928507 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-92b2b1ec-8cbc-4fa5-9381-4ca595712811 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 204 len: 0 microversion: 2.1 time: 0.453696 Aug 30 03:57:42.929136 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2716/5546] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:57:42 2022] DELETE /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:42.939338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:42.940507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:42.950694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:42.951373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:42.952286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:42.953205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:42.954186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:42.954791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:43.197239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:43.206659 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40aedb0d-8125-4335-8218-908ee4cd9cbc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1396 microversion: 2.1 time: 0.273277 Aug 30 03:57:43.210390 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2831/5547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:42 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1396 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:44.233384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:44.234114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:44.251000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:44.253415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:44.254039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:44.254983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:44.255605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:44.256188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:44.498197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:44.508245 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38916e95-d0ff-4632-90fb-d1a3e17dcd67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1396 microversion: 2.1 time: 0.282239 Aug 30 03:57:44.509728 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2717/5548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:44 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1396 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:45.208146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:45.209681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:45.242126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.242836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.244431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.247339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.249368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.250150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.334873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:57:45.384698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.454302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-972be32d-55bc-4fc3-9911-10d0e99ea91a tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 204 len: 0 microversion: 2.1 time: 0.255682 Aug 30 03:57:45.457273 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2832/5549] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:57:45 2022] DELETE /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:45.465091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:45.467630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:45.489723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.494067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.494751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.496858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.500316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.500763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.536746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:45.537880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:45.547161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.547721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.548740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.549888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.551305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.552330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.698993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:45.719509 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-068fbe63-f8cc-4480-9d19-7707b9cbf5a5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1354 microversion: 2.1 time: 0.184341 Aug 30 03:57:45.721884 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2833/5550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:45 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:45.743612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b18f9125-a4e5-45f0-9d95-4af8b04b549b req-8b54bfbd-5a10-49b5-ab6e-accc63dfcbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666b8c64-d4b4-47ff-840c-2f22985f4b54", "name": "network-vif-deleted", "tag": "7693ff8a-4cfc-41f9-9d34-8baaab50b4d5"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:45.773889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b18f9125-a4e5-45f0-9d95-4af8b04b549b req-8b54bfbd-5a10-49b5-ab6e-accc63dfcbc7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:45.775899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b18f9125-a4e5-45f0-9d95-4af8b04b549b req-8b54bfbd-5a10-49b5-ab6e-accc63dfcbc7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:45.776962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b18f9125-a4e5-45f0-9d95-4af8b04b549b req-8b54bfbd-5a10-49b5-ab6e-accc63dfcbc7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:45.798922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b18f9125-a4e5-45f0-9d95-4af8b04b549b req-8b54bfbd-5a10-49b5-ab6e-accc63dfcbc7 service nova] Creating event network-vif-deleted:7693ff8a-4cfc-41f9-9d34-8baaab50b4d5 for instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 on n-h1-854924-5 Aug 30 03:57:45.807211 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b18f9125-a4e5-45f0-9d95-4af8b04b549b req-8b54bfbd-5a10-49b5-ab6e-accc63dfcbc7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083570 Aug 30 03:57:45.809091 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2834/5551] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:57:45.815977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:45.825788 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6626b2d7-fa02-4ee3-a482-c35ef3b91510 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1514 microversion: 2.1 time: 0.363889 Aug 30 03:57:45.833195 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2718/5552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:45 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:46.746124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:46.747126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:46.756176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:46.756680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:46.757291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:46.758513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:46.759119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:46.759558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:46.851127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:46.860875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:46.861619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:46.862908 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d1e4a956-b3ca-4673-95fd-26034f2cb24e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1354 microversion: 2.1 time: 0.123221 Aug 30 03:57:46.863844 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2835/5553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:46 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:46.878370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:46.879636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:46.881104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:46.882617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:46.884214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:46.885698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:47.115204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:47.130155 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aac914f8-5d51-4cac-bfe6-f81356c3c9fb tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1514 microversion: 2.1 time: 0.273102 Aug 30 03:57:47.131013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2719/5554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:46 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:47.891250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:47.891930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:47.903963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:47.904748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:47.906125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:47.908191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:47.909021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:47.910108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:48.082742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:48.121696 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81b157b2-a715-4261-a3ba-afe91b2b10e3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1188 microversion: 2.1 time: 0.240082 Aug 30 03:57:48.127301 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2836/5555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:47 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1188 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:48.155107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:48.155727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:48.174899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:48.175294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:48.175745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:48.176466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:48.176935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:48.193976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:48.404827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:48.414822 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1fd6f1f-e1f9-4dbf-bc98-4553b9274eba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 200 len: 1472 microversion: 2.1 time: 0.263697 Aug 30 03:57:48.415990 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2720/5556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:48 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:48.476829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-45aab7bd-4f68-4b37-b9e7-58e5f4ea3279 req-331fe0bb-0c2c-41c9-be9d-5d70063c98a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea01332-6382-4c5c-a496-e4f68ef93407", "name": "network-vif-deleted", "tag": "2523ad39-087e-4ee5-9483-011615ad973c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:57:48.514889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-45aab7bd-4f68-4b37-b9e7-58e5f4ea3279 req-331fe0bb-0c2c-41c9-be9d-5d70063c98a2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:48.517232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-45aab7bd-4f68-4b37-b9e7-58e5f4ea3279 req-331fe0bb-0c2c-41c9-be9d-5d70063c98a2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:48.517734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-45aab7bd-4f68-4b37-b9e7-58e5f4ea3279 req-331fe0bb-0c2c-41c9-be9d-5d70063c98a2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:48.534589 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-45aab7bd-4f68-4b37-b9e7-58e5f4ea3279 req-331fe0bb-0c2c-41c9-be9d-5d70063c98a2 service nova] Creating event network-vif-deleted:2523ad39-087e-4ee5-9483-011615ad973c for instance dea01332-6382-4c5c-a496-e4f68ef93407 on n-h1-854924-5 Aug 30 03:57:48.542820 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-45aab7bd-4f68-4b37-b9e7-58e5f4ea3279 req-331fe0bb-0c2c-41c9-be9d-5d70063c98a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076629 Aug 30 03:57:48.543442 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2837/5557] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:57:49.146770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:49.147562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:49.165616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:49.166814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:49.167419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:49.168295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:49.168987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:49.169943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:49.273662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:49.287768 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4688ae3c-5d82-4156-9027-a43e7d5ebd32 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1188 microversion: 2.1 time: 0.144761 Aug 30 03:57:49.290442 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2721/5558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:49 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1188 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:49.438291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:49.439138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: dea01332-6382-4c5c-a496-e4f68ef93407] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:49.454846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:49.455424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:49.455895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:49.456604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:49.457184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:49.459618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:49.486755 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] HTTP exception thrown: Instance dea01332-6382-4c5c-a496-e4f68ef93407 could not be found. Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Request method failure captured: Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 HTTP/1.1 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYny9lcyYGepEEPobgmh0DjguJgfH3ODJLpWJliK_1fsYY2KlYDXSqgkSIuIwzm46AetbHisHwisdwEucMVOIwQzhIKN2LAIGCsRtlCUetPc1FD3qfC7L6UHJx0Bkqmh0GROUsy1qKs9XOu-w7Cje2V3J2vdOzuYl3oVglp4hOtaoN8 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 01caf2f557cb44e6bff0361870bc5166 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1035510672 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/01caf2f557cb44e6bff0361870bc5166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/01caf2f557cb44e6bff0361870bc5166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_01caf2f557cb44e6bff0361870bc5166", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/01caf2f557cb44e6bff0361870bc5166"}]}] Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesSnapshotTestJSON-1035510672 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 01caf2f557cb44e6bff0361870bc5166 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1035510672 Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesSnapshotTestJSON-1035510672-project Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 0ceab3f71bc749d4ac82fdf359799a0d Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesSnapshotTestJSON-1035510672-project Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance dea01332-6382-4c5c-a496-e4f68ef93407 could not be found. Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'dea01332-6382-4c5c-a496-e4f68ef93407'} Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea01332-6382-4c5c-a496-e4f68ef93407 could not be found. Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea01332-6382-4c5c-a496-e4f68ef93407 could not be found. Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:49.488439 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea01332-6382-4c5c-a496-e4f68ef93407 could not be found. Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Returning 404 to user: Instance dea01332-6382-4c5c-a496-e4f68ef93407 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:57:49.494697 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c258df92-4237-41b5-a722-5f9471a2d119 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407" status: 404 len: 111 microversion: 2.1 time: 0.057555 Aug 30 03:57:49.517611 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2838/5559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:49 2022] GET /compute/v2.1/servers/dea01332-6382-4c5c-a496-e4f68ef93407 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:57:50.313292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:50.313975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:50.327868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:50.328316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:50.328861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:50.329710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:50.330234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:50.330644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:50.549314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:50.559050 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8962fd8-2136-4554-a7a8-74761f5e29e0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1188 microversion: 2.1 time: 0.250360 Aug 30 03:57:50.570439 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2722/5560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:50 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1188 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:51.583130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:51.583749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:51.613044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:51.615044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:51.616436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:51.618466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:51.621265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:51.621830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:51.762888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:51.772530 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d0f6ecce-347d-43ca-977a-5963e676c9e1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1188 microversion: 2.1 time: 0.193331 Aug 30 03:57:51.773116 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2839/5561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:51 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1188 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:52.794427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:52.795076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:52.809209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:52.810371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:52.810821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:52.811558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:52.812016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:52.812442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:53.000596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:53.008690 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0f307a5-192c-48aa-a424-b18428929860 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1188 microversion: 2.1 time: 0.218673 Aug 30 03:57:53.009281 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2723/5562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:52 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1188 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:54.041683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:54.044455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:54.080901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:54.082907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:54.083501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:54.084099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:54.087615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:54.088100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:54.261919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:57:54.273925 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ad15d79f-23e9-4221-a538-1e2d3576dc0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 200 len: 1188 microversion: 2.1 time: 0.244448 Aug 30 03:57:54.274730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2840/5563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:54 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 1188 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:55.298108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:55.299493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 666b8c64-d4b4-47ff-840c-2f22985f4b54] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:57:55.309792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:55.310835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:55.311445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:55.312433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:55.313158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:55.313872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:55.334080 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 could not be found. Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 HTTP/1.1 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 could not be found. Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '666b8c64-d4b4-47ff-840c-2f22985f4b54'} Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 could not be found. Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 could not be found. Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:57:55.336171 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 could not be found. Aug 30 03:57:55.342304 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:57:55.346071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 666b8c64-d4b4-47ff-840c-2f22985f4b54 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:57:55.347051 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee38c634-e199-436a-a869-0393d087d56e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54" status: 404 len: 111 microversion: 2.1 time: 0.055693 Aug 30 03:57:55.351824 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2724/5564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:57:55 2022] GET /compute/v2.1/servers/666b8c64-d4b4-47ff-840c-2f22985f4b54 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:58:00.535428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-642756641", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "1aea0b5c-8feb-4a81-a910-486b2fd61538"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:00.650380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] validate_networks() for [('1aea0b5c-8feb-4a81-a910-486b2fd61538', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:58:01.770842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:58:01.771577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:58:01.772415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:58:01.773122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:58:01.774671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:58:01.805722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:01.806843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:01.807636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:01.808934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:01.810569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:01.811328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:01.892379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Getting quotas for project 01caf2f557cb44e6bff0361870bc5166. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:58:01.932075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Getting quotas for user 0ceab3f71bc749d4ac82fdf359799a0d and project 01caf2f557cb44e6bff0361870bc5166. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:58:01.984756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:58:01.993423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:58:02.055639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff89ebfa-7bea-4927-8a08-ddd002eba814 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526026 Aug 30 03:58:02.057286 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2841/5565] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 03:58:02.069564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d81681c7-77c0-40e5-b802-42ebb4ca32d8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:02.071657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d81681c7-77c0-40e5-b802-42ebb4ca32d8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:02.203609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d81681c7-77c0-40e5-b802-42ebb4ca32d8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:02.218099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d81681c7-77c0-40e5-b802-42ebb4ca32d8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1218 microversion: 2.1 time: 0.153949 Aug 30 03:58:02.220038 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2725/5566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:02 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:03.243533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:03.244684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:03.272942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:03.274236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:03.276021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:03.277385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:03.280686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:03.281335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:03.392804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:03.411465 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f78b4f66-50fd-4db7-98f8-4f482645c865 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1214 microversion: 2.1 time: 0.170114 Aug 30 03:58:03.412830 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2842/5567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:03 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:04.434210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:04.435407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:04.458403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:04.459219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:04.459873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:04.460805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:04.466653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:04.467348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:04.656475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:04.669379 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6e2f2bf-5a83-474a-af7d-d2d32b0085c2 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1276 microversion: 2.1 time: 0.239465 Aug 30 03:58:04.676119 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2726/5568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:04 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:05.708976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:05.710183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:05.721408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:05.722270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:05.722886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:05.723869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:05.724500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:05.725098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:06.172042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:06.184306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21397262-4a9b-4acd-a009-d53e4166fb8e tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.485965 Aug 30 03:58:06.197385 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2843/5569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:05 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:07.212591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:07.213571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:07.223583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:07.225109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:07.225606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:07.226049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:07.226762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:07.227220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:07.227645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:07.534116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:07.546962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d457602-85c1-4bd7-9ff2-d19d07318891 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.337300 Aug 30 03:58:07.548577 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2727/5570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:07 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:07.645947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-33b8c81f-d77f-4054-9ce0-46f286312024 req-57a7cfe5-49a9-4b21-b389-72cad3c10ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dccd246-3206-4aeb-9298-5280b6ba56a8", "tag": "9a64ab98-eb2c-4f8f-a216-eec4c95bf1b5"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:07.671182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:07.681566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-33b8c81f-d77f-4054-9ce0-46f286312024 req-57a7cfe5-49a9-4b21-b389-72cad3c10ade service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:07.689138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-33b8c81f-d77f-4054-9ce0-46f286312024 req-57a7cfe5-49a9-4b21-b389-72cad3c10ade service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:07.691267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-33b8c81f-d77f-4054-9ce0-46f286312024 req-57a7cfe5-49a9-4b21-b389-72cad3c10ade service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:07.739485 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-33b8c81f-d77f-4054-9ce0-46f286312024 req-57a7cfe5-49a9-4b21-b389-72cad3c10ade service nova] Creating event network-changed:9a64ab98-eb2c-4f8f-a216-eec4c95bf1b5 for instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 on n-h1-854924-5 Aug 30 03:58:07.757883 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-33b8c81f-d77f-4054-9ce0-46f286312024 req-57a7cfe5-49a9-4b21-b389-72cad3c10ade service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111851 Aug 30 03:58:07.761711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2844/5571] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:58:08.571727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:08.573198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:08.591033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:08.594912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:08.595621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:08.602350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:08.603112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:08.603975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:08.932965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:08.955440 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a5107ffa-82bb-4227-8bb7-48639d74bbcc tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.387468 Aug 30 03:58:08.959277 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2728/5572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:08 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:09.982661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:09.984331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:10.023655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:10.024489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:10.024941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:10.025672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:10.026126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:10.026821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:10.271437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:10.284154 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-853cd0b5-6ddf-46ad-9173-18613da685c1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.307881 Aug 30 03:58:10.285485 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2845/5573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:09 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:11.308864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:11.311774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:11.329748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:11.331271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:11.340268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:11.341516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:11.342837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:11.344128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:11.757247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:11.768384 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-899a2b05-27d1-44e0-9a55-f0f294ae0162 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.466282 Aug 30 03:58:11.782110 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2729/5574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:11 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:12.798154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:12.799879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:12.813154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.817099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.820189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:12.820885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:12.826290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:12.827338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:12.828059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:12.829089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:13.320216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:13.329194 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ef17d3f-c592-4ae4-add8-ad946cade2d6 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.536554 Aug 30 03:58:13.339058 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2846/5575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:12 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:14.355719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:14.357756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:14.369658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:14.382823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:14.386607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:14.389990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:14.396594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:14.397780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:14.399193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:14.480539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:14.682477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-99076dea-c90c-4881-8384-9d30b2f4c386 req-09c9f280-b566-42de-af1d-0d3501479275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dccd246-3206-4aeb-9298-5280b6ba56a8", "name": "network-vif-plugged", "status": "completed", "tag": "9a64ab98-eb2c-4f8f-a216-eec4c95bf1b5"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:14.708771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-99076dea-c90c-4881-8384-9d30b2f4c386 req-09c9f280-b566-42de-af1d-0d3501479275 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:14.709370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-99076dea-c90c-4881-8384-9d30b2f4c386 req-09c9f280-b566-42de-af1d-0d3501479275 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:14.710859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-99076dea-c90c-4881-8384-9d30b2f4c386 req-09c9f280-b566-42de-af1d-0d3501479275 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:14.743193 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-99076dea-c90c-4881-8384-9d30b2f4c386 req-09c9f280-b566-42de-af1d-0d3501479275 service nova] Creating event network-vif-plugged:9a64ab98-eb2c-4f8f-a216-eec4c95bf1b5 for instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 on n-h1-854924-5 Aug 30 03:58:14.760098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-99076dea-c90c-4881-8384-9d30b2f4c386 req-09c9f280-b566-42de-af1d-0d3501479275 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084329 Aug 30 03:58:14.763023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2847/5576] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:58:15.340829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:15.352356 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-11dd85fc-97b2-4f3e-a040-1821624eb1a8 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 1.001954 Aug 30 03:58:15.355297 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2730/5577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:14 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:16.375837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:16.378418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:16.390297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:16.397734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:16.404668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:16.405772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:16.406947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:16.407750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:16.412773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:16.732749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:16.758966 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-41d1367d-96cd-4c58-9cb3-e3345099a2d1 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1318 microversion: 2.1 time: 0.385954 Aug 30 03:58:16.773602 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2848/5578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:16 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:17.781187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:17.783013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:17.802079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:17.804869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:17.805606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:17.810786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:17.813451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:17.813993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:18.211169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:18.223402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e82525d4-32e2-49aa-b6c3-778069765ff3 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1507 microversion: 2.1 time: 0.446998 Aug 30 03:58:18.225281 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2731/5579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:17 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:18.273234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "955659bf-3cc3-44ec-8be7-2d7e0925f9da", "device": "/dev/sdb"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:18.277091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:18.302463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:18.302972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:18.303420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:18.304146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:18.304614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:18.305042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:18.961620 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a1bcecd2-4983-43c6-b415-2bbeb5da1a55 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "POST /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691069 Aug 30 03:58:18.962778 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2849/5580] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 03:58:18 2022] POST /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:58:41.705881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-613489376", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "67577898-b399-4774-8da7-3d812cbe652c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:41.751500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=9 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.755024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.892028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:58:42.609962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:58:42.610389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:58:42.610866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:58:42.611951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:58:42.612351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:58:42.627033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:42.627742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:42.628360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:42.629264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:42.630448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:42.631065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:42.663543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:58:42.677597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:58:42.695974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:58:42.698582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='67577898-b399-4774-8da7-3d812cbe652c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:58:42.816269 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-987b394d-8166-4278-945d-8e0706c857f8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107324 Aug 30 03:58:42.822712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2732/5581] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:58:42.828559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d3cffa-d6b9-4daf-8ddf-528198d72d21 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:42.829285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64d3cffa-d6b9-4daf-8ddf-528198d72d21 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:42.841903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=11 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.842930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.948518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64d3cffa-d6b9-4daf-8ddf-528198d72d21 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:42.962806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64d3cffa-d6b9-4daf-8ddf-528198d72d21 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1056 microversion: 2.1 time: 0.138381 Aug 30 03:58:42.963450 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2850/5582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:42 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1056 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:43.986128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:43.987637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:43.997232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:43.998455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:44.000232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:44.001632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:44.002577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:44.003234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:44.470672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:44.489833 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-afd34875-3d00-4eec-9b02-a5ad1a73a681 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1108 microversion: 2.1 time: 0.508910 Aug 30 03:58:44.492440 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2733/5583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:43 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1108 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:45.516109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:45.516956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:45.539258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:45.542846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:45.546788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:45.549367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:45.553892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:45.554839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:46.439399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:46.447923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ae6e3f5-28a7-4ee0-99fc-1368acd7a5bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.939522 Aug 30 03:58:46.448513 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2851/5584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:45 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:47.475114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:47.475774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:47.506404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:47.506945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:47.507420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:47.508150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:47.508619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:47.509055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:48.067267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:48.083080 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9f9495fd-0a0c-4a6c-a252-bd0133b82a01 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.612429 Aug 30 03:58:48.087579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2734/5585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:47 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:48.594661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-167a789c-fe0c-41a4-b48f-f07ad25a462e req-53724a31-5930-49fa-87ca-727d5db7edca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02483fbd-c721-4734-863e-d2d95b7a1c22", "tag": "3c6f7b8d-bac4-4236-ba30-f88a71a68ba6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:48.631976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-167a789c-fe0c-41a4-b48f-f07ad25a462e req-53724a31-5930-49fa-87ca-727d5db7edca service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:48.642153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-167a789c-fe0c-41a4-b48f-f07ad25a462e req-53724a31-5930-49fa-87ca-727d5db7edca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:48.645880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-167a789c-fe0c-41a4-b48f-f07ad25a462e req-53724a31-5930-49fa-87ca-727d5db7edca service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:48.684552 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-167a789c-fe0c-41a4-b48f-f07ad25a462e req-53724a31-5930-49fa-87ca-727d5db7edca service nova] Creating event network-changed:3c6f7b8d-bac4-4236-ba30-f88a71a68ba6 for instance 02483fbd-c721-4734-863e-d2d95b7a1c22 on n-h1-854924-5 Aug 30 03:58:48.702580 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-167a789c-fe0c-41a4-b48f-f07ad25a462e req-53724a31-5930-49fa-87ca-727d5db7edca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135798 Aug 30 03:58:48.704986 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2852/5586] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:58:49.104723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:49.106233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:49.123079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:49.123632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:49.124130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:49.124937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:49.147237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:49.147855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:50.642404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:50.668691 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6d9f889-ff1f-433e-8306-3eb0702c1f45 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 1.568093 Aug 30 03:58:50.669686 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2735/5587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:49 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:51.539612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1569159720", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:51.653318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 03:58:51.689839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:51.690625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:51.701940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:51.702565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:51.703137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:51.703980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:51.705955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:51.706546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:52.577487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:52.586093 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-50973fea-5390-4fa0-b57b-e6eab744811e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.899803 Aug 30 03:58:52.601196 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2736/5588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:51 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:52.877885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 03:58:52.877885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 03:58:52.878351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 03:58:52.878910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 03:58:52.879335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 03:58:52.938430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:52.939139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:52.939726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:52.940897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:52.941527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:52.942087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:52.970753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Getting quotas for project 2fa5b188c3264eaa87353cf4d91f011d. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 03:58:52.979581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Getting quotas for user ed953657ddca47439826bd8e177109b0 and project 2fa5b188c3264eaa87353cf4d91f011d. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 03:58:53.002515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 03:58:53.012256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 03:58:53.088160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b3165b8-2f6b-46c6-a558-b746603dcade tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553612 Aug 30 03:58:53.097517 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2853/5589] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 03:58:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 03:58:53.104621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8e3e57cd-4f86-4fb4-a3ce-285c71155422 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:53.108809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8e3e57cd-4f86-4fb4-a3ce-285c71155422 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:53.115468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.117151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.246532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8e3e57cd-4f86-4fb4-a3ce-285c71155422 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:53.255416 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8e3e57cd-4f86-4fb4-a3ce-285c71155422 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1215 microversion: 2.1 time: 0.157630 Aug 30 03:58:53.267548 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2737/5590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:53 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:53.630527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:53.632127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:53.676838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:53.680541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:53.682828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:53.687452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:53.688859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:53.692561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:53.711832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:53.720261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:53.744042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:53.744686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:53.744947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:53.748623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:53.754644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:53.755324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:54.022421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lazy-loading 'services' on Instance uuid 2dccd246-3206-4aeb-9298-5280b6ba56a8 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:58:54.048142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:54.069463 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-667d7ce0-567b-45bd-9fc8-6a38059ca436 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.432357 Aug 30 03:58:54.088710 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2854/5591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:53 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:54.181868 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-434787fb-f029-44a9-b8fb-1eba0f6de999 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8/os-volume_attachments/955659bf-3cc3-44ec-8be7-2d7e0925f9da" status: 202 len: 0 microversion: 2.1 time: 0.471514 Aug 30 03:58:54.181868 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2738/5592] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 03:58:53 2022] DELETE /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8/os-volume_attachments/955659bf-3cc3-44ec-8be7-2d7e0925f9da => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 03:58:54.278803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:54.279446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:54.295135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:54.296700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:54.299073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:54.301056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:54.302584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:54.303888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:54.436665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:54.447738 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7a3b164-a8d1-4931-b8ac-c2701b2002d8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1219 microversion: 2.1 time: 0.172817 Aug 30 03:58:54.457876 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2855/5593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:54 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:55.098059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:55.099027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:55.122659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:55.127387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:55.128093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:55.130503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:55.131491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:55.133195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:55.472985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:55.473758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:55.497872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:55.498398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:55.498859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:55.499588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:55.500053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:55.500492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:55.787355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:55.798217 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-925b3dc2-663f-46e1-accd-051ade067912 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1285 microversion: 2.1 time: 0.329386 Aug 30 03:58:55.817707 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2856/5594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:55 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1285 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:55.998353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:56.011870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bac8fbe-470e-4482-a5b6-45065b92803a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.917617 Aug 30 03:58:56.015225 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2739/5595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:55 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:56.829906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:56.830515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:56.844046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:56.846002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:56.849652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:56.850539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:56.852828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:56.853960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:57.041118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:57.042884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:57.066728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:57.067680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:57.068348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:57.069073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:57.071950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:57.073022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:57.129977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:57.143668 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-697d0990-0a19-41c3-89f8-35693dbfdf06 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1273 microversion: 2.1 time: 0.317486 Aug 30 03:58:57.169386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2857/5596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:56 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:57.315301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:57.327928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2843b68d-021a-464c-ad07-b954df0b90f6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.290667 Aug 30 03:58:57.329196 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2740/5597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:57 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:58.177852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:58.178689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:58.190743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:58.191937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:58.195415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:58.198637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:58.199678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:58.201835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:58.349303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:58.354355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:58.375706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:58.378545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:58.379208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:58.382815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:58.383524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:58.384001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:58.537041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:58.553542 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-568cf145-4bb6-4cee-99a4-3340f32969fc tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.376352 Aug 30 03:58:58.554882 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2858/5598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:58 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:58.769855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:58:58.787670 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a56440f-0977-4569-b134-388f4456713b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.443226 Aug 30 03:58:58.788790 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2741/5599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:58 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:59.190191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-06ce6497-376e-4ead-9bc1-402cbc31857d req-42cb0350-1789-4fcd-94cb-458a3764994a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399b90f6-f862-4079-bb8d-76f482e24328", "tag": "8114e9de-349c-4850-a9e0-b88bc701854c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:58:59.213959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-06ce6497-376e-4ead-9bc1-402cbc31857d req-42cb0350-1789-4fcd-94cb-458a3764994a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:59.216681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-06ce6497-376e-4ead-9bc1-402cbc31857d req-42cb0350-1789-4fcd-94cb-458a3764994a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:59.217321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-06ce6497-376e-4ead-9bc1-402cbc31857d req-42cb0350-1789-4fcd-94cb-458a3764994a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:59.243290 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-06ce6497-376e-4ead-9bc1-402cbc31857d req-42cb0350-1789-4fcd-94cb-458a3764994a service nova] Creating event network-changed:8114e9de-349c-4850-a9e0-b88bc701854c for instance 399b90f6-f862-4079-bb8d-76f482e24328 on n-h2-854924-5 Aug 30 03:58:59.255008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-06ce6497-376e-4ead-9bc1-402cbc31857d req-42cb0350-1789-4fcd-94cb-458a3764994a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068706 Aug 30 03:58:59.262626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2859/5600] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:58:59.597159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:59.597888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:59.617906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:59.625549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:59.630676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:59.638545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:59.642485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:59.642960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:59.814688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:58:59.815488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:58:59.829663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:59.831568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:59.834133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:58:59.836069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:58:59.836765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:58:59.837450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:00.362080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:00.372503 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75473f55-340b-4d74-980c-e4fe6f3e38e8 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.782884 Aug 30 03:59:00.373215 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2742/5601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:59 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:00.553269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:00.563225 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-780c2e85-a2d0-4b70-bd62-a17a6de8cb67 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.753434 Aug 30 03:59:00.577298 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2860/5602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:58:59 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:01.394437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:01.396695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:01.404791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:01.405519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:01.406131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:01.406979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:01.407580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:01.408151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:01.584989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:01.585677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:01.587571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:01.595333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:01.596372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:01.597005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:01.598122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:01.598756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:01.598901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f017a691-a16f-4e66-9b26-1c7fe443ec88 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.209002 Aug 30 03:59:01.599473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:01.602758 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2743/5603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:01 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:01.818390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:01.828068 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f241bad-09f0-4b22-9516-cd772fd5d0ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.247391 Aug 30 03:59:01.843218 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2861/5604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:01 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:02.214638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:02.215369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:02.222752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.223456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.224362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.225413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.226018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.226709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.260797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:59:02.371170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a178957-b2b4-42e3-bbe1-c95b5fb5c853 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 204 len: 0 microversion: 2.1 time: 0.160721 Aug 30 03:59:02.372575 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2744/5605] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:59:02 2022] DELETE /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:59:02.382118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:02.382894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:02.390039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.390866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.391529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.392577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.393243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.393983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.571797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:02.581995 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-318ef84f-66d8-47bb-979c-30ae0b90ce8b tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1513 microversion: 2.1 time: 0.204346 Aug 30 03:59:02.583157 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2862/5606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:02 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:02.628668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:02.629407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:02.636902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.637818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.638401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.639276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.639873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.640443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.810652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:02.819995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8592d2de-20a9-41ae-8685-ab7d7974efd6 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.196142 Aug 30 03:59:02.821547 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2745/5607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:02 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:02.850481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:02.851111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:02.866279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.866783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.867226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.867940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:02.868396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:02.868826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:02.961125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:02.996045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:03.063245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:03.082978 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e925ba53-4961-444e-8fe5-cd78a9f0e6bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.236175 Aug 30 03:59:03.084371 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2863/5608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:02 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:03.604194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:03.604808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:03.607140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:03.617552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:03.618051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:03.618495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:03.619283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:03.619739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:03.620167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:03.779052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:03.799000 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-359c23ba-0ee0-440e-8bad-c4a59c4eb6ba tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1513 microversion: 2.1 time: 0.198555 Aug 30 03:59:03.812798 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2746/5609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:03 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:03.842000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:03.842615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:03.849135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:03.849701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:03.850144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:03.850853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:03.851454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:03.851917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:04.104173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:04.106133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:04.116114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:04.116833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:04.117856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:04.122216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:04.123485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:04.124314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:04.124429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:04.139279 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9b4a9cb-b893-45d7-89b3-92d2acfd5229 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.299696 Aug 30 03:59:04.141024 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2864/5610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:03 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:04.335804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:04.339639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.346138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-572d617d-1554-4dd0-b063-2041d4ff1ea5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.245862 Aug 30 03:59:04.347202 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2747/5611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:04 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:04.837103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:04.838127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:04.847018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:04.847866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:04.849153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:04.850399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:04.852285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:04.854243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:05.141393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ceab3f71bc749d4ac82fdf359799a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01caf2f557cb44e6bff0361870bc5166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:05.164623 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-937201cb-2690-46b1-b102-a9247b13bd93 tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 200 len: 1513 microversion: 2.1 time: 0.340646 Aug 30 03:59:05.170276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:05.171519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:05.178752 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2865/5612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:04 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:05.193591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:05.194366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:05.194983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:05.195894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:05.196521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:05.197122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:05.235104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9c8c87fc-97a9-471a-95be-75af08b14c14 req-0863e2e1-92e4-4472-9aaa-d1f8dc023000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dccd246-3206-4aeb-9298-5280b6ba56a8", "name": "network-vif-deleted", "tag": "9a64ab98-eb2c-4f8f-a216-eec4c95bf1b5"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:05.245147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c8c87fc-97a9-471a-95be-75af08b14c14 req-0863e2e1-92e4-4472-9aaa-d1f8dc023000 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:05.246440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c8c87fc-97a9-471a-95be-75af08b14c14 req-0863e2e1-92e4-4472-9aaa-d1f8dc023000 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:05.247116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c8c87fc-97a9-471a-95be-75af08b14c14 req-0863e2e1-92e4-4472-9aaa-d1f8dc023000 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:05.262027 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9c8c87fc-97a9-471a-95be-75af08b14c14 req-0863e2e1-92e4-4472-9aaa-d1f8dc023000 service nova] Creating event network-vif-deleted:9a64ab98-eb2c-4f8f-a216-eec4c95bf1b5 for instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 on n-h1-854924-5 Aug 30 03:59:05.270454 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9c8c87fc-97a9-471a-95be-75af08b14c14 req-0863e2e1-92e4-4472-9aaa-d1f8dc023000 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038915 Aug 30 03:59:05.278019 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2866/5613] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:59:05.367802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:05.370015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:05.382912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:05.385503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:05.388331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:05.392931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:05.393681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:05.395358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:05.437299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:05.458339 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-26e54018-1ebf-43da-bc74-b25e60c96ff4 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.294565 Aug 30 03:59:05.467591 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2748/5614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:05 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:06.067437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:06.083220 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e979b82f-7556-45a5-83f5-a1140159341f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.719482 Aug 30 03:59:06.091109 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2867/5615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:05 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:06.192039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:06.192817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] [instance: 2dccd246-3206-4aeb-9298-5280b6ba56a8] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:06.207761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:06.208435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:06.208953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:06.210641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:06.212179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:06.213995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:06.229209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c58ea1ef-9152-42f4-813d-952d08db7881 req-22bcff51-9f99-4d8f-ba6b-8512a86f2f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399b90f6-f862-4079-bb8d-76f482e24328", "name": "network-vif-plugged", "status": "completed", "tag": "8114e9de-349c-4850-a9e0-b88bc701854c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:06.250104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c58ea1ef-9152-42f4-813d-952d08db7881 req-22bcff51-9f99-4d8f-ba6b-8512a86f2f31 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:06.253794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c58ea1ef-9152-42f4-813d-952d08db7881 req-22bcff51-9f99-4d8f-ba6b-8512a86f2f31 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:06.254590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c58ea1ef-9152-42f4-813d-952d08db7881 req-22bcff51-9f99-4d8f-ba6b-8512a86f2f31 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:06.263050 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] HTTP exception thrown: Instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 could not be found. Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Request method failure captured: Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 HTTP/1.1 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYny9lcyYGepEEPobgmh0DjguJgfH3ODJLpWJliK_1fsYY2KlYDXSqgkSIuIwzm46AetbHisHwisdwEucMVOIwQzhIKN2LAIGCsRtlCUetPc1FD3qfC7L6UHJx0Bkqmh0GROUsy1qKs9XOu-w7Cje2V3J2vdOzuYl3oVglp4hOtaoN8 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 01caf2f557cb44e6bff0361870bc5166 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1035510672 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/01caf2f557cb44e6bff0361870bc5166"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/01caf2f557cb44e6bff0361870bc5166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_01caf2f557cb44e6bff0361870bc5166", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/01caf2f557cb44e6bff0361870bc5166"}]}] Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesSnapshotTestJSON-1035510672 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 01caf2f557cb44e6bff0361870bc5166 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1035510672 Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesSnapshotTestJSON-1035510672-project Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 0ceab3f71bc749d4ac82fdf359799a0d Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesSnapshotTestJSON-1035510672-project Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 could not be found. Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2dccd246-3206-4aeb-9298-5280b6ba56a8'} Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 could not be found. Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 could not be found. Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:06.269787 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 could not be found. Aug 30 03:59:06.273785 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:06.276519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] Returning 404 to user: Instance 2dccd246-3206-4aeb-9298-5280b6ba56a8 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:06.279888 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bcd8507-d129-4458-80d2-407b038b9cea tempest-VolumesSnapshotTestJSON-1035510672 tempest-VolumesSnapshotTestJSON-1035510672-project] 10.222.0.30 "GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8" status: 404 len: 111 microversion: 2.1 time: 0.092842 Aug 30 03:59:06.282224 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2749/5616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:06 2022] GET /compute/v2.1/servers/2dccd246-3206-4aeb-9298-5280b6ba56a8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:59:06.293281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c58ea1ef-9152-42f4-813d-952d08db7881 req-22bcff51-9f99-4d8f-ba6b-8512a86f2f31 service nova] Creating event network-vif-plugged:8114e9de-349c-4850-a9e0-b88bc701854c for instance 399b90f6-f862-4079-bb8d-76f482e24328 on n-h2-854924-5 Aug 30 03:59:06.326364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c58ea1ef-9152-42f4-813d-952d08db7881 req-22bcff51-9f99-4d8f-ba6b-8512a86f2f31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101533 Aug 30 03:59:06.327487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2868/5617] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:59:06.492839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:06.493627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:06.504417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:06.506974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:06.507537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:06.508410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:06.510820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:06.512790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:06.745196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:06.747886 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30569573-3511-4cc7-8b0e-b953eac0582a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1315 microversion: 2.1 time: 0.259203 Aug 30 03:59:06.748656 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2750/5618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:06 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:07.111920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:07.112634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:07.133257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:07.133799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:07.134238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:07.135173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:07.135767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:07.136733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:07.555692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:07.569013 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5f47a8b-8581-4202-8189-17c897ffc482 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1168 microversion: 2.1 time: 0.461419 Aug 30 03:59:07.570623 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2869/5619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:07 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1168 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:07.784129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:07.789971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:07.812438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:07.815380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:07.815999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:07.818037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:07.819692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:07.821075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.133332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:08.149327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfb34d9e-f6cf-4195-8e69-a8040d543090 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1465 microversion: 2.1 time: 0.381085 Aug 30 03:59:08.150282 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2751/5620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:07 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1465 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:08.380883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:08.381411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:08.399295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:08.399800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:08.400240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.400969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:08.401501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:08.404172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.442557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:59:08.446010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:08.580083 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17e76661-a5b2-4f5c-8d7c-59fa9183333e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 204 len: 0 microversion: 2.1 time: 0.203104 Aug 30 03:59:08.581255 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2870/5621] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:59:08 2022] DELETE /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:59:08.591783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:08.592667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:08.604851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:08.606114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:08.607079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:08.610100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:08.610757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.614947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:08.615669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:08.617410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.624134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:08.625980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:08.627526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.633013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:08.633875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:08.637081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:08.942592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:08.942995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:08.952954 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10dff2e0-4338-4ec8-b6e6-e3570fce85c0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1214 microversion: 2.1 time: 0.358553 Aug 30 03:59:08.965386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2871/5622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:08 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1214 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:08.969499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b906cfb3-5476-4812-ab43-662c5cc74629 tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1471 microversion: 2.1 time: 0.382868 Aug 30 03:59:08.971093 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2752/5623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:08 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1471 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:09.977300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:09.978151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:09.993585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:09.994861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:09.996270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:09.996792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:10.000016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:10.000861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:10.003807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:10.004468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:10.009227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:10.012199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:10.013157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:10.018574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:10.020881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:10.021609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:10.291495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:10.315858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7dc0e9e3-07c5-465b-8750-45aa97571898 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.342255 Aug 30 03:59:10.336632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2872/5624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:09 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:10.680653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed953657ddca47439826bd8e177109b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa5b188c3264eaa87353cf4d91f011d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:10.692762 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dd89ea5e-9c7d-4667-89d7-c1ae02b32b5e tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 200 len: 1471 microversion: 2.1 time: 0.704519 Aug 30 03:59:10.694252 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2753/5625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:09 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 1471 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:10.790144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8b5f719c-4e80-47e6-8c80-e244c551a8f2 req-d9fecb94-353a-4f71-85af-d6073a8c32f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399b90f6-f862-4079-bb8d-76f482e24328", "name": "network-vif-deleted", "tag": "8114e9de-349c-4850-a9e0-b88bc701854c"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:10.802942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8b5f719c-4e80-47e6-8c80-e244c551a8f2 req-d9fecb94-353a-4f71-85af-d6073a8c32f6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:10.804281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8b5f719c-4e80-47e6-8c80-e244c551a8f2 req-d9fecb94-353a-4f71-85af-d6073a8c32f6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:10.804281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8b5f719c-4e80-47e6-8c80-e244c551a8f2 req-d9fecb94-353a-4f71-85af-d6073a8c32f6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:10.818133 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8b5f719c-4e80-47e6-8c80-e244c551a8f2 req-d9fecb94-353a-4f71-85af-d6073a8c32f6 service nova] Creating event network-vif-deleted:8114e9de-349c-4850-a9e0-b88bc701854c for instance 399b90f6-f862-4079-bb8d-76f482e24328 on n-h2-854924-5 Aug 30 03:59:10.825471 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8b5f719c-4e80-47e6-8c80-e244c551a8f2 req-d9fecb94-353a-4f71-85af-d6073a8c32f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041940 Aug 30 03:59:10.826672 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2873/5626] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:11.344288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:11.346070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:11.356636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:11.357506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:11.358313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:11.359218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:11.359917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:11.360552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:11.733182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:11.735658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] [instance: 399b90f6-f862-4079-bb8d-76f482e24328] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:11.753319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:11.754265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:11.754952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:11.755974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:11.757008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:11.757888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:11.771950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:11.784166 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c443bba-45f5-4d4c-991b-7ef46dbbcb5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.442805 Aug 30 03:59:11.786746 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2754/5627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:11 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:11.791278 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] HTTP exception thrown: Instance 399b90f6-f862-4079-bb8d-76f482e24328 could not be found. Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Request method failure captured: Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 HTTP/1.1 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYr34Nf0zAk02ex1IRTF69RruXh-LQwiqysiwjTEbvZBgjUYTtW2OA2yZTiFiue36NN7BgMsbk5Llzwn6E22luBlBnj-V5sjlq7FJoifGJ1HQhibZTwqO6M1xpqseEByiE5r2TV5Kh-E0t2CtDDZ7yfWAnotEiLjSXnMMUz-ZB-BXvQ Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 2fa5b188c3264eaa87353cf4d91f011d Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesNegativeTest-1862739536 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2fa5b188c3264eaa87353cf4d91f011d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2fa5b188c3264eaa87353cf4d91f011d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2fa5b188c3264eaa87353cf4d91f011d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2fa5b188c3264eaa87353cf4d91f011d"}]}] Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesNegativeTest-1862739536 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 2fa5b188c3264eaa87353cf4d91f011d Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesNegativeTest-1862739536 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesNegativeTest-1862739536-project Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: ed953657ddca47439826bd8e177109b0 Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesNegativeTest-1862739536-project Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 399b90f6-f862-4079-bb8d-76f482e24328 could not be found. Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '399b90f6-f862-4079-bb8d-76f482e24328'} Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399b90f6-f862-4079-bb8d-76f482e24328 could not be found. Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399b90f6-f862-4079-bb8d-76f482e24328 could not be found. Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:11.793544 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399b90f6-f862-4079-bb8d-76f482e24328 could not be found. Aug 30 03:59:11.796710 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:11.804216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] Returning 404 to user: Instance 399b90f6-f862-4079-bb8d-76f482e24328 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:11.810642 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99170022-1a91-490b-a93c-185dbef99b0a tempest-VolumesNegativeTest-1862739536 tempest-VolumesNegativeTest-1862739536-project] 10.222.0.30 "GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328" status: 404 len: 111 microversion: 2.1 time: 0.095695 Aug 30 03:59:11.823009 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2874/5628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:11 2022] GET /compute/v2.1/servers/399b90f6-f862-4079-bb8d-76f482e24328 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:59:12.811717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:12.812335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:12.820216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:12.842736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:12.843511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:12.853336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:12.857844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:12.859045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:12.859647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:13.237516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:13.244270 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2de139a6-45b3-4713-ab32-04599c7eb1ed tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.438668 Aug 30 03:59:13.257965 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2755/5629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:12 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:14.049869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:14.050401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:14.052514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:14.067914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:14.072489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:14.073086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:14.074557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:14.076330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:14.077511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:14.150805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:59:14.279563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:14.280210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:14.313779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:14.314228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:14.314678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:14.317703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:14.318213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:14.318671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:14.385516 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d551f60-50a0-4be8-bb11-9c71c664e4cd tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 204 len: 0 microversion: 2.32 time: 0.708540 Aug 30 03:59:14.386776 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2875/5630] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:59:13 2022] DELETE /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:59:14.418493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:14.421527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:14.440865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:14.441550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:14.441989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:14.443726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:14.445822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:14.447656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:14.844043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:14.853398 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a975298-a087-4211-8586-ecae96e0ddc4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.585159 Aug 30 03:59:14.860645 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2756/5631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:14 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:14.928911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:14.940625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:14.942145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:14.943680 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e53db55-d552-4ab5-9437-66cdbcb1757e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2949 microversion: 2.32 time: 0.537789 Aug 30 03:59:14.944241 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2876/5632] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:14 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2949 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:15.876819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:15.877428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:15.890138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:15.890572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:15.893241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:15.894011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:15.894476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:15.894910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:15.969650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:15.970476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:15.984426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:15.984805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:15.985238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:15.985973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:15.989511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:15.997600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:16.174679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:16.195224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c741bc58-81a5-4e55-9572-87119418f95d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.323183 Aug 30 03:59:16.210695 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2757/5633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:15 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:16.618903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:16.631679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:16.641573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:16.643096 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f2f1f90e-e77a-480b-9c09-366cc1d9be68 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2949 microversion: 2.32 time: 0.677726 Aug 30 03:59:16.643809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2877/5634] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:15 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2949 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:17.218950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:17.220122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:17.231754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:17.233904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:17.235201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:17.236724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:17.239508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:17.240123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:17.674789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:17.682375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:17.684046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:17.703515 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a6c6719a-3aa8-43be-ad21-e33318409008 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.486096 Aug 30 03:59:17.708472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:17.710024 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2758/5635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:17 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:17.710702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:17.713695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:17.721512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:17.722013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:17.722591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:18.172992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:18.183497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:18.189249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:18.195460 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5968ff1d-bd21-4c7d-befb-9a74fde5a43b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2949 microversion: 2.32 time: 0.516948 Aug 30 03:59:18.216156 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2878/5636] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:17 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2949 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:18.736007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:18.736644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:18.762476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:18.762982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:18.763444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:18.764187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:18.764657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:18.765096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:19.137913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f37af383-7f3a-4a82-be73-fdca60798d22 req-189d35e0-748a-4a35-b57a-6730167b9988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02483fbd-c721-4734-863e-d2d95b7a1c22", "name": "network-vif-plugged", "status": "completed", "tag": "3c6f7b8d-bac4-4236-ba30-f88a71a68ba6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:19.160684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f37af383-7f3a-4a82-be73-fdca60798d22 req-189d35e0-748a-4a35-b57a-6730167b9988 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:19.174368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f37af383-7f3a-4a82-be73-fdca60798d22 req-189d35e0-748a-4a35-b57a-6730167b9988 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:19.175005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f37af383-7f3a-4a82-be73-fdca60798d22 req-189d35e0-748a-4a35-b57a-6730167b9988 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:19.213548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f37af383-7f3a-4a82-be73-fdca60798d22 req-189d35e0-748a-4a35-b57a-6730167b9988 service nova] Creating event network-vif-plugged:3c6f7b8d-bac4-4236-ba30-f88a71a68ba6 for instance 02483fbd-c721-4734-863e-d2d95b7a1c22 on n-h1-854924-5 Aug 30 03:59:19.232391 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f37af383-7f3a-4a82-be73-fdca60798d22 req-189d35e0-748a-4a35-b57a-6730167b9988 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097765 Aug 30 03:59:19.237322 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2879/5637] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:59:19.247682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:19.248399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:19.270744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:19.271243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:19.271688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:19.272948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:19.273490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:19.273940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:19.528159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:19.558745 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-49f68187-ee84-4ca4-a4be-149712679b02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.830141 Aug 30 03:59:19.561042 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2759/5638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:18 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:19.798594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:19.810715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:19.822987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:19.825060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bbf6375f-a18a-46c2-ae1d-021313f45d3a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2949 microversion: 2.32 time: 0.586501 Aug 30 03:59:19.826154 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2880/5639] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:19 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2949 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:20.582338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:20.583644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:20.595387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:20.596038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:20.597293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:20.599506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:20.600179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:20.602241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:20.857275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:20.858714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:20.878726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:20.881525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:20.882152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:20.884195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:20.885792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:20.887304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:21.397890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:21.411832 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a6441e0-ed7a-40b3-a3c6-5ae6f6e037c3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1202 microversion: 2.1 time: 0.832085 Aug 30 03:59:21.413917 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2760/5640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:20 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1202 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:21.435009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "b2017978-ce51-472b-98e1-2aee34743484"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:21.475006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:21.477184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:21.478110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:21.551145 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] Creating event network-vif-unplugged:b2017978-ce51-472b-98e1-2aee34743484 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:21.561422 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] Creating event network-vif-unplugged:5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:21.591206 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-928b41bf-95b4-4767-bea7-8573de8a4df2 req-f6a7d590-4c59-4b4c-b538-cc5a79509aad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.167005 Aug 30 03:59:21.593190 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2761/5641] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:21.852042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:21.879102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:21.885656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:21.887876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b39f58ba-e8f9-466f-b6db-29914a425683 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2928 microversion: 2.32 time: 1.036876 Aug 30 03:59:21.889838 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2881/5642] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:20 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2928 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:22.436482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:22.437961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:22.457449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:22.460054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:22.462986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:22.464153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:22.464833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:22.465489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:22.925204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:22.926752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:22.958810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:22.961691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:22.967250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:22.975289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:22.977203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:22.982235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:23.454010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:23.473308 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c80a90e-c5de-4817-9704-17284277b803 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1389 microversion: 2.1 time: 1.040954 Aug 30 03:59:23.477831 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2762/5643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:22 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1389 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:23.495860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-22bbcb76-e352-45e8-89b7-8f99b7a67a26 req-90a7f76e-0e84-4669-922b-3d37ff06e053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-deleted", "tag": "5947e6f6-473a-49fb-a115-2fe1bbbd5e50"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:23.509289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-22bbcb76-e352-45e8-89b7-8f99b7a67a26 req-90a7f76e-0e84-4669-922b-3d37ff06e053 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:23.510335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-22bbcb76-e352-45e8-89b7-8f99b7a67a26 req-90a7f76e-0e84-4669-922b-3d37ff06e053 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:23.511692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-22bbcb76-e352-45e8-89b7-8f99b7a67a26 req-90a7f76e-0e84-4669-922b-3d37ff06e053 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:23.530034 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-22bbcb76-e352-45e8-89b7-8f99b7a67a26 req-90a7f76e-0e84-4669-922b-3d37ff06e053 service nova] Creating event network-vif-deleted:5947e6f6-473a-49fb-a115-2fe1bbbd5e50 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:23.536360 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-22bbcb76-e352-45e8-89b7-8f99b7a67a26 req-90a7f76e-0e84-4669-922b-3d37ff06e053 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055928 Aug 30 03:59:23.537318 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2763/5644] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:23.543281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:23.544160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:23.552476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:23.553212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:23.553873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:23.554929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:23.555601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:23.556725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:23.777302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:23.798451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:23.801933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:23.805259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bf53b86-f4a8-434b-a5c8-7972d6926474 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2861 microversion: 2.32 time: 0.889885 Aug 30 03:59:23.808455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2882/5645] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:22 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2861 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:23.818795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "5947e6f6-473a-49fb-a115-2fe1bbbd5e50"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2bf36c-3152-475c-aa2e-46819c7e1bd8"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "cc199761-2a7f-468d-baab-243aded35f64"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:23.844302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:23.845522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:23.846168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:23.864002 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Creating event network-vif-unplugged:5947e6f6-473a-49fb-a115-2fe1bbbd5e50 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:23.864801 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Creating event network-vif-unplugged:2d2bf36c-3152-475c-aa2e-46819c7e1bd8 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:23.865496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] Creating event network-vif-unplugged:cc199761-2a7f-468d-baab-243aded35f64 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:23.872718 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6a6c9a3e-91ee-4aee-a148-b338bd6d44e3 req-d86bf734-1fdd-431d-a62e-de59c675b040 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.062138 Aug 30 03:59:23.873611 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2883/5646] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:23.995870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:24.021421 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1effcc24-2736-4d4e-86df-b45d4b4206cc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1389 microversion: 2.1 time: 0.482393 Aug 30 03:59:24.022453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2764/5647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:23 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1389 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:24.056660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:24.061532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:24.070631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.071487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.072136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.073092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.073829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.074812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.540718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:24.565564 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-84508c8a-8001-4987-bc62-08cf77e72769 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1389 microversion: 2.1 time: 0.525766 Aug 30 03:59:24.570388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2884/5648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:24 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1389 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:24.726892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:24.728063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:24.738186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.739511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.740852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.741843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.746577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.747416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.786542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 03:59:24.832085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:24.836576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:24.837753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:24.855955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.856542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.856994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.861534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.862113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.864052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.947682 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-07c66180-e91e-4f6c-be50-0cd545086820 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 204 len: 0 microversion: 2.1 time: 0.225412 Aug 30 03:59:24.949256 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2765/5649] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:59:24 2022] DELETE /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 03:59:24.963501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:24.964268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:24.972711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.973213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.973684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:24.974447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:24.975761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:24.976179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:25.269602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:25.291244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:25.296076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:25.298558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:25.300049 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-178a94ba-2a90-4d83-9978-09fc0a47b3bf tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2815 microversion: 2.32 time: 0.467940 Aug 30 03:59:25.300838 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2885/5650] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:24 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2815 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:25.313533 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3aa03960-155e-42d8-95a7-592d960e57ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1395 microversion: 2.1 time: 0.349465 Aug 30 03:59:25.313533 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2766/5651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:24 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1395 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:25.602852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-deleted", "tag": "b2017978-ce51-472b-98e1-2aee34743484"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-deleted", "tag": "cc199761-2a7f-468d-baab-243aded35f64"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:25.625515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:25.631802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:25.632367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:25.661596 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] Creating event network-vif-deleted:b2017978-ce51-472b-98e1-2aee34743484 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:25.662392 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] Creating event network-vif-deleted:cc199761-2a7f-468d-baab-243aded35f64 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:25.670457 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-24bbf6d4-ec7d-463b-a12d-6917f3abc06d req-7845d98b-fb65-443c-a1ba-b98ead5f9eff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074541 Aug 30 03:59:25.675572 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2767/5652] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:26.331465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:26.333536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:26.337420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:26.340589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:26.351390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:26.352166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:26.353022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:26.354256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:26.356775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:26.357464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:26.360658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:26.361367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:26.361972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:26.363955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:26.365031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:26.366682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:26.695253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:26.723044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:26.725386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:26.727182 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d94358a-cdea-4504-a533-170c515fc882 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 2495 microversion: 2.32 time: 0.401784 Aug 30 03:59:26.730657 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2768/5653] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:26 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 2495 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:26.804108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:26.814498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:26.818050 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-331ec774-e602-4cbf-a793-d631455d1d34 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1395 microversion: 2.1 time: 0.497048 Aug 30 03:59:26.819305 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2886/5654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:26 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1395 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:27.690875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-deleted", "tag": "2d2bf36c-3152-475c-aa2e-46819c7e1bd8"}, {"server_uuid": "e06bd2ae-2a63-4963-b659-ae0e42c5a1b5", "name": "network-vif-deleted", "tag": "5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:27.707556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:27.710891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:27.711352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:27.725330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] Creating event network-vif-deleted:2d2bf36c-3152-475c-aa2e-46819c7e1bd8 for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:27.725998 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] Creating event network-vif-deleted:5c86de6f-0cf4-48eb-a95f-8418b9f3c5ea for instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 on n-h2-854924-5 Aug 30 03:59:27.732425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9ca09bc2-be58-4909-841f-69d24ce8cf78 req-a4824dd8-adb8-4cba-93ee-f81cd3ec6377 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046715 Aug 30 03:59:27.736928 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2769/5655] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 03:59:27.757915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:27.759056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:27.774225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:27.774737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:27.776446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:27.777229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:27.777970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:27.778409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:27.843610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:27.844875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:27.860975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:27.861507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:27.861949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:27.863988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:27.864448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:27.864879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:28.029117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:28.107443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:28.116341 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-898162d6-0b4e-4c2d-8aa0-462b514c926e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1353 microversion: 2.1 time: 0.279494 Aug 30 03:59:28.123156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:28.123530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2770/5656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:27 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:28.125465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:28.128008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-770ab1e0-e56b-4087-b728-288beb1a744a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.374681 Aug 30 03:59:28.143694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2887/5657] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:27 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:28.259730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e2ed6e59-c404-425c-88d3-5f7a4d57474d req-d541ff79-9a9e-4cf8-ac9c-9eed164e8faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02483fbd-c721-4734-863e-d2d95b7a1c22", "name": "network-vif-deleted", "tag": "3c6f7b8d-bac4-4236-ba30-f88a71a68ba6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:28.281294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e2ed6e59-c404-425c-88d3-5f7a4d57474d req-d541ff79-9a9e-4cf8-ac9c-9eed164e8faf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:28.283396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e2ed6e59-c404-425c-88d3-5f7a4d57474d req-d541ff79-9a9e-4cf8-ac9c-9eed164e8faf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:28.288284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e2ed6e59-c404-425c-88d3-5f7a4d57474d req-d541ff79-9a9e-4cf8-ac9c-9eed164e8faf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:28.333814 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e2ed6e59-c404-425c-88d3-5f7a4d57474d req-d541ff79-9a9e-4cf8-ac9c-9eed164e8faf service nova] Creating event network-vif-deleted:3c6f7b8d-bac4-4236-ba30-f88a71a68ba6 for instance 02483fbd-c721-4734-863e-d2d95b7a1c22 on n-h1-854924-5 Aug 30 03:59:28.356054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e2ed6e59-c404-425c-88d3-5f7a4d57474d req-d541ff79-9a9e-4cf8-ac9c-9eed164e8faf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097511 Aug 30 03:59:28.356819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2771/5658] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 03:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:29.145717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:29.146884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:29.157697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:29.158977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:29.181310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:29.187052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:29.187807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:29.188814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:29.188981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:29.192158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:29.192444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:29.195123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:29.195737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:29.197738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:29.203546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:29.205039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:29.494345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:29.495284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:29.517138 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0eb6886c-b34d-4386-ab8b-34490d3ab37c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.367414 Aug 30 03:59:29.518997 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2888/5659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:29 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:29.523255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:29.527300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:29.529105 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2216214d-fef5-47a0-896e-a01231d048e1 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.376240 Aug 30 03:59:29.532792 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2772/5660] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:29 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:30.543722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:30.544548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:30.551383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:30.551880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:30.552322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:30.553017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:30.553508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:30.553939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:30.564713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:30.566266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:30.573522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:30.574473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:30.575108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:30.576348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:30.577011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:30.577692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:30.671639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:30.679639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-032ae0d5-976e-44d0-9e86-a6a3141892ac tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.140468 Aug 30 03:59:30.680217 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2889/5661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:30 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:30.681009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:30.690864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:30.692661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:30.694107 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-436d98fd-9bc1-4301-b09f-fe747914c392 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.135128 Aug 30 03:59:30.694668 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2773/5662] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:30 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:31.700650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:31.701299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:31.708069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:31.708828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:31.709274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:31.710019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:31.710481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:31.710914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:31.720138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:31.720757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:31.728495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:31.728991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:31.729465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:31.730173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:31.730634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:31.731069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:31.842135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:31.857193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:31.861528 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-011f4c6c-a52b-4678-9959-b6b6a5b054bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.165151 Aug 30 03:59:31.863498 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2890/5663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:31 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:31.876695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:31.883460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:31.886211 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-416731f0-7961-43a6-940f-a16fd4745262 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.169379 Aug 30 03:59:31.886853 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2774/5664] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:31 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:32.885741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:32.886547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:32.893923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:32.894614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:32.895494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:32.896358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:32.896838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:32.897253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:32.918247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:32.919021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:32.929444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:32.930013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:32.930379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:32.931102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:32.934898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:32.935495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:32.994634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:33.003725 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d78364bf-dba9-475b-84cf-f9d19dc13910 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.124053 Aug 30 03:59:33.004294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2891/5665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:32 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:33.033007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:33.044016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:33.046008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:33.048605 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5335fbe8-a447-4fb1-a85f-3b7169a4bcff tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.134515 Aug 30 03:59:33.049358 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2775/5666] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:32 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:34.024021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:34.024793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:34.032871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:34.033616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:34.034154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:34.035101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:34.035657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:34.036178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:34.073645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:34.074828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:34.085618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:34.091810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:34.091810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:34.091810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:34.092096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:34.092362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:34.148880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:34.158072 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dda48325-9518-4a55-a42f-c19b83d94e35 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.137772 Aug 30 03:59:34.158758 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2892/5667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:34 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:34.198659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:34.210718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:34.212444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:34.214541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6fd45a0d-c7ca-4926-b47f-85a2e57ef073 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.145822 Aug 30 03:59:34.215381 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2776/5668] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:34 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:35.179157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:35.180348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:35.188621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:35.189485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:35.190139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:35.191052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:35.191713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:35.192376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:35.238816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:35.239546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:35.253492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:35.254085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:35.254602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:35.255408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:35.255946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:35.256450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:35.366802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:35.369021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:35.376930 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37e0ae80-8dc2-4b60-8036-c9ae5e060bee tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.201395 Aug 30 03:59:35.382403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:35.384127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:35.386556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5faba3af-11b1-4e5b-82b9-413049f22c48 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.151907 Aug 30 03:59:35.391094 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2893/5669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:35 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:35.397619 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2777/5670] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:35 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:36.400629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:36.401994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:36.409990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:36.410806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:36.411535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:36.412429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:36.412545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:36.413249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:36.413648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:36.414215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:36.423525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:36.424691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:36.425294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:36.426170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:36.426769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:36.427339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:36.487345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:36.499080 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af227eac-b608-4df7-8dd5-3f4b5ae29246 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1187 microversion: 2.1 time: 0.102913 Aug 30 03:59:36.500244 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2894/5671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:36 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:36.517576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:36.528657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:36.530131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:36.531705 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5772da5f-6df6-42f3-89e3-b6e422f6728f tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.124094 Aug 30 03:59:36.532681 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2778/5672] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:36 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:37.523040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:37.524274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:37.535359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:37.550082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:37.552357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:37.554490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:37.555293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:37.555920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:37.556340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:37.558210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:37.565601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:37.566106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:37.566553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:37.567269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:37.581784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:37.582584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:37.629887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:37.630839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:37.631288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:37.631748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lazy-loading 'fault' on Instance uuid 02483fbd-c721-4734-863e-d2d95b7a1c22 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 03:59:37.737377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:37.763833 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69b0f89b-4b6a-4153-a879-6589ed6ba26c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 200 len: 1192 microversion: 2.1 time: 0.247544 Aug 30 03:59:37.764453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2895/5673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:37 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 1192 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:37.766098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:37.792240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:37.794401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:37.798740 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cea58eb9-be60-4956-b37a-bd24d1358ed2 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.247280 Aug 30 03:59:37.799355 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2779/5674] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:37 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:38.798322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:38.802182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:38.815046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:38.824241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:38.825596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:38.828279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:38.828927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:38.829977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:38.830586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:38.831239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:38.848317 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 HTTP/1.1 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '02483fbd-c721-4734-863e-d2d95b7a1c22'} Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:38.850424 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:38.854997 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:38.856785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:38.856785 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13b82eba-5531-4d46-b537-297588aef978 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 404 len: 111 microversion: 2.1 time: 0.072925 Aug 30 03:59:38.862092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:38.862564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:38.864606 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2896/5675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:38 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:59:38.865026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:38.865809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:38.868587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:38.869067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:39.082023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:39.096481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:39.100490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:39.103250 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3bff723-fdba-47e5-b8ce-87494b23c871 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.284327 Aug 30 03:59:39.105666 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2780/5676] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:38 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:40.130000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:40.131712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:40.143475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:40.146050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:40.150867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:40.152581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:40.153563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:40.154234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:40.301465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:40.326696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:40.328173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:40.345561 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d39ee7d2-3047-4929-94ea-c5051ce9ab0b tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.205196 Aug 30 03:59:40.349673 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2897/5677] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:40 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:41.370657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:41.372086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:41.390968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:41.391467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:41.391902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:41.392609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:41.393065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:41.396125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:41.583007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:41.595855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:41.597318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:41.601778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12e830f2-3d1d-4500-900d-021163fce720 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.236175 Aug 30 03:59:41.606058 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2781/5678] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:41 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:42.628987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:42.629633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:42.640456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:42.640950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:42.641416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:42.642135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:42.642598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:42.643037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:42.887498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:42.905795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:42.907510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:42.908760 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b7dd81db-7e0f-4bd7-8629-74e14d1e9dac tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.283851 Aug 30 03:59:42.929680 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2898/5679] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:42 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:43.936783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:43.938103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:43.947060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:43.959241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:43.959976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:43.961020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:43.961903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:43.962567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:43.963174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:44.221945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:44.258874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:44.268785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:44.272934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21f79c9b-77f0-4a4f-8fc4-6c84d8fc688d tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.338957 Aug 30 03:59:44.294674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2782/5680] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:43 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:45.300396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:45.301602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:45.304662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:45.318960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:45.324810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:45.330887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:45.331851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:45.332852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:45.333273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:45.462510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:45.472645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:45.476077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:45.478883 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-85623264-0c44-48cb-8e37-ce7d853e46d6 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.182393 Aug 30 03:59:45.497503 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2899/5681] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:45 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:46.505527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:46.506802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:46.529983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:46.530667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:46.534777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:46.536782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:46.540791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:46.541435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:46.633333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:46.728434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:46.741647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:46.744438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:46.746655 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31d8adba-bffc-4b3b-b5fa-0ea519c00d55 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.245643 Aug 30 03:59:46.748694 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2783/5682] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:46 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:47.783777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:47.784390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:47.808917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:47.818798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:47.819713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:47.820628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:47.821240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:47.822050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:47.947152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:47.972049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:47.973911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:47.977808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b3da773-b301-4862-bb41-7575325fde4a tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.196905 Aug 30 03:59:47.978634 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2900/5683] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:47 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:48.315342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:48.315954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:48.332209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:48.332811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:48.337047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:48.338642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:48.339325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:48.340018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:48.372607 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 HTTP/1.1 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '02483fbd-c721-4734-863e-d2d95b7a1c22'} Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:48.374860 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.379371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.386111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:48.389244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf0406c7-1403-4af8-904a-0206e91e7a7c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 404 len: 111 microversion: 2.1 time: 0.078047 Aug 30 03:59:48.391630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2784/5684] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 03:59:48 2022] DELETE /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 03:59:48.400001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:48.400663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 02483fbd-c721-4734-863e-d2d95b7a1c22] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:48.413283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:48.413887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:48.414331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:48.415050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:48.415510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:48.415943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:48.472359 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 HTTP/1.1 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '02483fbd-c721-4734-863e-d2d95b7a1c22'} Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:48.476178 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:48.479956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 02483fbd-c721-4734-863e-d2d95b7a1c22 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:48.482701 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d168cc3a-77fd-4060-b8d8-09b2ebacfdbe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22" status: 404 len: 111 microversion: 2.1 time: 0.086721 Aug 30 03:59:48.483674 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2901/5685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 03:59:48 2022] GET /compute/v2.1/servers/02483fbd-c721-4734-863e-d2d95b7a1c22 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 03:59:49.000646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:49.001285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:49.016564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:49.017325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:49.017929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:49.018782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:49.019380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:49.019953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:50.023150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:50.044256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:50.047124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:50.051299 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cf120236-46e2-4d4c-8038-50285d81236e tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 1.054460 Aug 30 03:59:50.054605 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2785/5686] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:48 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:51.085665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:51.090167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:51.104602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:51.105590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:51.106358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:51.107390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:51.108002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:51.108584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:51.294502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:51.312589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:51.317287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '189c6e8abfdc4bff98b8197516648856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90eab31f60e34f6483f85eaa04fe1439', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 03:59:51.322671 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-767491c8-7d00-48ac-a0e1-7dd93d653499 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 200 len: 1603 microversion: 2.32 time: 0.240772 Aug 30 03:59:51.338884 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2902/5687] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:51 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 1603 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 03:59:52.350973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:52.351882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:52.370836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:52.371489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:52.372093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:52.372951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:52.376186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:52.376899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:52.409231 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] HTTP exception thrown: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Request method failure captured: Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 HTTP/1.1 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYm5Ap3J4ksdH-WRKfx8tJ3J7knG92ZLrBGO0N6qdZTuuS5tyQmJoLEeGVqUyM4YXGy7Yd-rby31av-1mIsPsVLpB2AMgM_6MONwSXHd2r9RTCwJxr6ElirKyOEmLgaE2hfZEk_r-UBM7G9GjBk9MDorSqAGBnzWAg_mNsh5lyjURUA Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 90eab31f60e34f6483f85eaa04fe1439 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90eab31f60e34f6483f85eaa04fe1439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90eab31f60e34f6483f85eaa04fe1439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90eab31f60e34f6483f85eaa04fe1439", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90eab31f60e34f6483f85eaa04fe1439"}]}] Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 90eab31f60e34f6483f85eaa04fe1439 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TaggedBootDevicesTest-392911565-project Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 189c6e8abfdc4bff98b8197516648856 Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TaggedBootDevicesTest-392911565-project Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e06bd2ae-2a63-4963-b659-ae0e42c5a1b5'} Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:52.414278 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:52.420077 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:52.428486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Returning 404 to user: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:52.429737 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-83a9a642-f755-49c7-8659-43e593c4a291 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 404 len: 111 microversion: 2.32 time: 0.082729 Aug 30 03:59:52.430759 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2786/5688] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:52 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:59:52.438927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69a7a3f4-e56e-4d59-9bee-f8c8a635ba44 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '.version_select at 0x7f897a6d8040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:52.479056 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69a7a3f4-e56e-4d59-9bee-f8c8a635ba44 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49900241" status: 204 len: 0 microversion: 2.32 time: 0.043601 Aug 30 03:59:52.481879 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2903/5689] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 03:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49900241 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 03:59:58.455578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:58.459143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:58.488745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:58.490899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:58.493492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:58.498885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:58.499782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:58.503572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:58.552721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] HTTP exception thrown: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Request method failure captured: Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 HTTP/1.1 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYm5Ap3J4ksdH-WRKfx8tJ3J7knG92ZLrBGO0N6qdZTuuS5tyQmJoLEeGVqUyM4YXGy7Yd-rby31av-1mIsPsVLpB2AMgM_6MONwSXHd2r9RTCwJxr6ElirKyOEmLgaE2hfZEk_r-UBM7G9GjBk9MDorSqAGBnzWAg_mNsh5lyjURUA Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 90eab31f60e34f6483f85eaa04fe1439 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90eab31f60e34f6483f85eaa04fe1439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90eab31f60e34f6483f85eaa04fe1439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90eab31f60e34f6483f85eaa04fe1439", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90eab31f60e34f6483f85eaa04fe1439"}]}] Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 90eab31f60e34f6483f85eaa04fe1439 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TaggedBootDevicesTest-392911565-project Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 189c6e8abfdc4bff98b8197516648856 Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TaggedBootDevicesTest-392911565-project Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e06bd2ae-2a63-4963-b659-ae0e42c5a1b5'} Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:58.554763 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.563463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Returning 404 to user: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:58.566358 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba0434ea-4b68-4e31-89e5-3c725ec4abd7 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 404 len: 111 microversion: 2.32 time: 0.120051 Aug 30 03:59:58.566952 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2787/5690] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 03:59:58 2022] DELETE /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 03:59:58.577974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:58.578787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] [instance: e06bd2ae-2a63-4963-b659-ae0e42c5a1b5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 03:59:58.594392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:58.595129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:58.596435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:58.597561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:59:58.601701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:59:58.602807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:59:58.636299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=91 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:58.643649 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] HTTP exception thrown: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Request method failure captured: Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 HTTP/1.1 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYm5Ap3J4ksdH-WRKfx8tJ3J7knG92ZLrBGO0N6qdZTuuS5tyQmJoLEeGVqUyM4YXGy7Yd-rby31av-1mIsPsVLpB2AMgM_6MONwSXHd2r9RTCwJxr6ElirKyOEmLgaE2hfZEk_r-UBM7G9GjBk9MDorSqAGBnzWAg_mNsh5lyjURUA Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 90eab31f60e34f6483f85eaa04fe1439 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90eab31f60e34f6483f85eaa04fe1439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/90eab31f60e34f6483f85eaa04fe1439"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_90eab31f60e34f6483f85eaa04fe1439", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/90eab31f60e34f6483f85eaa04fe1439"}]}] Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 90eab31f60e34f6483f85eaa04fe1439 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TaggedBootDevicesTest-392911565 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TaggedBootDevicesTest-392911565-project Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 189c6e8abfdc4bff98b8197516648856 Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TaggedBootDevicesTest-392911565-project Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e06bd2ae-2a63-4963-b659-ae0e42c5a1b5'} Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 03:59:58.646815 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. Aug 30 03:59:58.650391 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 03:59:58.653189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] Returning 404 to user: Instance e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 03:59:58.655382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d9cc8003-90fc-4695-ac83-164e6f77d127 tempest-TaggedBootDevicesTest-392911565 tempest-TaggedBootDevicesTest-392911565-project] 10.222.0.30 "GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5" status: 404 len: 111 microversion: 2.32 time: 0.083313 Aug 30 03:59:58.659009 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2904/5691] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 03:59:58 2022] GET /compute/v2.1/servers/e06bd2ae-2a63-4963-b659-ae0e42c5a1b5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:00:32.001864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-76084346", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7041c897-7d40-4ae8-893a-3b5edc3f9d36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:32.025743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:32.026657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:32.143853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:00:33.022805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:00:33.023357 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:00:33.023692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:00:33.024339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:00:33.024605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:00:33.044397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:33.045644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:33.046425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:33.047631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:33.048108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:33.048653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:33.077917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:00:33.087328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:00:33.173852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:00:33.176032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7041c897-7d40-4ae8-893a-3b5edc3f9d36',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:00:33.407937 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0f575dae-1b6c-4cb9-a929-c2aa95b9afd5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411389 Aug 30 04:00:33.409453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2788/5692] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:00:33.419892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-404f1c18-64fb-42fd-824a-6699dda63736 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:33.420510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-404f1c18-64fb-42fd-824a-6699dda63736 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:33.424518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:33.513833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-404f1c18-64fb-42fd-824a-6699dda63736 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:33.522873 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-404f1c18-64fb-42fd-824a-6699dda63736 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1069 microversion: 2.1 time: 0.106786 Aug 30 04:00:33.524639 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2905/5693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:33 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1069 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:34.205058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac9eb995-163f-437e-96ee-3c9d7b050084 tempest-ComputeTenantNetworksTest-277069972 tempest-ComputeTenantNetworksTest-277069972-project] Calling method '.version_select at 0x7f8983d940d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:34.535591 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac9eb995-163f-437e-96ee-3c9d7b050084 tempest-ComputeTenantNetworksTest-277069972 tempest-ComputeTenantNetworksTest-277069972-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.612374 Aug 30 04:00:34.538831 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2789/5694] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 04:00:33 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:34.561069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:34.561751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:34.567367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2cc2a983-e46b-4dc8-aa8c-54c2ae174e53 tempest-ComputeTenantNetworksTest-277069972 tempest-ComputeTenantNetworksTest-277069972-project] Calling method '.version_select at 0x7f897b7123a0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:34.579474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:34.580248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:34.580696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:34.581850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:34.582661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:34.583441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:34.749157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:34.763975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b25f00b4-649c-4709-913c-66c525fafa1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1111 microversion: 2.1 time: 0.213809 Aug 30 04:00:34.765324 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2906/5695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:34 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1111 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:34.954785 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2cc2a983-e46b-4dc8-aa8c-54c2ae174e53 tempest-ComputeTenantNetworksTest-277069972 tempest-ComputeTenantNetworksTest-277069972-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/3ce999a1-2f63-474a-9e61-7fb205aaf9d5" status: 200 len: 139 microversion: 2.1 time: 0.409385 Aug 30 04:00:34.962685 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2790/5696] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 04:00:34 2022] GET /compute/v2.1/os-tenant-networks/3ce999a1-2f63-474a-9e61-7fb205aaf9d5 => generated 139 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:35.791179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:35.791714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:35.807160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:35.807672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:35.808120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:35.808852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:35.809318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:35.809771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:36.013604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:36.027009 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1185 microversion: 2.1 time: 0.241463 Aug 30 04:00:36.028340 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2907/5697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:35 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1185 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:37.059799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:37.060541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:37.114044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:37.115057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:37.119978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:37.122862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:37.126825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:37.127824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:37.297223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:37.309863 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1185 microversion: 2.1 time: 0.264674 Aug 30 04:00:37.311432 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2791/5698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:37 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1185 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:38.222833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:38.225448 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002859 Aug 30 04:00:38.226505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2908/5699] 10.222.0.30 () {56 vars in 886 bytes} [Tue Aug 30 04:00:38 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:00:38.235227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:38.236377 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001898 Aug 30 04:00:38.236789 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2792/5700] 10.222.0.30 () {54 vars in 1035 bytes} [Tue Aug 30 04:00:38 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 30 04:00:38.244110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:38.245142 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ee6270d9-785d-4ddb-9201-31e4e9f7cbab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 30 04:00:38.252243 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2909/5701] 10.222.0.30 () {54 vars in 1041 bytes} [Tue Aug 30 04:00:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:38.256178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:38.257160 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-18f9f464-1823-4f3e-ac63-8732a9b0b84e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001357 Aug 30 04:00:38.257897 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2793/5702] 10.222.0.30 () {56 vars in 886 bytes} [Tue Aug 30 04:00:38 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:00:38.333424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:38.334206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:38.375911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:38.380223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:38.380876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:38.384753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:38.386876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:38.388488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:38.896927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:38.906315 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-959dbf6d-afb1-4b09-9b98-c308e838809c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1227 microversion: 2.1 time: 0.577574 Aug 30 04:00:38.928004 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2910/5703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:38 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1227 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:39.935599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:39.936774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:39.951177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:39.951911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:39.952606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:39.953533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:39.954139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:39.955832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:40.781370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:40.783131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-312feb53-aaa6-459e-8cc6-2bfbbb3b4537 req-96f7c000-0c2c-470b-90a9-947f2882fd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99140bd4-688a-4369-8532-d1500d682694", "tag": "b8dec595-0a51-42da-a05b-745901a21999"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:40.800095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee4ce4e4-6ca4-49a0-b716-6aaa3f0bd0e7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1227 microversion: 2.1 time: 0.863629 Aug 30 04:00:40.801371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-312feb53-aaa6-459e-8cc6-2bfbbb3b4537 req-96f7c000-0c2c-470b-90a9-947f2882fd07 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:40.806089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-312feb53-aaa6-459e-8cc6-2bfbbb3b4537 req-96f7c000-0c2c-470b-90a9-947f2882fd07 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:40.810552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-312feb53-aaa6-459e-8cc6-2bfbbb3b4537 req-96f7c000-0c2c-470b-90a9-947f2882fd07 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:40.814405 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2794/5704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:39 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1227 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:40.856496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-312feb53-aaa6-459e-8cc6-2bfbbb3b4537 req-96f7c000-0c2c-470b-90a9-947f2882fd07 service nova] Creating event network-changed:b8dec595-0a51-42da-a05b-745901a21999 for instance 99140bd4-688a-4369-8532-d1500d682694 on n-h1-854924-5 Aug 30 04:00:40.875302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-312feb53-aaa6-459e-8cc6-2bfbbb3b4537 req-96f7c000-0c2c-470b-90a9-947f2882fd07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386436 Aug 30 04:00:40.875932 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2911/5705] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:00:41.829580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:41.830826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:41.846197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:41.851735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:41.855496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:41.858052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:41.860280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:41.862321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:42.263377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:42.277884 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b2eeb872-9d2b-4ef7-9a2e-a137a2c164c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1227 microversion: 2.1 time: 0.452058 Aug 30 04:00:42.279733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2795/5706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:41 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1227 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:43.308228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:43.309447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:43.316733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:43.323835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:43.327794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:43.329073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:43.329622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:43.330044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:43.521281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:43.755435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:43.783417 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-470c72a5-db3d-4361-b0ae-7c0b1d993752 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1227 microversion: 2.1 time: 0.486673 Aug 30 04:00:43.785472 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2912/5707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:43 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1227 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:44.421993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49efba10-600b-4cc7-aa7c-b03544fb3737 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'create', calling method: .version_select at 0x7f897ae62280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1410705454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZR5KKldOSVWKtl0FV3MR4dKCrhvBbUNbCvRfx4TxDfSR9Mj0g6V4UobOM6IpE+V8jcDRXuFZJ8YS9tEXPiZ7SN6T+oLqSRDQ5b0h5SrdqkVQEr02JA6bv8IHmUZlJ7jA=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:44.435684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:44.442972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:44.473363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-49efba10-600b-4cc7-aa7c-b03544fb3737 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for project d212588e912641c6bdf0f50e15ca2519. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:00:44.491242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-49efba10-600b-4cc7-aa7c-b03544fb3737 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for user b2f8a2b059de406aa1d02936b4e0dbe3 and project d212588e912641c6bdf0f50e15ca2519. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:00:44.551339 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-49efba10-600b-4cc7-aa7c-b03544fb3737 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.135177 Aug 30 04:00:44.552064 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2796/5708] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:00:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:44.824737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:44.833808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:44.872592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:44.873482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:44.874215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:44.875248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:44.876241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:44.876916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:45.936065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:45.950483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ee741b9-3d34-4916-ae84-6b0b0f6c497f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1227 microversion: 2.1 time: 1.144331 Aug 30 04:00:45.954188 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2913/5709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:44 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1227 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:46.838440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2042462385", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b7383510-5842-41ce-9e6d-3df64647c584"}], "key_name": "tempest-TestNetworkBasicOps-1410705454", "security_groups": [{"name": "tempest-secgroup-smoke-332788053"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:46.975724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:46.976293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:47.005712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:47.006327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:47.006785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:47.008133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:47.008600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:47.009217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:47.264660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] validate_networks() for [('b7383510-5842-41ce-9e6d-3df64647c584', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:00:47.729771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:47.741046 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cfc4aa10-2fc4-4e22-bd11-44d1c2dfbf33 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.770603 Aug 30 04:00:47.741713 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2914/5710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:46 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:00:48.443245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:00:48.444375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:00:48.445071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:00:48.445743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:00:48.446347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:00:48.473798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:48.480148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:48.480790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:48.481852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:48.482503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:48.484825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:48.537725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for project d212588e912641c6bdf0f50e15ca2519. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:00:48.545704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for user b2f8a2b059de406aa1d02936b4e0dbe3 and project d212588e912641c6bdf0f50e15ca2519. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:00:48.570830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:00:48.575499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:00:48.647110 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8436817c-1667-4fb4-a56b-b58421320a0f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.815613 Aug 30 04:00:48.648467 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2797/5711] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:00:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:00:48.666913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cfdef94e-384a-4ff1-8110-a0c6fd4a3c44 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:48.667546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cfdef94e-384a-4ff1-8110-a0c6fd4a3c44 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:48.767158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:48.768225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:48.791332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:48.797846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:48.798580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:48.803955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:48.804774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:48.805479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:49.006104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cfdef94e-384a-4ff1-8110-a0c6fd4a3c44 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:49.022566 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cfdef94e-384a-4ff1-8110-a0c6fd4a3c44 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1249 microversion: 2.1 time: 0.365123 Aug 30 04:00:49.023453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2915/5712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:48 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1249 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:49.257529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:49.268021 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7f6df6b-9e65-46e3-a171-c0d5eec2072c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.504929 Aug 30 04:00:49.271429 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2798/5713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:48 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:00:50.049842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:50.051041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:50.089562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:50.090207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:50.090874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:50.093116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:50.094049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:50.097899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:50.218692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:50.236215 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54fa89cc-293a-40af-83d8-cdcaabdff560 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1301 microversion: 2.1 time: 0.190161 Aug 30 04:00:50.238181 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2916/5714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:50 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:50.297301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:50.298189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:50.315565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:50.316477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:50.317146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:50.318100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:50.319629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:50.320293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:50.899402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:50.917630 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-76315aca-1f23-4221-89db-1ff30229d390 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.622999 Aug 30 04:00:50.919088 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2799/5715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:50 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:51.259730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:51.260977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:51.277250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:51.277781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:51.278220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:51.279393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:51.280012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:51.280601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:51.436020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:51.445113 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b359453d-6c9e-46ff-aa57-417d408929c4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1307 microversion: 2.1 time: 0.190577 Aug 30 04:00:51.447210 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2917/5716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:51 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:51.942055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:51.942838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:51.964970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:51.967164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:51.968090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:51.971781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:51.972850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:51.976687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:52.428271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:52.439559 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-527232a4-2be3-403a-9d2f-b0a5e896a518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.501426 Aug 30 04:00:52.444032 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2800/5717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:51 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:52.468925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:52.469780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:52.482555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:52.483161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:52.485297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:52.486163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:52.494435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:52.498016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:52.951690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:52.961256 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd6dae2d-1233-48c2-9b5b-e7e58418c344 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 0.496179 Aug 30 04:00:52.977695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2918/5718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:52 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:53.475143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:53.479781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:53.491465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:53.492380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:53.493931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:53.494887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:53.496366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:53.497815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:53.920353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:53.930224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd77c1a9-948e-46d9-8c71-909ca8139934 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.469929 Aug 30 04:00:53.930874 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2801/5719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:53 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:53.987846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:53.988477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:53.998157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:53.998795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:53.999301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:54.017044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:54.019188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:54.022228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:54.496443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:54.506771 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e6b4717e-0146-4e39-a5f2-d3a072708eff tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 0.526394 Aug 30 04:00:54.515733 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2919/5720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:53 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:54.679155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-af00831e-d0c8-4fe3-a0e2-47334872fe27 req-01082975-bc1f-4720-9c9c-8361e206dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4", "tag": "bcb2fe4b-d232-4d78-a20a-3110ad1d6519"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:54.708827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-af00831e-d0c8-4fe3-a0e2-47334872fe27 req-01082975-bc1f-4720-9c9c-8361e206dd9c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:54.716621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-af00831e-d0c8-4fe3-a0e2-47334872fe27 req-01082975-bc1f-4720-9c9c-8361e206dd9c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:54.717170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-af00831e-d0c8-4fe3-a0e2-47334872fe27 req-01082975-bc1f-4720-9c9c-8361e206dd9c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:54.774549 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-af00831e-d0c8-4fe3-a0e2-47334872fe27 req-01082975-bc1f-4720-9c9c-8361e206dd9c service nova] Creating event network-changed:bcb2fe4b-d232-4d78-a20a-3110ad1d6519 for instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 on n-h2-854924-5 Aug 30 04:00:54.790727 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-af00831e-d0c8-4fe3-a0e2-47334872fe27 req-01082975-bc1f-4720-9c9c-8361e206dd9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413902 Aug 30 04:00:54.792195 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2802/5721] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:54.911488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d6b1016a-7502-4dd4-8abc-60e2bbdf374f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: .version_select at 0x7f897a4ef3a0>, body: {"keypair": {"name": "tempest-keypair-669644068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8kfHq0m+TpqsT7eAYx8qhAC4ZArFyBJaLTba62eo66YjSmLUOr3FfHz/aO6bt/Ssl13oiwEEPnKIppBDDflqNK25XwMhRysNxk458GN35Q39rVVtiNZ7xUDJ6C61vfnA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:54.947220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d6b1016a-7502-4dd4-8abc-60e2bbdf374f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:00:54.953437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:54.954385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:54.964555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:54.965119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d6b1016a-7502-4dd4-8abc-60e2bbdf374f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:00:54.965542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:54.976276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:54.978266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:54.978981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:54.979579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:55.029992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d6b1016a-7502-4dd4-8abc-60e2bbdf374f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267875 Aug 30 04:00:55.030671 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2920/5722] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:00:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:00:55.316282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:55.328057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-beb38725-e89f-4a01-adf8-c9fc88f26a12 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.379786 Aug 30 04:00:55.328703 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2803/5723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:54 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:55.541663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:55.542558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:55.552123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:55.552950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:55.553578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:55.554462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:55.555281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:55.556429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:55.851766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:55.865490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a92944d-a6b2-4b96-a27a-429747ae0d46 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 0.333623 Aug 30 04:00:55.876567 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2921/5724] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:55 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:56.250900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e9d54d34-1acc-48a2-91c5-2ac389a60db1 req-7da46189-a090-46ec-837f-916e0068b760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99140bd4-688a-4369-8532-d1500d682694", "name": "network-vif-plugged", "status": "completed", "tag": "b8dec595-0a51-42da-a05b-745901a21999"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:56.271427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e9d54d34-1acc-48a2-91c5-2ac389a60db1 req-7da46189-a090-46ec-837f-916e0068b760 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:56.271911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e9d54d34-1acc-48a2-91c5-2ac389a60db1 req-7da46189-a090-46ec-837f-916e0068b760 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:56.272345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e9d54d34-1acc-48a2-91c5-2ac389a60db1 req-7da46189-a090-46ec-837f-916e0068b760 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:56.296763 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e9d54d34-1acc-48a2-91c5-2ac389a60db1 req-7da46189-a090-46ec-837f-916e0068b760 service nova] Creating event network-vif-plugged:b8dec595-0a51-42da-a05b-745901a21999 for instance 99140bd4-688a-4369-8532-d1500d682694 on n-h1-854924-5 Aug 30 04:00:56.318395 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e9d54d34-1acc-48a2-91c5-2ac389a60db1 req-7da46189-a090-46ec-837f-916e0068b760 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209767 Aug 30 04:00:56.319019 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2804/5725] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:56.351058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:56.351675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:56.359569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:56.367300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:56.369509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:56.371526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:56.375519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:56.377112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:56.903752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:56.905605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:56.926195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:56.926859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:56.927408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:56.928231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:56.928951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:56.930454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:57.390809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:57.403736 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8288805b-14c4-432a-8881-23a5f461d280 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 1.056418 Aug 30 04:00:57.414069 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2922/5726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:56 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:57.999825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:58.010929 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b2fa920-0f87-44fe-b005-d4d87065108d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 1.122098 Aug 30 04:00:58.011902 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2805/5727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:56 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:00:58.440915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:58.442638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:58.453631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:58.455935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:58.457497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:58.460004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:58.460697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:58.462870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:58.807046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:58.829038 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f841b130-62dd-4cb1-bb25-15a61661f20f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1215 microversion: 2.1 time: 0.393295 Aug 30 04:00:58.840458 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2923/5728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:58 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1215 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:59.041428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:59.043502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:59.135281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:59.140989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:59.152591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:59.157727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:59.159025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:59.165774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:59.166336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:59.166778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:59.277888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448160312", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6ec5b19-fb85-4e4b-a816-8856b9dda964"}], "security_groups": [{"name": "tempest-securitygroup--1429641675"}], "key_name": "tempest-keypair-669644068", "user_data": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:59.574669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] validate_networks() for [('c6ec5b19-fb85-4e4b-a816-8856b9dda964', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:00:59.579426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:00:59.587610 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42398606-16ea-487c-ad32-1ac7332d73af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 0.558578 Aug 30 04:00:59.591604 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2806/5729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:59 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:00:59.857326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:59.858309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:00:59.867408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:59.870404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:59.871130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:00:59.872624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:00:59.873539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:00:59.874153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.209244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:00.219972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-902508cd-c5e1-47fd-9ff8-ccd7a7d03a1a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1402 microversion: 2.1 time: 0.366495 Aug 30 04:01:00.220574 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2807/5730] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:00:59 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1402 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:00.240675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:00.242947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:00.255869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.256380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.256825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.257570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.258032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.258457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.297488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:01:00.298061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:01:00.298658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:01:00.299189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:01:00.299753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:01:00.319392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.320110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.321457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.323694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.324894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.326356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.370237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:01:00.381607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:01:00.407370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:01:00.410286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:01:00.421072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:00.431176 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d01d55ed-2211-4959-9a5b-e39406aefc76 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1402 microversion: 2.1 time: 0.193818 Aug 30 04:01:00.432245 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2808/5731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:00 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1402 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:00.455464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-171243857"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:00.458514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:00.466531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.467414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.468117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.469195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.469996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.470699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.494809 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81e5b8f7-3eb9-4e3e-baf2-9030e74d6faa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.221351 Aug 30 04:01:00.496076 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2924/5732] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:00:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:01:00.507831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7317bddb-c606-4302-ba10-c273d88f7484 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:00.508865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7317bddb-c606-4302-ba10-c273d88f7484 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:00.652418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7317bddb-c606-4302-ba10-c273d88f7484 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:00.661721 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7317bddb-c606-4302-ba10-c273d88f7484 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1241 microversion: 2.1 time: 0.158794 Aug 30 04:01:00.674357 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2925/5733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:00 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:00.681899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:00.682726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:00.690472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.695890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.696890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.704428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:00.704878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:00.707316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:00.725721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Attempting to quiesce instance before volume snapshot. Aug 30 04:01:00.773496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 30 04:01:00.910553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Creating snapshot from volume 7041c897-7d40-4ae8-893a-3b5edc3f9d36. {{(pid=122167) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 30 04:01:01.044462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:01.058385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df4b44d2-0fb8-48cb-ad12-ba0e33cc81fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 0.382695 Aug 30 04:01:01.061213 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2926/5734] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:00 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:01.069725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4954b2f2-097d-4d0d-bce4-df28287fe912 req-5edc73ea-8966-4ceb-a1b5-a81b895d6286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4", "name": "network-vif-plugged", "status": "completed", "tag": "bcb2fe4b-d232-4d78-a20a-3110ad1d6519"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:01.095272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4954b2f2-097d-4d0d-bce4-df28287fe912 req-5edc73ea-8966-4ceb-a1b5-a81b895d6286 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:01.096368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4954b2f2-097d-4d0d-bce4-df28287fe912 req-5edc73ea-8966-4ceb-a1b5-a81b895d6286 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:01.097007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4954b2f2-097d-4d0d-bce4-df28287fe912 req-5edc73ea-8966-4ceb-a1b5-a81b895d6286 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:01.129809 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4954b2f2-097d-4d0d-bce4-df28287fe912 req-5edc73ea-8966-4ceb-a1b5-a81b895d6286 service nova] Creating event network-vif-plugged:bcb2fe4b-d232-4d78-a20a-3110ad1d6519 for instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 on n-h2-854924-5 Aug 30 04:01:01.147479 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4954b2f2-097d-4d0d-bce4-df28287fe912 req-5edc73ea-8966-4ceb-a1b5-a81b895d6286 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083278 Aug 30 04:01:01.148813 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2927/5735] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:01.689083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:01.690558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:01.700828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:01.701314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:01.701770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:01.702457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:01.711044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:01.711672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:01.849727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:01.866508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78422e79-f418-4677-aae5-7de6538cd708 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1237 microversion: 2.1 time: 0.182140 Aug 30 04:01:01.866875 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2928/5736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:01 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:02.106104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:02.107725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:02.118509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:02.119391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:02.120398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:02.122025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:02.122696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:02.123690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:02.185261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:02.400233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e49271a8-4eaf-49be-a202-b2590cc58597 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694/action" status: 202 len: 0 microversion: 2.1 time: 1.950131 Aug 30 04:01:02.401510 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2809/5737] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:01:00 2022] POST /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694/action => generated 0 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:01:02.752538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:02.764301 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d449798b-0c96-477b-aaec-456e3f536b8b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1374 microversion: 2.1 time: 0.681409 Aug 30 04:01:02.765506 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2929/5738] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:02 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1374 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:02.889184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:02.890168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:02.909095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:02.917691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:02.918317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:02.918777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:02.919542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:02.920022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:02.920465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:02.930135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:03.165756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:03.192160 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4e6ddff2-49f3-4a6c-a8fc-a17420821347 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1299 microversion: 2.1 time: 0.308048 Aug 30 04:01:03.193461 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2810/5739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:02 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:03.699529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1607391247", "imageRef": "b656f412-6c52-4060-bcba-ddea8196dfe1", "flavorRef": "452", "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:03.710915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:03.763764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:01:03.786143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:03.786924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:03.792991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:03.793720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:03.794350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:03.795059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:03.795519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:03.796312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:04.212360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:04.223236 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1eacee5a-e86a-4037-b9fc-331cd5f3209c tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1546 microversion: 2.1 time: 0.441007 Aug 30 04:01:04.224217 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2811/5740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:03 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1546 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:04.245289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:04.246202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:04.252460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:04.252954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:04.253420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:04.254137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:04.254599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:04.255030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:04.939043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:04.948522 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-011b0094-b570-43c2-b12c-7cd2e0d8f5ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 0.709538 Aug 30 04:01:04.949439 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2812/5741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:04 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:04.971290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:04.972435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:04.982331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:04.983498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:04.983962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:04.984712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:04.985365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:04.987367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:05.163845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:01:05.164974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:01:05.165960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:01:05.166531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:01:05.167272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:01:05.180144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:05.181485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:05.181922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:05.182650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:05.183337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:05.183784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:05.207050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:01:05.213724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:01:05.229309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:01:05.232232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9292c94f-a0ee-45c0-a4a5-f6d4c9611e15',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:01:05.329034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:05.341985 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-71f1a7a5-6a68-4203-b182-5f2bdc7a5e2b tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1546 microversion: 2.1 time: 0.376607 Aug 30 04:01:05.346431 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2813/5742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:04 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1546 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:05.392371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fef278e3-c1f4-47e1-9e16-8b50f37c954c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697523 Aug 30 04:01:05.401645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2930/5743] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:01:05.407935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67db30f9-6d48-48ae-89c7-587cdc466947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:05.408584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-67db30f9-6d48-48ae-89c7-587cdc466947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:05.518534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67db30f9-6d48-48ae-89c7-587cdc466947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:05.532598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67db30f9-6d48-48ae-89c7-587cdc466947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1230 microversion: 2.1 time: 0.129039 Aug 30 04:01:05.533530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2814/5744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:05 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1230 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:05.971610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:05.974120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:05.996379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:05.996919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:06.000103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:06.003266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:06.006124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:06.006871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:06.372791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e823fd98-239c-43a5-91a2-baea1f4b6e5f req-4e534ad9-f354-456c-ae56-72a1ede83391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5579e2c3-da3a-4aa1-85ab-ce76724c91ea", "tag": "b405fed1-bd5b-4351-8e00-1c3380fb1a2e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:06.406660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e823fd98-239c-43a5-91a2-baea1f4b6e5f req-4e534ad9-f354-456c-ae56-72a1ede83391 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:06.408362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e823fd98-239c-43a5-91a2-baea1f4b6e5f req-4e534ad9-f354-456c-ae56-72a1ede83391 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:06.408838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e823fd98-239c-43a5-91a2-baea1f4b6e5f req-4e534ad9-f354-456c-ae56-72a1ede83391 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:06.447282 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e823fd98-239c-43a5-91a2-baea1f4b6e5f req-4e534ad9-f354-456c-ae56-72a1ede83391 service nova] Creating event network-changed:b405fed1-bd5b-4351-8e00-1c3380fb1a2e for instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea on n-h1-854924-5 Aug 30 04:01:06.459078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e823fd98-239c-43a5-91a2-baea1f4b6e5f req-4e534ad9-f354-456c-ae56-72a1ede83391 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095057 Aug 30 04:01:06.461287 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2815/5745] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:06.560907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:06.561747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:06.573977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:06.574504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:06.575675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:06.579649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:06.580944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:06.582296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:06.583017 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-18f26449-053d-4a2b-99fe-5d77aeea30b4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 0.617611 Aug 30 04:01:06.587894 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2931/5746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:05 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:06.597442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:06.872113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:06.886992 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77038029-3952-4682-8e98-c1822eb5576e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1226 microversion: 2.1 time: 0.332684 Aug 30 04:01:06.888074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2816/5747] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:06 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1226 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:07.604976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.606360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:07.625054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:07.625600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:07.626038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:07.626746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:07.627206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:07.627632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:07.912985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.914255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:07.927799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:07.928312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:07.936514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:07.940497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:07.941046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:07.941533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:08.657630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:08.668831 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe4c5464-d04c-4b79-a042-26b63f700e02 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1300 microversion: 2.1 time: 0.760273 Aug 30 04:01:08.673928 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2817/5748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:07 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1300 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:08.756128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:08.773672 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc933df6-d381-415d-b1b1-592c16f17ab0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 1.172410 Aug 30 04:01:08.775971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2932/5749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:07 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:09.697131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:09.697798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:09.704833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:09.718242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:09.718723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:09.719497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:09.719980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:09.720423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:09.796860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:09.798118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:09.822249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:09.823398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:09.826218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:09.828557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:09.831310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:09.832148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:10.175812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:10.185756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-785e1592-8777-4719-9963-7412e71d8a65 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.493354 Aug 30 04:01:10.199561 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2818/5750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:09 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:10.225629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:10.238804 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce7a7076-5265-4549-887c-7d91e33249aa tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 0.445763 Aug 30 04:01:10.242263 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2933/5751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:09 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:10.554046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1235e4e1-2440-45d6-b80c-4e894091c3f1 req-5233fbe0-77e4-4a7d-bd98-30c569a26840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4", "tag": "bcb2fe4b-d232-4d78-a20a-3110ad1d6519"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:10.576344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1235e4e1-2440-45d6-b80c-4e894091c3f1 req-5233fbe0-77e4-4a7d-bd98-30c569a26840 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:10.576858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1235e4e1-2440-45d6-b80c-4e894091c3f1 req-5233fbe0-77e4-4a7d-bd98-30c569a26840 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:10.577376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1235e4e1-2440-45d6-b80c-4e894091c3f1 req-5233fbe0-77e4-4a7d-bd98-30c569a26840 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:10.631682 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1235e4e1-2440-45d6-b80c-4e894091c3f1 req-5233fbe0-77e4-4a7d-bd98-30c569a26840 service nova] Creating event network-changed:bcb2fe4b-d232-4d78-a20a-3110ad1d6519 for instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 on n-h2-854924-5 Aug 30 04:01:10.642095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1235e4e1-2440-45d6-b80c-4e894091c3f1 req-5233fbe0-77e4-4a7d-bd98-30c569a26840 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091463 Aug 30 04:01:10.643070 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2819/5752] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:10.950633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b6900977-1f6f-4627-8ad9-823672b10a2d req-bcd0c3b5-ae2a-4482-b41a-bab24d913ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1296241a-b649-4763-b5f9-3859be4c9a82", "tag": "c2a28910-ede8-413e-89ba-c32d82cf95e4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:10.985587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b6900977-1f6f-4627-8ad9-823672b10a2d req-bcd0c3b5-ae2a-4482-b41a-bab24d913ba1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:10.986087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b6900977-1f6f-4627-8ad9-823672b10a2d req-bcd0c3b5-ae2a-4482-b41a-bab24d913ba1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:10.986532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b6900977-1f6f-4627-8ad9-823672b10a2d req-bcd0c3b5-ae2a-4482-b41a-bab24d913ba1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:11.017656 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b6900977-1f6f-4627-8ad9-823672b10a2d req-bcd0c3b5-ae2a-4482-b41a-bab24d913ba1 service nova] Creating event network-changed:c2a28910-ede8-413e-89ba-c32d82cf95e4 for instance 1296241a-b649-4763-b5f9-3859be4c9a82 on n-h2-854924-5 Aug 30 04:01:11.031098 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b6900977-1f6f-4627-8ad9-823672b10a2d req-bcd0c3b5-ae2a-4482-b41a-bab24d913ba1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085650 Aug 30 04:01:11.034846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2934/5753] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:11.220374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:11.221137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:11.236676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:11.239223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:11.241059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:11.243607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:11.246572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:11.247276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:11.265147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:11.266223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:11.288823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:11.293223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:11.294611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:11.302525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:11.304473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:11.306239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:12.510515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:12.525059 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27192b42-057d-48c0-924e-f02ebc276484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 1.307497 Aug 30 04:01:12.527026 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2820/5754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:11 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:12.907747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:12.916340 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4051fcc7-2bb1-4e41-98cf-df9567a07859 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 1.659338 Aug 30 04:01:12.916933 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2935/5755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:11 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:13.938247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:13.939633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:13.966773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:13.967328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:13.969287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:13.973217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:13.974149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:13.974803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:14.128843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:14.130278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:14.141020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:14.146049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:14.146766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:14.147709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:14.151349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:14.152183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:14.755974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:14.776505 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d8ebda84-58fc-490d-98f0-db070241b5f1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 0.842752 Aug 30 04:01:14.778321 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2936/5756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:13 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:14.925040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:14.939076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4285c71-072e-4448-acff-b980bf39dc26 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 1.390486 Aug 30 04:01:14.940799 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2821/5757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:13 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:15.820591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:15.820591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:15.828343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:15.835407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=20 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:15.846635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:15.847538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:15.848363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:15.852230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:15.854357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:15.854357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:15.967545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:15.970175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:15.978072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:15.997887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:15.998802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:15.999669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:16.005388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:16.006253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:16.010342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:16.408620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:16.424558 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2bcb2995-56ed-4706-add3-12ea0ad79099 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.461686 Aug 30 04:01:16.424868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:16.426117 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2822/5758] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:15 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:16.433806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b5741f30-d9ae-4408-a2e9-3b820fe0304d req-e4d34c59-d17a-44a2-a161-5b809e85a02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5579e2c3-da3a-4aa1-85ab-ce76724c91ea", "name": "network-vif-plugged", "status": "completed", "tag": "b405fed1-bd5b-4351-8e00-1c3380fb1a2e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:16.439391 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a1272f8-b53c-4a23-ae12-aef63e6b29bb tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 0.632141 Aug 30 04:01:16.440005 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2937/5759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:15 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:16.469754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b5741f30-d9ae-4408-a2e9-3b820fe0304d req-e4d34c59-d17a-44a2-a161-5b809e85a02f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:16.470782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b5741f30-d9ae-4408-a2e9-3b820fe0304d req-e4d34c59-d17a-44a2-a161-5b809e85a02f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:16.471695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b5741f30-d9ae-4408-a2e9-3b820fe0304d req-e4d34c59-d17a-44a2-a161-5b809e85a02f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:16.493418 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b5741f30-d9ae-4408-a2e9-3b820fe0304d req-e4d34c59-d17a-44a2-a161-5b809e85a02f service nova] Creating event network-vif-plugged:b405fed1-bd5b-4351-8e00-1c3380fb1a2e for instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea on n-h1-854924-5 Aug 30 04:01:16.500703 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b5741f30-d9ae-4408-a2e9-3b820fe0304d req-e4d34c59-d17a-44a2-a161-5b809e85a02f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071428 Aug 30 04:01:16.502155 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2823/5760] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:17.451046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:17.452751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:17.460945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:17.462547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:17.463387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:17.464224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:17.466332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:17.466332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:17.474424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:17.484084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:17.509175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:17.519790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:17.520490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:17.521514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:17.522500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:17.523267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:17.806522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:17.817840 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-87cc3934-0599-444e-ac9a-272445af251f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.371660 Aug 30 04:01:17.818531 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2938/5761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:17 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:17.841201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:17.854856 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4ecc6e78-01d9-4371-b1c6-6adee1a28be9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1367 microversion: 2.1 time: 0.385114 Aug 30 04:01:17.868931 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2824/5762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:17 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:18.843783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:18.845741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:18.855291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:18.855985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:18.856674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:18.860087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:18.862171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:18.862652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:18.891680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:18.892546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:18.914342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:18.914978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:18.915560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:18.916484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:18.917101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:18.917885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:19.332407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:19.346245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-95006acf-ffb0-4cde-979c-64d4a639b9f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.505861 Aug 30 04:01:19.350672 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2939/5763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:18 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:19.392914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:19.403709 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46bf298c-b8e9-4b13-b9a0-553548a3daac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1558 microversion: 2.1 time: 0.530462 Aug 30 04:01:19.404956 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2825/5764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:18 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1558 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:19.454312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:19.454816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:19.484513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:19.485904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:19.488024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:19.489597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:19.491591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:19.492042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:19.746907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a3fdce9-23bb-455a-892b-ecdb15756650 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.322109 Aug 30 04:01:19.747543 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2940/5765] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:01:19 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:20.375964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:20.378198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:20.393979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:20.398137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:20.403115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:20.404227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:20.408838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:20.409705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:20.764458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:20.780719 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e787a6c7-5c09-4db3-a6d2-327acf6f8ffa tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.407305 Aug 30 04:01:20.795719 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2826/5766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:20 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:21.228103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-65b35713-d363-4985-ac0e-71c0df87a956 req-96df7ad6-735d-45b9-9da8-e1e88b13c1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5579e2c3-da3a-4aa1-85ab-ce76724c91ea", "tag": "b405fed1-bd5b-4351-8e00-1c3380fb1a2e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:21.246402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-65b35713-d363-4985-ac0e-71c0df87a956 req-96df7ad6-735d-45b9-9da8-e1e88b13c1e9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:21.247255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-65b35713-d363-4985-ac0e-71c0df87a956 req-96df7ad6-735d-45b9-9da8-e1e88b13c1e9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:21.248001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-65b35713-d363-4985-ac0e-71c0df87a956 req-96df7ad6-735d-45b9-9da8-e1e88b13c1e9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:21.271371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-65b35713-d363-4985-ac0e-71c0df87a956 req-96df7ad6-735d-45b9-9da8-e1e88b13c1e9 service nova] Creating event network-changed:b405fed1-bd5b-4351-8e00-1c3380fb1a2e for instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea on n-h1-854924-5 Aug 30 04:01:21.286499 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-65b35713-d363-4985-ac0e-71c0df87a956 req-96df7ad6-735d-45b9-9da8-e1e88b13c1e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064776 Aug 30 04:01:21.288403 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2941/5767] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:21.813041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:21.814426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:21.828085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:21.828952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:21.829885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:21.831421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:21.833434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:21.836794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:22.101579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:22.112526 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5ccfe20-c4e1-4110-a01b-c53f6d6240ff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.307193 Aug 30 04:01:22.121941 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2827/5768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:21 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:23.139161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:23.142296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:23.160311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:23.161102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:23.161864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:23.162581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:23.163181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:23.163639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:23.383961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:23.395592 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-60d12439-4a00-4697-b6f1-9a377dc5b527 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.264171 Aug 30 04:01:23.413430 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2942/5769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:23 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:24.421452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:24.422724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:24.453317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:24.454713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:24.462929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:24.463993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:24.464989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:24.465736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:24.741771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:24.751621 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c4f0bc0-9c72-4297-966e-5f6e9beafedd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.335199 Aug 30 04:01:24.753944 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2828/5770] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:24 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:25.778368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:25.778986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:25.789197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:25.789752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:25.790242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:25.791074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:25.791529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:25.792180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:26.025117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:26.035123 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68a466a6-8f4d-4921-a87b-6ccdaa91e6f3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.262247 Aug 30 04:01:26.046709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2943/5771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:25 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:27.059484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:27.060962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:27.073897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:27.076366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:27.078954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:27.081476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:27.082308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:27.083080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:27.083754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:27.084257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:27.101051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:27.102878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:27.104133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:27.114544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:27.115385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:27.118742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:27.251328 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-790c305d-de91-4428-bad0-8a817b83d58a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4/action" status: 200 len: 24575 microversion: 2.1 time: 0.175560 Aug 30 04:01:27.260294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2944/5772] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:01:27 2022] POST /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4/action => generated 24575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:01:27.507707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:27.510995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:27.521830 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-239fd2db-1866-48da-8fc6-d87bd309c72d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.467143 Aug 30 04:01:27.523042 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2829/5773] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:27 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:28.543890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:28.544826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:28.554665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:28.559571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:28.560243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:28.564065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:28.564718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:28.565323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:28.919630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:28.939321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8becf06b-65a8-4522-b4bf-f54f01becbbd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1342 microversion: 2.1 time: 0.399642 Aug 30 04:01:28.953787 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2945/5774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:28 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1342 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:29.961539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:29.963035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:29.975928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:29.979133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:29.981138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:29.982028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:29.984423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:29.985293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:30.484139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:30.496405 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f97da5c5-69b1-4e92-baf6-7962bbb656d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1388 microversion: 2.1 time: 0.539923 Aug 30 04:01:30.497533 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2830/5775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:29 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1388 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:31.518673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:31.520467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:31.532280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:31.533076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:31.533806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:31.535475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:31.535790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:31.536434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:31.739607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:31.749184 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca97d2e5-3fe9-4b05-b99b-0f717f249484 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.234565 Aug 30 04:01:31.750380 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2946/5776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:31 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:32.771828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:32.772535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:32.787973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:32.788572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:32.789025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:32.790536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:32.791190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:32.795092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:33.017861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:33.026971 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7cd5fb48-ff66-4dae-a581-9490bec69ceb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.259030 Aug 30 04:01:33.027713 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2831/5777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:32 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:34.051062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:34.052421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:34.065763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:34.083730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:34.084237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:34.086742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:34.105430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:34.106194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:34.106657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:34.113475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=90 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:34.268756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:34.277800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f883e89c-396d-42f1-ab7d-df9e5b42cf3b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.232275 Aug 30 04:01:34.279475 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2947/5778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:34 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:35.302219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:35.303572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:35.308703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=46 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:35.324410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:35.325382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:35.326899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:35.329111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:35.329874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:35.332295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:35.625788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:35.638306 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84d4911e-1310-4c45-9bd1-8c5a05476b27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.341095 Aug 30 04:01:35.639245 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2832/5779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:35 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:36.663369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:36.665816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:36.679367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:36.680928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:36.691053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:36.691053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:36.691053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:36.691053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:37.052399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:37.064174 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b78de5a-3e5b-471f-ab78-e8307777ee5c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.405709 Aug 30 04:01:37.065407 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2948/5780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:36 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:38.089130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:38.089808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:38.099056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:38.099609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:38.100234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:38.101102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:38.102896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:38.103477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:38.377914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:38.408241 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca44e1c1-d034-4c9f-a561-06166a81f0d7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.323744 Aug 30 04:01:38.411888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2833/5781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:38 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:39.436103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:39.437390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:39.449821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:39.450318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:39.450762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:39.451497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:39.451942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:39.452654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:39.837923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:39.857062 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bcdb7222-1d22-4b6d-abe2-144ba0138562 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.422605 Aug 30 04:01:39.860403 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2949/5782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:39 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:40.889519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:40.890163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:40.897566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:40.898426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:40.899740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:40.900701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:40.901455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:40.902141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:41.035945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5a02f30d-8962-4c00-b4d0-689858a9b689 req-96fb5bbf-b661-4443-8747-62ff3bf7f533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1296241a-b649-4763-b5f9-3859be4c9a82", "name": "network-vif-plugged", "status": "completed", "tag": "c2a28910-ede8-413e-89ba-c32d82cf95e4"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:41.050752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a02f30d-8962-4c00-b4d0-689858a9b689 req-96fb5bbf-b661-4443-8747-62ff3bf7f533 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:41.051479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a02f30d-8962-4c00-b4d0-689858a9b689 req-96fb5bbf-b661-4443-8747-62ff3bf7f533 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:41.052714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5a02f30d-8962-4c00-b4d0-689858a9b689 req-96fb5bbf-b661-4443-8747-62ff3bf7f533 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:41.071114 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5a02f30d-8962-4c00-b4d0-689858a9b689 req-96fb5bbf-b661-4443-8747-62ff3bf7f533 service nova] Creating event network-vif-plugged:c2a28910-ede8-413e-89ba-c32d82cf95e4 for instance 1296241a-b649-4763-b5f9-3859be4c9a82 on n-h2-854924-5 Aug 30 04:01:41.087418 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5a02f30d-8962-4c00-b4d0-689858a9b689 req-96fb5bbf-b661-4443-8747-62ff3bf7f533 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063771 Aug 30 04:01:41.088691 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2950/5783] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:41.118768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:41.128435 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2fc5a4be-ec2f-40ab-a9ba-640d0cf1bf74 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.242716 Aug 30 04:01:41.129524 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2834/5784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:40 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:42.154664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:42.155596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:42.167205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:42.167706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:42.168154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:42.172812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:42.174579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:42.175840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:42.450728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:42.462283 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9fb7a7ad-c781-4a16-ae0f-dbb3b2f75986 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1376 microversion: 2.1 time: 0.313604 Aug 30 04:01:42.463351 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2951/5785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:42 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1376 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:43.484211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:43.486904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:43.496384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:43.496900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:43.497606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:43.499016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:43.499510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:43.500126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:43.721944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7d0a6cb4-e2b8-4d97-bd02-3c76d3596e2f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'create', calling method: .version_select at 0x7f897a4b4e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-866622930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHFne2Nktnb7Zy/Al4zUzDkgIY+pqQ94Y9wR5BNZY8h2vxd1VlMA3cjiVqj2EBBA0Ek3YPxB/sfPdKB0UECs2ljMEZbl14sLk3Lpo4WTQJV8Es17IMjGMM2fz0Q4NZETw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:43.745126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7d0a6cb4-e2b8-4d97-bd02-3c76d3596e2f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for project d212588e912641c6bdf0f50e15ca2519. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:01:43.753935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7d0a6cb4-e2b8-4d97-bd02-3c76d3596e2f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for user b2f8a2b059de406aa1d02936b4e0dbe3 and project d212588e912641c6bdf0f50e15ca2519. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:01:43.784565 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7d0a6cb4-e2b8-4d97-bd02-3c76d3596e2f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.067936 Aug 30 04:01:43.791432 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2952/5786] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:01:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:43.792910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:43.802091 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78093095-a56a-4e06-8f4e-dd8141ec0588 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1563 microversion: 2.1 time: 0.321818 Aug 30 04:01:43.803000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2835/5787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:43 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1563 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:43.822740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:43.824089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:43.832526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:43.834009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:43.834522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:43.835542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:43.837460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:43.838129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:44.206999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:44.222135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f462f7fd-c199-4b93-9eba-fc476cca70a0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1563 microversion: 2.1 time: 0.400174 Aug 30 04:01:44.223820 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2953/5788] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:43 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1563 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:44.329711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:44.330432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:44.347281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:44.351281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:44.352387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:44.353159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:44.353693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:44.356083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:44.415677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:01:44.640553 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57cb66c0-d0df-4bdc-ba8e-a0a46a482cef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 204 len: 0 microversion: 2.1 time: 0.318255 Aug 30 04:01:44.642943 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2836/5789] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:01:44 2022] DELETE /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:01:44.653401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:44.654310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:44.663055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:44.663762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:44.664578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:44.665652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:44.667310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:44.667858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:45.000253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:45.009122 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30d81265-e17d-43bb-905d-e4011e9c62ba tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1569 microversion: 2.1 time: 0.362084 Aug 30 04:01:45.013482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2954/5790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:44 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1569 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:45.623081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1042537059", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "c91ab1ac-a339-4611-a7e6-cf9da00ed280"}], "key_name": "tempest-TestNetworkBasicOps-866622930", "security_groups": [{"name": "tempest-secgroup-smoke-1435134365"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:45.825429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] validate_networks() for [('c91ab1ac-a339-4611-a7e6-cf9da00ed280', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:01:46.035671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:46.036455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:46.056859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:46.057511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:46.058299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:46.059410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:46.059984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:46.060568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:46.651573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:46.666689 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ace43ff-6bc3-457a-87e3-89fe820484fc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1569 microversion: 2.1 time: 0.635275 Aug 30 04:01:46.667280 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2955/5791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:46 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1569 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:47.149661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:01:47.150159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:01:47.150309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:01:47.150938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:01:47.152116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:01:47.177928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:47.183504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:47.183974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:47.188300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:47.188833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:47.189286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:47.250031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for project d212588e912641c6bdf0f50e15ca2519. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:01:47.264039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for user b2f8a2b059de406aa1d02936b4e0dbe3 and project d212588e912641c6bdf0f50e15ca2519. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:01:47.299994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:01:47.302951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:01:47.392833 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1424152a-74ec-4ffe-9ee4-8fb0f3aa8999 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.775181 Aug 30 04:01:47.397793 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2837/5792] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:01:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:01:47.405664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1bb39cbe-610a-414e-9d65-5e5cae2010ce tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:47.406832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1bb39cbe-610a-414e-9d65-5e5cae2010ce tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:47.635387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1bb39cbe-610a-414e-9d65-5e5cae2010ce tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:47.644497 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1bb39cbe-610a-414e-9d65-5e5cae2010ce tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1248 microversion: 2.1 time: 0.242942 Aug 30 04:01:47.646063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ea152676-8958-4a8a-8229-4d8aba44c28c req-459bd30d-cd97-448e-9896-7177d2c090c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1296241a-b649-4763-b5f9-3859be4c9a82", "name": "network-vif-deleted", "tag": "c2a28910-ede8-413e-89ba-c32d82cf95e4"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:47.647852 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2956/5793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:47 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1248 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:47.671207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ea152676-8958-4a8a-8229-4d8aba44c28c req-459bd30d-cd97-448e-9896-7177d2c090c2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:47.671885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ea152676-8958-4a8a-8229-4d8aba44c28c req-459bd30d-cd97-448e-9896-7177d2c090c2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:47.673366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ea152676-8958-4a8a-8229-4d8aba44c28c req-459bd30d-cd97-448e-9896-7177d2c090c2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:47.698638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:47.699291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:47.699564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ea152676-8958-4a8a-8229-4d8aba44c28c req-459bd30d-cd97-448e-9896-7177d2c090c2 service nova] Creating event network-vif-deleted:c2a28910-ede8-413e-89ba-c32d82cf95e4 for instance 1296241a-b649-4763-b5f9-3859be4c9a82 on n-h2-854924-5 Aug 30 04:01:47.705076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ea152676-8958-4a8a-8229-4d8aba44c28c req-459bd30d-cd97-448e-9896-7177d2c090c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070708 Aug 30 04:01:47.706148 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2838/5794] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:47.718603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:47.720932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:47.723952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:47.725206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:47.726027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:47.727318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:47.825635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:47.839342 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2dc1056c-f3be-4216-9f87-b86bab93e0f0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1361 microversion: 2.1 time: 0.156107 Aug 30 04:01:47.840745 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2957/5795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:47 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:48.676484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:48.677219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:48.688595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:48.689228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:48.691519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:48.693495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:48.696431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:48.697151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:48.855587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:48.863916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:48.866861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:48.886699 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a39be0b-f5bc-476e-abfc-ded57c9e5dbc tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1300 microversion: 2.1 time: 0.211729 Aug 30 04:01:48.888648 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2839/5796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:48 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:48.890232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:48.891017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:48.893886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:48.895102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:48.896789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:48.897368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:49.039261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:49.052130 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-26e31646-0835-4a15-9a59-5200ed6351af tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1361 microversion: 2.1 time: 0.194286 Aug 30 04:01:49.067129 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2958/5797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:48 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:49.911015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:49.912646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:49.924652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:49.932877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:49.934079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:49.934874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:49.935378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:49.935828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:50.036604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:50.052118 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f823114c-f51b-4752-a4ba-4186d60013a5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1306 microversion: 2.1 time: 0.142784 Aug 30 04:01:50.053741 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2840/5798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:49 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1306 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:50.078303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:50.079536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:50.092375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:50.095066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:50.095695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:50.096570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:50.100252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:50.100747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:50.669440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:50.681148 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-79c7e487-502e-4f94-904d-b9283daf348e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1361 microversion: 2.1 time: 0.608684 Aug 30 04:01:50.698382 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2959/5799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:50 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1361 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:51.082313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:51.083050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:51.096581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:51.107350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:51.108391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:51.110732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:51.111469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:51.113175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:51.468893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:51.485620 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-752c0e2b-f92c-4d39-af19-f3632b7b687a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.407050 Aug 30 04:01:51.493601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2841/5800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:51 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:51.712955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:51.714599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:51.723493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:51.724496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:51.725300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:51.726976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:51.727743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:51.728417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:51.821804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:51.838901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0bb7085d-0950-457c-bc92-98e4cee6b9ef tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1361 microversion: 2.1 time: 0.130300 Aug 30 04:01:51.851069 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2960/5801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:51 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1361 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:52.274103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a819e98e-1080-43c2-b30f-64a7311f81d6 req-a7c7f916-3b3f-4962-98a7-d16270dfcd38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97c6ad8-07d0-4f06-ac83-86536d69c775", "tag": "f9c9ba19-2e00-40a9-b309-ff67fbfe32c8"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:01:52.300696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a819e98e-1080-43c2-b30f-64a7311f81d6 req-a7c7f916-3b3f-4962-98a7-d16270dfcd38 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:52.301608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a819e98e-1080-43c2-b30f-64a7311f81d6 req-a7c7f916-3b3f-4962-98a7-d16270dfcd38 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:52.302531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a819e98e-1080-43c2-b30f-64a7311f81d6 req-a7c7f916-3b3f-4962-98a7-d16270dfcd38 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:52.326594 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a819e98e-1080-43c2-b30f-64a7311f81d6 req-a7c7f916-3b3f-4962-98a7-d16270dfcd38 service nova] Creating event network-changed:f9c9ba19-2e00-40a9-b309-ff67fbfe32c8 for instance b97c6ad8-07d0-4f06-ac83-86536d69c775 on n-h1-854924-5 Aug 30 04:01:52.346719 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a819e98e-1080-43c2-b30f-64a7311f81d6 req-a7c7f916-3b3f-4962-98a7-d16270dfcd38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076690 Aug 30 04:01:52.347795 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2842/5802] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:52.509098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:52.510331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:52.527480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:52.530494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:52.531085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:52.532196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:52.533857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:52.536821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:52.863807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:52.864595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:52.878303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:52.878994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:52.883674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:52.887207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:52.888280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:52.889147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:53.150452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:53.162874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a9c4e680-6290-40d5-8288-e64ab8bc3db7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1361 microversion: 2.1 time: 0.303021 Aug 30 04:01:53.163670 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2843/5803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:52 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:53.333170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:53.349505 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2bd1e95d-76af-4265-9077-7b431a1860ac tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.845175 Aug 30 04:01:53.350823 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2961/5804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:52 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:54.186999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:54.187817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:54.195002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:54.202917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:54.205126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:54.206840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:54.209703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:54.211080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:54.328219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:54.339286 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1bcef752-fa7a-4e1b-b923-b90ebdb513ec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 200 len: 1361 microversion: 2.1 time: 0.154802 Aug 30 04:01:54.340591 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2844/5805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:54 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:54.375259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:54.376735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:54.385856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:54.387528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:54.389790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:54.393216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:54.394137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:54.395453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:54.634406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:54.647370 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-664e3e2a-f8a0-4017-94b8-eba4f2c7401e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.275970 Aug 30 04:01:54.648355 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2962/5806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:54 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:55.371134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:55.372454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:55.389396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:55.390289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:55.390992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:55.392714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:55.393687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:55.396026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:55.448300 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 HTTP/1.1 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '1296241a-b649-4763-b5f9-3859be4c9a82'} Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:01:55.452295 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:01:55.456340 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:01:55.460122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:01:55.462550 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-50fae669-66bf-456e-9288-f736a445df09 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 404 len: 111 microversion: 2.1 time: 0.106725 Aug 30 04:01:55.465715 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2845/5807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:55 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:01:55.668829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:55.670102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:55.677589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:55.678462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:55.679002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:55.680600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:55.681547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:55.682538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:55.908060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:55.918988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0495d171-ede5-4576-b70b-65d2de3c105d tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.254709 Aug 30 04:01:55.933434 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2963/5808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:55 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:56.944380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:56.945325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:56.959113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:56.959614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:56.960067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:56.960824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:56.961293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:56.966599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:57.209593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:57.265748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:57.279489 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee977a7f-2422-4b49-9df5-24a3f971a99e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.339160 Aug 30 04:01:57.280089 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2846/5809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:56 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:58.306097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:58.307455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:58.316599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:58.321334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:58.322278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:58.323163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:58.324750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:58.325873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:58.326638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:58.556735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:58.566661 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-294332af-1ac5-4932-b558-b3194001dda9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.266743 Aug 30 04:01:58.568149 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2964/5810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:58 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:59.591502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:59.593066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:01:59.595003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:59.620157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:59.622400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:59.624258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:59.624258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:01:59.628272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:01:59.628933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:01:59.680194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:59.914367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:01:59.928048 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21fc4005-a5d8-401c-b347-a8fc477f32d2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.340341 Aug 30 04:01:59.929184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2847/5811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:01:59 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:00.562005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-53797ef2-5080-4eba-bef2-23aac9ac5014 req-ba3ece19-6409-4329-9a7e-1cf907f8c5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97c6ad8-07d0-4f06-ac83-86536d69c775", "name": "network-vif-plugged", "status": "completed", "tag": "f9c9ba19-2e00-40a9-b309-ff67fbfe32c8"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:00.574254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-53797ef2-5080-4eba-bef2-23aac9ac5014 req-ba3ece19-6409-4329-9a7e-1cf907f8c5b2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:00.574910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-53797ef2-5080-4eba-bef2-23aac9ac5014 req-ba3ece19-6409-4329-9a7e-1cf907f8c5b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:00.575639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-53797ef2-5080-4eba-bef2-23aac9ac5014 req-ba3ece19-6409-4329-9a7e-1cf907f8c5b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:00.604539 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-53797ef2-5080-4eba-bef2-23aac9ac5014 req-ba3ece19-6409-4329-9a7e-1cf907f8c5b2 service nova] Creating event network-vif-plugged:f9c9ba19-2e00-40a9-b309-ff67fbfe32c8 for instance b97c6ad8-07d0-4f06-ac83-86536d69c775 on n-h1-854924-5 Aug 30 04:02:00.610402 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-53797ef2-5080-4eba-bef2-23aac9ac5014 req-ba3ece19-6409-4329-9a7e-1cf907f8c5b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052136 Aug 30 04:02:00.611592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2965/5812] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:00.949077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:00.949750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:00.957421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:00.957933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:00.958383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:00.959278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:00.959912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:00.960359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:01.006704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:01.007307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:01.024112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:01.024615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:01.025055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:01.025786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:01.026245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:01.026668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:01.071221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:02:01.105050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:01.167718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:01.177920 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4531f350-c155-40b2-a6fe-63167b444e2a tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.231568 Aug 30 04:02:01.179401 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2848/5813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:00 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:01.193154 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65ec487f-98df-4b51-95fc-930307266334 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 204 len: 0 microversion: 2.1 time: 0.190342 Aug 30 04:02:01.193869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2966/5814] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:02:01 2022] DELETE /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:01.205767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:01.206668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:01.215351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:01.215992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:01.216456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:01.217183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:01.217707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:01.218173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:01.366687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:01.375545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-200a0d55-1900-42da-9230-b13b776f3cc2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1408 microversion: 2.1 time: 0.175612 Aug 30 04:02:01.376198 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2849/5815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:01 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:02.200861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:02.201513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:02.208820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:02.209898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:02.210418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:02.211145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:02.211599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:02.212146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:02.358661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:02.368039 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8100a3de-a7ce-4aff-81e4-8c58d841f9fa tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.171799 Aug 30 04:02:02.368608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2967/5816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:02 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:02.398607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:02.399366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:02.407509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:02.408148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:02.408717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:02.409578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:02.410386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:02.410928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:02.563025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:02.574483 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd0d6903-e584-4784-91d4-d3458fdf6405 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1408 microversion: 2.1 time: 0.180722 Aug 30 04:02:02.575074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2850/5817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:02 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:03.388790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:03.389423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:03.396727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:03.397512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:03.397951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:03.399247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:03.399697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:03.400149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:03.556830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:03.565469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8fd7f5dc-c220-4e91-823f-6173ee7b65de tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1374 microversion: 2.1 time: 0.180617 Aug 30 04:02:03.566826 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2968/5818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:03 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:03.597433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:03.598154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:03.606675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:03.607195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:03.607837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:03.608356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:03.608827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:03.609271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:03.798902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:03.808771 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-53528f1a-7755-455f-ac2c-76bf7aaa5e2c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1408 microversion: 2.1 time: 0.215966 Aug 30 04:02:03.809671 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2851/5819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:03 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:04.443703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-adc7ef61-4695-4129-a813-f6ba05566ccd req-af58ef8c-422b-4d4f-b245-c509198d2bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99140bd4-688a-4369-8532-d1500d682694", "name": "network-vif-deleted", "tag": "b8dec595-0a51-42da-a05b-745901a21999"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:04.450630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:04.456992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-adc7ef61-4695-4129-a813-f6ba05566ccd req-af58ef8c-422b-4d4f-b245-c509198d2bb6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.457478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-adc7ef61-4695-4129-a813-f6ba05566ccd req-af58ef8c-422b-4d4f-b245-c509198d2bb6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.458152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-adc7ef61-4695-4129-a813-f6ba05566ccd req-af58ef8c-422b-4d4f-b245-c509198d2bb6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:04.472978 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-adc7ef61-4695-4129-a813-f6ba05566ccd req-af58ef8c-422b-4d4f-b245-c509198d2bb6 service nova] Creating event network-vif-deleted:b8dec595-0a51-42da-a05b-745901a21999 for instance 99140bd4-688a-4369-8532-d1500d682694 on n-h1-854924-5 Aug 30 04:02:04.478549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-adc7ef61-4695-4129-a813-f6ba05566ccd req-af58ef8c-422b-4d4f-b245-c509198d2bb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 Aug 30 04:02:04.479616 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2969/5820] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:04.588738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:04.589692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:04.608809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.609426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.609806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:04.610536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.611013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.611485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:04.833497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:04.844095 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8aff623f-9a9d-45fd-9866-a7c8f0200813 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1546 microversion: 2.1 time: 0.259965 Aug 30 04:02:04.845220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:04.847213 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2852/5821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:04 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:04.849528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:04.867787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.868903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.870620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:04.871751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.872685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.873487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:04.877657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:04.878305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:04.895144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.895687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.896146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:04.896884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:04.897722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:04.898871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:05.056331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:05.069107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3caf6f67-19cd-4ca4-9250-b4e14a018941 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1200 microversion: 2.1 time: 0.239704 Aug 30 04:02:05.093443 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2970/5822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:04 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1200 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:05.202676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:05.212223 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf73a1a4-5031-49f8-943c-47115654e284 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1546 microversion: 2.1 time: 0.338176 Aug 30 04:02:05.213924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2853/5823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:04 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1546 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:06.103813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:06.104782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:06.111115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:06.111716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:06.112220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:06.113428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:06.114101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:06.114719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:06.193814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:06.207370 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74ea04c6-ab4c-4982-983f-296d0679b9e4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1200 microversion: 2.1 time: 0.116945 Aug 30 04:02:06.208851 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2971/5824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:06 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:07.231297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:07.232579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:07.235632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:07.248294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:07.249138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:07.249623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:07.250351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:07.250826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:07.251263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:07.361393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:07.371304 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e529299-8f02-4ad4-8b9b-bb18e06c8b16 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1200 microversion: 2.1 time: 0.144358 Aug 30 04:02:07.372597 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2854/5825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:07 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1200 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:08.392265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:08.392976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:08.409604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:08.410510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:08.411032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:08.411851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:08.412573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:08.413505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:08.526544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:08.539420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e7fafe6b-cd7d-4cfe-a15a-531043025455 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1200 microversion: 2.1 time: 0.150472 Aug 30 04:02:08.540136 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2972/5826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:08 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1200 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:09.563558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:09.564788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:09.576634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:09.577614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:09.578329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:09.579267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:09.579955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:09.580613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:09.654223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:09.663197 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e129563-f3e8-424a-bb49-6a8b0679bba5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 200 len: 1200 microversion: 2.1 time: 0.106180 Aug 30 04:02:09.664750 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2855/5827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:09 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 1200 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:10.692605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:10.693229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:10.707866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:10.712034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:10.712492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:10.713227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:10.714808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:10.715247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:10.738935 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 HTTP/1.1 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '99140bd4-688a-4369-8532-d1500d682694'} Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:10.741387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:10.746728 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-038c775c-8b1e-4bf7-9f69-6892ce13a264 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 404 len: 111 microversion: 2.1 time: 0.054336 Aug 30 04:02:10.749624 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2973/5828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:10 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:14.135885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:14.136378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:14.150223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.151050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.151776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.152706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.153358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.153959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.175652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 HTTP/1.1 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '1296241a-b649-4763-b5f9-3859be4c9a82'} Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:14.177566 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.182637 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.184245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:14.186260 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4802c6f-67ad-4b25-80d0-9bcbffb39233 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 404 len: 111 microversion: 2.1 time: 0.061549 Aug 30 04:02:14.186925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2856/5829] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:02:14 2022] DELETE /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:14.204062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:14.208922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 1296241a-b649-4763-b5f9-3859be4c9a82] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:14.226483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.227356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.228305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.229253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.229930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.230674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.260082 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 HTTP/1.1 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '1296241a-b649-4763-b5f9-3859be4c9a82'} Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:14.262217 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. Aug 30 04:02:14.267167 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.269299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 1296241a-b649-4763-b5f9-3859be4c9a82 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:14.270524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3631bda7-9aff-4555-9a55-5654ccce550f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82" status: 404 len: 111 microversion: 2.1 time: 0.078727 Aug 30 04:02:14.272071 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2974/5830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:14 2022] GET /compute/v2.1/servers/1296241a-b649-4763-b5f9-3859be4c9a82 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:14.937708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:14.938433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:14.944614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.945705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.946351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.947220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.947684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.948119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.963029 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 HTTP/1.1 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '99140bd4-688a-4369-8532-d1500d682694'} Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:14.965373 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-87566c88-03c8-427b-8c1d-284cc6d880df tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 404 len: 111 microversion: 2.1 time: 0.032959 Aug 30 04:02:14.969778 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2857/5831] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:02:14 2022] DELETE /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:14.975776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:14.976439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 99140bd4-688a-4369-8532-d1500d682694] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:14.984643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.985139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.985613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:14.986314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:14.986766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:14.987189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:15.002837 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 HTTP/1.1 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '99140bd4-688a-4369-8532-d1500d682694'} Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:15.004858 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 99140bd4-688a-4369-8532-d1500d682694 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-19edcc46-272b-4d37-a98a-c51b8a5c6c0b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694" status: 404 len: 111 microversion: 2.1 time: 0.034625 Aug 30 04:02:15.010384 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2975/5832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:14 2022] GET /compute/v2.1/servers/99140bd4-688a-4369-8532-d1500d682694 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:15.089360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8210b15-6041-4d90-91ba-36e34696444f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: .version_select at 0x7f897b861c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-454808694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBj0SqlMTmTj5n7teh6Urj2GO1OMt7KN8NbZ5cHcsZ2n3FR5GwfBhl49qipz/wS3gEDHbRiQlbUOGonO9Oq+IJRZcbMC5Xybd40qNToPA07B3mWM5BuyeF8WkfCX4KW+rA=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:15.108614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a8210b15-6041-4d90-91ba-36e34696444f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:02:15.114129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-a8210b15-6041-4d90-91ba-36e34696444f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:02:15.138490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8210b15-6041-4d90-91ba-36e34696444f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053530 Aug 30 04:02:15.139387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2858/5833] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:02:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:24.498258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-60254303", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "c1471fe9-c1be-43f9-be09-022fb33acf89"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:24.561646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] validate_networks() for [('c1471fe9-c1be-43f9-be09-022fb33acf89', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:02:24.965991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:02:24.966431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:02:24.966909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:02:24.967653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:02:24.968240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:02:24.978509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:24.979235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:24.979862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:24.980942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:24.981746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:24.982330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:25.001447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Getting quotas for project 169b75b5d07c4076b34a37ebb445f7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:02:25.007776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Getting quotas for user a1bdb63f9f064976b5a30136841557eb and project 169b75b5d07c4076b34a37ebb445f7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:02:25.021617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:02:25.024223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:02:25.092146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0bb93e09-1da9-4de1-8bae-caa7ea352132 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598431 Aug 30 04:02:25.093425 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2976/5834] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:02:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:02:25.102660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=55 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:25.109258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15a81780-f725-4abd-91dd-14ef89ef66bc tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:25.110455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-15a81780-f725-4abd-91dd-14ef89ef66bc tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:25.122874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:25.211926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-15a81780-f725-4abd-91dd-14ef89ef66bc tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:25.222402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-15a81780-f725-4abd-91dd-14ef89ef66bc tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1212 microversion: 2.1 time: 0.122198 Aug 30 04:02:25.223917 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2859/5835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:25 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1212 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:26.245146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:26.246454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:26.255319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:26.255756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:26.256200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:26.256974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:26.258024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:26.258462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:26.332405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:26.342532 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5c074ad7-9354-45ea-8f80-28f61462d653 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1264 microversion: 2.1 time: 0.103040 Aug 30 04:02:26.343117 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2977/5836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:26 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1264 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:27.365511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:27.367735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:27.377683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:27.378544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:27.379227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:27.380715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:27.381454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:27.382478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:27.665318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:27.674508 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-289acf8c-8098-4ae6-86b1-88386d3f0e0d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1312 microversion: 2.1 time: 0.313571 Aug 30 04:02:27.689415 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2860/5837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:27 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:28.192752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-960b9210-65df-4895-a703-d353c2ed0ff9 req-c5d54c99-fa27-4465-8b28-eab51dcb49bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66", "tag": "4e28c0a2-a7e3-41c2-8e0a-1d2fae9312dc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:28.215252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-960b9210-65df-4895-a703-d353c2ed0ff9 req-c5d54c99-fa27-4465-8b28-eab51dcb49bc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:28.215742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-960b9210-65df-4895-a703-d353c2ed0ff9 req-c5d54c99-fa27-4465-8b28-eab51dcb49bc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:28.216222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-960b9210-65df-4895-a703-d353c2ed0ff9 req-c5d54c99-fa27-4465-8b28-eab51dcb49bc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:28.234247 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-960b9210-65df-4895-a703-d353c2ed0ff9 req-c5d54c99-fa27-4465-8b28-eab51dcb49bc service nova] Creating event network-changed:4e28c0a2-a7e3-41c2-8e0a-1d2fae9312dc for instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 on n-h2-854924-5 Aug 30 04:02:28.240051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-960b9210-65df-4895-a703-d353c2ed0ff9 req-c5d54c99-fa27-4465-8b28-eab51dcb49bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052504 Aug 30 04:02:28.241224 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2978/5838] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:28.697372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:28.699038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:28.707749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:28.708972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:28.710090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:28.711400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:28.712098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:28.713107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:28.881637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:28.890556 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aeb8c560-eb29-44d4-a7b2-3c53d0052195 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1312 microversion: 2.1 time: 0.197816 Aug 30 04:02:28.891241 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2861/5839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:28 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:29.912717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:29.914148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:29.922199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:29.923012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:29.923626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:29.924505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:29.925147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:29.925763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:30.149868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:30.159008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d13accc2-7252-4ec7-a214-81bc4b67c103 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1312 microversion: 2.1 time: 0.250527 Aug 30 04:02:30.159720 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2979/5840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:29 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:31.183673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:31.184310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:31.191652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:31.192564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:31.193194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:31.194121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:31.195149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:31.195594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:31.349905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:31.359785 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b113ca52-482f-4e8c-a888-7da6b842c334 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1312 microversion: 2.1 time: 0.180425 Aug 30 04:02:31.360854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2862/5841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:31 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:32.382047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:32.383269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:32.390577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:32.391105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:32.391549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:32.392299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:32.392930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:32.393564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:32.397975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:32.589407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:32.599545 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-03e8130f-5b33-4942-b671-c44236fc0e76 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1312 microversion: 2.1 time: 0.221636 Aug 30 04:02:32.612398 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2980/5842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:32 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:33.048786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e48e6de0-10b8-45a7-a95c-c63833a49d31 req-22a0309f-3a38-43f5-ae84-5c2706546c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66", "name": "network-vif-plugged", "status": "completed", "tag": "4e28c0a2-a7e3-41c2-8e0a-1d2fae9312dc"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:33.059895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e48e6de0-10b8-45a7-a95c-c63833a49d31 req-22a0309f-3a38-43f5-ae84-5c2706546c2c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:33.060493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e48e6de0-10b8-45a7-a95c-c63833a49d31 req-22a0309f-3a38-43f5-ae84-5c2706546c2c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:33.061141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e48e6de0-10b8-45a7-a95c-c63833a49d31 req-22a0309f-3a38-43f5-ae84-5c2706546c2c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:33.075860 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e48e6de0-10b8-45a7-a95c-c63833a49d31 req-22a0309f-3a38-43f5-ae84-5c2706546c2c service nova] Creating event network-vif-plugged:4e28c0a2-a7e3-41c2-8e0a-1d2fae9312dc for instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 on n-h2-854924-5 Aug 30 04:02:33.081064 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e48e6de0-10b8-45a7-a95c-c63833a49d31 req-22a0309f-3a38-43f5-ae84-5c2706546c2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036274 Aug 30 04:02:33.081991 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2863/5843] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:33.621902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:33.623782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:33.631783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:33.632951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:33.635045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:33.635045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:33.635045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:33.644322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:33.881814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:33.890097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0b3a7f4a-7d4f-4c00-a3ee-52a3a0ea56dd tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1312 microversion: 2.1 time: 0.272290 Aug 30 04:02:33.890898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2981/5844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:33 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:34.913398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:34.914151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:34.925704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:34.926871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:34.927381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:34.928401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:34.929660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:34.930392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:35.222598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:35.271481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:35.281391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c98fc561-ce5d-470f-9f6b-53997d59830a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1497 microversion: 2.1 time: 0.372575 Aug 30 04:02:35.293916 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2864/5845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:34 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1497 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:35.823823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:35.825748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:35.838715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:35.839851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:35.841222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:35.854439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:35.855128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:35.855734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:35.856453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:35.856940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:35.857549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:35.890745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:02:36.001660 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d63a3d6-9202-4726-b721-3e868495d403 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 204 len: 0 microversion: 2.1 time: 0.183272 Aug 30 04:02:36.002503 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2982/5846] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:02:35 2022] DELETE /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:36.011384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:36.012793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:36.025060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:36.026089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:36.026089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:36.026745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:36.027209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:36.027648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:36.270830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:36.292655 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c469451-b004-4de6-a767-ebbf30b21d00 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1503 microversion: 2.1 time: 0.282841 Aug 30 04:02:36.293546 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2865/5847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:36 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:37.019037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:37.019640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:37.026789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:37.027557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:37.028179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:37.029096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:37.029784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:37.030394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:37.058446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d8786ae7-4298-4a6b-9510-a2fac212564b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/ips" status: 200 len: 151 microversion: 2.1 time: 0.043879 Aug 30 04:02:37.059484 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2983/5848] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 04:02:37 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:02:37.126504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-644722979", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-454808694", "security_groups": [{"name": "tempest-secgroup-smoke-946206122"}], "block_device_mapping_v2": [{"uuid": "3d05353d-a03e-4d37-adc0-5261e76ad110", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:37.315526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:37.316344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:37.324101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:37.328834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:37.330309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:37.333562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:37.334319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:37.335521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:37.370638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:02:38.031609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:38.040615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0ade241-df85-4f58-9fd7-c05fa4512b64 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1503 microversion: 2.1 time: 0.730026 Aug 30 04:02:38.055599 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2984/5849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:37 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1503 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:38.206281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:38.525860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-576bb30d-1c80-4494-af9b-369a0d86b50d req-22aafbb4-bc75-42cd-bc7e-d746396d45a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66", "name": "network-vif-deleted", "tag": "4e28c0a2-a7e3-41c2-8e0a-1d2fae9312dc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:38.553242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-576bb30d-1c80-4494-af9b-369a0d86b50d req-22aafbb4-bc75-42cd-bc7e-d746396d45a0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:38.554357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-576bb30d-1c80-4494-af9b-369a0d86b50d req-22aafbb4-bc75-42cd-bc7e-d746396d45a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:38.554961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-576bb30d-1c80-4494-af9b-369a0d86b50d req-22aafbb4-bc75-42cd-bc7e-d746396d45a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:38.584895 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-576bb30d-1c80-4494-af9b-369a0d86b50d req-22aafbb4-bc75-42cd-bc7e-d746396d45a0 service nova] Creating event network-vif-deleted:4e28c0a2-a7e3-41c2-8e0a-1d2fae9312dc for instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 on n-h2-854924-5 Aug 30 04:02:38.603697 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-576bb30d-1c80-4494-af9b-369a0d86b50d req-22aafbb4-bc75-42cd-bc7e-d746396d45a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095765 Aug 30 04:02:38.605304 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2985/5850] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:38.724279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:02:38.724828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:02:38.725209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:02:38.729242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:02:38.729901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:02:38.741704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:38.742151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:38.742605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:38.743363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:38.748153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:38.748836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:38.796678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:02:38.811055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:02:38.907993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:02:38.910336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d05353d-a03e-4d37-adc0-5261e76ad110',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:02:39.067265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:39.068282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:39.094362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:39.095378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:39.096204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:39.097164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:39.097975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:39.098562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:39.155223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:39.156245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:39.160049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:39.160745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lazy-loading 'fault' on Instance uuid ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:02:39.171932 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e73b5744-a66e-490a-b39a-15a3e7718c9f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.049094 Aug 30 04:02:39.179115 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2866/5851] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:02:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:02:39.197607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70bb1409-7888-4b8b-a722-af8cb8cc60b5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:39.200673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70bb1409-7888-4b8b-a722-af8cb8cc60b5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:39.385084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:39.403783 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0aa08bd-d27a-4e1d-985b-596e3ac31545 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 200 len: 1302 microversion: 2.1 time: 0.341620 Aug 30 04:02:39.405756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-70bb1409-7888-4b8b-a722-af8cb8cc60b5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:39.407456 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2986/5852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:39 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 1302 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:39.432253 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70bb1409-7888-4b8b-a722-af8cb8cc60b5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1093 microversion: 2.1 time: 0.251421 Aug 30 04:02:39.436550 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2867/5853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:39 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1093 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:39.686097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e650005a-d139-46bf-b56a-7548a967298c"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:39.690192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:39.701961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:39.702715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:39.703367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:39.704353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:39.704971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:39.705688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:40.106716 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-399edfc3-6aac-434d-98f9-5ec83a00abf6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423604 Aug 30 04:02:40.107585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2987/5854] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:02:39 2022] POST /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:02:40.427390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:40.428181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:40.435863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:40.436754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:40.437754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:40.438793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:40.439707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:40.440380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:40.461991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:40.463435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:40.471527 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] HTTP exception thrown: Instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 could not be found. Aug 30 04:02:40.474847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Request method failure captured: Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 HTTP/1.1 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYvOGQrIcvCaj8zszXLFmUo8iOx31Vd3Y-lfh5Cy5J-z55EyY-Gh1MjhJe_rhhtTfQebHd8D5Gbj4Bl-vBjtdGEHzwtFhVgZpW4_1pKjKY-K9Cbvj772-Wdmm4cH8CS_YSe2hAOeeO3a0Pk3_xUyjqpoGxw5EkxUxkNa4Qv8IzxdavY Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 169b75b5d07c4076b34a37ebb445f7c6 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesActionsTest-292592404 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/169b75b5d07c4076b34a37ebb445f7c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/169b75b5d07c4076b34a37ebb445f7c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_169b75b5d07c4076b34a37ebb445f7c6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/169b75b5d07c4076b34a37ebb445f7c6"}]}] Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesActionsTest-292592404 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 169b75b5d07c4076b34a37ebb445f7c6 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesActionsTest-292592404 Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesActionsTest-292592404-project Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: a1bdb63f9f064976b5a30136841557eb Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesActionsTest-292592404-project Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 could not be found. Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66'} Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 could not be found. Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 could not be found. Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:40.476061 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 could not be found. Aug 30 04:02:40.480937 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:40.482069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:40.484990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Returning 404 to user: Instance ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:40.485245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:40.485245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:40.485245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:40.485617 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80045b2d-5607-43f0-b4c8-72489826d981 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66" status: 404 len: 111 microversion: 2.1 time: 0.061357 Aug 30 04:02:40.485719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:40.509692 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2868/5855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:40 2022] GET /compute/v2.1/servers/ffc1f3f3-48c4-45b2-a17e-4bb4a7b57e66 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:40.654446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:40.678188 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-846d2482-e96d-401d-8ee2-6f1663272ae9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1191 microversion: 2.1 time: 0.225337 Aug 30 04:02:40.679840 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2988/5856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:40 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1191 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:40.699680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1120016049", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "c1471fe9-c1be-43f9-be09-022fb33acf89"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:40.832371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] validate_networks() for [('c1471fe9-c1be-43f9-be09-022fb33acf89', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:02:41.701117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:41.702748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:41.713560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:41.716101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:41.716710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:41.719376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:41.723232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:41.724701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:42.127366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:42.141475 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c8f9329-9901-427c-819b-498be951ce05 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1209 microversion: 2.1 time: 0.441301 Aug 30 04:02:42.142427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2989/5857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:41 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1209 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:42.560922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:02:42.561958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:02:42.563437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:02:42.564082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:02:42.564668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:02:42.586656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:42.586795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:42.588586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:42.589660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:42.590143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:42.591127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:42.637990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Getting quotas for project 169b75b5d07c4076b34a37ebb445f7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:02:42.656405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Getting quotas for user a1bdb63f9f064976b5a30136841557eb and project 169b75b5d07c4076b34a37ebb445f7c6. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:02:42.690165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:02:42.698084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:02:42.820603 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-46187f8d-078d-4a72-af9c-b82d4996896d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141756 Aug 30 04:02:42.829125 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2869/5858] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:02:42.833507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd6c4f1c-2d41-48a7-8178-d176476cef6a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:42.835134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd6c4f1c-2d41-48a7-8178-d176476cef6a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:42.958915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fd6c4f1c-2d41-48a7-8178-d176476cef6a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:42.968920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd6c4f1c-2d41-48a7-8178-d176476cef6a tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1214 microversion: 2.1 time: 0.139475 Aug 30 04:02:42.971172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2990/5859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:42 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:43.171163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:43.173330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:43.191592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:43.192437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:43.194885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:43.196622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:43.197853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:43.198469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:43.403614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:43.421765 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4fd217b9-3745-485f-990f-eb8fa6042770 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1209 microversion: 2.1 time: 0.258955 Aug 30 04:02:43.423818 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2870/5860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:43 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1209 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:43.995772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:43.997259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:44.020702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:44.021570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:44.022262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:44.038636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:44.039473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:44.047458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:44.204861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:44.232148 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bd4a7d40-dc32-4838-ad12-9ccca399838d tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1218 microversion: 2.1 time: 0.243575 Aug 30 04:02:44.237759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2991/5861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:43 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1218 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:44.451994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:44.453575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:44.470671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:44.471543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:44.472961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:44.474635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:44.475826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:44.477515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:45.274648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:45.275980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:45.290331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:45.299064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:45.299503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:45.300275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:45.300761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:45.301197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:46.151933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:46.172118 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-590e04f5-2335-4ebf-8e3b-b7407b4bcd44 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1276 microversion: 2.1 time: 1.731677 Aug 30 04:02:46.173813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2871/5862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:44 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1276 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:46.222102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:46.230556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e762c55f-4d7e-427f-a3a7-afbb3fd9f3aa tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1284 microversion: 2.1 time: 0.960102 Aug 30 04:02:46.231158 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2992/5863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:45 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1284 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:46.875469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:46.876413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:46.889650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:46.890212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:46.890666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:46.893189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:46.896078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:46.897012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:46.984131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f7440d9b-c02b-49bf-b9da-c643c61c7a3c req-61278735-accd-4e7b-9df6-f5a91e39465e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd84d9b-3ccd-4caf-a46a-84b6254819e2", "tag": "3767254f-e4e0-4026-a8a3-3c15337ceb57"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:47.006682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:02:47.011473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f7440d9b-c02b-49bf-b9da-c643c61c7a3c req-61278735-accd-4e7b-9df6-f5a91e39465e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.016422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f7440d9b-c02b-49bf-b9da-c643c61c7a3c req-61278735-accd-4e7b-9df6-f5a91e39465e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.016922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f7440d9b-c02b-49bf-b9da-c643c61c7a3c req-61278735-accd-4e7b-9df6-f5a91e39465e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:47.060773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f7440d9b-c02b-49bf-b9da-c643c61c7a3c req-61278735-accd-4e7b-9df6-f5a91e39465e service nova] Creating event network-changed:3767254f-e4e0-4026-a8a3-3c15337ceb57 for instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 on n-h2-854924-5 Aug 30 04:02:47.078354 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f7440d9b-c02b-49bf-b9da-c643c61c7a3c req-61278735-accd-4e7b-9df6-f5a91e39465e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093110 Aug 30 04:02:47.079688 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2993/5864] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:47.198673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:47.199308 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d48c0e96-24b3-43ba-8c56-c7e6a1f2a5b4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 204 len: 0 microversion: 2.1 time: 0.327512 Aug 30 04:02:47.199789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:47.201005 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2872/5865] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:02:46 2022] DELETE /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:47.216958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:47.218065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:47.223592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.226988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.227479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:47.231692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.232190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.232646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:47.234490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.236662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.237876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:47.240779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.243965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.244606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:47.825807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:47.836888 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30e1b61b-db32-4ade-8283-c214ef9adde5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1276 microversion: 2.1 time: 0.645087 Aug 30 04:02:47.838846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2994/5866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:47 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1276 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:47.851997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:47.853388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:47.856328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:47.864342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.868395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.869855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:47.870523 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-020819e2-f9fc-49d8-8cab-ce0bdc6f1818 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1552 microversion: 2.1 time: 0.662977 Aug 30 04:02:47.871476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:47.872160 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2873/5867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:47 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1552 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:47.873569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:47.874109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:48.464525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:48.479201 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-275c3ef7-417c-45d6-82fa-76fcdf50f037 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.635518 Aug 30 04:02:48.480072 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2995/5868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:47 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:48.861909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:48.863114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:48.873416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:48.876039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:48.876670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:48.878723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:48.879613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:48.880382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:48.884384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-17f3b4ff-402e-4f11-99bc-ac4d3da71e4e tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-689646177", "availability_zone": "foo_zone"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:48.886417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:48.892054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.aggregate [None req-17f3b4ff-402e-4f11-99bc-ac4d3da71e4e tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Generated uuid 53975c0d-75ba-45a3-9f9c-12a65afb8c3a for aggregate {{(pid=122167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:02:48.951718 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-17f3b4ff-402e-4f11-99bc-ac4d3da71e4e tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.336133 Aug 30 04:02:48.960730 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2874/5869] 10.222.0.30 () {60 vars in 1164 bytes} [Tue Aug 30 04:02:48 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:48.968388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:48.969329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:48.978317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:48.979023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:48.979636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:48.980877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:48.981554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:48.982354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:49.607000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:49.620968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-de4a3c39-4ece-4f5d-ac3c-fc15f73c8155 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1276 microversion: 2.1 time: 0.766972 Aug 30 04:02:49.636683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:49.639352 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2996/5870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:48 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1276 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:49.644580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-044c417f-4d41-4622-ae66-cd09e41ef9b4 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:49.645787 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e98a4e69-157d-4f20-b98c-ae817f82dfd2 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 200 len: 1552 microversion: 2.1 time: 0.683401 Aug 30 04:02:49.653893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2875/5871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:48 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 1552 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:49.663361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:49.669257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:49.676659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:49.677275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:49.677823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:49.679181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:49.679721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:49.680648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:49.704900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-044c417f-4d41-4622-ae66-cd09e41ef9b4 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.062738 Aug 30 04:02:49.713966 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2997/5872] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 04:02:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:49.720978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6f7921d8-f177-47d4-bd92-64db2899df28 req-49634015-10a6-40a5-b75c-f87bcb1a3218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97c6ad8-07d0-4f06-ac83-86536d69c775", "name": "network-vif-deleted", "tag": "f9c9ba19-2e00-40a9-b309-ff67fbfe32c8"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:49.740889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f7921d8-f177-47d4-bd92-64db2899df28 req-49634015-10a6-40a5-b75c-f87bcb1a3218 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:49.743808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f7921d8-f177-47d4-bd92-64db2899df28 req-49634015-10a6-40a5-b75c-f87bcb1a3218 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:49.744353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f7921d8-f177-47d4-bd92-64db2899df28 req-49634015-10a6-40a5-b75c-f87bcb1a3218 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:49.757258 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6f7921d8-f177-47d4-bd92-64db2899df28 req-49634015-10a6-40a5-b75c-f87bcb1a3218 service nova] Creating event network-vif-deleted:f9c9ba19-2e00-40a9-b309-ff67fbfe32c8 for instance b97c6ad8-07d0-4f06-ac83-86536d69c775 on n-h1-854924-5 Aug 30 04:02:49.763660 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6f7921d8-f177-47d4-bd92-64db2899df28 req-49634015-10a6-40a5-b75c-f87bcb1a3218 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048178 Aug 30 04:02:49.766167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2998/5873] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:49.776873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:49.782320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:49.782981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:49.784131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:49.785316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:49.785936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:49.786870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:49.819665 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-947c1ea0-e91e-490d-8bf8-2d1e0a360f03 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051800 Aug 30 04:02:49.820529 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 2999/5874] 10.222.0.30 () {58 vars in 1176 bytes} [Tue Aug 30 04:02:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:49.839431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-485666aa-3249-4acd-8a20-cb008f6919f8 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:49.852001 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-485666aa-3249-4acd-8a20-cb008f6919f8 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.016249 Aug 30 04:02:49.852830 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3000/5875] 10.222.0.30 () {58 vars in 1143 bytes} [Tue Aug 30 04:02:49 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:49.873767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4afbe950-3b9d-42e8-8c64-88f949eeae02 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854924-5"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:49.896252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4afbe950-3b9d-42e8-8c64-88f949eeae02 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:49.896743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4afbe950-3b9d-42e8-8c64-88f949eeae02 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:49.897734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4afbe950-3b9d-42e8-8c64-88f949eeae02 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.120000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:50.140062 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75b1410c-268b-4466-9b74-dc546481bef1 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.484933 Aug 30 04:02:50.140773 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2876/5876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:49 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:50.350886 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4afbe950-3b9d-42e8-8c64-88f949eeae02 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.488170 Aug 30 04:02:50.365564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf838d72-8a39-44d1-8a8c-cdd30c316f46 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:50.376660 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3001/5877] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 04:02:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:50.382257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf838d72-8a39-44d1-8a8c-cdd30c316f46 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.019759 Aug 30 04:02:50.403021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b6b254f-382a-4780-9460-1c91ba0a4a58 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1609018300", "availability_zone": "foo_zone"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:50.403456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2877/5878] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 04:02:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:50.544806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fdb81ccc-2c42-422d-a9e7-f5224d55b198 req-e8caa846-dc7e-470f-a194-fc3a9eebed89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a17927-4ec2-46d7-bf21-541384d40063", "tag": "e01ee83c-d9b8-42a4-a24a-f8a0bdaaf60f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:50.559136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b6b254f-382a-4780-9460-1c91ba0a4a58 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.166910 Aug 30 04:02:50.560261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3002/5879] 10.222.0.30 () {60 vars in 1173 bytes} [Tue Aug 30 04:02:50 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:50.566994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fdb81ccc-2c42-422d-a9e7-f5224d55b198 req-e8caa846-dc7e-470f-a194-fc3a9eebed89 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:50.569880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fdb81ccc-2c42-422d-a9e7-f5224d55b198 req-e8caa846-dc7e-470f-a194-fc3a9eebed89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:50.570615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fdb81ccc-2c42-422d-a9e7-f5224d55b198 req-e8caa846-dc7e-470f-a194-fc3a9eebed89 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.590566 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fdb81ccc-2c42-422d-a9e7-f5224d55b198 req-e8caa846-dc7e-470f-a194-fc3a9eebed89 service nova] Creating event network-changed:e01ee83c-d9b8-42a4-a24a-f8a0bdaaf60f for instance d2a17927-4ec2-46d7-bf21-541384d40063 on n-h1-854924-5 Aug 30 04:02:50.593504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02ce858c-b229-429a-b309-44ee373cb915 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:50.596375 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fdb81ccc-2c42-422d-a9e7-f5224d55b198 req-e8caa846-dc7e-470f-a194-fc3a9eebed89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056091 Aug 30 04:02:50.598476 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2878/5880] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:50.624097 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02ce858c-b229-429a-b309-44ee373cb915 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.047421 Aug 30 04:02:50.624697 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3003/5881] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 04:02:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:50.637068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-572335d1-0908-4a0c-86d5-6929f3880a45 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:50.646624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:50.648091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:50.655943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:50.656904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:50.658089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.658239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-572335d1-0908-4a0c-86d5-6929f3880a45 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.025129 Aug 30 04:02:50.659069 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2879/5882] 10.222.0.30 () {58 vars in 1152 bytes} [Tue Aug 30 04:02:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:02:50.659296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:50.659770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:50.662025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.667958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:50.668875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: b97c6ad8-07d0-4f06-ac83-86536d69c775] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:50.676977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:50.677778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:50.678921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.680023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:50.680865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:50.681702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.707493 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] HTTP exception thrown: Instance b97c6ad8-07d0-4f06-ac83-86536d69c775 could not be found. Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Request method failure captured: Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 HTTP/1.1 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYtcXWzT_h6rHtabWmTPJkhSRJdORiJgSy1NePHWpdNu36l3UhiAfEyYR8McH7ekV2NO8v50J5yQmt71BxgRFCGsIbFHZBw7XNgclgHe1u1bjVI9B0P3PLNsEWPl6r2Z_KdKMnxxHg_VxRUw5FhiQ_EXqkZ1zYH8SB3Iw7YmS1i_r5k Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d212588e912641c6bdf0f50e15ca2519 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d212588e912641c6bdf0f50e15ca2519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d212588e912641c6bdf0f50e15ca2519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d212588e912641c6bdf0f50e15ca2519", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d212588e912641c6bdf0f50e15ca2519"}]}] Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d212588e912641c6bdf0f50e15ca2519 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestNetworkBasicOps-1943470822-project Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: b2f8a2b059de406aa1d02936b4e0dbe3 Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestNetworkBasicOps-1943470822-project Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance b97c6ad8-07d0-4f06-ac83-86536d69c775 could not be found. Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'b97c6ad8-07d0-4f06-ac83-86536d69c775'} Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97c6ad8-07d0-4f06-ac83-86536d69c775 could not be found. Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97c6ad8-07d0-4f06-ac83-86536d69c775 could not be found. Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:50.709310 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97c6ad8-07d0-4f06-ac83-86536d69c775 could not be found. Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Returning 404 to user: Instance b97c6ad8-07d0-4f06-ac83-86536d69c775 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b1e45a7-9eae-4ccb-ab83-163a1551d132 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775" status: 404 len: 111 microversion: 2.1 time: 0.048173 Aug 30 04:02:50.713933 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2880/5883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:50 2022] GET /compute/v2.1/servers/b97c6ad8-07d0-4f06-ac83-86536d69c775 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:50.716684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b2e88199-9284-4ba0-b561-991ee21276c7 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854924-5"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:50.730507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e88199-9284-4ba0-b561-991ee21276c7 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:50.731016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e88199-9284-4ba0-b561-991ee21276c7 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:50.731535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2e88199-9284-4ba0-b561-991ee21276c7 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:50.978397 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b2e88199-9284-4ba0-b561-991ee21276c7 tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.265205 Aug 30 04:02:50.980228 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2881/5884] 10.222.0.30 () {60 vars in 1194 bytes} [Tue Aug 30 04:02:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:50.992919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-127ab5e9-ee6f-4790-a9a0-2f79d1eab64e tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:51.045217 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-127ab5e9-ee6f-4790-a9a0-2f79d1eab64e tempest-TestAggregatesBasicOps-1046961304 tempest-TestAggregatesBasicOps-1046961304-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.056868 Aug 30 04:02:51.045911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2882/5885] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 04:02:50 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:02:51.171073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:51.173364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:51.193316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:51.195784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:51.196467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:51.198833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:51.199338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:51.199804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:51.642138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:51.658307 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3709eeb-70c1-4377-ace6-2497ebba05bf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1280 microversion: 2.1 time: 1.015512 Aug 30 04:02:51.659148 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3004/5886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:50 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1280 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:51.664639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b2df2236-66ca-47f9-808b-cfbd46422165 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '.version_select at 0x7f897a6d89d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:51.710554 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b2df2236-66ca-47f9-808b-cfbd46422165 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-866622930" status: 202 len: 0 microversion: 2.1 time: 0.049573 Aug 30 04:02:51.711396 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3005/5887] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 30 04:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-866622930 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:02:51.787672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:51.796916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3b3b716-c22f-41b4-917b-250ae61fb84e tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.637838 Aug 30 04:02:51.799575 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2883/5888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:51 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:52.684328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:52.687623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:52.708110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:52.708823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:52.709273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:52.712123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:52.714909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:52.715545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:52.820700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:52.821536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:52.830757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:52.844339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:52.846235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:52.846894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:52.847451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:52.848298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:52.850040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:52.855028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:52.873493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:52.965049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.220184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:53.229617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:53.234901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8185bfc-46d8-4456-9b9e-9c9cbf514788 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.418719 Aug 30 04:02:53.236197 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2884/5889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:52 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:53.252100 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81835409-39a1-4acb-bad2-cde5ae66686e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1276 microversion: 2.1 time: 0.575923 Aug 30 04:02:53.253021 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3006/5890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:52 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1276 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:54.256750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:54.257996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:54.268134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:54.268711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:54.272197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:54.280164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:54.280802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:54.288971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:54.289609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:54.290076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:54.302803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:54.307273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:54.308144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:54.312120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:54.312864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:54.313642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:54.771576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:54.783844 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c38b8b6f-524e-4216-9f7e-e579384a1bd5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.531278 Aug 30 04:02:54.787672 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2885/5891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:54 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:54.904936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:54.932760 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bedf9039-6acd-4564-aeae-ed56ace1610b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1276 microversion: 2.1 time: 0.658084 Aug 30 04:02:54.936379 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3007/5892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:54 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1276 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:55.806054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:55.820471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:55.836334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:55.836992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:55.837724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:55.838878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:55.839460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:55.840163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:55.967151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:55.968705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:55.989603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:55.990349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:55.994030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:55.995947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:55.996833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.001551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.060622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:56.084259 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d77bdd05-af9d-4d23-92f1-4cf22b0c0474 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.280150 Aug 30 04:02:56.084886 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2886/5893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:55 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:56.090830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:56.091587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:56.117472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:56.117472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.117472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.118475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:56.118968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.119700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.166247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:02:56.278922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:56.286937 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-693f5d75-70ad-4ce0-a6d8-c5c4e702e0e6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 204 len: 0 microversion: 2.1 time: 0.200346 Aug 30 04:02:56.288479 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2887/5894] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:02:56 2022] DELETE /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:56.295490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e3727b63-b30a-4740-b389-5417a1a601d4 req-cb019d00-1f83-4bb3-a0c9-e78f2f7da9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4", "tag": "bcb2fe4b-d232-4d78-a20a-3110ad1d6519"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:56.310722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e3727b63-b30a-4740-b389-5417a1a601d4 req-cb019d00-1f83-4bb3-a0c9-e78f2f7da9c1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:56.311709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e3727b63-b30a-4740-b389-5417a1a601d4 req-cb019d00-1f83-4bb3-a0c9-e78f2f7da9c1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.312234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e3727b63-b30a-4740-b389-5417a1a601d4 req-cb019d00-1f83-4bb3-a0c9-e78f2f7da9c1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.326400 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e3727b63-b30a-4740-b389-5417a1a601d4 req-cb019d00-1f83-4bb3-a0c9-e78f2f7da9c1 service nova] Creating event network-changed:bcb2fe4b-d232-4d78-a20a-3110ad1d6519 for instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 on n-h2-854924-5 Aug 30 04:02:56.331887 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e3727b63-b30a-4740-b389-5417a1a601d4 req-cb019d00-1f83-4bb3-a0c9-e78f2f7da9c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041889 Aug 30 04:02:56.332598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:56.332822 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2888/5895] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:56.338715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:56.339374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:56.346083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:56.346991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.347122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.347738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:56.347884 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64d7b7a3-9258-402a-a8db-70281a0ffb0c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.393173 Aug 30 04:02:56.348267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.348711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.349839 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3008/5896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:55 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:56.505704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:56.518520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2856a5c-e992-44a4-b108-a0fe9a6548f5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1671 microversion: 2.1 time: 0.183826 Aug 30 04:02:56.529568 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2889/5897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:56 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:56.790569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-88da3429-adef-4cfa-8151-2ee3e94d6c9c req-1c784ee2-1115-4e2a-850c-9debc63f85e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a17927-4ec2-46d7-bf21-541384d40063", "name": "network-vif-plugged", "status": "completed", "tag": "e01ee83c-d9b8-42a4-a24a-f8a0bdaaf60f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:56.802827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88da3429-adef-4cfa-8151-2ee3e94d6c9c req-1c784ee2-1115-4e2a-850c-9debc63f85e8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:56.803679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88da3429-adef-4cfa-8151-2ee3e94d6c9c req-1c784ee2-1115-4e2a-850c-9debc63f85e8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:56.804274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88da3429-adef-4cfa-8151-2ee3e94d6c9c req-1c784ee2-1115-4e2a-850c-9debc63f85e8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:56.818894 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-88da3429-adef-4cfa-8151-2ee3e94d6c9c req-1c784ee2-1115-4e2a-850c-9debc63f85e8 service nova] Creating event network-vif-plugged:e01ee83c-d9b8-42a4-a24a-f8a0bdaaf60f for instance d2a17927-4ec2-46d7-bf21-541384d40063 on n-h1-854924-5 Aug 30 04:02:56.824958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-88da3429-adef-4cfa-8151-2ee3e94d6c9c req-1c784ee2-1115-4e2a-850c-9debc63f85e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038643 Aug 30 04:02:56.826184 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3009/5898] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:57.114339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:57.114977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:57.125011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:57.125582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:57.126220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:57.127008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:57.127425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:57.127869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:57.372967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:57.374422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:57.381848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:57.382447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:57.382887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:57.383589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:57.384045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:57.384473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:57.466139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:57.473917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6dd82291-68a4-4eef-b976-e21af8becdd0 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.363477 Aug 30 04:02:57.474493 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2890/5899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:57 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:57.543979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:57.544910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:57.551095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:57.551601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:57.552157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:57.552875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:57.553595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:57.554034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:57.816432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:57.825256 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e50041bc-4043-4048-bf63-29e5fe7d8cec tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.457794 Aug 30 04:02:57.825916 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3010/5900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:57 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:57.938056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:57.948307 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-902d0252-a9ff-48ac-9faf-16a89f5ec82e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 200 len: 1671 microversion: 2.1 time: 0.408031 Aug 30 04:02:57.972533 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2891/5901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:57 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 1671 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:58.041396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-528a024d-7942-4e39-b2f7-2b5e930dd208 req-1cb425bb-593c-46ca-a37e-d67b0442d9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4", "name": "network-vif-deleted", "tag": "bcb2fe4b-d232-4d78-a20a-3110ad1d6519"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:02:58.052057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-528a024d-7942-4e39-b2f7-2b5e930dd208 req-1cb425bb-593c-46ca-a37e-d67b0442d9d3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.052539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-528a024d-7942-4e39-b2f7-2b5e930dd208 req-1cb425bb-593c-46ca-a37e-d67b0442d9d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.052968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-528a024d-7942-4e39-b2f7-2b5e930dd208 req-1cb425bb-593c-46ca-a37e-d67b0442d9d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.065101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-528a024d-7942-4e39-b2f7-2b5e930dd208 req-1cb425bb-593c-46ca-a37e-d67b0442d9d3 service nova] Creating event network-vif-deleted:bcb2fe4b-d232-4d78-a20a-3110ad1d6519 for instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 on n-h2-854924-5 Aug 30 04:02:58.071066 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-528a024d-7942-4e39-b2f7-2b5e930dd208 req-1cb425bb-593c-46ca-a37e-d67b0442d9d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Aug 30 04:02:58.072274 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3011/5902] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:02:58.496238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:58.497201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:58.504845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.505334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.505825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.507157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.508006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.508713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.825642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:58.848491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:58.849899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:58.855102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3f65acce-66cc-4611-bd28-278ef9a0dab5 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1314 microversion: 2.1 time: 0.362546 Aug 30 04:02:58.868839 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2892/5903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:58 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:58.871475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:58.873798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.874314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.874754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.875469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.875929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.876375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.973292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:58.973903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:58.980743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.981249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.981934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.982655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:58.983140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:58.983585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:58.998012 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] HTTP exception thrown: Instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 could not be found. Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Request method failure captured: Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 HTTP/1.1 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYtcXWzT_h6rHtabWmTPJkhSRJdORiJgSy1NePHWpdNu36l3UhiAfEyYR8McH7ekV2NO8v50J5yQmt71BxgRFCGsIbFHZBw7XNgclgHe1u1bjVI9B0P3PLNsEWPl6r2Z_KdKMnxxHg_VxRUw5FhiQ_EXqkZ1zYH8SB3Iw7YmS1i_r5k Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: d212588e912641c6bdf0f50e15ca2519 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d212588e912641c6bdf0f50e15ca2519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d212588e912641c6bdf0f50e15ca2519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d212588e912641c6bdf0f50e15ca2519", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d212588e912641c6bdf0f50e15ca2519"}]}] Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: d212588e912641c6bdf0f50e15ca2519 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestNetworkBasicOps-1943470822-project Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: b2f8a2b059de406aa1d02936b4e0dbe3 Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestNetworkBasicOps-1943470822-project Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 could not be found. Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4'} Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 could not be found. Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 could not be found. Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:02:58.999745 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 could not be found. Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Returning 404 to user: Instance dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80aed894-2a59-45fd-be03-f69da2aadea9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4" status: 404 len: 111 microversion: 2.1 time: 0.032018 Aug 30 04:02:59.005232 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2893/5904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:58 2022] GET /compute/v2.1/servers/dc3e370c-bd3d-4edf-a0b1-6dcfd88410c4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:02:59.177286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:02:59.185860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba3848f3-7d01-46c5-88e2-f4d87ecd545c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.342933 Aug 30 04:02:59.186443 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3012/5905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:58 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:59.384621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81de1f33-c0cc-4c69-adb8-18630d8ce7a4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '.version_select at 0x7f897b84d8b0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:59.419023 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-81de1f33-c0cc-4c69-adb8-18630d8ce7a4 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1410705454" status: 202 len: 0 microversion: 2.1 time: 0.045426 Aug 30 04:02:59.420298 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2894/5906] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Aug 30 04:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1410705454 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:02:59.877319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:02:59.877974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:02:59.879829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.886886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:59.888041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:59.888721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:02:59.889836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:02:59.890526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:02:59.891177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:00.127952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:00.137291 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d5b27b8-a669-44bf-8f6c-3701db387866 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1499 microversion: 2.1 time: 0.263675 Aug 30 04:03:00.138631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3013/5907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:02:59 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1499 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:00.210074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:00.210791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:00.227418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:00.227569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:00.230290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:00.232605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:00.234515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:00.235989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:00.515728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12256724-4ec2-4342-b68a-4b09e0622833 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: .version_select at 0x7f897a49f1f0>, body: {"keypair": {"name": "tempest-keypair-897592330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEd+VRV05ITJo0xPZuBskSJ6FQDDwZnqvI4N1/q8427ZgKdPv+xbSbNag2p3fcKVINyE4aX0sfA2V+lEzJulq5RS88HUjXEVBBrb/unLNN0ORdJZ1L1svDpD+534ZlFQA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:00.540914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-12256724-4ec2-4342-b68a-4b09e0622833 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:03:00.555648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-12256724-4ec2-4342-b68a-4b09e0622833 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:03:00.625206 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12256724-4ec2-4342-b68a-4b09e0622833 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113291 Aug 30 04:03:00.628008 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3014/5908] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:03:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:00.816416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:00.817474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:00.826074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:00.827031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:00.827706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:00.828758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:00.829522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:00.830336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:00.869683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:03:01.005045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:01.017574 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-355ca37b-5e68-4431-8626-1f7a35007abf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.813382 Aug 30 04:03:01.019013 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2895/5909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:00 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:01.057919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0aac89b-d53a-4368-a1b9-ddab9cc9c7ce tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 204 len: 0 microversion: 2.1 time: 0.245190 Aug 30 04:03:01.061936 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3015/5910] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:03:00 2022] DELETE /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:01.070676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:01.074788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:01.091810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:01.092727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:01.093692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:01.094600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:01.095677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:01.096418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:01.472814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:01.498898 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9186ccae-9b3e-4481-87a1-5c98d905799b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1505 microversion: 2.1 time: 0.435804 Aug 30 04:03:01.504541 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2896/5911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:01 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:02.044013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:02.044976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:02.055227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:02.055998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:02.056435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:02.057130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:02.057947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:02.058978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:02.385668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:02.396527 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10b2b94f-e4e6-4a52-94c8-c3818d133923 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.356861 Aug 30 04:03:02.397863 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3016/5912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:02 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:02.527622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:02.528374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:02.546792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:02.547452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:02.548004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:02.548898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:02.549617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:02.550160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:02.864404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-100647385", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6ec5b19-fb85-4e4b-a816-8856b9dda964"}], "security_groups": [{"name": "tempest-securitygroup--2060060590"}], "key_name": "tempest-keypair-897592330", "user_data": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:03.010740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:03.018706 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1399fbcc-66df-48a6-bd0e-e4b34ee4056b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1505 microversion: 2.1 time: 0.497190 Aug 30 04:03:03.019309 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2897/5913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:02 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:03.078980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] validate_networks() for [('c6ec5b19-fb85-4e4b-a816-8856b9dda964', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:03:03.418109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:03.418812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:03.437582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:03.438387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:03.439083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:03.440055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:03.440670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:03.441242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:03.822862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:03.834103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d8b08fa-7834-4202-9d95-a9ef442892cd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.419945 Aug 30 04:03:03.871513 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2898/5914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:03 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:03.886483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1db9091b-887f-4490-9afb-26b917abe427 req-0ddc64ea-2bee-4024-b931-8388dcfa1d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a17927-4ec2-46d7-bf21-541384d40063", "name": "network-vif-deleted", "tag": "e01ee83c-d9b8-42a4-a24a-f8a0bdaaf60f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:03.905333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1db9091b-887f-4490-9afb-26b917abe427 req-0ddc64ea-2bee-4024-b931-8388dcfa1d96 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:03.907089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1db9091b-887f-4490-9afb-26b917abe427 req-0ddc64ea-2bee-4024-b931-8388dcfa1d96 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:03.907657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1db9091b-887f-4490-9afb-26b917abe427 req-0ddc64ea-2bee-4024-b931-8388dcfa1d96 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:03.924877 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1db9091b-887f-4490-9afb-26b917abe427 req-0ddc64ea-2bee-4024-b931-8388dcfa1d96 service nova] Creating event network-vif-deleted:e01ee83c-d9b8-42a4-a24a-f8a0bdaaf60f for instance d2a17927-4ec2-46d7-bf21-541384d40063 on n-h1-854924-5 Aug 30 04:03:03.936307 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1db9091b-887f-4490-9afb-26b917abe427 req-0ddc64ea-2bee-4024-b931-8388dcfa1d96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063035 Aug 30 04:03:03.937801 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2899/5915] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:04.056640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:04.060545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:04.077011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.078078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.078586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:03:04.079004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:03:04.079559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:03:04.079867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:03:04.080280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:04.081375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.082277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.083098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:04.084548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:03:04.108532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.109640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.110992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:04.112516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.113137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.113876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:04.145614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:03:04.165596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:03:04.190536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:03:04.193902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:03:04.203649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.204189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.204643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:04.205269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lazy-loading 'fault' on Instance uuid d2a17927-4ec2-46d7-bf21-541384d40063 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:03:04.269508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d444d1fd-0ac4-49ff-bd15-3b8e7a01bf7a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.410022 Aug 30 04:03:04.270510 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3017/5916] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:03:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:03:04.282760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9bc4c34-71d2-472c-8ce9-a03ca9d1c96c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:04.284780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9bc4c34-71d2-472c-8ce9-a03ca9d1c96c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:04.321033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bdb63f9f064976b5a30136841557eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169b75b5d07c4076b34a37ebb445f7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:04.331838 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4acea49c-da02-4a7e-8c99-372a7b539e9b tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 200 len: 1304 microversion: 2.1 time: 0.294432 Aug 30 04:03:04.345897 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2900/5917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:04 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 1304 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:04.378526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9bc4c34-71d2-472c-8ce9-a03ca9d1c96c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:04.389891 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9bc4c34-71d2-472c-8ce9-a03ca9d1c96c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1240 microversion: 2.1 time: 0.111743 Aug 30 04:03:04.391042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3018/5918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:04 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:04.861559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:04.862917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:04.869395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.883977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.884584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:04.885408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:04.885867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:04.886319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:05.223892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:05.227701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:05.237698 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-068ccdce-5db6-4d17-a996-cae9b0d024d5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.381020 Aug 30 04:03:05.258996 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2901/5919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:04 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:05.364065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:05.367263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] [instance: d2a17927-4ec2-46d7-bf21-541384d40063] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:05.378157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:05.378974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:05.379425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:05.380193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:05.380819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:05.381527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:05.399683 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] HTTP exception thrown: Instance d2a17927-4ec2-46d7-bf21-541384d40063 could not be found. Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Request method failure captured: Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 HTTP/1.1 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYvOGQrIcvCaj8zszXLFmUo8iOx31Vd3Y-lfh5Cy5J-z55EyY-Gh1MjhJe_rhhtTfQebHd8D5Gbj4Bl-vBjtdGEHzwtFhVgZpW4_1pKjKY-K9Cbvj772-Wdmm4cH8CS_YSe2hAOeeO3a0Pk3_xUyjqpoGxw5EkxUxkNa4Qv8IzxdavY Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 169b75b5d07c4076b34a37ebb445f7c6 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesActionsTest-292592404 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/169b75b5d07c4076b34a37ebb445f7c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/169b75b5d07c4076b34a37ebb445f7c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_169b75b5d07c4076b34a37ebb445f7c6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/169b75b5d07c4076b34a37ebb445f7c6"}]}] Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesActionsTest-292592404 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 169b75b5d07c4076b34a37ebb445f7c6 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesActionsTest-292592404 Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesActionsTest-292592404-project Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a1bdb63f9f064976b5a30136841557eb Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesActionsTest-292592404-project Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance d2a17927-4ec2-46d7-bf21-541384d40063 could not be found. Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'd2a17927-4ec2-46d7-bf21-541384d40063'} Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a17927-4ec2-46d7-bf21-541384d40063 could not be found. Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a17927-4ec2-46d7-bf21-541384d40063 could not be found. Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:03:05.402323 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a17927-4ec2-46d7-bf21-541384d40063 could not be found. Aug 30 04:03:05.410078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:03:05.419516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:05.420616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:05.423823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] Returning 404 to user: Instance d2a17927-4ec2-46d7-bf21-541384d40063 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:03:05.427495 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06f9919d-48b3-4eed-8a0b-a6217008fbb7 tempest-VolumesActionsTest-292592404 tempest-VolumesActionsTest-292592404-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063" status: 404 len: 111 microversion: 2.1 time: 0.074346 Aug 30 04:03:05.430492 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3019/5920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:05 2022] GET /compute/v2.1/servers/d2a17927-4ec2-46d7-bf21-541384d40063 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:03:05.434463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:05.435198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:05.435827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:05.437197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:05.437853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:05.438497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:05.582245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:05.592563 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6226c8b3-c04a-4114-bc6b-b148130da0d8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1292 microversion: 2.1 time: 0.178736 Aug 30 04:03:05.593939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2902/5921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:05 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:05.623862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d4233d0f-4c0e-4c1b-a5b6-1fb16bbaa2a8 req-efab3a31-7658-48ef-a6c9-b98346d7f25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd84d9b-3ccd-4caf-a46a-84b6254819e2", "name": "network-vif-plugged", "status": "completed", "tag": "3767254f-e4e0-4026-a8a3-3c15337ceb57"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:05.640346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4233d0f-4c0e-4c1b-a5b6-1fb16bbaa2a8 req-efab3a31-7658-48ef-a6c9-b98346d7f25f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:05.641860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4233d0f-4c0e-4c1b-a5b6-1fb16bbaa2a8 req-efab3a31-7658-48ef-a6c9-b98346d7f25f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:05.642867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d4233d0f-4c0e-4c1b-a5b6-1fb16bbaa2a8 req-efab3a31-7658-48ef-a6c9-b98346d7f25f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:05.658569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d4233d0f-4c0e-4c1b-a5b6-1fb16bbaa2a8 req-efab3a31-7658-48ef-a6c9-b98346d7f25f service nova] Creating event network-vif-plugged:3767254f-e4e0-4026-a8a3-3c15337ceb57 for instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 on n-h2-854924-5 Aug 30 04:03:05.668010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d4233d0f-4c0e-4c1b-a5b6-1fb16bbaa2a8 req-efab3a31-7658-48ef-a6c9-b98346d7f25f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052598 Aug 30 04:03:05.669019 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3020/5922] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:06.260385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:06.261904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:06.280385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:06.281639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:06.282978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:06.285212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:06.285956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:06.286746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:06.615278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:06.616189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:06.623497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:06.624323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:06.624967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:06.625896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:06.626553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:06.627183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:06.773189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:06.791529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8761bbc6-88d9-4a2a-8c67-1ba82d12ff14 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1298 microversion: 2.1 time: 0.180350 Aug 30 04:03:06.802170 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3021/5923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:06 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1298 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:07.029125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:07.046978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-33ca2e0c-c05f-4d75-8660-026cebe5612e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1264 microversion: 2.1 time: 0.790641 Aug 30 04:03:07.049222 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2903/5924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:06 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1264 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:07.180988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-99d2d788-7a92-4578-9422-4edaacb8314f tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Action: 'create', calling method: .version_select at 0x7f897a9ced30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1010609716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFEEU1loQBUcB4cPHRDv+ZzCPhNsP/Dg/EzZWO8gNfFTPSsfHXWdhtlriYTZt8otghK+w18++F5TgKoOyicqwQqROyQHhH9jADyNa5Natff4Ng5JK+N9M/NWkfhj37znQ=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:07.199170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-99d2d788-7a92-4578-9422-4edaacb8314f tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Getting quotas for project 43b6993ce60c4eada6d588e7fe67af52. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:03:07.204441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-99d2d788-7a92-4578-9422-4edaacb8314f tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Getting quotas for user d35430b2c8454d81bbfa6d3e6ea8a5c9 and project 43b6993ce60c4eada6d588e7fe67af52. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:03:07.236600 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-99d2d788-7a92-4578-9422-4edaacb8314f tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.326378 Aug 30 04:03:07.237795 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3022/5925] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:03:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:07.813570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:07.814806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:07.822359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:07.823941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:07.824738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:07.825646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:07.826271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:07.827358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:07.991715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:08.003385 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aadb9c86-f9d8-4e05-b72f-b3207e57665e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1298 microversion: 2.1 time: 0.194664 Aug 30 04:03:08.009613 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2904/5926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:07 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:08.070123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:08.080908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:08.112831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:08.113899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:08.114531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:08.118299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:08.119333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:08.122447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:08.617833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:08.629879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e14cf2c8-f23d-444d-b357-70a65a6f090f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1450 microversion: 2.1 time: 0.564308 Aug 30 04:03:08.657565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:08.658205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:08.665148 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3023/5927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:08 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1450 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:08.670382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:08.671178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:08.671849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:08.674012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:08.674499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:08.676405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:09.024195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:09.034780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:09.035420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:09.038821 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-86a0a2f0-faf7-4f2e-ab68-278c3e84eed0 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1450 microversion: 2.1 time: 0.384752 Aug 30 04:03:09.040904 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2905/5928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:08 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1450 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:09.060416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:09.064886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:09.065833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:09.067398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:09.067938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:09.069301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:09.108820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.457688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:09.468146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09f65815-039d-484e-96e9-633d51dad2b1 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 0.447917 Aug 30 04:03:09.468743 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3024/5929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:09 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:09.917584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fd089ad4-5b62-4f0e-952f-be7c72229972 req-289595e8-2182-44e3-a9e2-1ecd7bafe59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa42eca-0fb4-4900-93b8-37fe3680acf5", "tag": "0cf4563d-a0fd-4918-bb9a-375b3635046a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:09.962546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fd089ad4-5b62-4f0e-952f-be7c72229972 req-289595e8-2182-44e3-a9e2-1ecd7bafe59a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:09.964803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fd089ad4-5b62-4f0e-952f-be7c72229972 req-289595e8-2182-44e3-a9e2-1ecd7bafe59a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:09.965312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fd089ad4-5b62-4f0e-952f-be7c72229972 req-289595e8-2182-44e3-a9e2-1ecd7bafe59a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:10.002644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fd089ad4-5b62-4f0e-952f-be7c72229972 req-289595e8-2182-44e3-a9e2-1ecd7bafe59a service nova] Creating event network-changed:0cf4563d-a0fd-4918-bb9a-375b3635046a for instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 on n-h1-854924-5 Aug 30 04:03:10.042546 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fd089ad4-5b62-4f0e-952f-be7c72229972 req-289595e8-2182-44e3-a9e2-1ecd7bafe59a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125826 Aug 30 04:03:10.043886 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2906/5930] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:10.495264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:10.496622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:10.514969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:10.515818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:10.516467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:10.517283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:10.519496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:10.519998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:11.273388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:11.285723 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-74851ef8-c678-4e4b-a1bc-6ca2aa1606d0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 0.796301 Aug 30 04:03:11.288800 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3025/5931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:10 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:12.310803 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:12.312931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:12.336354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:12.339423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:12.345911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:12.350512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:12.351301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:12.353373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:12.807756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:12.829267 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a3ca6f6a-fb4f-4373-a045-92b3011338b6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 0.519081 Aug 30 04:03:12.830640 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2907/5932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:12 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:13.851160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:13.852484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:13.878369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:13.881596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:13.883964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:13.886262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:13.889734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:13.890994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:14.127820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:14.686481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2eb4fb14-d932-41f6-a5a1-82fbfcd0a927 req-ca88152a-e763-45e0-b3c2-949a50279af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd84d9b-3ccd-4caf-a46a-84b6254819e2", "tag": "3767254f-e4e0-4026-a8a3-3c15337ceb57"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:14.727039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2eb4fb14-d932-41f6-a5a1-82fbfcd0a927 req-ca88152a-e763-45e0-b3c2-949a50279af2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:14.728186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2eb4fb14-d932-41f6-a5a1-82fbfcd0a927 req-ca88152a-e763-45e0-b3c2-949a50279af2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:14.731029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2eb4fb14-d932-41f6-a5a1-82fbfcd0a927 req-ca88152a-e763-45e0-b3c2-949a50279af2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:14.783200 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2eb4fb14-d932-41f6-a5a1-82fbfcd0a927 req-ca88152a-e763-45e0-b3c2-949a50279af2 service nova] Creating event network-changed:3767254f-e4e0-4026-a8a3-3c15337ceb57 for instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 on n-h2-854924-5 Aug 30 04:03:14.796625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2eb4fb14-d932-41f6-a5a1-82fbfcd0a927 req-ca88152a-e763-45e0-b3c2-949a50279af2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115344 Aug 30 04:03:14.800452 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2908/5933] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:14.824347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:14.841245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6be04fa0-0e0f-4b24-ac62-77518b745db6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 0.994479 Aug 30 04:03:14.842491 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3026/5934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:13 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:15.865587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:15.866307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:15.890483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:15.891032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:15.891494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:15.902218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:15.903244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:15.903696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:16.862085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:16.887765 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd74759f-5491-4050-bfbc-e9e131b66f51 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 1.025469 Aug 30 04:03:16.889283 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2909/5935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:15 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:17.911829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:17.912704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:17.915803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=16 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.946480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:17.947316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:17.948135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:17.952648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:17.953412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:17.954062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:20.100532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ef2169eb-7086-4e99-bd00-11e6a6548f4b req-c709ca4e-eb8d-47f2-bd15-798efbb5b801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa42eca-0fb4-4900-93b8-37fe3680acf5", "name": "network-vif-plugged", "status": "completed", "tag": "0cf4563d-a0fd-4918-bb9a-375b3635046a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:20.130104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ef2169eb-7086-4e99-bd00-11e6a6548f4b req-c709ca4e-eb8d-47f2-bd15-798efbb5b801 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:20.133242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ef2169eb-7086-4e99-bd00-11e6a6548f4b req-c709ca4e-eb8d-47f2-bd15-798efbb5b801 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:20.133784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ef2169eb-7086-4e99-bd00-11e6a6548f4b req-c709ca4e-eb8d-47f2-bd15-798efbb5b801 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:20.179800 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ef2169eb-7086-4e99-bd00-11e6a6548f4b req-c709ca4e-eb8d-47f2-bd15-798efbb5b801 service nova] Creating event network-vif-plugged:0cf4563d-a0fd-4918-bb9a-375b3635046a for instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 on n-h1-854924-5 Aug 30 04:03:20.186427 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ef2169eb-7086-4e99-bd00-11e6a6548f4b req-c709ca4e-eb8d-47f2-bd15-798efbb5b801 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089866 Aug 30 04:03:20.189439 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2910/5936] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:20.418298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:20.430905 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bcad0bce-121a-4ca0-a231-96399498ec0f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 2.523824 Aug 30 04:03:20.434793 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3027/5937] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:17 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:20.901272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-74c654ce-4141-4679-bc1e-e5adb2fbf4af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'create', calling method: .version_select at 0x7f8983d88a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1398495440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWk4WpJGhVSlPpv8z2YlLQnH3HdkZksFHqP/c0+KDnNc0DDPfDz2r3qMwUwlandSYPojbt0jjnTb3ubeiHi3h9oQkHdGFztI7z4n4iTJHcjcGlKGjoOyiDMfui1YW/UVw=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:21.005642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-74c654ce-4141-4679-bc1e-e5adb2fbf4af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for project d212588e912641c6bdf0f50e15ca2519. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:03:21.024561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-74c654ce-4141-4679-bc1e-e5adb2fbf4af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for user b2f8a2b059de406aa1d02936b4e0dbe3 and project d212588e912641c6bdf0f50e15ca2519. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:03:21.103209 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-74c654ce-4141-4679-bc1e-e5adb2fbf4af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.203903 Aug 30 04:03:21.116897 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2911/5938] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:03:20 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:21.459328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:21.460449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:21.480340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:21.481697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:21.482849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:21.483839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:21.484447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:21.485075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:21.543546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1281858941-access_point-1779331173", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "7a5c5847-2538-4b43-906f-09d4e6c891e9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1010609716", "security_groups": [{"name": "tempest-secgroup_access--519204905"}, {"name": "tempest-secgroup_general--1143678783"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:22.146903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:22.158974 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4c5d4f14-aa31-4d0f-8ee1-0604f49791f5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1366 microversion: 2.1 time: 0.707513 Aug 30 04:03:22.159435 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3028/5939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:21 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1366 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:22.372245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] validate_networks() for [('7a5c5847-2538-4b43-906f-09d4e6c891e9', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:03:23.187436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:23.189030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:23.208674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:23.210896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:23.211546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:23.212871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:23.213891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:23.214486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:23.621703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:23.632017 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-703dc264-8c03-4d32-8f0f-102970ab70ef tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1556 microversion: 2.1 time: 0.452127 Aug 30 04:03:23.634955 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3029/5940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:23 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1556 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:23.639288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:03:23.640327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:03:23.641035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:03:23.642276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:03:23.642931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:03:23.653360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:23.654099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:23.661217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:23.662233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:23.662860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:23.663994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:23.664788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:23.665436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:23.713733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:23.716040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:23.749861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:23.762937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:23.765171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:23.766457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:23.844580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Getting quotas for project 43b6993ce60c4eada6d588e7fe67af52. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:03:23.856226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Getting quotas for user d35430b2c8454d81bbfa6d3e6ea8a5c9 and project 43b6993ce60c4eada6d588e7fe67af52. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:03:23.861660 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec4e8d5d-9638-4955-84d2-d9868db49709 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.212093 Aug 30 04:03:23.874453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3030/5941] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:03:23 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:03:23.917649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:03:23.920056 n-d-854924-5 devstack@n-api.service[122167]: WARNING nova.utils [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1281858941-access_point-1779331173 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1281858941-ac Aug 30 04:03:23.920954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:03:24.046254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3749b699-b597-4861-bb4b-359c61045917 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.506713 Aug 30 04:03:24.047571 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2912/5942] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:03:21 2022] POST /compute/v2.1/servers => generated 457 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:03:24.058643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0504e79-db7e-4261-9b1a-319124370bdf tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:24.059273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0504e79-db7e-4261-9b1a-319124370bdf tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:24.176544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0504e79-db7e-4261-9b1a-319124370bdf tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:24.185549 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0504e79-db7e-4261-9b1a-319124370bdf tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1295 microversion: 2.1 time: 0.130870 Aug 30 04:03:24.189662 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3031/5943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:24 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1295 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:24.219371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-275642007", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "46893006-1fdc-46ef-a98e-5d4d218420ca"}], "key_name": "tempest-TestNetworkBasicOps-1398495440", "security_groups": [{"name": "tempest-secgroup-smoke-2098551000"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:24.483004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] validate_networks() for [('46893006-1fdc-46ef-a98e-5d4d218420ca', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:03:25.211872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:25.212488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:25.223942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:25.224469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:25.225555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:25.226274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:25.234160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:25.234837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:25.370301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:25.433373 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e6293a9a-bcf1-42da-a208-683ebc064ce6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1299 microversion: 2.1 time: 0.224347 Aug 30 04:03:25.437436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3032/5944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:25 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:25.853215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:03:25.853707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:03:25.854157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:03:25.854580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:03:25.855350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:03:25.872199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:25.872726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:25.873185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:25.876931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:25.877474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:25.877934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:25.954157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for project d212588e912641c6bdf0f50e15ca2519. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:03:25.982680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Getting quotas for user b2f8a2b059de406aa1d02936b4e0dbe3 and project d212588e912641c6bdf0f50e15ca2519. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:03:26.027927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:03:26.039740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:03:26.156502 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-56f852b4-d724-4af6-9fb8-d9901fa20c28 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.942080 Aug 30 04:03:26.161666 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2913/5945] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:03:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:03:26.173302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a356794-c466-4979-ad38-31f85f8b028f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:26.174250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a356794-c466-4979-ad38-31f85f8b028f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:26.407122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a356794-c466-4979-ad38-31f85f8b028f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:26.427353 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a356794-c466-4979-ad38-31f85f8b028f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1248 microversion: 2.1 time: 0.258869 Aug 30 04:03:26.434646 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3033/5946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:26 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1248 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:26.458704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:26.459493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:26.469312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:26.486003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:26.486918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:26.488699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:26.489888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:26.491675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:26.511039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:26.747102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a73ff8eb-bd19-4524-97be-66a42cb52c05 req-7a3f17e5-cf6d-4124-85ba-c082308d4c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa42eca-0fb4-4900-93b8-37fe3680acf5", "tag": "0cf4563d-a0fd-4918-bb9a-375b3635046a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:26.755380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:26.773420 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6ee1dbb-e729-4100-9778-c8e78e0a24ab tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1353 microversion: 2.1 time: 0.319227 Aug 30 04:03:26.774228 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2914/5947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:26 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:26.814818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a73ff8eb-bd19-4524-97be-66a42cb52c05 req-7a3f17e5-cf6d-4124-85ba-c082308d4c1a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:26.815748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a73ff8eb-bd19-4524-97be-66a42cb52c05 req-7a3f17e5-cf6d-4124-85ba-c082308d4c1a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:26.816411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a73ff8eb-bd19-4524-97be-66a42cb52c05 req-7a3f17e5-cf6d-4124-85ba-c082308d4c1a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:26.848198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a73ff8eb-bd19-4524-97be-66a42cb52c05 req-7a3f17e5-cf6d-4124-85ba-c082308d4c1a service nova] Creating event network-changed:0cf4563d-a0fd-4918-bb9a-375b3635046a for instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 on n-h1-854924-5 Aug 30 04:03:26.863869 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a73ff8eb-bd19-4524-97be-66a42cb52c05 req-7a3f17e5-cf6d-4124-85ba-c082308d4c1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118955 Aug 30 04:03:26.866669 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3034/5948] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:03:27.456272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:27.457779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:27.470028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:27.470932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:27.472583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:27.475052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:27.475784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:27.478393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:27.807464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:27.808168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:27.837549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:27.838334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:27.844807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:27.847635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:27.850892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:27.851902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:28.030099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:28.040042 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0858e3be-4a5f-4409-b879-14e7a0e52ec7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1252 microversion: 2.1 time: 0.588606 Aug 30 04:03:28.045094 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2915/5949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:27 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1252 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:28.120027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:28.133314 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9705ae0b-b392-4304-b6c2-83399a3d40f6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1353 microversion: 2.1 time: 0.331057 Aug 30 04:03:28.135110 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3035/5950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:27 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1353 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:29.069268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:29.071227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:29.079040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:29.079557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:29.080189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:29.081111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:29.083119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:29.083665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:29.163323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:29.163962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:29.177423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:29.186781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:29.187561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:29.188205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:29.189877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:29.190560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:29.191240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:29.471521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:29.484997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-886d796f-ca42-4eb1-a4b4-a26d96a080af tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1306 microversion: 2.1 time: 0.420087 Aug 30 04:03:29.507805 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2916/5951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:29 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1306 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:29.801138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:29.814956 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e4cd4d45-7d34-4ad0-bbd3-a9188f31b6ac tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1472 microversion: 2.1 time: 0.661156 Aug 30 04:03:29.818955 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3036/5952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:29 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1472 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:30.515347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:30.516108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:30.526476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:30.529019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:30.531282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:30.535204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:30.535997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:30.536717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:30.754636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:30.766541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6463749a-320c-4ca1-a1cc-efa17dee91ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.255783 Aug 30 04:03:30.781460 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2917/5953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:30 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:30.840713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:30.841323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:30.855330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:30.856128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:30.856822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:30.857907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:30.860888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:30.861840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:30.941255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ed82c6a6-d3bc-42e3-8937-dda4cc7671b4 req-a42ff5cb-d334-4237-849c-e33ce5fa512b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9565d892-87ad-4888-b8bc-72972b1b619a", "tag": "5750e0f5-0e16-48e7-8589-5f01e26783bb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:30.980864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ed82c6a6-d3bc-42e3-8937-dda4cc7671b4 req-a42ff5cb-d334-4237-849c-e33ce5fa512b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:30.982426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ed82c6a6-d3bc-42e3-8937-dda4cc7671b4 req-a42ff5cb-d334-4237-849c-e33ce5fa512b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:30.983725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ed82c6a6-d3bc-42e3-8937-dda4cc7671b4 req-a42ff5cb-d334-4237-849c-e33ce5fa512b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:31.012741 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ed82c6a6-d3bc-42e3-8937-dda4cc7671b4 req-a42ff5cb-d334-4237-849c-e33ce5fa512b service nova] Creating event network-changed:5750e0f5-0e16-48e7-8589-5f01e26783bb for instance 9565d892-87ad-4888-b8bc-72972b1b619a on n-h2-854924-5 Aug 30 04:03:31.027075 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ed82c6a6-d3bc-42e3-8937-dda4cc7671b4 req-a42ff5cb-d334-4237-849c-e33ce5fa512b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093519 Aug 30 04:03:31.027783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2918/5954] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:31.368300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:31.382153 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e6e4005-1bdb-49f4-9f5e-eb3df6ef87f0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1472 microversion: 2.1 time: 0.545652 Aug 30 04:03:31.386487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3037/5955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:30 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:31.516866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-87623707-5c89-486b-8bd4-45067f7465ce req-70725a0d-702c-4d36-9d22-855f8936eebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b88489-4f1c-4043-ab5c-79c6bbea188b", "tag": "98dc0177-6c8b-4f14-8fc8-8cecf04988bd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:31.560789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-87623707-5c89-486b-8bd4-45067f7465ce req-70725a0d-702c-4d36-9d22-855f8936eebb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:31.563834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-87623707-5c89-486b-8bd4-45067f7465ce req-70725a0d-702c-4d36-9d22-855f8936eebb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:31.565916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-87623707-5c89-486b-8bd4-45067f7465ce req-70725a0d-702c-4d36-9d22-855f8936eebb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:31.602381 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-87623707-5c89-486b-8bd4-45067f7465ce req-70725a0d-702c-4d36-9d22-855f8936eebb service nova] Creating event network-changed:98dc0177-6c8b-4f14-8fc8-8cecf04988bd for instance 86b88489-4f1c-4043-ab5c-79c6bbea188b on n-h1-854924-5 Aug 30 04:03:31.624448 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-87623707-5c89-486b-8bd4-45067f7465ce req-70725a0d-702c-4d36-9d22-855f8936eebb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113422 Aug 30 04:03:31.625925 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2919/5956] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:31.789746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:31.790701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:31.807695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:31.808225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:31.808769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:31.809487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:31.810176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:31.810799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:31.987169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:32.002306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c40fa36a-26b8-43c0-a3be-43985b6276f6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.211031 Aug 30 04:03:32.003222 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3038/5957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:31 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:32.410817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:32.412426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:32.420534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:32.421165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:32.421714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:32.422901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:32.424030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:32.426318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:32.602683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:32.610921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13683cbe-49a7-44a0-9188-2010a4e8fc65 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1472 microversion: 2.1 time: 0.204650 Aug 30 04:03:32.612522 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2920/5958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:32 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:33.026175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:33.026938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:33.039319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:33.045931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:33.047589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:33.048593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:33.049279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:33.049825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:33.332111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:33.346931 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-92d59269-476c-4309-8d9b-1c8ac72d1071 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.324518 Aug 30 04:03:33.348459 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3039/5959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:33 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:33.635925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:33.637898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:33.645536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:33.646041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:33.646519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:33.647825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:33.648548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:33.649496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:33.815191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:33.824403 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d40d75b-65d2-47fe-a829-2c7ffc665162 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1472 microversion: 2.1 time: 0.194137 Aug 30 04:03:33.830140 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2921/5960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:33 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:34.372625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:34.373240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:34.408202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:34.408710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:34.409151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:34.412665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:34.415434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:34.417853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:34.602616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:34.614031 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b29baf19-54f3-4c2b-8866-ae1c223aee5f tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.245865 Aug 30 04:03:34.617942 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3040/5961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:34 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:34.846097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:34.847637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:34.870374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:34.871533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:34.874470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:34.875423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:34.877984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:34.878573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:35.108705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:35.125089 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-778d4e47-7135-4eb9-8a76-e525ba975aed tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1472 microversion: 2.1 time: 0.283801 Aug 30 04:03:35.126412 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2922/5962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:34 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:35.384031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-84902c22-ec45-4744-ad0d-53aaaf348aff req-fff733af-1730-4f90-a8dd-cca7615b1d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9565d892-87ad-4888-b8bc-72972b1b619a", "name": "network-vif-plugged", "status": "completed", "tag": "5750e0f5-0e16-48e7-8589-5f01e26783bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:35.414659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-84902c22-ec45-4744-ad0d-53aaaf348aff req-fff733af-1730-4f90-a8dd-cca7615b1d33 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:35.418745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-84902c22-ec45-4744-ad0d-53aaaf348aff req-fff733af-1730-4f90-a8dd-cca7615b1d33 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:35.419738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-84902c22-ec45-4744-ad0d-53aaaf348aff req-fff733af-1730-4f90-a8dd-cca7615b1d33 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:35.455607 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-84902c22-ec45-4744-ad0d-53aaaf348aff req-fff733af-1730-4f90-a8dd-cca7615b1d33 service nova] Creating event network-vif-plugged:5750e0f5-0e16-48e7-8589-5f01e26783bb for instance 9565d892-87ad-4888-b8bc-72972b1b619a on n-h2-854924-5 Aug 30 04:03:35.463656 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-84902c22-ec45-4744-ad0d-53aaaf348aff req-fff733af-1730-4f90-a8dd-cca7615b1d33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084389 Aug 30 04:03:35.465288 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3041/5963] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:35.637855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:35.638485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:35.651475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:35.651991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:35.652867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:35.653608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:35.654331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:35.655094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:35.715778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=93 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.906731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.918419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:35.933227 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-357e1a4e-10e5-4848-804b-683ecec069db tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.294348 Aug 30 04:03:35.934073 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2923/5964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:35 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:36.148335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:36.149591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:36.159353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:36.160003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:36.160539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:36.161526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:36.162092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:36.162603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:36.340755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:36.352687 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c09821d-dd21-4379-a443-a31c295a7e1b tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1472 microversion: 2.1 time: 0.210334 Aug 30 04:03:36.353379 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3042/5965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:36 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:36.954898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:36.955535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:36.957494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=16 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:36.964012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:36.964949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:36.965626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:36.966529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:36.967156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:36.967751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.146033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:37.155076 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-63132799-2b64-45c3-a0f2-011e3d7b07a8 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.204612 Aug 30 04:03:37.169485 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2924/5966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:36 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:37.376622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:37.377941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:37.382787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:37.386753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.387512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.387954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.388656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.389108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.389559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.560302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:37.569289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-41a3a609-cdb4-426c-b98c-f7480b06f749 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1644 microversion: 2.1 time: 0.196763 Aug 30 04:03:37.570179 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3043/5967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:37 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1644 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:37.592092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:37.592953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:37.599384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.599950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.600400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.601421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.602053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.602485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.636052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1fabc779-e5f7-4720-9d0a-e6a5c5e02191 req-3c24b361-e7d9-4f46-a96e-e1e544e40ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b88489-4f1c-4043-ab5c-79c6bbea188b", "name": "network-vif-plugged", "status": "completed", "tag": "98dc0177-6c8b-4f14-8fc8-8cecf04988bd"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:37.669147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1fabc779-e5f7-4720-9d0a-e6a5c5e02191 req-3c24b361-e7d9-4f46-a96e-e1e544e40ef8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.672237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1fabc779-e5f7-4720-9d0a-e6a5c5e02191 req-3c24b361-e7d9-4f46-a96e-e1e544e40ef8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.674697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1fabc779-e5f7-4720-9d0a-e6a5c5e02191 req-3c24b361-e7d9-4f46-a96e-e1e544e40ef8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.698329 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1fabc779-e5f7-4720-9d0a-e6a5c5e02191 req-3c24b361-e7d9-4f46-a96e-e1e544e40ef8 service nova] Creating event network-vif-plugged:98dc0177-6c8b-4f14-8fc8-8cecf04988bd for instance 86b88489-4f1c-4043-ab5c-79c6bbea188b on n-h1-854924-5 Aug 30 04:03:37.706855 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1fabc779-e5f7-4720-9d0a-e6a5c5e02191 req-3c24b361-e7d9-4f46-a96e-e1e544e40ef8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074454 Aug 30 04:03:37.707796 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3044/5968] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:03:37.830763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:37.840293 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1456d298-4ceb-47a0-8a4c-71b2186056fd tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1644 microversion: 2.1 time: 0.252337 Aug 30 04:03:37.841234 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2925/5969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:37 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1644 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:37.862164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:37.863114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:37.870644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.871148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.871594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.872753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:37.873223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:37.873821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:37.878798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:38.149694 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-291fc09d-98ad-4b09-b26c-3089a8109516 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1795 microversion: 2.1 time: 0.292322 Aug 30 04:03:38.150389 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3045/5970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:37 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1795 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:38.178394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:38.179081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:38.187048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:38.187635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:38.188311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:38.189165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:38.189711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:38.190162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:38.418249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:38.426901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b64a8a9-2ba2-4458-bea7-11c70bde3ef5 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1374 microversion: 2.1 time: 0.254462 Aug 30 04:03:38.440889 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2926/5971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:38 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:39.449230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:39.450585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:39.461627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:39.462806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:39.464115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:39.465155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:39.465784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:39.466509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:40.130233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:40.138288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb7d0732-c91e-4c3b-a012-3890e24dbfe6 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1546 microversion: 2.1 time: 0.693535 Aug 30 04:03:40.153878 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3046/5972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:39 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1546 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:40.160897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:03:40.161610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:03:40.169988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:40.170493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:40.170938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:40.171655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:40.172125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:40.172557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:40.423297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:03:40.431439 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f93e731f-2ba0-427f-b0c5-6e6a9fc6da40 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1546 microversion: 2.1 time: 0.275004 Aug 30 04:03:40.432211 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2927/5973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:03:40 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:40.721816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e42e8644-f308-4d5d-85f7-795f5cbed347 req-73437a80-9984-46dd-9cea-8a8c45104b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9565d892-87ad-4888-b8bc-72972b1b619a", "tag": "5750e0f5-0e16-48e7-8589-5f01e26783bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:40.732932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e42e8644-f308-4d5d-85f7-795f5cbed347 req-73437a80-9984-46dd-9cea-8a8c45104b76 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:40.733659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e42e8644-f308-4d5d-85f7-795f5cbed347 req-73437a80-9984-46dd-9cea-8a8c45104b76 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:40.734249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e42e8644-f308-4d5d-85f7-795f5cbed347 req-73437a80-9984-46dd-9cea-8a8c45104b76 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:40.763913 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e42e8644-f308-4d5d-85f7-795f5cbed347 req-73437a80-9984-46dd-9cea-8a8c45104b76 service nova] Creating event network-changed:5750e0f5-0e16-48e7-8589-5f01e26783bb for instance 9565d892-87ad-4888-b8bc-72972b1b619a on n-h2-854924-5 Aug 30 04:03:40.769533 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e42e8644-f308-4d5d-85f7-795f5cbed347 req-73437a80-9984-46dd-9cea-8a8c45104b76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051265 Aug 30 04:03:40.770394 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3047/5974] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:03:42.850492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6bfc55e3-fa8b-427e-b9ac-cccea2a8e310 req-c5325315-af6d-4483-b62c-1833932b6909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b88489-4f1c-4043-ab5c-79c6bbea188b", "tag": "98dc0177-6c8b-4f14-8fc8-8cecf04988bd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:03:42.862405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6bfc55e3-fa8b-427e-b9ac-cccea2a8e310 req-c5325315-af6d-4483-b62c-1833932b6909 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:03:42.863239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6bfc55e3-fa8b-427e-b9ac-cccea2a8e310 req-c5325315-af6d-4483-b62c-1833932b6909 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:03:42.864058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6bfc55e3-fa8b-427e-b9ac-cccea2a8e310 req-c5325315-af6d-4483-b62c-1833932b6909 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:03:42.883702 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6bfc55e3-fa8b-427e-b9ac-cccea2a8e310 req-c5325315-af6d-4483-b62c-1833932b6909 service nova] Creating event network-changed:98dc0177-6c8b-4f14-8fc8-8cecf04988bd for instance 86b88489-4f1c-4043-ab5c-79c6bbea188b on n-h1-854924-5 Aug 30 04:03:42.889570 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6bfc55e3-fa8b-427e-b9ac-cccea2a8e310 req-c5325315-af6d-4483-b62c-1833932b6909 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044112 Aug 30 04:03:42.890826 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2928/5975] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:19.182381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:19.185474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:19.189273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=23 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.190458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=13 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.199373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:19.199870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:19.205316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:19.206667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:19.207611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:19.208798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:19.316047 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81523258-7e3f-4631-8c99-64d401798380 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b/action" status: 200 len: 24558 microversion: 2.1 time: 0.133608 Aug 30 04:04:19.321362 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3048/5976] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:04:19 2022] POST /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b/action => generated 24558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:21.939428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1849870641", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "7c2b9617-36f8-4ae3-82c3-79b5b224cf9a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1010609716", "security_groups": []}, "os:scheduler_hints": {"different_host": ["9565d892-87ad-4888-b8bc-72972b1b619a"]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:21.952099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=29 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.952678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=31 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.149737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] validate_networks() for [('7c2b9617-36f8-4ae3-82c3-79b5b224cf9a', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:04:22.673687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:04:22.674642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:04:22.674949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:04:22.675543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:04:22.676183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:04:22.688626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:22.689581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:22.690241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:22.691275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:22.691855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:22.692604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:22.720725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Getting quotas for project 43b6993ce60c4eada6d588e7fe67af52. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:04:22.727279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Getting quotas for user d35430b2c8454d81bbfa6d3e6ea8a5c9 and project 43b6993ce60c4eada6d588e7fe67af52. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:04:22.759164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:04:22.768466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:04:22.839984 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08ed936a-8c40-4a26-a0a3-709902ec6309 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.904769 Aug 30 04:04:22.841645 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2929/5977] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:04:21 2022] POST /compute/v2.1/servers => generated 361 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:04:22.853441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f4c5351-3086-4ed6-b6ad-a3d8f8f3be86 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:22.855037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f4c5351-3086-4ed6-b6ad-a3d8f8f3be86 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:23.040965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f4c5351-3086-4ed6-b6ad-a3d8f8f3be86 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:23.053312 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f4c5351-3086-4ed6-b6ad-a3d8f8f3be86 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1242 microversion: 2.1 time: 0.204807 Aug 30 04:04:23.054527 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3049/5978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:22 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:24.075139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:24.075850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:24.087868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:24.088377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:24.089041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:24.090030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:24.091375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:24.091996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:24.209875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:24.224310 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f9e2b17-7245-423d-a687-2d55b0bd7860 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1294 microversion: 2.1 time: 0.152437 Aug 30 04:04:24.239276 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2930/5979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:24 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:25.251101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:25.252520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:25.262866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:25.263728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:25.264377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:25.265300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:25.266005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:25.266770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:25.358588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:25.367501 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2bc0f6b-a3e4-47b3-8e8c-7bcf46489a1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.123084 Aug 30 04:04:25.368134 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3050/5980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:25 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:25.787942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ca86ca42-3a4e-4e7d-bad4-4195cdec5b2b req-31e3ca08-b1cf-48f3-a94e-65c11825bb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43b1019-a4f1-4f2b-88c4-47dde67a18e1", "tag": "1161789d-1937-43a8-8041-10789e802d4f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:25.803278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ca86ca42-3a4e-4e7d-bad4-4195cdec5b2b req-31e3ca08-b1cf-48f3-a94e-65c11825bb63 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:25.804039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ca86ca42-3a4e-4e7d-bad4-4195cdec5b2b req-31e3ca08-b1cf-48f3-a94e-65c11825bb63 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:25.804989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ca86ca42-3a4e-4e7d-bad4-4195cdec5b2b req-31e3ca08-b1cf-48f3-a94e-65c11825bb63 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:25.822434 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ca86ca42-3a4e-4e7d-bad4-4195cdec5b2b req-31e3ca08-b1cf-48f3-a94e-65c11825bb63 service nova] Creating event network-changed:1161789d-1937-43a8-8041-10789e802d4f for instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 on n-h1-854924-5 Aug 30 04:04:25.829278 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ca86ca42-3a4e-4e7d-bad4-4195cdec5b2b req-31e3ca08-b1cf-48f3-a94e-65c11825bb63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048762 Aug 30 04:04:25.830372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2931/5981] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:26.389574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:26.390189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:26.397396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:26.397887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:26.398325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:26.399018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:26.399466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:26.399884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:26.506131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:26.514599 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec23da72-6c31-47ab-8f37-1fba681e3260 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.128945 Aug 30 04:04:26.515175 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3051/5982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:26 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:27.537239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:27.537989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:27.544276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:27.544783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:27.545234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:27.545970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:27.546437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:27.546873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:27.629463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:27.638332 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c0e3e60-cd97-472d-bb98-bae2cf159e56 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.106649 Aug 30 04:04:27.639018 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2932/5983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:27 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:28.659183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:28.659811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:28.674262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:28.675508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:28.675954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:28.677264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:28.677766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:28.678194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:28.777927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:28.787565 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f314096-1763-489c-8391-505160c70756 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.132313 Aug 30 04:04:28.788731 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3052/5984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:28 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:29.809320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:29.810247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:29.817714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:29.818335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:29.819551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:29.820355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:29.821002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:29.821625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:29.917145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:29.927011 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7dd4318a-8365-4164-a47d-6810a504c79d tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.121417 Aug 30 04:04:29.928800 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2933/5985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:29 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:30.948245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:30.949127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:30.961609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:30.962323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:30.962942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:30.963775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:30.964318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:30.964862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:31.056924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:31.065654 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-687a72c1-321b-46e6-98c4-46dce9584146 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.121231 Aug 30 04:04:31.066648 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3053/5986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:30 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:31.980917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0fc88097-9faa-4fdf-b12f-f52fa9310406 req-a160a69a-3a11-4663-906f-e4ebb45122ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43b1019-a4f1-4f2b-88c4-47dde67a18e1", "name": "network-vif-plugged", "status": "completed", "tag": "1161789d-1937-43a8-8041-10789e802d4f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:31.994156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0fc88097-9faa-4fdf-b12f-f52fa9310406 req-a160a69a-3a11-4663-906f-e4ebb45122ed service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:31.995112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0fc88097-9faa-4fdf-b12f-f52fa9310406 req-a160a69a-3a11-4663-906f-e4ebb45122ed service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:31.995633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0fc88097-9faa-4fdf-b12f-f52fa9310406 req-a160a69a-3a11-4663-906f-e4ebb45122ed service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:32.008330 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0fc88097-9faa-4fdf-b12f-f52fa9310406 req-a160a69a-3a11-4663-906f-e4ebb45122ed service nova] Creating event network-vif-plugged:1161789d-1937-43a8-8041-10789e802d4f for instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 on n-h1-854924-5 Aug 30 04:04:32.013831 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0fc88097-9faa-4fdf-b12f-f52fa9310406 req-a160a69a-3a11-4663-906f-e4ebb45122ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036410 Aug 30 04:04:32.014795 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2934/5987] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:32.099618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:32.100243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:32.109039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:32.109571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:32.110217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:32.110936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:32.111438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:32.111872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:32.195568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:32.203438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3e4930d-a50f-4b73-b9c6-1e29ba565214 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.108527 Aug 30 04:04:32.204025 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3054/5988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:32 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:04:33.221380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.222337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.228368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:33.229578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:33.237284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:33.237848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:33.238299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:33.239794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:33.240204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:33.240671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:33.327662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:33.335824 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0a703828-94e9-44f4-a0a6-4636b924e875 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1300 microversion: 2.1 time: 0.115323 Aug 30 04:04:33.336421 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2935/5989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:33 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:34.357161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:34.357922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:34.360175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.367360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.367849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.368290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.368991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.369474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.369918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.461509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:34.470135 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bee1561c-8bc8-4244-beb8-4dc7efdb0ded tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1473 microversion: 2.1 time: 0.117060 Aug 30 04:04:34.470749 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3055/5990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:34 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1473 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:34.492343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:34.493146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:34.500565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.501076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.501594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.502316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.502786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.503231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.590199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:34.598391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb34e3de-c4fb-424e-8ebd-97df8b1038a1 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1473 microversion: 2.1 time: 0.110293 Aug 30 04:04:34.599028 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2936/5991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:34 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1473 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:34.618365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:34.619021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:34.625168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.625753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.626306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.627064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.627586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.628079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.711335 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7630f546-063d-4e3f-bc40-e036876cec66 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1624 microversion: 2.1 time: 0.097067 Aug 30 04:04:34.711911 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3056/5992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:34 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1624 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:34.733108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:34.734054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:34.743313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.744208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.745009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.745753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.746236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.746679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.887115 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eec9dbd7-d99e-47be-9410-b89bb5817000 tempest-TestSecurityGroupsBasicOps-977754638 tempest-TestSecurityGroupsBasicOps-977754638-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1913 microversion: 2.1 time: 0.160052 Aug 30 04:04:34.887697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2937/5993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:34 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1913 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:34.955542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:34.956280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:34.962473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.962973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.963394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.964084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:34.964534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:34.964953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:34.990580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:04:35.072086 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-249a04dc-2b6b-4daa-a504-ffb20fda34e2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 204 len: 0 microversion: 2.1 time: 0.119992 Aug 30 04:04:35.072716 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3057/5994] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:04:34 2022] DELETE /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:35.081744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:35.082375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:35.089572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:35.090084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:35.090536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:35.091260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:35.091725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:35.092435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:35.183751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:35.192826 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b322d467-70e6-4d26-a133-acb629044171 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1479 microversion: 2.1 time: 0.115492 Aug 30 04:04:35.193423 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2938/5995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:35 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1479 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:36.215196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:36.217009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:36.223902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:36.224387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:36.224822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:36.225568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:36.226026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:36.226480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:36.323121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:36.330955 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-380fa9cd-8136-41b7-8bd3-a88ed9eabbd0 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1479 microversion: 2.1 time: 0.120442 Aug 30 04:04:36.331531 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3058/5996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:36 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1479 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:37.318448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8cebd9df-2491-4a68-b354-2a941b6d2fb2 req-b8374e1b-5d43-4de8-9d0b-dea783fe94e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43b1019-a4f1-4f2b-88c4-47dde67a18e1", "name": "network-vif-deleted", "tag": "1161789d-1937-43a8-8041-10789e802d4f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:37.335177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8cebd9df-2491-4a68-b354-2a941b6d2fb2 req-b8374e1b-5d43-4de8-9d0b-dea783fe94e5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:37.335980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8cebd9df-2491-4a68-b354-2a941b6d2fb2 req-b8374e1b-5d43-4de8-9d0b-dea783fe94e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:37.337174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8cebd9df-2491-4a68-b354-2a941b6d2fb2 req-b8374e1b-5d43-4de8-9d0b-dea783fe94e5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:37.354680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:37.356396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:37.371521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:37.372441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:37.373105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:37.374264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:37.374997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:37.375631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:37.385499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8cebd9df-2491-4a68-b354-2a941b6d2fb2 req-b8374e1b-5d43-4de8-9d0b-dea783fe94e5 service nova] Creating event network-vif-deleted:1161789d-1937-43a8-8041-10789e802d4f for instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 on n-h1-854924-5 Aug 30 04:04:37.401086 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8cebd9df-2491-4a68-b354-2a941b6d2fb2 req-b8374e1b-5d43-4de8-9d0b-dea783fe94e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088162 Aug 30 04:04:37.405881 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2939/5997] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:37.458623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:37.467877 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-47e647a8-6501-4a34-bee9-883be85820a6 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 200 len: 1327 microversion: 2.1 time: 0.119596 Aug 30 04:04:37.468703 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3059/5998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:37 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:04:38.496260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:38.498780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: d43b1019-a4f1-4f2b-88c4-47dde67a18e1] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:38.514269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:38.515689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:38.516801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:38.518578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:38.519695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:38.520866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:38.545956 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] HTTP exception thrown: Instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 could not be found. Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Request method failure captured: Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 HTTP/1.1 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYv5xqOh-wof6gyb4qIMfNnVfkOgDBKqDuwILgbiD5tKA-t-Eo4ne5LVKLBxpkkTL84p2a4-ppvRr_xlyOJ1panGvBumnGTtHBfKsy69F7BKo9yCd4uQ8LoT8jTnTHPPPstoOitrki6suo8nhvKZ-l6Ahi44QH7tpRbB676GZDX7RA8 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 43b6993ce60c4eada6d588e7fe67af52 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1281858941 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43b6993ce60c4eada6d588e7fe67af52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43b6993ce60c4eada6d588e7fe67af52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43b6993ce60c4eada6d588e7fe67af52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43b6993ce60c4eada6d588e7fe67af52"}]}] Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1281858941 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 43b6993ce60c4eada6d588e7fe67af52 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1281858941 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestSecurityGroupsBasicOps-1281858941-project Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d35430b2c8454d81bbfa6d3e6ea8a5c9 Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1281858941-project Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 could not be found. Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'd43b1019-a4f1-4f2b-88c4-47dde67a18e1'} Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 could not be found. Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 could not be found. Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:38.547989 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 could not be found. Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Returning 404 to user: Instance d43b1019-a4f1-4f2b-88c4-47dde67a18e1 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ac36153-79fe-416b-bfba-3ee9d156fb1a tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1" status: 404 len: 111 microversion: 2.1 time: 0.066926 Aug 30 04:04:38.561646 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2940/5999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:38 2022] GET /compute/v2.1/servers/d43b1019-a4f1-4f2b-88c4-47dde67a18e1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:04:40.923617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:40.924179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:40.936380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:40.936876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:40.937316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:40.941452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:40.944506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:40.945161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.005585 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f307b077-2612-41a8-8486-a85f1711ce85 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/ips" status: 200 len: 149 microversion: 2.1 time: 0.080174 Aug 30 04:04:41.007259 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3060/6000] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 04:04:40 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/ips => generated 149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:41.017846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e650005a-d139-46bf-b56a-7548a967298c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:41.021836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:41.036505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:41.037398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:41.038018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.038973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:41.039603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:41.040213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.163431 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Invalid volume: volume e650005a-d139-46bf-b56a-7548a967298c is already attached to instances: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/os-volume_attachments HTTP/1.1 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 74 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: {"volumeAttachment": {"volumeId": "e650005a-d139-46bf-b56a-7548a967298c"}} Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid volume: volume e650005a-d139-46bf-b56a-7548a967298c is already attached to instances: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '4aa42eca-0fb4-4900-93b8-37fe3680acf5', 'body': {'volumeAttachment': {'volumeId': 'e650005a-d139-46bf-b56a-7548a967298c'}}} Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e650005a-d139-46bf-b56a-7548a967298c is already attached to instances: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:04:41.166046 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e650005a-d139-46bf-b56a-7548a967298c is already attached to instances: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e650005a-d139-46bf-b56a-7548a967298c is already attached to instances: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea Aug 30 04:04:41.170743 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:41.173237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 400 to user: Invalid volume: volume e650005a-d139-46bf-b56a-7548a967298c is already attached to instances: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:04:41.174649 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ad33f85-7107-414e-b311-ca01c3f1cbe7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161041 Aug 30 04:04:41.175901 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2941/6001] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:04:41 2022] POST /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:04:41.185681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:41.186602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:41.198751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:41.199587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:41.200232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.201777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:41.203183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:41.203932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.250585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:04:41.491146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-818111cf-122f-4422-8a38-73ead8f5265c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 204 len: 0 microversion: 2.1 time: 0.309822 Aug 30 04:04:41.491761 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3061/6002] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:04:41 2022] DELETE /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:04:41.500944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:41.501635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:41.517096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:41.517684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:41.518147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.521815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:41.522732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:41.523782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:41.698608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:41.713832 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-373a3e66-1052-450e-9604-732e4b074596 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1680 microversion: 2.1 time: 0.217014 Aug 30 04:04:41.714873 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2942/6003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:41 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:42.740432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:42.741371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:42.748358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:42.748975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:42.749543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:42.750507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:42.751179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:42.751705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:42.980482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:42.984897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.991681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d1d9e80c-123c-4a4b-8c09-dcbd7d4d29b0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1680 microversion: 2.1 time: 0.255498 Aug 30 04:04:42.992395 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3062/6004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:42 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:43.509729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:43.510874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:43.514135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-7afd64c8-6f26-4a7a-acdf-66b783c7307b req-38e5e8ae-45ac-4279-a6bf-3dbad200c433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9565d892-87ad-4888-b8bc-72972b1b619a", "tag": "5750e0f5-0e16-48e7-8589-5f01e26783bb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:43.522783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:43.526475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7afd64c8-6f26-4a7a-acdf-66b783c7307b req-38e5e8ae-45ac-4279-a6bf-3dbad200c433 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:43.527209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7afd64c8-6f26-4a7a-acdf-66b783c7307b req-38e5e8ae-45ac-4279-a6bf-3dbad200c433 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:43.527857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7afd64c8-6f26-4a7a-acdf-66b783c7307b req-38e5e8ae-45ac-4279-a6bf-3dbad200c433 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:43.534106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:43.534584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:43.535335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:43.536329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:43.536774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:43.542467 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-7afd64c8-6f26-4a7a-acdf-66b783c7307b req-38e5e8ae-45ac-4279-a6bf-3dbad200c433 service nova] Creating event network-changed:5750e0f5-0e16-48e7-8589-5f01e26783bb for instance 9565d892-87ad-4888-b8bc-72972b1b619a on n-h2-854924-5 Aug 30 04:04:43.548270 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-7afd64c8-6f26-4a7a-acdf-66b783c7307b req-38e5e8ae-45ac-4279-a6bf-3dbad200c433 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037938 Aug 30 04:04:43.549706 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3063/6005] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:04:43.584945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:04:43.696295 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5797b09d-76cb-4ebc-b08b-9586242499d2 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 204 len: 0 microversion: 2.1 time: 0.191011 Aug 30 04:04:43.698200 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2943/6006] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:04:43 2022] DELETE /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:43.712762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:43.716744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:43.730551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:43.731704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:43.732249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:43.733104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:43.733778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:43.734451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:44.013527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:44.015666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:44.016510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:44.023257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:44.024084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:44.024817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:44.025687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:44.026383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:44.026529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8970561a-7896-4e49-81f9-7baac433ad28 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1768 microversion: 2.1 time: 0.322616 Aug 30 04:04:44.037392 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3064/6007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:43 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1768 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:44.038182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:44.210173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:44.220836 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b56fa9f2-9b70-47da-bc66-7dde847df531 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 200 len: 1612 microversion: 2.1 time: 0.209481 Aug 30 04:04:44.223521 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2944/6008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:44 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 1612 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:44.439065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-41d12394-90a9-42e3-aaf4-2611bc0979b0 req-1a261288-7f89-46b5-ae98-7864ec2bdd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa42eca-0fb4-4900-93b8-37fe3680acf5", "name": "network-vif-deleted", "tag": "0cf4563d-a0fd-4918-bb9a-375b3635046a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:44.469437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-41d12394-90a9-42e3-aaf4-2611bc0979b0 req-1a261288-7f89-46b5-ae98-7864ec2bdd88 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:44.473818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-41d12394-90a9-42e3-aaf4-2611bc0979b0 req-1a261288-7f89-46b5-ae98-7864ec2bdd88 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:44.474295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-41d12394-90a9-42e3-aaf4-2611bc0979b0 req-1a261288-7f89-46b5-ae98-7864ec2bdd88 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:44.518143 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-41d12394-90a9-42e3-aaf4-2611bc0979b0 req-1a261288-7f89-46b5-ae98-7864ec2bdd88 service nova] Creating event network-vif-deleted:0cf4563d-a0fd-4918-bb9a-375b3635046a for instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 on n-h1-854924-5 Aug 30 04:04:44.527589 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-41d12394-90a9-42e3-aaf4-2611bc0979b0 req-1a261288-7f89-46b5-ae98-7864ec2bdd88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092091 Aug 30 04:04:44.544730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3065/6009] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:45.052356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:45.053727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:45.071441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:45.079753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:45.081153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:45.085288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:45.086855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:45.087519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:45.246409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:45.247071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:45.265804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:45.266068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:45.266516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:45.267246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:45.267707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:45.268287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:45.308686 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 HTTP/1.1 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '4aa42eca-0fb4-4900-93b8-37fe3680acf5'} Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:45.322080 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:04:45.326542 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6ab356fd-f39f-4d92-a800-b279ef2380dd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 404 len: 111 microversion: 2.1 time: 0.082593 Aug 30 04:04:45.327698 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3066/6010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:45 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:04:45.337203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d42eb89-11e8-4b16-9fd3-cdae215f83e7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '.version_select at 0x7f897a99a8b0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:45.382993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d42eb89-11e8-4b16-9fd3-cdae215f83e7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897592330" status: 202 len: 0 microversion: 2.1 time: 0.050678 Aug 30 04:04:45.383992 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3067/6011] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 04:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897592330 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:04:45.586016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35430b2c8454d81bbfa6d3e6ea8a5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b6993ce60c4eada6d588e7fe67af52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:45.599548 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e0ca2683-a4df-46c8-ab3e-95831873a4ff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 200 len: 1768 microversion: 2.1 time: 0.554036 Aug 30 04:04:45.606319 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2945/6012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:45 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 1768 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:46.478212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:46.478866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:46.487657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.488154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.488601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.495867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.496356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.496792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.546022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e0eeadaf-905f-4b1a-81bf-6a6b97b836be req-d69a5386-93fb-44f3-9ae1-15fe72be27cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9565d892-87ad-4888-b8bc-72972b1b619a", "name": "network-vif-deleted", "tag": "5750e0f5-0e16-48e7-8589-5f01e26783bb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:46.557497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e0eeadaf-905f-4b1a-81bf-6a6b97b836be req-d69a5386-93fb-44f3-9ae1-15fe72be27cc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.557990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e0eeadaf-905f-4b1a-81bf-6a6b97b836be req-d69a5386-93fb-44f3-9ae1-15fe72be27cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.558448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e0eeadaf-905f-4b1a-81bf-6a6b97b836be req-d69a5386-93fb-44f3-9ae1-15fe72be27cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.571205 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e0eeadaf-905f-4b1a-81bf-6a6b97b836be req-d69a5386-93fb-44f3-9ae1-15fe72be27cc service nova] Creating event network-vif-deleted:5750e0f5-0e16-48e7-8589-5f01e26783bb for instance 9565d892-87ad-4888-b8bc-72972b1b619a on n-h2-854924-5 Aug 30 04:04:46.576600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e0eeadaf-905f-4b1a-81bf-6a6b97b836be req-d69a5386-93fb-44f3-9ae1-15fe72be27cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Aug 30 04:04:46.577662 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2946/6013] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:46.592072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lazy-loading 'services' on Instance uuid 5579e2c3-da3a-4aa1-85ab-ce76724c91ea {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:04:46.628938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:46.628938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] [instance: 9565d892-87ad-4888-b8bc-72972b1b619a] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:46.641999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.643309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.644258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.646321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.647002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.647800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.681160 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] HTTP exception thrown: Instance 9565d892-87ad-4888-b8bc-72972b1b619a could not be found. Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Request method failure captured: Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a HTTP/1.1 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYv5xqOh-wof6gyb4qIMfNnVfkOgDBKqDuwILgbiD5tKA-t-Eo4ne5LVKLBxpkkTL84p2a4-ppvRr_xlyOJ1panGvBumnGTtHBfKsy69F7BKo9yCd4uQ8LoT8jTnTHPPPstoOitrki6suo8nhvKZ-l6Ahi44QH7tpRbB676GZDX7RA8 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 43b6993ce60c4eada6d588e7fe67af52 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1281858941 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43b6993ce60c4eada6d588e7fe67af52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43b6993ce60c4eada6d588e7fe67af52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43b6993ce60c4eada6d588e7fe67af52", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43b6993ce60c4eada6d588e7fe67af52"}]}] Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1281858941 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 43b6993ce60c4eada6d588e7fe67af52 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1281858941 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestSecurityGroupsBasicOps-1281858941-project Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: d35430b2c8454d81bbfa6d3e6ea8a5c9 Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1281858941-project Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 9565d892-87ad-4888-b8bc-72972b1b619a could not be found. Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '9565d892-87ad-4888-b8bc-72972b1b619a'} Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9565d892-87ad-4888-b8bc-72972b1b619a could not be found. Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9565d892-87ad-4888-b8bc-72972b1b619a could not be found. Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:46.683425 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9565d892-87ad-4888-b8bc-72972b1b619a could not be found. Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:04:46.690097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Returning 404 to user: Instance 9565d892-87ad-4888-b8bc-72972b1b619a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:04:46.691734 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8fc2072-71ec-4f0c-b633-1bdeddb48cd5 tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a" status: 404 len: 111 microversion: 2.1 time: 0.066246 Aug 30 04:04:46.691734 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2947/6014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:46 2022] GET /compute/v2.1/servers/9565d892-87ad-4888-b8bc-72972b1b619a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:04:46.754229 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-92e19b57-8caa-4622-870a-fe893b22c64a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments/e650005a-d139-46bf-b56a-7548a967298c" status: 202 len: 0 microversion: 2.1 time: 0.280628 Aug 30 04:04:46.755790 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3068/6015] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:04:46 2022] DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments/e650005a-d139-46bf-b56a-7548a967298c => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:04:46.772661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:46.778881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:46.789836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.792144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.792704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.793583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:46.794155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:46.794680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:46.821606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:46.847713 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a0bb2941-d311-4b4e-85ef-9e45176f43a6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084839 Aug 30 04:04:46.848727 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2948/6016] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:46 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:47.864168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:47.867182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:47.874377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:47.874860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:47.875489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:47.876520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:47.877126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:47.877728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:47.913746 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-578133e5-e313-462c-8b4e-fcf38be0ac9a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056575 Aug 30 04:04:47.915222 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3069/6017] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:47 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:48.935008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:48.937560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:48.951210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:48.951775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:48.952226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:48.953253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:48.954339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:48.955248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:49.013268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b11d30c1-8059-4aa8-83d1-fc9ecef5c8c2 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085685 Aug 30 04:04:49.013921 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2949/6018] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:48 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:50.031842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:50.040389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:50.046913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:50.071209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:50.072260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:50.073329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:50.074741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:50.075639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:50.076243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:50.150399 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-04ffb843-8f68-4adc-9b64-0db61ece0535 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126866 Aug 30 04:04:50.153651 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3070/6019] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:50 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:04:51.166719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:51.169591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:51.189090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:51.189639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:51.190212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:51.193963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:51.194488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:51.194973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:51.261062 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c40091d1-8434-404e-8ffe-45b5d80ece6d tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099376 Aug 30 04:04:51.271559 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2950/6020] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:51 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:52.123117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ccdc3c5f-f2bb-4357-8d30-de8d76560aff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] Calling method '.version_select at 0x7f897b8b6550>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:52.150720 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ccdc3c5f-f2bb-4357-8d30-de8d76560aff tempest-TestSecurityGroupsBasicOps-1281858941 tempest-TestSecurityGroupsBasicOps-1281858941-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1010609716" status: 202 len: 0 microversion: 2.1 time: 0.031374 Aug 30 04:04:52.151513 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3071/6021] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 04:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1010609716 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:04:52.283445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:52.285772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:52.301963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.305616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:52.307132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:52.308221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:52.310573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:52.311984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:52.312982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:52.412841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-717fc97f-c8b0-4c9e-ac24-c9401dc9e652 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133384 Aug 30 04:04:52.414149 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2951/6022] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:52 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:53.429990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:53.433033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:53.443255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:53.443845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:53.444322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:53.445094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:53.445695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:53.447113 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:53.482424 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81d88230-3ca1-424e-8711-459c54a4845c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059761 Aug 30 04:04:53.483428 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3072/6023] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:04:53 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:04:53.562393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:53.563039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:53.571865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:53.572514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:53.572973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:53.573978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:53.574640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:53.575078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:53.615071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:04:53.747591 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea29a0a5-ce96-46b4-ae92-79680f8de383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 204 len: 0 microversion: 2.1 time: 0.188680 Aug 30 04:04:53.748378 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2952/6024] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:04:53 2022] DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:53.758802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:53.759874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:53.768309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:53.771772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:53.771772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:53.771772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:53.772405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:53.772941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:54.045275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:54.053914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3de57c2b-1406-44e9-b5d8-6f6e4dd0f323 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1683 microversion: 2.1 time: 0.299654 Aug 30 04:04:54.054834 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3073/6025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:53 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1683 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:55.077034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:55.077821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:55.088307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:55.088838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:55.089574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:55.090323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:55.090807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:55.091289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:55.266557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:55.276251 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c21b3e7b-b653-427e-a493-b0219a67114b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1683 microversion: 2.1 time: 0.203736 Aug 30 04:04:55.276986 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2953/6026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:55 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:56.298532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:56.299130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:56.310796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:56.311194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:56.312158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:56.312365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:56.312789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:56.313208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:56.419186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:56.427989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f163a07f-4993-475d-b8c7-ead451708069 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1615 microversion: 2.1 time: 0.133349 Aug 30 04:04:56.428730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3074/6027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:56 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1615 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:56.731474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-dac42b02-ea69-44fc-96b7-4323ead2355c req-87860842-00db-4fde-aaa9-1f096d19ffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5579e2c3-da3a-4aa1-85ab-ce76724c91ea", "name": "network-vif-deleted", "tag": "b405fed1-bd5b-4351-8e00-1c3380fb1a2e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:56.762420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dac42b02-ea69-44fc-96b7-4323ead2355c req-87860842-00db-4fde-aaa9-1f096d19ffa3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:56.763455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dac42b02-ea69-44fc-96b7-4323ead2355c req-87860842-00db-4fde-aaa9-1f096d19ffa3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:56.774512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dac42b02-ea69-44fc-96b7-4323ead2355c req-87860842-00db-4fde-aaa9-1f096d19ffa3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:56.789316 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-dac42b02-ea69-44fc-96b7-4323ead2355c req-87860842-00db-4fde-aaa9-1f096d19ffa3 service nova] Creating event network-vif-deleted:b405fed1-bd5b-4351-8e00-1c3380fb1a2e for instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea on n-h1-854924-5 Aug 30 04:04:56.796735 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-dac42b02-ea69-44fc-96b7-4323ead2355c req-87860842-00db-4fde-aaa9-1f096d19ffa3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077716 Aug 30 04:04:56.798052 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2954/6028] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:04:57.456724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:57.458313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:57.486925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:57.492927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:57.493765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:57.494820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:57.501683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:57.505053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:57.596355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:57.597665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:57.603295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:57.604579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lazy-loading 'fault' on Instance uuid 5579e2c3-da3a-4aa1-85ab-ce76724c91ea {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:04:57.684297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:04:57.695173 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b0d67103-0f71-41d6-a0e6-5baea2cff6fc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 200 len: 1331 microversion: 2.1 time: 0.249553 Aug 30 04:04:57.699386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3075/6029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:57 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 1331 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:58.415522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:04:58.418878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:58.431623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:58.432379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:58.443225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:58.444430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:58.445094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:58.452415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:58.539962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bd998da8-c1d0-4326-b5c0-e8d9b9ea00a9 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "POST /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b/action" status: 200 len: 32629 microversion: 2.1 time: 0.129187 Aug 30 04:04:58.540654 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2955/6030] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:04:58 2022] POST /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b/action => generated 32629 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:58.726686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:58.727408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:04:58.735424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:58.736412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:58.737277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:58.738705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:04:58.739191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:04:58.739855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:04:58.763962 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea HTTP/1.1 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '5579e2c3-da3a-4aa1-85ab-ce76724c91ea'} Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:04:58.767205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:04:58.772802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:04:58.773455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df698873-34c3-43ed-b53b-0111a4c106bc tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 404 len: 111 microversion: 2.1 time: 0.050485 Aug 30 04:04:58.776036 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3076/6031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:04:58 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:04:58.783629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-901b4209-1e27-4d9d-a4bc-44d57705aed3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '.version_select at 0x7f897a6d3790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:04:58.811988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-901b4209-1e27-4d9d-a4bc-44d57705aed3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669644068" status: 202 len: 0 microversion: 2.1 time: 0.033368 Aug 30 04:04:58.812942 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2956/6032] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 04:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669644068 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:05:00.634912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:00.636027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:00.645310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-098176d1-6780-46e5-86d3-1c7f64f4330a req-8e27b1ef-dbd4-4ec2-824e-a53cb5cf02b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b88489-4f1c-4043-ab5c-79c6bbea188b", "tag": "98dc0177-6c8b-4f14-8fc8-8cecf04988bd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:00.653696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:00.657737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:00.658523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:00.659663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:00.660156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:00.661700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:00.672551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-098176d1-6780-46e5-86d3-1c7f64f4330a req-8e27b1ef-dbd4-4ec2-824e-a53cb5cf02b1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:00.675470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-098176d1-6780-46e5-86d3-1c7f64f4330a req-8e27b1ef-dbd4-4ec2-824e-a53cb5cf02b1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:00.677742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-098176d1-6780-46e5-86d3-1c7f64f4330a req-8e27b1ef-dbd4-4ec2-824e-a53cb5cf02b1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:00.714040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:05:00.717954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-098176d1-6780-46e5-86d3-1c7f64f4330a req-8e27b1ef-dbd4-4ec2-824e-a53cb5cf02b1 service nova] Creating event network-changed:98dc0177-6c8b-4f14-8fc8-8cecf04988bd for instance 86b88489-4f1c-4043-ab5c-79c6bbea188b on n-h1-854924-5 Aug 30 04:05:00.730557 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-098176d1-6780-46e5-86d3-1c7f64f4330a req-8e27b1ef-dbd4-4ec2-824e-a53cb5cf02b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089521 Aug 30 04:05:00.736497 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2957/6033] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:05:00.883406 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f2698629-0444-40b2-bc2f-bfbf8ef3a084 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "DELETE /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 204 len: 0 microversion: 2.1 time: 0.258126 Aug 30 04:05:00.884557 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3077/6034] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:05:00 2022] DELETE /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:05:00.894876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:00.897127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:00.914793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:00.915341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:00.915812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:00.916568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:00.918472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:00.920317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:01.748682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:01.759215 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ca44d4d-a9dc-405f-9e70-b5d3c52ff81e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1671 microversion: 2.1 time: 0.868788 Aug 30 04:05:01.759728 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2958/6035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:00 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1671 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:01.930784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1f4fca02-336e-45d4-a233-e214eee47b4f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: .version_select at 0x7f897a99aa60>, body: {"keypair": {"name": "tempest-keypair-1304910321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1fbcPBo0DCfi4ZNMXxl9dSjl+QPxjmlX+cZuvTZLQZJ2dlsMDDRH1Sn7Tse8oBao57AvnAAqic7Zv5jdCESVW93KL0441dZ9obLc9RYeeqGFPY8XP0CkBw00Jbz9lawA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:01.964629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1f4fca02-336e-45d4-a233-e214eee47b4f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:01.996646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-1f4fca02-336e-45d4-a233-e214eee47b4f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:02.063146 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1f4fca02-336e-45d4-a233-e214eee47b4f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179970 Aug 30 04:05:02.064144 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3078/6036] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:05:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:02.799110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:02.799850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:02.830305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:02.831340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:02.832641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:02.834450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:02.835302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:02.836176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:03.378960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:03.389199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b377628-1cd6-4efc-9474-fe95214f6e7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1671 microversion: 2.1 time: 0.596805 Aug 30 04:05:03.403907 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2959/6037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:02 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1671 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:04.024659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f65d6b9-6ae2-4260-983a-b3d3fc197014 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: .version_select at 0x7f897be115e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1772362557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTRnRyY96GRZIudvwAeUt4c5H8zqEuRzs5fM1PndEVQlh9sAcYNQ/KnGUJd1jF2QgbTrZKKfumBy82Z/+LEQmgjllkomnC5yMty48FEWrg6FJS8iHHx9Ngy0SLBYBicAw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:04.047594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-6f65d6b9-6ae2-4260-983a-b3d3fc197014 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:04.056161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-6f65d6b9-6ae2-4260-983a-b3d3fc197014 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:04.091757 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f65d6b9-6ae2-4260-983a-b3d3fc197014 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.331446 Aug 30 04:05:04.092509 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3079/6038] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:05:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:05:04.132872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-573fe9f6-d82a-4cfa-b6ae-77a75c49bb39 req-c116614b-f37b-4c70-8ff9-d69b013bf359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b88489-4f1c-4043-ab5c-79c6bbea188b", "name": "network-vif-deleted", "tag": "98dc0177-6c8b-4f14-8fc8-8cecf04988bd"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:04.157073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-573fe9f6-d82a-4cfa-b6ae-77a75c49bb39 req-c116614b-f37b-4c70-8ff9-d69b013bf359 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:04.158125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-573fe9f6-d82a-4cfa-b6ae-77a75c49bb39 req-c116614b-f37b-4c70-8ff9-d69b013bf359 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:04.159042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-573fe9f6-d82a-4cfa-b6ae-77a75c49bb39 req-c116614b-f37b-4c70-8ff9-d69b013bf359 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:04.180572 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-573fe9f6-d82a-4cfa-b6ae-77a75c49bb39 req-c116614b-f37b-4c70-8ff9-d69b013bf359 service nova] Creating event network-vif-deleted:98dc0177-6c8b-4f14-8fc8-8cecf04988bd for instance 86b88489-4f1c-4043-ab5c-79c6bbea188b on n-h1-854924-5 Aug 30 04:05:04.199217 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-573fe9f6-d82a-4cfa-b6ae-77a75c49bb39 req-c116614b-f37b-4c70-8ff9-d69b013bf359 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073408 Aug 30 04:05:04.201014 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2960/6039] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:04.412427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:04.414031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:04.421792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:04.423382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:04.424306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:04.425285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:04.426052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:04.426701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:04.533729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:04.534302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:04.536077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:04.536927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lazy-loading 'fault' on Instance uuid 86b88489-4f1c-4043-ab5c-79c6bbea188b {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:05:04.678293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f8a2b059de406aa1d02936b4e0dbe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd212588e912641c6bdf0f50e15ca2519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:04.693406 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82035f70-a3f5-400f-a465-60deebf393ba tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 200 len: 1338 microversion: 2.1 time: 0.284152 Aug 30 04:05:04.712331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3080/6040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:04 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 1338 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:05.524562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1980908706", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6ec5b19-fb85-4e4b-a816-8856b9dda964"}], "security_groups": [{"name": "tempest-securitygroup--894231154"}], "key_name": "tempest-keypair-1304910321", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:05.711258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] validate_networks() for [('c6ec5b19-fb85-4e4b-a816-8856b9dda964', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:05:05.718844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:05.720150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] [instance: 86b88489-4f1c-4043-ab5c-79c6bbea188b] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:05.728368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:05.729121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:05.729821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:05.730763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:05.731431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:05.732068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:05.751437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] HTTP exception thrown: Instance 86b88489-4f1c-4043-ab5c-79c6bbea188b could not be found. Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Request method failure captured: Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b HTTP/1.1 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYtcXWzT_h6rHtabWmTPJkhSRJdORiJgSy1NePHWpdNu36l3UhiAfEyYR8McH7ekV2NO8v50J5yQmt71BxgRFCGsIbFHZBw7XNgclgHe1u1bjVI9B0P3PLNsEWPl6r2Z_KdKMnxxHg_VxRUw5FhiQ_EXqkZ1zYH8SB3Iw7YmS1i_r5k Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d212588e912641c6bdf0f50e15ca2519 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d212588e912641c6bdf0f50e15ca2519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d212588e912641c6bdf0f50e15ca2519"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d212588e912641c6bdf0f50e15ca2519", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d212588e912641c6bdf0f50e15ca2519"}]}] Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d212588e912641c6bdf0f50e15ca2519 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkBasicOps-1943470822 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkBasicOps-1943470822-project Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: b2f8a2b059de406aa1d02936b4e0dbe3 Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkBasicOps-1943470822-project Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 86b88489-4f1c-4043-ab5c-79c6bbea188b could not be found. Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '86b88489-4f1c-4043-ab5c-79c6bbea188b'} Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b88489-4f1c-4043-ab5c-79c6bbea188b could not be found. Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b88489-4f1c-4043-ab5c-79c6bbea188b could not be found. Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:05:05.753324 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b88489-4f1c-4043-ab5c-79c6bbea188b could not be found. Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Returning 404 to user: Instance 86b88489-4f1c-4043-ab5c-79c6bbea188b could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b84c4e8e-9e33-43eb-9a37-be7901769a7e tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b" status: 404 len: 111 microversion: 2.1 time: 0.041196 Aug 30 04:05:05.760569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3081/6041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:05 2022] GET /compute/v2.1/servers/86b88489-4f1c-4043-ab5c-79c6bbea188b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:05:05.982970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9b13ac5a-23de-43eb-b9a9-e01d26fcd1f7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] Calling method '.version_select at 0x7f8983d54a60>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:06.012968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9b13ac5a-23de-43eb-b9a9-e01d26fcd1f7 tempest-TestNetworkBasicOps-1943470822 tempest-TestNetworkBasicOps-1943470822-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1398495440" status: 202 len: 0 microversion: 2.1 time: 0.034730 Aug 30 04:05:06.014252 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3082/6042] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Aug 30 04:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1398495440 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:05:06.706640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:05:06.709387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:05:06.710536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:05:06.710837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:05:06.711331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:05:06.724201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:06.725002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:06.726579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:06.729465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:06.730315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:06.732748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:06.763872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:06.774325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:06.791252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:05:06.796467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:05:06.911177 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-769440c6-0f5a-46b2-8838-d3fca53e9327 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.392130 Aug 30 04:05:06.914130 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2961/6043] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:05:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:05:06.924330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c8ee04f-efed-4bb5-adc2-5a77f06596a5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:06.925516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6c8ee04f-efed-4bb5-adc2-5a77f06596a5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:07.656819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6c8ee04f-efed-4bb5-adc2-5a77f06596a5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:07.669756 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6c8ee04f-efed-4bb5-adc2-5a77f06596a5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1242 microversion: 2.1 time: 0.750568 Aug 30 04:05:07.670854 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3083/6044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:06 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1242 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:08.693199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:08.694640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:08.701911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:08.702749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:08.703425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:08.704453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:08.705152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:08.705936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:08.867318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:08.889866 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bac8e4b7-db9f-4583-b94c-ce8d456d0aae tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1302 microversion: 2.1 time: 0.201636 Aug 30 04:05:08.904221 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2962/6045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:08 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:09.912717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:09.913336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:09.920847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:09.921684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:09.922285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:09.923157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:09.923772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:09.924393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:10.257270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:10.285360 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc4d024d-045c-4ec8-9e1a-3a6d2223e3be tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1300 microversion: 2.1 time: 0.375047 Aug 30 04:05:10.287057 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3084/6046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:09 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1300 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:10.694324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:10.695401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:10.711720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:10.712547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:10.713009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:10.713778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:10.714410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:10.715000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:10.759069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:05:10.869088 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cba79676-c3d8-4f8d-8656-1dc2cc5f7fea tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 204 len: 0 microversion: 2.1 time: 0.178382 Aug 30 04:05:10.870163 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2963/6047] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:05:10 2022] DELETE /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:05:10.878540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:10.880006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:10.886604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:10.887187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:10.887718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:10.888613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:10.889076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:10.889545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:11.308108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:11.308823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:11.315048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:11.315832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:11.316954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:11.317882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:11.318355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:11.318790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:11.799278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:11.803087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:11.809397 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45c0a9de-775b-4de9-9f39-dc46944caf47 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1574 microversion: 2.1 time: 0.934832 Aug 30 04:05:11.809990 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3085/6048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:10 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1574 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:11.888493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:11.914699 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3c0cd2f3-fcb8-44b0-bde8-26eeae435785 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.610400 Aug 30 04:05:11.916725 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2964/6049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:11 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:12.831606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:12.833456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:12.849991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:12.850910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:12.851741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:12.853494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:12.854967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:12.855703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:12.947092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:12.949207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:12.965186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:12.967931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:12.968416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:12.969147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:12.969658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:12.972562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:13.312601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:13.324308 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8232b7e9-b672-41bb-b2c9-57942e058b2d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1574 microversion: 2.1 time: 0.497618 Aug 30 04:05:13.324931 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3086/6050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:12 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1574 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:13.485227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:13.490112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:13.501100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-71d00b86-ae9b-4ef1-a82e-579fbd00162e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.562062 Aug 30 04:05:13.506008 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2965/6051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:12 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:13.595389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3d5e16a6-6c7c-4bc2-b12c-4b7265bff175 req-5a25729c-57a2-409a-9b81-58ea82efdb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c609049-48cc-4023-b502-230aeaff791e", "tag": "a3503f39-47b8-4189-afe4-dd248d086f01"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:13.615419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5e16a6-6c7c-4bc2-b12c-4b7265bff175 req-5a25729c-57a2-409a-9b81-58ea82efdb49 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:13.617919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5e16a6-6c7c-4bc2-b12c-4b7265bff175 req-5a25729c-57a2-409a-9b81-58ea82efdb49 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:13.622325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3d5e16a6-6c7c-4bc2-b12c-4b7265bff175 req-5a25729c-57a2-409a-9b81-58ea82efdb49 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:13.644317 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3d5e16a6-6c7c-4bc2-b12c-4b7265bff175 req-5a25729c-57a2-409a-9b81-58ea82efdb49 service nova] Creating event network-changed:a3503f39-47b8-4189-afe4-dd248d086f01 for instance 0c609049-48cc-4023-b502-230aeaff791e on n-h1-854924-5 Aug 30 04:05:13.664911 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3d5e16a6-6c7c-4bc2-b12c-4b7265bff175 req-5a25729c-57a2-409a-9b81-58ea82efdb49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079454 Aug 30 04:05:13.665867 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3087/6052] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:14.352058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:14.352675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:14.373334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:14.373873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:14.376467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:14.379572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:14.380127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:14.380574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:14.532671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:14.533437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:14.548933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:14.549475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:14.549919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:14.550676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:14.551200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:14.551628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:14.710666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:14.735687 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ae8c7e6b-33aa-4e8b-a8cf-bcc7013a3d60 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1507 microversion: 2.1 time: 0.389932 Aug 30 04:05:14.739521 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2966/6053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:14 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:15.197757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d9e293b4-9699-45f4-bf0f-25ef10c432ff req-5781b935-361c-4843-96b8-f18cfda28ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd84d9b-3ccd-4caf-a46a-84b6254819e2", "name": "network-vif-deleted", "tag": "3767254f-e4e0-4026-a8a3-3c15337ceb57"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:15.268842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d9e293b4-9699-45f4-bf0f-25ef10c432ff req-5781b935-361c-4843-96b8-f18cfda28ed1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:15.270217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d9e293b4-9699-45f4-bf0f-25ef10c432ff req-5781b935-361c-4843-96b8-f18cfda28ed1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:15.270698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d9e293b4-9699-45f4-bf0f-25ef10c432ff req-5781b935-361c-4843-96b8-f18cfda28ed1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:15.331706 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d9e293b4-9699-45f4-bf0f-25ef10c432ff req-5781b935-361c-4843-96b8-f18cfda28ed1 service nova] Creating event network-vif-deleted:3767254f-e4e0-4026-a8a3-3c15337ceb57 for instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 on n-h2-854924-5 Aug 30 04:05:15.343337 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d9e293b4-9699-45f4-bf0f-25ef10c432ff req-5781b935-361c-4843-96b8-f18cfda28ed1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160648 Aug 30 04:05:15.349536 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2967/6054] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:05:15.552436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:15.565598 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ba7174a-725b-4946-83d8-06abc49c1e79 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 1.038824 Aug 30 04:05:15.568283 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3088/6055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:14 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:15.776009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:15.781000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:15.834860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:15.849484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:15.851851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:15.859452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:15.860761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:15.861228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:16.137675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:16.153955 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69ee07bb-fb99-4014-bc6a-4e0b77ec8947 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1224 microversion: 2.1 time: 0.393263 Aug 30 04:05:16.154782 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2968/6056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:15 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1224 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:16.589190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:16.590070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:16.601540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:16.602136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:16.602663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:16.604448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:16.605557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:16.605997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:17.068956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:17.086636 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e90d139-3258-44f3-bacc-1c59590f8645 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.499866 Aug 30 04:05:17.110411 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3089/6057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:16 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:17.172171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:17.172978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:17.178474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:17.179109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:17.197636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:17.198150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:17.198608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:17.199375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:17.199843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:17.200280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:17.398824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:17.425510 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5b3dfdab-7e15-4830-bf15-18ffab37f450 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1224 microversion: 2.1 time: 0.236964 Aug 30 04:05:17.428685 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2969/6058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:17 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1224 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:18.117924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:18.118709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:18.121840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=10 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:18.132492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:18.133406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:18.134066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:18.135293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:18.135961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:18.136624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:18.440385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:18.448670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:18.449958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:18.468493 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3e86f051-d3de-4321-9f27-ad9999777f6e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.354841 Aug 30 04:05:18.469101 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3090/6059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:18 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:18.473494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:18.474015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:18.474469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:18.475201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:18.475674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:18.476119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:18.710076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:18.721176 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a31f5abe-c92e-4d0f-9b6f-e556306e02db tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1224 microversion: 2.1 time: 0.276380 Aug 30 04:05:18.724167 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2970/6060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:18 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1224 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:19.155631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a911e35-fbd3-430c-95c5-6daed7e50b11 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Action: 'create', calling method: .version_select at 0x7f897ba32040>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1532287498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3bLvDMDbtXOva0W84NgGu0a7/cKljr3+bJnkSqcOtxnVFKTgEv8k0W4cIyQXh5OpCHyQeO/CMv9xspdhuy4rlhISnb9igEw2YGzl6GofY+6Z/jZOEUb3XwnpNCMtgPJQ=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:19.188866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-8a911e35-fbd3-430c-95c5-6daed7e50b11 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Getting quotas for project 2ab0f10e3ac84795a9309e9e59e89389. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:19.202703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-8a911e35-fbd3-430c-95c5-6daed7e50b11 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Getting quotas for user cf441c81ca6846829c715d3354b40305 and project 2ab0f10e3ac84795a9309e9e59e89389. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:19.268789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a911e35-fbd3-430c-95c5-6daed7e50b11 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.477865 Aug 30 04:05:19.271337 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3091/6061] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:05:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:19.489619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:19.490445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:19.504781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:19.508019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:19.508778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:19.509841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:19.515261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:19.521337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:19.760684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:19.762641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:19.776400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:19.780860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:19.783822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:19.789609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:19.790322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:19.791774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:20.159132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:20.169537 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ab459b8-4558-468d-81da-51e193966724 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1224 microversion: 2.1 time: 0.425891 Aug 30 04:05:20.175374 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3092/6062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:19 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1224 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:20.355260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:20.369494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1accba20-520a-4185-a5a5-b393bf52538f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.883795 Aug 30 04:05:20.371495 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2971/6063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:19 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:21.204404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:21.206581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:21.218716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:21.234557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:21.238130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:21.238824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:21.239636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:21.240118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:21.243852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:21.395883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:21.396572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:21.417697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:21.419911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:21.426576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:21.428101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:21.428826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:21.429465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:22.265979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:22.274208 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-373eefb7-2339-4c33-a743-941dcca4885c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 200 len: 1224 microversion: 2.1 time: 1.077409 Aug 30 04:05:22.274807 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3093/6064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:21 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 1224 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:22.299882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-321118747", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "40e4f8f1-a707-486c-8587-37319134ba73"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1772362557", "security_groups": [{"name": "tempest-secgroup-smoke-2111223224"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:22.684683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] validate_networks() for [('40e4f8f1-a707-486c-8587-37319134ba73', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:05:22.941861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:22.965613 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31cf274c-60d7-4a54-af82-5607c16171b5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 1.570511 Aug 30 04:05:22.968106 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2972/6065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:21 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:22.996611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-910748797", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1532287498", "security_groups": [{"name": "tempest-secgroup-smoke-1097781977"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "10866d6a-e17e-47fc-920c-96f482e3fa4e"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:23.022109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:23.377391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] validate_networks() for [('10866d6a-e17e-47fc-920c-96f482e3fa4e', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:05:24.340112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:05:24.341215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:05:24.341943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:05:24.342593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:05:24.343273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:05:24.373983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:24.374952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:24.375704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:24.376702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:24.377571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:24.378244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:24.416589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:24.423650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:24.463252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:05:24.469852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:05:24.590589 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc79eb19-2cac-4f27-85c5-0f04b2be69b3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.294724 Aug 30 04:05:24.591368 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3094/6066] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:05:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:05:24.610256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:24.612163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:24.629261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:24.631580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:24.633201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:24.635880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:24.637856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:24.638553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:24.685305 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 HTTP/1.1 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0dd84d9b-3ccd-4caf-a46a-84b6254819e2'} Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:05:24.691127 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:05:24.695916 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:05:24.697805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:05:24.700556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-94135f04-c9d6-489e-9bd1-c0c6ccf177cb tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 404 len: 111 microversion: 2.1 time: 0.099326 Aug 30 04:05:24.702330 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3095/6067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:24 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:05:24.717851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:24.719666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:24.734461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:24.736561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:24.737179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:24.740061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:24.740820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:24.741855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:24.992665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Getting quotas for project 2ab0f10e3ac84795a9309e9e59e89389. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:25.002906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Getting quotas for user cf441c81ca6846829c715d3354b40305 and project 2ab0f10e3ac84795a9309e9e59e89389. Resources: dict_keys(['metadata_items']) {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:25.055533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:05:25.057170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:05:25.057978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:05:25.058641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:05:25.059596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:05:25.072099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:25.073000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:25.074116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:25.075107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:25.075885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:25.076310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:25.119178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Getting quotas for project 2ab0f10e3ac84795a9309e9e59e89389. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:25.127174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Getting quotas for user cf441c81ca6846829c715d3354b40305 and project 2ab0f10e3ac84795a9309e9e59e89389. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:25.152151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:05:25.157468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:05:25.241183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf512fb3-3c5c-4cae-843c-09917c07e01d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.256836 Aug 30 04:05:25.242221 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2973/6068] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:05:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:05:25.247033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-29a8009a-9dff-4c7c-8319-01599826e832 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:25.247959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-29a8009a-9dff-4c7c-8319-01599826e832 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:25.340669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:25.349945 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-41386040-314e-4219-92ab-439b3aac509a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.644689 Aug 30 04:05:25.353446 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3096/6069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:24 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:25.382881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-486986472", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-454808694", "security_groups": [{"name": "tempest-secgroup-smoke-946206122"}], "block_device_mapping_v2": [{"uuid": "3d05353d-a03e-4d37-adc0-5261e76ad110", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:25.478768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-29a8009a-9dff-4c7c-8319-01599826e832 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:25.492625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-29a8009a-9dff-4c7c-8319-01599826e832 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1266 microversion: 2.1 time: 0.247742 Aug 30 04:05:25.493236 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2974/6070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:25 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:25.515712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ac02e17c-dcca-4261-b5ca-22644dbd8dda req-69c5d0a8-36be-484e-b80b-c4323d23a3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c609049-48cc-4023-b502-230aeaff791e", "name": "network-vif-plugged", "status": "completed", "tag": "a3503f39-47b8-4189-afe4-dd248d086f01"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:25.550145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ac02e17c-dcca-4261-b5ca-22644dbd8dda req-69c5d0a8-36be-484e-b80b-c4323d23a3d6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:25.551309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ac02e17c-dcca-4261-b5ca-22644dbd8dda req-69c5d0a8-36be-484e-b80b-c4323d23a3d6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:25.557334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ac02e17c-dcca-4261-b5ca-22644dbd8dda req-69c5d0a8-36be-484e-b80b-c4323d23a3d6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:25.586460 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ac02e17c-dcca-4261-b5ca-22644dbd8dda req-69c5d0a8-36be-484e-b80b-c4323d23a3d6 service nova] Creating event network-vif-plugged:a3503f39-47b8-4189-afe4-dd248d086f01 for instance 0c609049-48cc-4023-b502-230aeaff791e on n-h1-854924-5 Aug 30 04:05:25.605240 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ac02e17c-dcca-4261-b5ca-22644dbd8dda req-69c5d0a8-36be-484e-b80b-c4323d23a3d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101344 Aug 30 04:05:25.605951 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2975/6071] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:25.652434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f5bd5d48-bff9-464e-8084-514ce3dc3f52 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:25.658539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f5bd5d48-bff9-464e-8084-514ce3dc3f52 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:25.712706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:05:26.061797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5bd5d48-bff9-464e-8084-514ce3dc3f52 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:26.077972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f5bd5d48-bff9-464e-8084-514ce3dc3f52 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1302 microversion: 2.1 time: 0.460829 Aug 30 04:05:26.080701 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2976/6072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:25 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1302 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:26.375743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:26.376724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:26.384110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:26.384993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:26.385768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:26.386738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:26.387425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:26.388081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:26.854370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:26.864291 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48927465-e9b0-48c1-bbca-04fff47d1ee9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1367 microversion: 2.1 time: 0.492376 Aug 30 04:05:26.867816 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2977/6073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:26 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:26.887909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:26.889163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:26.899579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:26.901512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:26.902259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:26.903766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:26.904460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:26.905418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:27.007480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:05:27.009721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:05:27.010591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:05:27.011256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:05:27.012201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:05:27.035543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:27.052550 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d0f520c2-5b43-49d5-9f72-0a2269b522a9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1336 microversion: 2.1 time: 0.177112 Aug 30 04:05:27.054642 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2978/6074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:26 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1336 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:27.058129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:27.062930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:27.063591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:27.065232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:27.066028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:27.067716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:27.108487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:27.109833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:27.127947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:05:27.134940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:05:27.143813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:27.144376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:27.144834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:27.145587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:27.146268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:27.146473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:27.297205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:05:27.299986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d05353d-a03e-4d37-adc0-5261e76ad110',volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:05:27.352390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:27.365388 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d7a16e11-c7ea-4f57-a0ff-48ebc2f29deb tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1362 microversion: 2.1 time: 0.261736 Aug 30 04:05:27.378088 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2979/6075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:27 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:27.655336 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a7d01204-5ebc-46da-916a-a4d509a115a2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.290691 Aug 30 04:05:27.670712 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3097/6076] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:05:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:05:27.681897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ba6bfe0-6746-4d37-8e82-9a221a03e635 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:27.682889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ba6bfe0-6746-4d37-8e82-9a221a03e635 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:27.889547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:27.890105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:27.904245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:27.904757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:27.905198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:27.907458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:27.907931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:27.908371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:28.409267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ba6bfe0-6746-4d37-8e82-9a221a03e635 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:28.428519 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ba6bfe0-6746-4d37-8e82-9a221a03e635 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1093 microversion: 2.1 time: 0.745063 Aug 30 04:05:28.431168 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2980/6077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:27 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1093 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:28.440798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:28.442523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:28.451360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:28.452687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:28.453587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:28.454641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:28.455672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:28.456559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.039785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:29.049906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d1f8f50-f573-49c5-9a67-65878fee0de7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1557 microversion: 2.1 time: 1.165035 Aug 30 04:05:29.051680 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3098/6078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:27 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1557 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:29.078845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:29.079824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:29.105757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.110079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.116795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.126413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.127091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.127812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.206598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:29.246022 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fe07d552-d4a6-4249-9644-0433d35d416d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1392 microversion: 2.1 time: 0.802286 Aug 30 04:05:29.249707 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2981/6079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:28 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1392 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:29.256925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:29.259039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:29.274447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.274966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.286081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.287068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.287582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.288043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.319637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:29.329065 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b628457a-3560-4356-bba5-c3005dd51ae6 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1360 microversion: 2.1 time: 0.274211 Aug 30 04:05:29.331514 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3099/6080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:29 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:29.450244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7f01b316-a415-43f8-8111-66a3e785243b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197333 Aug 30 04:05:29.452192 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2982/6081] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:05:29 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:29.464837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:29.466376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:29.484389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c62c46d6-275c-4f52-8bc5-a47e969f9550 req-6e98188c-8282-4fd4-838c-e4ca5cf7353a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:29.486820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.489181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.489826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.492346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.494711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.495593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.519730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c62c46d6-275c-4f52-8bc5-a47e969f9550 req-6e98188c-8282-4fd4-838c-e4ca5cf7353a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:29.522743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c62c46d6-275c-4f52-8bc5-a47e969f9550 req-6e98188c-8282-4fd4-838c-e4ca5cf7353a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:29.523388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c62c46d6-275c-4f52-8bc5-a47e969f9550 req-6e98188c-8282-4fd4-838c-e4ca5cf7353a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:29.556678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c62c46d6-275c-4f52-8bc5-a47e969f9550 req-6e98188c-8282-4fd4-838c-e4ca5cf7353a service nova] Creating event network-changed:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h2-854924-5 Aug 30 04:05:29.567633 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c62c46d6-275c-4f52-8bc5-a47e969f9550 req-6e98188c-8282-4fd4-838c-e4ca5cf7353a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090417 Aug 30 04:05:29.572466 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2983/6082] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:05:29.718054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:29.730615 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54b25247-882d-4d3c-9b12-d7b1a0bfa3bc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1191 microversion: 2.1 time: 0.280059 Aug 30 04:05:29.734658 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3100/6083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:29 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1191 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:30.272464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:30.274111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:30.296181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:30.298932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:30.301630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:30.302842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:30.303567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:30.304191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:30.353652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:30.354901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:30.367839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:30.368712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:30.370132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:30.372186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:30.373975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:30.374674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:30.934578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:30.943493 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c3ea76a-4e9b-4f85-a2f6-cbe281e0edc1 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1360 microversion: 2.1 time: 0.594687 Aug 30 04:05:30.944176 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3101/6084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:30 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1360 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:30.949252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:30.949968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:30.965791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:30.966609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:30.967276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:30.968222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:30.969190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:30.969905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:31.171831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:31.181789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbe67263-4719-4ebb-947e-b8fcbfc32528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1209 microversion: 2.1 time: 0.236247 Aug 30 04:05:31.191207 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3102/6085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:30 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1209 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:31.396350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:31.417857 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f83836de-087b-4bea-a93b-868d4d5360be tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1392 microversion: 2.1 time: 1.149397 Aug 30 04:05:31.422183 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2984/6086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:30 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1392 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:31.964574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:31.965192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:31.975109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:31.981301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:31.982921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:31.986704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:31.987450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:31.989803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:32.203968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:32.204631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:32.227925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:32.228971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:32.232113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:32.233174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:32.233948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:32.238535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:32.845263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:32.854744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d146460-ff48-43e9-ae04-86e75a3b8026 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1209 microversion: 2.1 time: 0.654499 Aug 30 04:05:32.855269 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2985/6087] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:32 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1209 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:32.860707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:32.861729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:32.868932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:32.869741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:32.870367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:32.871264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:32.872062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:32.872526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:33.168394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:33.178280 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a38cf704-0d3d-4154-ade6-7dbde365ddb0 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 1.217715 Aug 30 04:05:33.180329 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3103/6088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:31 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:33.472043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:33.481707 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c8c5e14-f1ff-441f-9f3f-4fa601628c6e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1392 microversion: 2.1 time: 0.625009 Aug 30 04:05:33.482611 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2986/6089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:32 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1392 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:33.875181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:33.876067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:33.882998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:33.884112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:33.885080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:33.886384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:33.887206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:33.887843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:34.200234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:34.201045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:34.208246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:34.209163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:34.209884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:34.211166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:34.212050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:34.212851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:34.538714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:34.555093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-283c31bf-5344-48fd-a9d2-990882b3338b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1276 microversion: 2.1 time: 0.683635 Aug 30 04:05:34.565896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3104/6090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:33 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1276 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:34.571029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:34.572521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:34.580769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:34.581928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:34.582583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:34.583547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:34.584889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:34.585652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:35.101382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:35.423574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:35.446150 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77a69644-1ab3-464f-81a4-44c9ef4c8bfa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 1.250083 Aug 30 04:05:35.461783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2987/6091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:34 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:35.471991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:35.476402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-37a041dd-55e9-4b42-a573-30ec340fa081 req-a864066e-53f3-4f04-a85c-3250bf8bcacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c609049-48cc-4023-b502-230aeaff791e", "tag": "a3503f39-47b8-4189-afe4-dd248d086f01"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:35.481093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ae941dc-1267-4fd0-9bdc-37a6fc29cb4f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1392 microversion: 2.1 time: 0.921076 Aug 30 04:05:35.485236 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3105/6092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:34 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1392 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:35.494215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-37a041dd-55e9-4b42-a573-30ec340fa081 req-a864066e-53f3-4f04-a85c-3250bf8bcacd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:35.494954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-37a041dd-55e9-4b42-a573-30ec340fa081 req-a864066e-53f3-4f04-a85c-3250bf8bcacd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:35.495666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-37a041dd-55e9-4b42-a573-30ec340fa081 req-a864066e-53f3-4f04-a85c-3250bf8bcacd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:35.508669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-37a041dd-55e9-4b42-a573-30ec340fa081 req-a864066e-53f3-4f04-a85c-3250bf8bcacd service nova] Creating event network-changed:a3503f39-47b8-4189-afe4-dd248d086f01 for instance 0c609049-48cc-4023-b502-230aeaff791e on n-h1-854924-5 Aug 30 04:05:35.514749 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-37a041dd-55e9-4b42-a573-30ec340fa081 req-a864066e-53f3-4f04-a85c-3250bf8bcacd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050838 Aug 30 04:05:35.515885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2988/6093] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:35.577124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:35.577848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:35.591920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:35.592901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:35.596723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:35.597851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:35.598547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:35.599211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:35.604118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:36.069519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:36.077012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-370e3dfb-3a9e-4970-bce4-297640e6f51a req-7154fca3-a28e-4ea3-a94a-dc565e47345f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "name": "network-vif-plugged", "status": "completed", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:36.103511 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5786e9d8-cb98-46ce-8a37-5915d53b09b1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1276 microversion: 2.1 time: 0.528995 Aug 30 04:05:36.104176 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3106/6094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:35 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1276 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:36.136572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-370e3dfb-3a9e-4970-bce4-297640e6f51a req-7154fca3-a28e-4ea3-a94a-dc565e47345f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:36.137552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-370e3dfb-3a9e-4970-bce4-297640e6f51a req-7154fca3-a28e-4ea3-a94a-dc565e47345f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:36.138344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-370e3dfb-3a9e-4970-bce4-297640e6f51a req-7154fca3-a28e-4ea3-a94a-dc565e47345f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:36.154444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:36.180758 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-370e3dfb-3a9e-4970-bce4-297640e6f51a req-7154fca3-a28e-4ea3-a94a-dc565e47345f service nova] Creating event network-vif-plugged:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h2-854924-5 Aug 30 04:05:36.199421 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-370e3dfb-3a9e-4970-bce4-297640e6f51a req-7154fca3-a28e-4ea3-a94a-dc565e47345f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145114 Aug 30 04:05:36.209596 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2989/6095] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:05:36.470024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:36.470718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:36.485795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:36.486306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:36.486755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:36.490326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:36.490821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:36.491262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:36.509770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:36.511124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:36.523247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:36.528942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:36.529530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:36.530299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:36.530967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:36.531584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:37.029965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:37.042222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:37.045799 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68b6b397-cd53-445d-a9cd-f1134c90ecbf tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.580485 Aug 30 04:05:37.046563 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3107/6096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:36 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:37.052473 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-457e1551-58d7-41ee-8e96-9e6648c14c30 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1392 microversion: 2.1 time: 0.548108 Aug 30 04:05:37.053182 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2990/6097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:36 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1392 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:37.129598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:37.130220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:37.133291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:37.137232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:37.138001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:37.138441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:37.139152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:37.139606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:37.140034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:37.143807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=16 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:37.540246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:37.558348 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a15ca3cc-78fb-426d-bbed-999a6ba730b9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.433262 Aug 30 04:05:37.559172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3108/6098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:37 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:37.580473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4c46d6-4ccc-4082-bf99-c73d7f2640e3", "tag": "f4315f8e-9349-4753-930f-6c3be937202a"}, {"name": "network-changed", "server_uuid": "3900f24c-aa4b-4197-a6c4-87d314ac0a11", "tag": "7b5c7abf-9ffe-42d9-b8f5-a451d66837b9"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:37.591163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:37.591932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:37.592370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:37.608729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] Creating event network-changed:f4315f8e-9349-4753-930f-6c3be937202a for instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 on n-h2-854924-5 Aug 30 04:05:37.609249 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] Creating event network-changed:7b5c7abf-9ffe-42d9-b8f5-a451d66837b9 for instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 on n-h1-854924-5 Aug 30 04:05:37.619449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3eaf9954-c5df-47bc-9fe0-ebbb7bb23db5 req-dbadb8b9-3035-498b-b76c-f5edcbaab7e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044662 Aug 30 04:05:37.620351 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2991/6099] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:38.066541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:38.067277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:38.072735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:38.073662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:38.074221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.074762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.075194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.076060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.076520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.076946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.079992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.080492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.081148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.082588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.082882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.083319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.416576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=16 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:38.676898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:38.690024 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e2eca7a-156c-46ea-8c18-8d70812e3113 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1564 microversion: 2.1 time: 0.621234 Aug 30 04:05:38.690633 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2992/6100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:38 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1564 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:38.695744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:38.696374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:38.703250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.703433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:38.704304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.704963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.706095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.707426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.708162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.719275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3791c80-f9dc-407b-b62f-199077fb265b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.655875 Aug 30 04:05:38.720386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3109/6101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:38 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:38.746860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:38.747501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:38.765561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.766055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.766487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.767391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:38.768236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:38.768903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:38.998145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:39.009687 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aacbccd8-ce13-4d34-aae9-507147245abe tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.315930 Aug 30 04:05:39.010201 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2993/6102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:38 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:39.043213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:39.053411 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9eafba5f-9f7b-4996-8f3e-c1827d485aa6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1564 microversion: 2.1 time: 0.328394 Aug 30 04:05:39.055187 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3110/6103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:38 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1564 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:39.744074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:39.745736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:39.763223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:39.767855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:39.767855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:39.773657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:39.774844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:39.775546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:40.031617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:40.032988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:40.044538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:40.045909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:40.046582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:40.047535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:40.067306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:40.068124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:40.252305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:40.266734 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-491c1e55-3ef4-4466-99c1-8abc65bb0259 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.526563 Aug 30 04:05:40.268797 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2994/6104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:39 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:40.433059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:40.443600 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5250fd51-180e-42a5-8763-ab2052150528 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.416672 Aug 30 04:05:40.458864 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3111/6105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:40 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:41.290120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:41.291306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:41.298295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.299008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.299464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.300727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.301209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.301673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.459788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:41.466288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:41.467960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:41.469763 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9860b9a-0847-4a8d-af81-3625db6d3ded tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.183369 Aug 30 04:05:41.482064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.482064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.482064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.482064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.482064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.482064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.483488 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2995/6106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:41 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:41.643687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:41.653604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a95bb2a-4afc-41b7-ae87-7af9b286b666 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.192836 Aug 30 04:05:41.662175 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3112/6107] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:41 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:41.703640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:41.704291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:41.716596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.717128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.717631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.718420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.718912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.719368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.730063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3f91e613-e20b-4ffe-95cd-3271ea535d4c req-8cfa22dc-67df-4cf4-83ed-ad98a7f7887a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:41.750428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3f91e613-e20b-4ffe-95cd-3271ea535d4c req-8cfa22dc-67df-4cf4-83ed-ad98a7f7887a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:41.751233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3f91e613-e20b-4ffe-95cd-3271ea535d4c req-8cfa22dc-67df-4cf4-83ed-ad98a7f7887a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:41.751867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3f91e613-e20b-4ffe-95cd-3271ea535d4c req-8cfa22dc-67df-4cf4-83ed-ad98a7f7887a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:41.777166 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3f91e613-e20b-4ffe-95cd-3271ea535d4c req-8cfa22dc-67df-4cf4-83ed-ad98a7f7887a service nova] Creating event network-changed:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h2-854924-5 Aug 30 04:05:41.789918 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3f91e613-e20b-4ffe-95cd-3271ea535d4c req-8cfa22dc-67df-4cf4-83ed-ad98a7f7887a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063844 Aug 30 04:05:41.797741 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3113/6108] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:42.070386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:42.085135 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a142199-7f8d-4391-a6a8-f3e248490b4e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1564 microversion: 2.1 time: 0.385836 Aug 30 04:05:42.095233 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2996/6109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:41 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1564 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:42.496362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:42.497192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:42.504195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:42.504784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:42.505312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:42.506153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:42.506723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:42.507222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:42.648359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:42.656919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-284f36ee-5b36-4949-9104-e0c03cdbe1fa tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.166007 Aug 30 04:05:42.657653 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3114/6110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:42 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:42.676681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:42.677405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:42.684519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:42.685193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:42.685689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:42.686402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:42.686867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:42.687300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:42.832761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:42.842107 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-62b4fce2-b49c-4726-b3bd-9c97619f79d4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.170384 Aug 30 04:05:42.842696 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2997/6111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:42 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:43.678640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:43.679258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:43.686621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:43.686986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:43.687425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:43.688269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:43.688716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:43.689138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:43.825809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:43.837983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-482f5cb0-3438-49ed-8e71-564870dd0d98 req-6af890eb-a51f-42f4-a37a-1b9878d5c59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4c46d6-4ccc-4082-bf99-c73d7f2640e3", "name": "network-vif-plugged", "status": "completed", "tag": "f4315f8e-9349-4753-930f-6c3be937202a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:43.845970 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0278bd5-f36a-41c0-aa8f-5450a58071a2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.171601 Aug 30 04:05:43.847445 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3115/6112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:43 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:43.850163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-482f5cb0-3438-49ed-8e71-564870dd0d98 req-6af890eb-a51f-42f4-a37a-1b9878d5c59d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:43.850720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-482f5cb0-3438-49ed-8e71-564870dd0d98 req-6af890eb-a51f-42f4-a37a-1b9878d5c59d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:43.851175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-482f5cb0-3438-49ed-8e71-564870dd0d98 req-6af890eb-a51f-42f4-a37a-1b9878d5c59d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:43.866767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:43.867700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:43.870227 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-482f5cb0-3438-49ed-8e71-564870dd0d98 req-6af890eb-a51f-42f4-a37a-1b9878d5c59d service nova] Creating event network-vif-plugged:f4315f8e-9349-4753-930f-6c3be937202a for instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 on n-h2-854924-5 Aug 30 04:05:43.876470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:43.877183 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-482f5cb0-3438-49ed-8e71-564870dd0d98 req-6af890eb-a51f-42f4-a37a-1b9878d5c59d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042934 Aug 30 04:05:43.877433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:43.878048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:43.878509 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2998/6113] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:43.878756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:43.879376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:43.879799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:44.089149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:44.097604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d4286d8-e026-40d0-82c0-3e5a8cb8b518 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.235868 Aug 30 04:05:44.098206 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3116/6114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:43 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:44.874423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:44.875409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:44.884282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:44.884788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:44.885238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:44.886006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:44.886470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:44.886914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:45.029939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:45.037917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-11e7d00b-ba1b-412e-88f6-6a27499b8c93 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1428 microversion: 2.1 time: 0.172776 Aug 30 04:05:45.038510 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 2999/6115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:44 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1428 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:45.119348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:45.119961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:45.126989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:45.127407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:45.127843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:45.129051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:45.129540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:45.129972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:45.281577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:45.289507 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed5ea95e-a6a1-4edf-87c6-c71234d0bbaf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.174555 Aug 30 04:05:45.290075 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3117/6116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:45 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:46.057952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:46.058580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:46.065122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.065668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.066126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.066830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.067304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.067743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.206869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:46.214858 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d08dc25-2a98-41b1-b2ff-1d301d3898b7 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1609 microversion: 2.1 time: 0.161063 Aug 30 04:05:46.215453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3000/6117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:46 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1609 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:46.235639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:46.236260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:46.248820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.249464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.249789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.250509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.250965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.251392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.310634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:46.311371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:46.318955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.319813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.320275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.321001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.321513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.322252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.442525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:46.450901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bd1d848-7909-490d-998f-47e9f6cd055f tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1609 microversion: 2.1 time: 0.219214 Aug 30 04:05:46.451771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3118/6118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:46 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1609 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:46.471229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:46.471875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:46.478584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.479110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.479665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.480384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:46.480849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:46.481282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:46.491036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:46.499416 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-99512e7f-e852-496f-bd58-a344b25f9ec9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.193218 Aug 30 04:05:46.503712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3001/6119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:46 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:46.621265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:46.629601 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3546e599-b18f-4d0c-a728-cb15b475e6a4 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1609 microversion: 2.1 time: 0.162271 Aug 30 04:05:46.630178 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3119/6120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:46 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1609 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:05:47.520461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:47.521133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:47.528392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:47.528896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:47.529372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:47.530089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:47.530554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:47.531060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:47.766955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:47.775343 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c266ab54-7742-4ab9-bc6b-59ba97e314ce tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.259123 Aug 30 04:05:47.776015 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3002/6121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:47 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:48.294744 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-523a3d90-bf76-471d-bead-c0b7f8e61e15 req-0fed3aae-071b-4070-b5a5-5f3e7c6fd138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3900f24c-aa4b-4197-a6c4-87d314ac0a11", "name": "network-vif-plugged", "status": "completed", "tag": "7b5c7abf-9ffe-42d9-b8f5-a451d66837b9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:48.310216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-523a3d90-bf76-471d-bead-c0b7f8e61e15 req-0fed3aae-071b-4070-b5a5-5f3e7c6fd138 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:48.310719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-523a3d90-bf76-471d-bead-c0b7f8e61e15 req-0fed3aae-071b-4070-b5a5-5f3e7c6fd138 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:48.311389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-523a3d90-bf76-471d-bead-c0b7f8e61e15 req-0fed3aae-071b-4070-b5a5-5f3e7c6fd138 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:48.327214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-523a3d90-bf76-471d-bead-c0b7f8e61e15 req-0fed3aae-071b-4070-b5a5-5f3e7c6fd138 service nova] Creating event network-vif-plugged:7b5c7abf-9ffe-42d9-b8f5-a451d66837b9 for instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 on n-h1-854924-5 Aug 30 04:05:48.332766 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-523a3d90-bf76-471d-bead-c0b7f8e61e15 req-0fed3aae-071b-4070-b5a5-5f3e7c6fd138 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045251 Aug 30 04:05:48.333409 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3120/6122] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:05:48.797001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:48.797666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:48.806424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:48.806934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:48.807389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:48.808110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:48.808582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:48.809024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:49.011926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:49.020252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3141765d-9842-4799-b589-eac4bb9639e8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.227238 Aug 30 04:05:49.020860 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3003/6123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:48 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:49.311643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5f664997-3853-40a2-be4d-d8c5fb851833 req-7d61acbc-0cc1-40b6-84bb-7d2a292632c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4c46d6-4ccc-4082-bf99-c73d7f2640e3", "tag": "f4315f8e-9349-4753-930f-6c3be937202a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:49.323097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f664997-3853-40a2-be4d-d8c5fb851833 req-7d61acbc-0cc1-40b6-84bb-7d2a292632c7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:49.323574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f664997-3853-40a2-be4d-d8c5fb851833 req-7d61acbc-0cc1-40b6-84bb-7d2a292632c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:49.324000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5f664997-3853-40a2-be4d-d8c5fb851833 req-7d61acbc-0cc1-40b6-84bb-7d2a292632c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:49.337709 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5f664997-3853-40a2-be4d-d8c5fb851833 req-7d61acbc-0cc1-40b6-84bb-7d2a292632c7 service nova] Creating event network-changed:f4315f8e-9349-4753-930f-6c3be937202a for instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 on n-h2-854924-5 Aug 30 04:05:49.344141 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5f664997-3853-40a2-be4d-d8c5fb851833 req-7d61acbc-0cc1-40b6-84bb-7d2a292632c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186245 Aug 30 04:05:49.344756 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3121/6124] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:05:50.043639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:50.044445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:50.052595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:50.053210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:50.053965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:50.054680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:50.055281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:50.055783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:50.255162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:50.265967 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b6a3ba98-63b8-473e-b025-60ecb13932cf tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1264 microversion: 2.1 time: 0.225838 Aug 30 04:05:50.267201 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3004/6125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:50 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:51.288768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:51.289624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:51.296661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:51.297145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:51.297611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:51.298306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:51.298756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:51.299176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:51.432481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:51.440410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-759764ca-3817-4dba-a75c-fd6fe68b0b5b tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1451 microversion: 2.1 time: 0.156217 Aug 30 04:05:51.441677 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3122/6126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:51 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:51.461313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:05:51.461982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:05:51.468887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:51.469411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:51.469867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:51.470567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:51.471037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:51.471476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:51.609038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:05:51.617933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0548683e-79e3-4fed-8e82-6f102b3a6676 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1451 microversion: 2.1 time: 0.160622 Aug 30 04:05:51.618537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3005/6127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:05:51 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:05:53.336283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8740b339-0475-463d-a5ab-a7c4cc88e368 req-7e99934e-7271-4967-8e94-421733ac737c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3900f24c-aa4b-4197-a6c4-87d314ac0a11", "tag": "7b5c7abf-9ffe-42d9-b8f5-a451d66837b9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:05:53.342668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:53.349537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8740b339-0475-463d-a5ab-a7c4cc88e368 req-7e99934e-7271-4967-8e94-421733ac737c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:05:53.350022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8740b339-0475-463d-a5ab-a7c4cc88e368 req-7e99934e-7271-4967-8e94-421733ac737c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:05:53.350456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8740b339-0475-463d-a5ab-a7c4cc88e368 req-7e99934e-7271-4967-8e94-421733ac737c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:05:53.372398 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8740b339-0475-463d-a5ab-a7c4cc88e368 req-7e99934e-7271-4967-8e94-421733ac737c service nova] Creating event network-changed:7b5c7abf-9ffe-42d9-b8f5-a451d66837b9 for instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 on n-h1-854924-5 Aug 30 04:05:53.377642 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8740b339-0475-463d-a5ab-a7c4cc88e368 req-7e99934e-7271-4967-8e94-421733ac737c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045492 Aug 30 04:05:53.378349 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3123/6128] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:03.348314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:03.350627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:03.353688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:03.354408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=88 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:03.361871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:03.362326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:03.362771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:03.364125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:03.364588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:03.365024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:03.429226 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13c20a62-ee3f-471d-a18c-02af4ba50795 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action" status: 200 len: 24563 microversion: 2.1 time: 0.085158 Aug 30 04:06:03.430209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3006/6129] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:06:03 2022] POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action => generated 24563 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:06:14.313623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=90 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:14.314361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:14.318518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:14.319251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:14.326863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:14.327367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:14.327850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:14.328552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:14.329029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:14.329499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:14.598695 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d80e70d-d98c-4633-9e59-1c0274ba9c33 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1833 microversion: 2.1 time: 0.287725 Aug 30 04:06:14.599350 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3124/6130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:14 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1833 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:14.619105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:14.619865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:14.624011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:14.624731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:14.633408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:14.633880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:14.634337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:14.635050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:14.635516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:14.635954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:14.784877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:14.795082 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f6febe4-e52f-4021-9dd4-9c6656f6f11c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1682 microversion: 2.1 time: 0.178057 Aug 30 04:06:14.795653 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3007/6131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:14 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:14.894128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:14.896858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:14.903001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:14.903486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:14.903927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:14.904621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:14.905074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:14.905584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:14.958922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2be1d45f-32a3-4bdc-a09f-2890377bdeb4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action" status: 200 len: 32633 microversion: 2.1 time: 0.068004 Aug 30 04:06:14.959606 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3125/6132] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:06:14 2022] POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action => generated 32633 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:06:15.150527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:15.151116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:15.157778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:15.158308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:15.158786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:15.159458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:15.160204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:15.160641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:15.200447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e6e44d2723f4a5486eee7bfdd437ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66aef5236f74073b0d5c0a2126bd04e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:15.201090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] flavor_id is None. Assuming migration. {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 04:06:15.201589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:06:15.318283 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ff52d7f-33cb-40b9-8f45-84a1c585fc89 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action" status: 202 len: 0 microversion: 2.1 time: 0.171515 Aug 30 04:06:15.318888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3008/6133] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:06:15 2022] POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:06:15.328439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:15.330816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:15.337695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:15.338271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:15.338686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:15.339496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:15.339862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:15.340723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:15.533487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:15.542263 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a64a81f-d99e-48ae-b0f0-6f486bd650bb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1691 microversion: 2.1 time: 0.218416 Aug 30 04:06:15.543320 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3126/6134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:15 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:16.566443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:16.567079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:16.574684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:16.575195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:16.575655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:16.576371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:16.576842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:16.577285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:16.711491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:16.719322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4d5719e-4dbf-4b4a-a4b1-93ca7bff6047 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1691 microversion: 2.1 time: 0.157859 Aug 30 04:06:16.719892 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3009/6135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:16 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:17.740646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:17.741260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:17.748187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:17.748675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:17.749115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:17.749840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:17.750299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:17.750724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:17.894738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:17.902682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5ec9d791-2a09-4fa0-86ee-88bef0bfb348 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.166492 Aug 30 04:06:17.903250 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3127/6136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:17 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:18.923975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:18.924611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:18.932242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:18.932738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:18.933184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:18.933913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:18.934378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:18.934808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:19.141785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:19.150186 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6a418974-a96a-4e45-aebf-0c7fd49a3374 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.230011 Aug 30 04:06:19.150770 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3010/6137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:18 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:20.172056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:20.172705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:20.180953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:20.181506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:20.181954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:20.182686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:20.183143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:20.183573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:20.386416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:20.394375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2559e50f-619d-443e-9e53-84aaba6d18a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.226212 Aug 30 04:06:20.394959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3128/6138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:20 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:21.415378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:21.416002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:21.422919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:21.423488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:21.423800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:21.424500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:21.424966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:21.425436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:21.573238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:21.581018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba565d6c-8ff2-405f-b062-691a786efe14 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.169546 Aug 30 04:06:21.581621 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3011/6139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:21 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:22.601059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:22.601692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:22.608474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:22.608952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:22.609413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:22.610096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:22.610546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:22.610963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:22.742517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:22.750239 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-466702d2-98c0-4d74-9736-fe98056858e4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.153080 Aug 30 04:06:22.750801 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3129/6140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:22 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:23.771205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:23.771823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:23.778650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:23.779137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:23.779581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:23.780268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:23.780727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:23.781155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:23.915877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:23.923846 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e74f51dc-d7ab-4af6-adcf-0f843c53a37c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.156564 Aug 30 04:06:23.924461 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3012/6141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:23 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:24.946406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:24.947030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:24.954360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:24.954852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:24.955292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:24.955986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:24.956442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:24.956875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:25.099190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:25.107674 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bfa79dcc-dbe3-4c23-a06e-e2b1b3efd441 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.165804 Aug 30 04:06:25.108242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3130/6142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:24 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:26.129179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:26.129822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:26.136714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:26.137212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:26.137690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:26.138394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:26.138859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:26.139322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:26.329587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:26.339074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cfb89073-6768-43d6-a3e1-6a718abafd84 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.213809 Aug 30 04:06:26.339653 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3013/6143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:26 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:27.286782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:27.287397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:27.294190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:27.294663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:27.295091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:27.295768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:27.296213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:27.296627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:27.321145 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-caedf163-39c6-4046-a9bf-8d8d0c728cee tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.038627 Aug 30 04:06:27.321817 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3131/6144] 10.222.0.30 () {58 vars in 1293 bytes} [Tue Aug 30 04:06:27 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3/os-server-password => generated 116 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:27.360815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:27.361470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:27.368928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:27.369463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:27.369926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:27.370629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:27.371101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:27.371542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:27.502392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:27.510136 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-677ef45d-f6ca-4ba0-8d6d-c941ab3ca00f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.153266 Aug 30 04:06:27.510712 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3014/6145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:27 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:28.530607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:28.531221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:28.538445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:28.538935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:28.539399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:28.540085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:28.540543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:28.540967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:28.675429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:28.683733 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3dc9396e-2a7c-4f57-8c96-175e19e400a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.157096 Aug 30 04:06:28.684312 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3132/6146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:28 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:29.705273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:29.705948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:29.713568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:29.714000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:29.714448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:29.715141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:29.715606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:29.716039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:29.848740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:29.856591 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8110ce76-da4e-4cc2-8d4f-0b043c3956aa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.155533 Aug 30 04:06:29.857168 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3015/6147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:29 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:30.878959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:30.878959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:30.886306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:30.886787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:30.887267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:30.887992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:30.888502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:30.889026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:31.024995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:31.033870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ef2ef288-c5e0-4ce8-8d4e-3d031a9970b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.159948 Aug 30 04:06:31.034573 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3133/6148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:30 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:32.057070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:32.057740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:32.064929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:32.065568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:32.066040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:32.066736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:32.067225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:32.067669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:32.212306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:32.220652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-51d71eed-4cbc-49d2-82dd-8caf85e255d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.167573 Aug 30 04:06:32.221276 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3016/6149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:32 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:33.243453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:33.244074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:33.251297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:33.251784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:33.252219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:33.252918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:33.253390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:33.253814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:33.389078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:33.397231 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29682c66-1bbe-4731-b000-ceed6d821a7b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.158201 Aug 30 04:06:33.397827 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3134/6150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:33 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:34.418975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:34.419607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:34.426577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:34.427080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:34.427535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:34.428243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:34.428717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:34.429160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:34.608966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:34.617691 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f56076e-84d5-4a62-9a88-d5e965f7b53e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1696 microversion: 2.1 time: 0.202492 Aug 30 04:06:34.618310 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3017/6151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:34 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:35.237978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "name": "network-vif-unplugged", "status": "completed", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:35.249263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:35.249845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:35.250339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:35.272369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] Creating event network-vif-unplugged:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h1-854924-5 Aug 30 04:06:35.282769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:06:35.304862 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1f93bba8-4468-4f9a-a59d-e7a80f948e61 req-16a0dafc-bca4-4956-b3a0-6dd3e769af10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070069 Aug 30 04:06:35.306177 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3135/6152] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:06:35.639796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:35.640465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:35.649253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:35.649785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:35.650240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:35.650952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:35.651426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:35.651865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:35.905713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:35.913782 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc168331-7ada-4ba1-858e-748a9b16e086 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1695 microversion: 2.1 time: 0.277792 Aug 30 04:06:35.914264 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3018/6153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:35 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1695 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:36.938812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:36.939514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:36.946564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:36.947053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:36.947491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:36.948184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:36.948642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:36.949066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:37.102127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:37.109915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-45fe19f7-16bd-4770-b902-bf4864f7b03d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1693 microversion: 2.1 time: 0.177791 Aug 30 04:06:37.110482 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3136/6154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:36 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:37.346424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:37.356472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:37.356951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:37.357408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:37.367042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:37.367559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:37.369539 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] Creating event network-changed:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h1-854924-5 Aug 30 04:06:37.373628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:37.374120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:37.374570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:37.374984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:06:37.375273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:37.375737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:37.376174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:37.386551 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-92be2d2b-980e-4569-856c-e9086140d2a3 req-651aa6a9-6cf4-47b3-9ed3-accfd01a58b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043916 Aug 30 04:06:37.387200 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3137/6155] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:06:37.403340 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90cc0564-b4cf-45ec-8730-8eadbed006e4 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/ips" status: 200 len: 150 microversion: 2.1 time: 0.152750 Aug 30 04:06:37.403923 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3019/6156] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 04:06:37 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/ips => generated 150 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:38.132614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:38.133488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:38.139958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:38.140437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:38.140872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:38.141590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:38.142040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:38.142466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:38.279592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:38.289011 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1edb3be5-d36e-4ff0-ac67-a1c5bf2cab61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1693 microversion: 2.1 time: 0.161504 Aug 30 04:06:38.289637 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3138/6157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:38 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:38.753714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fce8eda2-d9ae-4c09-ab44-09f5e1c838d8"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:38.756778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:38.763894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:38.764387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:38.764831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:38.765641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:38.766105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:38.766538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:39.312067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:39.315029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:39.325986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:39.327046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:39.328202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:39.329285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:39.329977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:39.330562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:39.442373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:39.454378 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7c4903bc-caa1-4451-a7a8-d252c940f9f9 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.704767 Aug 30 04:06:39.455004 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3020/6158] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:06:38 2022] POST /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:06:39.574335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:39.582721 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63e1b707-82f4-4014-a147-f91b5e573e93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1693 microversion: 2.1 time: 0.276059 Aug 30 04:06:39.583514 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3139/6159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:39 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:40.606319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:40.607329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:40.615253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:40.615764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:40.616216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:40.616947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:40.617485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:40.618136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:40.771659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:40.781195 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-55818840-b045-4e86-998d-269a5d81bf58 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1690 microversion: 2.1 time: 0.180425 Aug 30 04:06:40.781868 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3021/6160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:40 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:40.803073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:40.803836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:40.811042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:40.811582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:40.812012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:40.813224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:40.813224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:40.813681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:40.866547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:40.878012 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-539cef3a-394a-41ab-8e42-e4a5dae662ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action" status: 204 len: 0 microversion: 2.1 time: 0.079578 Aug 30 04:06:40.878665 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3140/6161] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:06:40 2022] POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:06:40.886738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:40.887753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:40.894641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:40.895446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:40.895944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:40.896654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:40.897119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:40.897593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:41.159783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:41.175444 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b511a0e1-d8b8-4f68-b6da-4582aef3687c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1690 microversion: 2.1 time: 0.292254 Aug 30 04:06:41.177502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3022/6162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:40 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1690 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:42.202999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:42.204523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:42.213883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:42.214565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:42.214996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:42.216583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:42.217136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:42.217606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:42.385144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:42.396101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-385710aa-ac76-4a85-a381-603599d6bb59 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1690 microversion: 2.1 time: 0.199663 Aug 30 04:06:42.397028 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3141/6163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:42 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:42.671805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b5aea766-abf7-4d25-8084-9b665c0bc423 req-6a294665-063e-438d-bec6-fb7c1b6155bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "name": "network-vif-plugged", "status": "completed", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:42.694881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b5aea766-abf7-4d25-8084-9b665c0bc423 req-6a294665-063e-438d-bec6-fb7c1b6155bb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:42.695953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b5aea766-abf7-4d25-8084-9b665c0bc423 req-6a294665-063e-438d-bec6-fb7c1b6155bb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:42.696670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b5aea766-abf7-4d25-8084-9b665c0bc423 req-6a294665-063e-438d-bec6-fb7c1b6155bb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:42.713796 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b5aea766-abf7-4d25-8084-9b665c0bc423 req-6a294665-063e-438d-bec6-fb7c1b6155bb service nova] Creating event network-vif-plugged:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h1-854924-5 Aug 30 04:06:42.719631 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b5aea766-abf7-4d25-8084-9b665c0bc423 req-6a294665-063e-438d-bec6-fb7c1b6155bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140725 Aug 30 04:06:42.720387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3023/6164] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:43.419334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:43.419982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:43.426950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:43.427439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:43.427879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:43.428579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:43.429039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:43.429501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:43.563164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:43.571495 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d443d8e-0c03-469e-bc2d-082850eec12f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1682 microversion: 2.1 time: 0.156100 Aug 30 04:06:43.572073 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3142/6165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:43 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:51.273766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fce8eda2-d9ae-4c09-ab44-09f5e1c838d8"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:06:51.276297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:51.278263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=37 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:51.284098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:51.285213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:51.285732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:51.286473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:51.286935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:51.287398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:51.374243 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Invalid volume: volume fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 is already attached to instances: 0c609049-48cc-4023-b502-230aeaff791e Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments HTTP/1.1 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 74 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: {"volumeAttachment": {"volumeId": "fce8eda2-d9ae-4c09-ab44-09f5e1c838d8"}} Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: exception: Invalid volume: volume fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 is already attached to instances: 0c609049-48cc-4023-b502-230aeaff791e Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '0c609049-48cc-4023-b502-230aeaff791e', 'body': {'volumeAttachment': {'volumeId': 'fce8eda2-d9ae-4c09-ab44-09f5e1c838d8'}}} Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 is already attached to instances: 0c609049-48cc-4023-b502-230aeaff791e Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:06:51.376020 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 is already attached to instances: 0c609049-48cc-4023-b502-230aeaff791e Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 is already attached to instances: 0c609049-48cc-4023-b502-230aeaff791e Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 400 to user: Invalid volume: volume fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 is already attached to instances: 0c609049-48cc-4023-b502-230aeaff791e {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ecd02db6-0f40-4a9d-8439-4160f3e26943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109880 Aug 30 04:06:51.381235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3024/6166] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:06:51 2022] POST /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:06:51.443190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:51.443711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:51.446746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=39 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:51.452238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:51.452731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:51.453169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:51.453902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:51.454360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:51.454786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:51.535307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lazy-loading 'services' on Instance uuid 0c609049-48cc-4023-b502-230aeaff791e {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:06:51.615103 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9945b8e8-16af-4f5b-8f02-b0c95e7d43bd tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments/fce8eda2-d9ae-4c09-ab44-09f5e1c838d8" status: 202 len: 0 microversion: 2.1 time: 0.176067 Aug 30 04:06:51.615631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3143/6167] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:06:51 2022] DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments/fce8eda2-d9ae-4c09-ab44-09f5e1c838d8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:06:51.624305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:51.626542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:51.633136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:51.633692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:51.634166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:51.634889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:51.635389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:51.635835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:51.668262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e41f6ac6-70b7-4c17-8b36-e1fa190e8fa8 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047926 Aug 30 04:06:51.668827 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3025/6168] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:06:51 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:06:52.682073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:52.684474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:52.691655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:52.692134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:52.692566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:52.693253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:52.693726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:52.694149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:52.723735 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-100dd460-8d6c-442e-b6ab-931d06adbdf3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046750 Aug 30 04:06:52.728167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3144/6169] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:06:52 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:53.739466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:53.742092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:53.750491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:53.751077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:53.751465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:53.752218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:53.753268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:53.753780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:53.788472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a101e95-0aff-4494-b9d9-1316df714f1a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055499 Aug 30 04:06:53.789100 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3026/6170] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:06:53 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:54.801540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:54.803943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:54.810983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:54.811504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:54.811950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:54.812655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:54.813134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:54.813593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:54.844541 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0e04cd3e-747f-4df6-a598-6d93e321e628 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047640 Aug 30 04:06:54.845116 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3145/6171] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:06:54 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:55.856714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:55.858967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:55.867097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:55.867606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:55.868060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:55.868788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:55.869260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:55.869735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:55.902439 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-112d19d9-88e2-448e-8487-c8ee05685c23 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049712 Aug 30 04:06:55.903028 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3027/6172] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:06:55 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:56.915004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:56.917229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:56.924455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:56.924949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:56.925412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:56.926112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:56.926565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:56.926988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:56.957988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-82a7d590-4abe-4728-82d1-c2e342613d34 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046963 Aug 30 04:06:56.958570 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3146/6173] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:06:56 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:06:57.020125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:57.020655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:57.027511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:57.028003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:57.028446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:57.029137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:57.029627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:57.030060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:57.055870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:06:57.136597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52ad477b-985b-4e72-94da-526ac855de02 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 204 len: 0 microversion: 2.1 time: 0.120108 Aug 30 04:06:57.137205 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3028/6174] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:06:57 2022] DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:06:57.146046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:57.146621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:57.152963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:57.153508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:57.153951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:57.154645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:57.155100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:57.155525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:57.288897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:57.296959 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2f28005-a893-452f-9c56-00d0f8f23a8f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1682 microversion: 2.1 time: 0.155354 Aug 30 04:06:57.297581 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3147/6175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:57 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:58.319901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:58.320614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:58.327458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:58.328098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:58.328547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:58.329244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:58.329924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:58.330164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:58.464619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:58.472564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db51eb6c-5ee1-45db-bfcd-1fff48b87b95 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1682 microversion: 2.1 time: 0.157626 Aug 30 04:06:58.473152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3029/6176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:58 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:59.494698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:59.495301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:06:59.502528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:59.503017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:59.503455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:59.504154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:59.504606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:59.505031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:59.696800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:06:59.704729 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd1ecd05-91e0-4d12-ba5a-7ed602c8c3f3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 200 len: 1682 microversion: 2.1 time: 0.213986 Aug 30 04:06:59.720703 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3148/6177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:06:59 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:00.056755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-eb242aba-1cbd-4d53-8462-5cc0bc530f12 req-62bebc22-6c85-4301-8272-e35be48c4bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c609049-48cc-4023-b502-230aeaff791e", "name": "network-vif-deleted", "tag": "a3503f39-47b8-4189-afe4-dd248d086f01"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:00.067645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-eb242aba-1cbd-4d53-8462-5cc0bc530f12 req-62bebc22-6c85-4301-8272-e35be48c4bdc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:00.068125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-eb242aba-1cbd-4d53-8462-5cc0bc530f12 req-62bebc22-6c85-4301-8272-e35be48c4bdc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:00.068562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-eb242aba-1cbd-4d53-8462-5cc0bc530f12 req-62bebc22-6c85-4301-8272-e35be48c4bdc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:00.080180 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-eb242aba-1cbd-4d53-8462-5cc0bc530f12 req-62bebc22-6c85-4301-8272-e35be48c4bdc service nova] Creating event network-vif-deleted:a3503f39-47b8-4189-afe4-dd248d086f01 for instance 0c609049-48cc-4023-b502-230aeaff791e on n-h1-854924-5 Aug 30 04:07:00.085048 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-eb242aba-1cbd-4d53-8462-5cc0bc530f12 req-62bebc22-6c85-4301-8272-e35be48c4bdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031960 Aug 30 04:07:00.085788 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3030/6178] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:00.729291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:00.730179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:00.739187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:00.739826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:00.740363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:00.741171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:00.741903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:00.742377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:00.759704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e HTTP/1.1 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0c609049-48cc-4023-b502-230aeaff791e'} Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:07:00.761533 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:07:00.766606 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e91ed30-6dcb-4673-9815-3a5cceade5e0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 404 len: 111 microversion: 2.1 time: 0.040122 Aug 30 04:07:00.770418 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3149/6179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:00 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:07:00.777107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3793baf0-1339-4402-b8ae-64a7ec092ae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '.version_select at 0x7f89784c0280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:00.797726 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3793baf0-1339-4402-b8ae-64a7ec092ae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304910321" status: 202 len: 0 microversion: 2.1 time: 0.025779 Aug 30 04:07:00.798356 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3031/6180] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 04:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304910321 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:07:01.452073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5a31727-34e7-4f1a-91ed-1bd651bc1383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: .version_select at 0x7f897bd96820>, body: {"keypair": {"name": "tempest-keypair-880268833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhkunS4srI6mYa2pJxynEM7shgGuyA2XzZ6eilu/A05MIBRuE5WezGWG9S7UGwmcwEoyaRvCDWXKzr7FCFFYPB1we2SMY6behxn9zYe+G5gWdQLI3tGbbMUQ1NhtgIYnQ=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:01.468561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b5a31727-34e7-4f1a-91ed-1bd651bc1383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:07:01.473827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-b5a31727-34e7-4f1a-91ed-1bd651bc1383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:07:01.499534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5a31727-34e7-4f1a-91ed-1bd651bc1383 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051605 Aug 30 04:07:01.500162 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3150/6181] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:07:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:02.764720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1735670517", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6ec5b19-fb85-4e4b-a816-8856b9dda964"}], "security_groups": [{"name": "tempest-securitygroup--1021202909"}], "key_name": "tempest-keypair-880268833", "user_data": "}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:02.876625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] validate_networks() for [('c6ec5b19-fb85-4e4b-a816-8856b9dda964', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:07:03.265184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:07:03.265665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:07:03.266176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:07:03.266603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:07:03.267030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:07:03.276067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:03.276562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:03.277012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:03.277792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:03.278264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:03.278703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:03.296222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:07:03.302113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Getting quotas for user 7f2e6f38ec00437ea2c7d930b9543dfd and project ba69b28f21c047339b942b183f6f7afe. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:07:03.315275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:07:03.317747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:07:03.365500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-856689ea-fc17-4823-b3ea-08e72e67c991 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605993 Aug 30 04:07:03.366173 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3032/6182] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:07:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:07:03.378104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a4977637-f241-4efb-9ac9-9ad7d6c0fa57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:03.378724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a4977637-f241-4efb-9ac9-9ad7d6c0fa57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:03.442541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a4977637-f241-4efb-9ac9-9ad7d6c0fa57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:03.451198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a4977637-f241-4efb-9ac9-9ad7d6c0fa57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1241 microversion: 2.1 time: 0.077855 Aug 30 04:07:03.451697 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3151/6183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:03 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:04.471815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:04.472834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:04.482059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:04.482882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:04.483554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:04.484503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:04.484972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:04.485620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:04.572634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:04.580834 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-11a4ab2f-fcfe-4a9c-bb43-d8737cda28e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1311 microversion: 2.1 time: 0.112957 Aug 30 04:07:04.581798 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3033/6184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:04 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:05.602343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:05.603002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:05.610892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:05.611469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:05.611912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:05.612627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:05.613083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:05.613537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:05.798462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:05.806998 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f5fd830-47ce-4396-856e-28a773d467df tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.208535 Aug 30 04:07:05.807583 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3152/6185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:05 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:05.863700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-31b56e7c-9eaa-427b-9bc8-de709da70dfe req-24558df7-9aa3-4c46-86be-b932012f213f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b1694-13f2-4100-b7a1-48271742a641", "tag": "ff7e7038-a2bb-4db2-b387-4e068a387693"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:05.875910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-31b56e7c-9eaa-427b-9bc8-de709da70dfe req-24558df7-9aa3-4c46-86be-b932012f213f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:05.876934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-31b56e7c-9eaa-427b-9bc8-de709da70dfe req-24558df7-9aa3-4c46-86be-b932012f213f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:05.877400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-31b56e7c-9eaa-427b-9bc8-de709da70dfe req-24558df7-9aa3-4c46-86be-b932012f213f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:05.890536 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-31b56e7c-9eaa-427b-9bc8-de709da70dfe req-24558df7-9aa3-4c46-86be-b932012f213f service nova] Creating event network-changed:ff7e7038-a2bb-4db2-b387-4e068a387693 for instance 9f2b1694-13f2-4100-b7a1-48271742a641 on n-h2-854924-5 Aug 30 04:07:05.896804 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-31b56e7c-9eaa-427b-9bc8-de709da70dfe req-24558df7-9aa3-4c46-86be-b932012f213f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036740 Aug 30 04:07:05.897495 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3034/6186] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:06.830459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:06.831136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:06.838049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:06.838538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:06.839007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:06.839700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:06.840153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:06.840578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:06.973426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:06.981088 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc77face-0338-4d51-9290-dcaedf64a2a3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.155096 Aug 30 04:07:06.981694 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3153/6187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:06 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:08.004235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:08.004866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:08.011130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:08.011632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:08.012086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:08.012782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:08.013250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:08.013712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:08.153146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:08.162313 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-57248610-fbf2-4cb7-9bf6-a2f54788769b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.163738 Aug 30 04:07:08.162922 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3035/6188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:07 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:09.188088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:09.189300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:09.196227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:09.196705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:09.197136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:09.197849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:09.198328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:09.198742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:09.330739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:09.338539 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a322d72f-5abc-434e-9d72-14d7545c4a1f tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.154390 Aug 30 04:07:09.339116 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3154/6189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:09 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:10.360171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:10.360814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:10.367893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:10.368401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:10.368859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:10.369603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:10.370076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:10.370519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:10.507124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:10.516239 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bdc56bdc-cf54-45ac-a231-6756f968ae1e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.160059 Aug 30 04:07:10.516869 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3036/6190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:10 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:11.536836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:11.537477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:11.544291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:11.544779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:11.545211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:11.545929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:11.546381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:11.546803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:11.683149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:11.691649 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21e82263-3a55-48ea-81e3-45b5a19b8c57 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.159327 Aug 30 04:07:11.692233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3155/6191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:11 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:12.295291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-bc7777a2-12a0-4b79-8fc3-376c760f40ed req-cd403728-64df-4e6d-98dd-c9d42fcd402b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b1694-13f2-4100-b7a1-48271742a641", "name": "network-vif-plugged", "status": "completed", "tag": "ff7e7038-a2bb-4db2-b387-4e068a387693"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:12.307313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bc7777a2-12a0-4b79-8fc3-376c760f40ed req-cd403728-64df-4e6d-98dd-c9d42fcd402b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:12.308503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bc7777a2-12a0-4b79-8fc3-376c760f40ed req-cd403728-64df-4e6d-98dd-c9d42fcd402b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:12.309000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bc7777a2-12a0-4b79-8fc3-376c760f40ed req-cd403728-64df-4e6d-98dd-c9d42fcd402b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:12.314410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:12.322597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-bc7777a2-12a0-4b79-8fc3-376c760f40ed req-cd403728-64df-4e6d-98dd-c9d42fcd402b service nova] Creating event network-vif-plugged:ff7e7038-a2bb-4db2-b387-4e068a387693 for instance 9f2b1694-13f2-4100-b7a1-48271742a641 on n-h2-854924-5 Aug 30 04:07:12.328545 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-bc7777a2-12a0-4b79-8fc3-376c760f40ed req-cd403728-64df-4e6d-98dd-c9d42fcd402b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037051 Aug 30 04:07:12.329462 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3037/6192] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:12.713149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:12.714063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:12.721681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:12.722177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:12.722606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:12.723294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:12.723738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:12.724176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:12.726998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=78 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:12.854351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:12.862088 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7fbed433-318c-4f92-b04c-392360183ba5 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1367 microversion: 2.1 time: 0.153028 Aug 30 04:07:12.862656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3156/6193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:12 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:13.787979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:13.789588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:13.794193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:13.796492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:13.806140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:13.806644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:13.807096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:13.807806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:13.808272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:13.808709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:13.878997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8dbf8ae6-4187-4c97-87c7-babf4ec228ad tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action" status: 200 len: 24578 microversion: 2.1 time: 0.091642 Aug 30 04:07:13.879665 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3038/6194] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:07:13 2022] POST /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07/action => generated 24578 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:07:13.882833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:13.883478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:13.885613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:13.892558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:13.893077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:13.893538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:13.894230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:13.894677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:13.895126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:14.035881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:14.043876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b18b4e8f-b754-43ab-ad70-cb27602d6b4a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1557 microversion: 2.1 time: 0.164837 Aug 30 04:07:14.044466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3157/6195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:13 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:14.064956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:14.065591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:14.072853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:14.073366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:14.073861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:14.074571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:14.075043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:14.075480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:14.498348 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-38b0448d-d9ff-4b82-b1b2-c55073e7d848 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.438332 Aug 30 04:07:14.498947 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3039/6196] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:07:14 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-interface => generated 284 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:15.465925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-26da8379-4192-4278-aebe-3738cee65901 req-37a17e5f-dd48-4a2c-820f-4789860557c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b1694-13f2-4100-b7a1-48271742a641", "tag": "ff7e7038-a2bb-4db2-b387-4e068a387693"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:15.477142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-26da8379-4192-4278-aebe-3738cee65901 req-37a17e5f-dd48-4a2c-820f-4789860557c0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:15.477656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-26da8379-4192-4278-aebe-3738cee65901 req-37a17e5f-dd48-4a2c-820f-4789860557c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:15.478083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-26da8379-4192-4278-aebe-3738cee65901 req-37a17e5f-dd48-4a2c-820f-4789860557c0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:15.492723 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-26da8379-4192-4278-aebe-3738cee65901 req-37a17e5f-dd48-4a2c-820f-4789860557c0 service nova] Creating event network-changed:ff7e7038-a2bb-4db2-b387-4e068a387693 for instance 9f2b1694-13f2-4100-b7a1-48271742a641 on n-h2-854924-5 Aug 30 04:07:15.498748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-26da8379-4192-4278-aebe-3738cee65901 req-37a17e5f-dd48-4a2c-820f-4789860557c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036530 Aug 30 04:07:15.499466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3158/6197] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:33.293821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:33.294586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=9 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:33.299452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1734754519", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-454808694", "security_groups": [{"name": "tempest-secgroup-smoke-946206122"}], "block_device_mapping_v2": [{"uuid": "68c539e1-462f-4f12-878b-f577b7297c13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "969d24b7-5db1-4f17-8ef5-9801cf9d64b6"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:33.417733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] validate_networks() for [('969d24b7-5db1-4f17-8ef5-9801cf9d64b6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:07:33.807269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:07:33.807710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:07:33.808198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:07:33.808622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:07:33.809046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:07:33.819152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:33.819647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:33.820098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:33.820834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:33.821302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:33.821766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:33.838672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:07:33.844035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Getting quotas for user 8fe7a59ed41f4b01b1575359c771d8e8 and project 27219cb68b7246e884799492355ebab1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:07:33.902375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:07:33.904571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68c539e1-462f-4f12-878b-f577b7297c13',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:07:34.032134 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d17dd9d-13ea-42a1-b22a-a0ad4f0432d9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.740236 Aug 30 04:07:34.032797 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3040/6198] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:07:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:07:34.044527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa24c8d9-7a38-4a50-a0da-b84c902d4fab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:34.045372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aa24c8d9-7a38-4a50-a0da-b84c902d4fab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:34.048887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:34.049559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=13 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:34.114616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aa24c8d9-7a38-4a50-a0da-b84c902d4fab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:34.121849 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa24c8d9-7a38-4a50-a0da-b84c902d4fab tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1094 microversion: 2.1 time: 0.081811 Aug 30 04:07:34.122504 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3159/6199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:34 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:35.143118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:35.143777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:35.150065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:35.150648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:35.151174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:35.152316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:35.153100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:35.153775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:35.233704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:35.242602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5e84578b-bf84-45d7-9d53-1c229f95501a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1200 microversion: 2.1 time: 0.104166 Aug 30 04:07:35.253422 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3041/6200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:35 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:36.265107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:36.266490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:36.273885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:36.274587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:36.275519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:36.276572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:36.277196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:36.277807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:36.521889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:36.530264 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ad87a531-8f1d-40f6-81a4-306b5f9afe84 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1277 microversion: 2.1 time: 0.269970 Aug 30 04:07:36.531244 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3160/6201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:36 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:36.642974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0f80ab91-26b7-4bd8-ac3d-b6c3843c732e req-56051d76-283b-4351-9160-f0c92a570044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e611962-2632-42e7-9ec0-04941340d065", "tag": "9a96057a-f65d-4021-9fe4-f045bc6c512a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:36.657483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0f80ab91-26b7-4bd8-ac3d-b6c3843c732e req-56051d76-283b-4351-9160-f0c92a570044 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:36.658180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0f80ab91-26b7-4bd8-ac3d-b6c3843c732e req-56051d76-283b-4351-9160-f0c92a570044 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:36.658721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0f80ab91-26b7-4bd8-ac3d-b6c3843c732e req-56051d76-283b-4351-9160-f0c92a570044 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:36.671274 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0f80ab91-26b7-4bd8-ac3d-b6c3843c732e req-56051d76-283b-4351-9160-f0c92a570044 service nova] Creating event network-changed:9a96057a-f65d-4021-9fe4-f045bc6c512a for instance 5e611962-2632-42e7-9ec0-04941340d065 on n-h1-854924-5 Aug 30 04:07:36.686549 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0f80ab91-26b7-4bd8-ac3d-b6c3843c732e req-56051d76-283b-4351-9160-f0c92a570044 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047729 Aug 30 04:07:36.687583 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3042/6202] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:36.953154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:36.953794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:36.959745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:36.960470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:36.960914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:36.961632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:36.962249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:36.962681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:37.169438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6b2207cd-f176-44a9-81ad-911b54533836 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1833 microversion: 2.1 time: 0.219930 Aug 30 04:07:37.170029 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3161/6203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:36 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1833 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:37.553712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:37.555541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:37.567933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:37.568740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:37.569390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:37.571167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:37.572585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:37.573223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.088368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:38.089529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:38.098100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.098828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.099450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.100329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.101874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.102648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.136962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:07:38.227426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:38.236826 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16b74941-147d-4758-b539-85636d357304 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1277 microversion: 2.1 time: 0.688082 Aug 30 04:07:38.253294 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3043/6204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:37 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1277 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:38.282375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dde052c2-895a-4536-9b38-922bd4b8b502 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 204 len: 0 microversion: 2.1 time: 0.199289 Aug 30 04:07:38.288331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3162/6205] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:07:38 2022] DELETE /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:07:38.295911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:38.296860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:38.303834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.304942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.305722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.306793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.307430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.310187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.343745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-8641bef5-868f-4230-8a11-4e2c57116895 req-15c0eb95-8e76-4959-9fa2-5cf93546e4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:38.356394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8641bef5-868f-4230-8a11-4e2c57116895 req-15c0eb95-8e76-4959-9fa2-5cf93546e4b6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.357126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8641bef5-868f-4230-8a11-4e2c57116895 req-15c0eb95-8e76-4959-9fa2-5cf93546e4b6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.358327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-8641bef5-868f-4230-8a11-4e2c57116895 req-15c0eb95-8e76-4959-9fa2-5cf93546e4b6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.376486 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-8641bef5-868f-4230-8a11-4e2c57116895 req-15c0eb95-8e76-4959-9fa2-5cf93546e4b6 service nova] Creating event network-changed:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h1-854924-5 Aug 30 04:07:38.384669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-8641bef5-868f-4230-8a11-4e2c57116895 req-15c0eb95-8e76-4959-9fa2-5cf93546e4b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129423 Aug 30 04:07:38.385794 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3044/6206] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:38.475615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:38.484838 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0a38b4eb-ec1a-4f58-bea0-1d7f1ee65090 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1688 microversion: 2.1 time: 0.194869 Aug 30 04:07:38.485761 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3163/6207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:38 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:39.267219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:39.269303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:39.284447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:39.285380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:39.286075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:39.287921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:39.288659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:39.289361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:39.496108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:39.507495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:39.508712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:39.509899 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04d98a0c-73c9-41dd-99d2-22f28cae42da tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1277 microversion: 2.1 time: 0.252353 Aug 30 04:07:39.527106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:39.527980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:39.528860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:39.529216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:39.530334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:39.530761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:39.531923 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3045/6208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:39 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:39.741531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:39.749875 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1126d953-4da2-4807-b0be-ea42aafcbfcc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1688 microversion: 2.1 time: 0.247241 Aug 30 04:07:39.750549 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3164/6209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:39 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:40.427562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5029f2e4-9fdc-46f7-9c1c-7586ae52c657 req-6c4dbaab-9658-4977-b542-f8c47a6624ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508a4ab-d308-4a9b-9776-b9b1f1247c07", "name": "network-vif-deleted", "tag": "779235f3-0f2e-4df3-90d5-747d86f11096"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:40.438481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5029f2e4-9fdc-46f7-9c1c-7586ae52c657 req-6c4dbaab-9658-4977-b542-f8c47a6624ff service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:40.439070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5029f2e4-9fdc-46f7-9c1c-7586ae52c657 req-6c4dbaab-9658-4977-b542-f8c47a6624ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:40.439574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5029f2e4-9fdc-46f7-9c1c-7586ae52c657 req-6c4dbaab-9658-4977-b542-f8c47a6624ff service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:40.452587 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5029f2e4-9fdc-46f7-9c1c-7586ae52c657 req-6c4dbaab-9658-4977-b542-f8c47a6624ff service nova] Creating event network-vif-deleted:779235f3-0f2e-4df3-90d5-747d86f11096 for instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 on n-h1-854924-5 Aug 30 04:07:40.457830 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5029f2e4-9fdc-46f7-9c1c-7586ae52c657 req-6c4dbaab-9658-4977-b542-f8c47a6624ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034468 Aug 30 04:07:40.458435 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3046/6210] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:40.532843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:40.533491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:40.540285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:40.540761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:40.541198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:40.541916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:40.542368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:40.542793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:40.672185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:40.679895 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8218e6e6-db57-4468-b5b7-9c564449e6dd tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.152151 Aug 30 04:07:40.680464 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3165/6211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:40 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:40.771635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:40.772353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:40.781749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:40.782262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:40.782717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:40.783465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:40.783933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:40.784370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:40.820720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:40.821218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:40.821694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:40.822166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lazy-loading 'fault' on Instance uuid 7508a4ab-d308-4a9b-9776-b9b1f1247c07 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:07:40.866432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:40.874933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f83e342a-d0cb-48f0-8473-e7c230def6a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1356 microversion: 2.1 time: 0.107609 Aug 30 04:07:40.875458 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3047/6212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:40 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:41.700036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:41.700655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:41.707209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:41.707692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:41.708129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:41.708814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:41.709270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:41.709730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:41.847124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:41.855118 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e283a46-8358-469a-8aa9-90ea79c86de1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.159068 Aug 30 04:07:41.855683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3166/6213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:41 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:41.895991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:41.896574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:41.903471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:41.903965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:41.904411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:41.905106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:41.905593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:41.906282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:41.939174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:41.939668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:41.940116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:41.940622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lazy-loading 'fault' on Instance uuid 7508a4ab-d308-4a9b-9776-b9b1f1247c07 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:07:41.983513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:41.991525 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3d4d1454-c1c4-476c-b436-51f5d101394d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 200 len: 1356 microversion: 2.1 time: 0.099489 Aug 30 04:07:41.992086 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3048/6214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:41 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:42.876188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:42.876730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:42.883536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:42.884054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:42.884486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:42.885179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:42.885667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:42.886089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:43.015281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:43.016254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7508a4ab-d308-4a9b-9776-b9b1f1247c07] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:43.020725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:43.022539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:43.023206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:43.023658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:43.024364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:43.024826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:43.025265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:43.028835 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39acda26-14c6-4e20-babf-a19e74ca4ff5 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.156606 Aug 30 04:07:43.030001 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3167/6215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:42 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:43.039874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] HTTP exception thrown: Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 could not be found. Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Request method failure captured: Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 HTTP/1.1 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYxuevvbjEmzmE7LNIoiJni0CQDkjw1SEe6YrHZ0x-mMjVsIrjRCxOwnu5c96r5TkKB32fgEqJaC8sPrV2HYBnLaYWcyYTrma9Wjh6uURb3MxzmZ7rH7kNomkf-kuu3IBiLpmswnh0havRyh65NG7CoBisJezCWqtgXg2nNFXmhFo80 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_af9b246f8e4e497398b5461f56a695a5", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}] Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c6e3ddedaef54119acc2f890fe5492de Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 could not be found. Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7508a4ab-d308-4a9b-9776-b9b1f1247c07'} Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 could not be found. Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 could not be found. Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:07:43.041628 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 could not be found. Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Returning 404 to user: Instance 7508a4ab-d308-4a9b-9776-b9b1f1247c07 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8ab75a2-0c1e-4e3a-ab08-08ee719cb17c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07" status: 404 len: 111 microversion: 2.1 time: 0.033402 Aug 30 04:07:43.046686 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3049/6216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:43 2022] GET /compute/v2.1/servers/7508a4ab-d308-4a9b-9776-b9b1f1247c07 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:07:44.051165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:44.051788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:44.059468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:44.060407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:44.061696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:44.062477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:44.063216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:44.063659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:44.119361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:44.224386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:44.232221 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec0bd3c8-4ed3-469a-bd46-35493e442ab9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.185191 Aug 30 04:07:44.232776 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3168/6217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:44 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:45.253680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:45.254863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:45.258035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:45.258904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:45.268257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:45.268938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:45.269525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:45.270532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:45.271006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:45.271552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:45.444807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:45.454264 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c98777e5-e3bf-48cf-ae9a-2dbdb9e2233c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.204844 Aug 30 04:07:45.454854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3050/6218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:45 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:46.476889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:46.477550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:46.484617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:46.485109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:46.485594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:46.486294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:46.486745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:46.487171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:46.646249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-40885be1-e3a2-4a73-b7d8-6ec9682dcb4c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '.version_select at 0x7f897b811790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:46.681800 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-40885be1-e3a2-4a73-b7d8-6ec9682dcb4c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1772362557" status: 202 len: 0 microversion: 2.1 time: 0.044568 Aug 30 04:07:46.683477 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3051/6219] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Aug 30 04:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1772362557 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:07:46.699853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:46.717537 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08601453-fd03-43cb-a719-f8d5cfd2b7d3 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.243672 Aug 30 04:07:46.719010 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3169/6220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:46 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:46.738986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-42126ef3-75c8-4a19-82a7-1be0080699cc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: .version_select at 0x7f897be873a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-491656880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrIjHS/PUh5s6hy+grM+YYe9qOOqDLHKbdM+UZ514BAQU2wGcH04/JiKu85fj7Lljyd2QVVOoC+TtU0ZFd+ij95gl/rGu0dP5V1vKKRMUZXlLU3MwatFPBKDwAgEir/Og=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:46.760538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-42126ef3-75c8-4a19-82a7-1be0080699cc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:07:46.766194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-42126ef3-75c8-4a19-82a7-1be0080699cc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:07:46.789879 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-42126ef3-75c8-4a19-82a7-1be0080699cc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062649 Aug 30 04:07:46.790481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3052/6221] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:07:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:07:47.756175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:47.756944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:47.777778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:47.778286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:47.779246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:47.780143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:47.780860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:47.781292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:48.028120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:48.036663 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68c9fcfe-2017-40e6-b0ca-a7cc74c95a8a tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.286354 Aug 30 04:07:48.037582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3170/6222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:47 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:49.059257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:49.060503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:49.066768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:49.067280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:49.067737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:49.068454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:49.068927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:49.069412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:49.215955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:49.225099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9da9a60c-e85c-4d14-9354-6471c758a444 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.170663 Aug 30 04:07:49.225720 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3053/6223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:49 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:50.248713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:50.249950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:50.261891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:50.262766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:50.263761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:50.265579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:50.266817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:50.267607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:50.403495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:50.408265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:50.425750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:50.426320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:50.426798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:50.427658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:50.428724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:50.430071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:50.430928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:50.442125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9e2bce33-9c4b-422b-a171-02dcb9c57f81 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.199533 Aug 30 04:07:50.443276 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3171/6224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:50 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:50.472647 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-671bfffd-dba6-4377-a15e-1c7d9e95fcac tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/ips" status: 200 len: 150 microversion: 2.1 time: 0.073659 Aug 30 04:07:50.473266 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3054/6225] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 04:07:50 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/ips => generated 150 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:51.298292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ba6b9ea7-5223-449b-a362-af8cdc7ba3d0 req-ab1631e7-1541-437e-ae91-b175205990bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e611962-2632-42e7-9ec0-04941340d065", "name": "network-vif-plugged", "status": "completed", "tag": "9a96057a-f65d-4021-9fe4-f045bc6c512a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:51.309497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ba6b9ea7-5223-449b-a362-af8cdc7ba3d0 req-ab1631e7-1541-437e-ae91-b175205990bf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:51.310818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ba6b9ea7-5223-449b-a362-af8cdc7ba3d0 req-ab1631e7-1541-437e-ae91-b175205990bf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:51.311481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ba6b9ea7-5223-449b-a362-af8cdc7ba3d0 req-ab1631e7-1541-437e-ae91-b175205990bf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:51.328203 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ba6b9ea7-5223-449b-a362-af8cdc7ba3d0 req-ab1631e7-1541-437e-ae91-b175205990bf service nova] Creating event network-vif-plugged:9a96057a-f65d-4021-9fe4-f045bc6c512a for instance 5e611962-2632-42e7-9ec0-04941340d065 on n-h1-854924-5 Aug 30 04:07:51.334281 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ba6b9ea7-5223-449b-a362-af8cdc7ba3d0 req-ab1631e7-1541-437e-ae91-b175205990bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039582 Aug 30 04:07:51.335525 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3172/6226] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:51.469286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:51.470691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:51.488528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:51.489037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:51.489515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:51.490222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:51.490687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:51.491120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:51.792103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:51.803485 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1cbcdb9f-76e5-4bda-a042-8aa2f144371f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.344223 Aug 30 04:07:51.804702 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3055/6227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:51 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:52.825155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:52.825939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:52.833104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:52.833623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:52.834059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:52.835157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:52.835819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:52.836253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:52.966666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a6d5eb-3366-4bb7-9a53-0b9ab96d20bf"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:52.969882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:52.979479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:52.979957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:52.980642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:52.981638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:52.982304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:52.982931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:53.064954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:53.076198 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba8c7b62-6991-488c-9285-c803612fbe29 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1265 microversion: 2.1 time: 0.255638 Aug 30 04:07:53.080197 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3173/6228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:52 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:53.206432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-832489240", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "2a79ac86-d98a-465e-8c84-a57c35c8de37"}], "key_name": "tempest-TestNetworkAdvancedServerOps-491656880", "security_groups": [{"name": "tempest-secgroup-smoke-1355834875"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:53.390510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] validate_networks() for [('2a79ac86-d98a-465e-8c84-a57c35c8de37', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:07:53.431466 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-159daf06-6926-458f-a9c9-a8d4d61aeaca tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "POST /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470596 Aug 30 04:07:53.437385 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3056/6229] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:07:52 2022] POST /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:53.964869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:07:53.965375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:07:53.973982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:07:53.974889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:07:53.975528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:07:53.997984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:53.998483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:53.998926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:53.999663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:54.000250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:54.000900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:54.021591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:07:54.027609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:07:54.042397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:07:54.045717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:07:54.113006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:54.115251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:54.131487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:54.135826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:54.136304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:54.137059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:54.140169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:54.142359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:54.153756 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [64482527-36cc-4e1f-bbb8-e6f4f73bccb5] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:07:54.330544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:54.341129 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be5f4803-59cc-4ced-98c7-b32515785c24 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1452 microversion: 2.1 time: 0.239938 Aug 30 04:07:54.344645 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3057/6230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:54 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1452 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:54.363557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:54.364463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:54.372118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:54.372746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:54.373304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:54.374161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:54.374737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:54.375253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:54.523680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:54.532896 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de09ea81-11f6-4574-9452-a3ba49fa5aff tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1452 microversion: 2.1 time: 0.173302 Aug 30 04:07:54.533505 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3058/6231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:54 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:55.167476 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [64482527-36cc-4e1f-bbb8-e6f4f73bccb5] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59970. Aug 30 04:07:55.174265 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ff05112-e916-4059-8ae0-c016fba086e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.974464 Aug 30 04:07:55.175512 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3174/6232] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:07:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:07:55.191839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8b80e9d-af13-408b-93e2-cdab7d392af2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:55.193863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8b80e9d-af13-408b-93e2-cdab7d392af2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:55.287927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c8b80e9d-af13-408b-93e2-cdab7d392af2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:55.296767 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8b80e9d-af13-408b-93e2-cdab7d392af2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1265 microversion: 2.1 time: 0.111806 Aug 30 04:07:55.298354 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3059/6233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:55 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:56.319176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:56.320356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:56.337069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:56.337603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:56.338049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:56.338771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:56.339224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:56.341845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:56.525175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:56.535202 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6c538a55-0164-4cea-9285-f365a7bd8087 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1317 microversion: 2.1 time: 0.219952 Aug 30 04:07:56.541544 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3175/6234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:56 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:07:56.939882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7596c75a-160a-4749-ad70-95426834e571 req-397876f2-7af3-4ad0-949b-711d63588ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e611962-2632-42e7-9ec0-04941340d065", "tag": "9a96057a-f65d-4021-9fe4-f045bc6c512a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:56.953991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7596c75a-160a-4749-ad70-95426834e571 req-397876f2-7af3-4ad0-949b-711d63588ea3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:56.955052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7596c75a-160a-4749-ad70-95426834e571 req-397876f2-7af3-4ad0-949b-711d63588ea3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:56.955526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7596c75a-160a-4749-ad70-95426834e571 req-397876f2-7af3-4ad0-949b-711d63588ea3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:56.983440 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7596c75a-160a-4749-ad70-95426834e571 req-397876f2-7af3-4ad0-949b-711d63588ea3 service nova] Creating event network-changed:9a96057a-f65d-4021-9fe4-f045bc6c512a for instance 5e611962-2632-42e7-9ec0-04941340d065 on n-h1-854924-5 Aug 30 04:07:56.993904 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7596c75a-160a-4749-ad70-95426834e571 req-397876f2-7af3-4ad0-949b-711d63588ea3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057888 Aug 30 04:07:56.995123 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3060/6235] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:07:57.563679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:57.564455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:57.576538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:57.580648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:57.583316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:57.584473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:57.585124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:57.585772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:57.595049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:57.954806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:57.967767 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c5fd61c-c0ea-487e-ad4f-435c71898757 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1323 microversion: 2.1 time: 0.408814 Aug 30 04:07:57.984561 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3176/6236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:57 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:07:58.992053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:07:58.993124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:07:59.001282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:59.001960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:59.002523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:59.003344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:59.003918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:59.004480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:59.124585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3ce23369-4605-4280-8296-be7dcbd08575 req-6cfb22d9-9b70-4428-856d-6a6af9a5bd9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:07:59.136092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3ce23369-4605-4280-8296-be7dcbd08575 req-6cfb22d9-9b70-4428-856d-6a6af9a5bd9a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:59.136590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3ce23369-4605-4280-8296-be7dcbd08575 req-6cfb22d9-9b70-4428-856d-6a6af9a5bd9a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:59.144806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3ce23369-4605-4280-8296-be7dcbd08575 req-6cfb22d9-9b70-4428-856d-6a6af9a5bd9a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:59.159932 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3ce23369-4605-4280-8296-be7dcbd08575 req-6cfb22d9-9b70-4428-856d-6a6af9a5bd9a service nova] Creating event network-changed:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:07:59.165094 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3ce23369-4605-4280-8296-be7dcbd08575 req-6cfb22d9-9b70-4428-856d-6a6af9a5bd9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044173 Aug 30 04:07:59.165716 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3177/6237] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:07:59.259594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:07:59.270720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:59.279564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a24a1f14-4267-468c-942f-054550532312 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.291932 Aug 30 04:07:59.280530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3061/6238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:07:58 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:00.302092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:00.302791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:00.309827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:00.310309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:00.310739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:00.311454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:00.311902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:00.312660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:00.459795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:00.467602 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae01e714-bad8-4bb7-87dc-42ef1461d50b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.170954 Aug 30 04:08:00.468183 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3178/6239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:00 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:01.488892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:01.489560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:01.498362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:01.498864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:01.499316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:01.500014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:01.500483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:01.500922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:01.633335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:01.641012 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64483de4-a9ee-44a6-afbf-35d96fbde93b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.156081 Aug 30 04:08:01.641617 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3062/6240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:01 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:02.661657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:02.662268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:02.670515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:02.671033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:02.671466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:02.672162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:02.672610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:02.673046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:02.812359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:02.820082 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6386b684-4e11-454c-90f2-23bf03ad579c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.162438 Aug 30 04:08:02.820660 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3179/6241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:02 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:03.840827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:03.841618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:03.844523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:03.850363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:03.851015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:03.851496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:03.852224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:03.852835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:03.853270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:04.001607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:04.009694 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8133a4a4-17f2-4468-8c20-89b4a11874e6 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.173086 Aug 30 04:08:04.010293 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3063/6242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:03 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:04.580078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-bf06417b-7a95-40bc-a35a-cc3f91b0b1a3 req-9c734f43-aed7-4626-8793-20a009a87205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "name": "network-vif-plugged", "status": "completed", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:04.586406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:04.587061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:04.588080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:04.595491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bf06417b-7a95-40bc-a35a-cc3f91b0b1a3 req-9c734f43-aed7-4626-8793-20a009a87205 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:04.595965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bf06417b-7a95-40bc-a35a-cc3f91b0b1a3 req-9c734f43-aed7-4626-8793-20a009a87205 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:04.596393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bf06417b-7a95-40bc-a35a-cc3f91b0b1a3 req-9c734f43-aed7-4626-8793-20a009a87205 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:04.609589 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-bf06417b-7a95-40bc-a35a-cc3f91b0b1a3 req-9c734f43-aed7-4626-8793-20a009a87205 service nova] Creating event network-vif-plugged:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:08:04.615014 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-bf06417b-7a95-40bc-a35a-cc3f91b0b1a3 req-9c734f43-aed7-4626-8793-20a009a87205 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038867 Aug 30 04:08:04.615611 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3180/6243] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:05.033328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:05.035250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:05.053247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:05.053842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:05.054385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:05.055203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:05.055757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:05.056206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:05.260113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:05.268514 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4be7a86b-ea1a-407f-8dfd-f9163e415644 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.240360 Aug 30 04:08:05.269109 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3064/6244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:05 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:05.486872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:05.487466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:05.494581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:05.495065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:05.495503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:05.496692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:05.497145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:05.497662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:05.576572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lazy-loading 'services' on Instance uuid 9f2b1694-13f2-4100-b7a1-48271742a641 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:08:05.646661 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9e48509-9ec7-4b72-9b8a-daf9e494980e tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments/f5a6d5eb-3366-4bb7-9a53-0b9ab96d20bf" status: 202 len: 0 microversion: 2.1 time: 0.163956 Aug 30 04:08:05.647284 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3181/6245] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:08:05 2022] DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments/f5a6d5eb-3366-4bb7-9a53-0b9ab96d20bf => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:08:05.655922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:05.658160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:05.660063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:05.665390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:05.665886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:05.666330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:05.667020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:05.667480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:05.668475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:05.698109 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8a4e74a-4d3a-4aa5-b8c3-a86a8391d4ff tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Aug 30 04:08:05.698682 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3065/6246] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:08:05 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:06.290333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:06.291058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:06.297327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:06.297843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:06.298280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:06.298968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:06.299423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:06.299849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:06.441438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:06.449058 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d78c2b0-4582-404e-b279-1743a6a1b86a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1391 microversion: 2.1 time: 0.162985 Aug 30 04:08:06.449651 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3182/6247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:06 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:06.711206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:06.713558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:06.720582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:06.721080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:06.721570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:06.722280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:06.722747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:06.723184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:06.754849 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d8668a4-bcab-4c6b-8830-627435928b55 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047603 Aug 30 04:08:06.755433 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3066/6248] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:08:06 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:07.469994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:07.470702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:07.478049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:07.478674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:07.479210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:07.479916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:07.480379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:07.480807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:07.617410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:07.625848 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f062b4b-9821-4482-b402-fda6bcab8b89 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1564 microversion: 2.1 time: 0.159769 Aug 30 04:08:07.626428 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3183/6249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:07 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:07.646037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:07.646669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:07.653375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:07.653884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:07.654596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:07.655315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:07.655785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:07.656426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:07.768088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:07.770769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:07.776928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:07.777608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:07.778109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:07.779184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:07.779959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:07.780448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:07.802059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:07.811322 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-308dd750-2b2b-450d-a28a-0df401610fcb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1564 microversion: 2.1 time: 0.169075 Aug 30 04:08:07.811908 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3067/6250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:07 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:07.827420 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af50f088-e734-463e-b70b-144be0e94259 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063311 Aug 30 04:08:07.829483 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3184/6251] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:08:07 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:08:08.841786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:08.845598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:08.857460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:08.857967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:08.858421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:08.859342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:08.859987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:08.860435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:08.896436 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1c9a9d1-8857-4ee1-a8d0-88c6746efe0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060175 Aug 30 04:08:08.897039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3068/6252] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:08:08 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:09.471868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:09.472485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:09.478199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1510067b-8e52-4746-a4f3-52a37b17e295 req-9764446b-5895-4cec-9f31-ffc4b3db63bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:09.483165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:09.483658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:09.485151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:09.487910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:09.490119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:09.490752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:09.492325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1510067b-8e52-4746-a4f3-52a37b17e295 req-9764446b-5895-4cec-9f31-ffc4b3db63bb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:09.492826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1510067b-8e52-4746-a4f3-52a37b17e295 req-9764446b-5895-4cec-9f31-ffc4b3db63bb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:09.493271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1510067b-8e52-4746-a4f3-52a37b17e295 req-9764446b-5895-4cec-9f31-ffc4b3db63bb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:09.505873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1510067b-8e52-4746-a4f3-52a37b17e295 req-9764446b-5895-4cec-9f31-ffc4b3db63bb service nova] Creating event network-changed:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:08:09.512039 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1510067b-8e52-4746-a4f3-52a37b17e295 req-9764446b-5895-4cec-9f31-ffc4b3db63bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Aug 30 04:08:09.512996 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3069/6253] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:09.719115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:09.734123 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8fe6189-21e2-43e0-ba93-f3bdab168ecd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1564 microversion: 2.1 time: 0.266492 Aug 30 04:08:09.734713 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3185/6254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:09 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1564 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:09.916122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:09.920248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:09.928571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:09.929081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:09.929564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:09.930404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:09.931046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:09.931858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:09.978233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27dcd583-4153-4345-be7b-3db08d6142bf tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070663 Aug 30 04:08:09.979535 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3070/6255] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:08:09 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:10.991542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:10.994732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:11.001849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:11.002373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:11.002827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:11.003465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:11.003914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:11.004336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:11.038697 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-24a96d72-1338-482e-ac12-582be30826e3 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051022 Aug 30 04:08:11.039238 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3186/6256] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:08:10 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:08:11.112178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:11.112907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:11.123340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:11.123889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:11.124420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:11.125135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:11.125623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:11.126064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:11.413719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:08:11.491939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfd8cab1-6521-4c22-8b62-31aabad83ea7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 204 len: 0 microversion: 2.1 time: 0.387685 Aug 30 04:08:11.492639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3071/6257] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:11 2022] DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:08:11.503498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:11.504118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:11.510520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:11.511620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:11.512051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:11.512846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:11.513303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:11.513774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:11.658110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:11.666574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2b697a3d-ef45-46e4-a012-460c21a80664 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1682 microversion: 2.1 time: 0.168580 Aug 30 04:08:11.667169 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3187/6258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:11 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:12.689675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:12.690391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:12.697828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:12.698863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:12.699321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:12.700025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:12.700494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:12.700933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:12.830846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:12.838564 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b45a23ae-cec0-40f9-92b7-cb512197f69b tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1682 microversion: 2.1 time: 0.153246 Aug 30 04:08:12.841084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3072/6259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:12 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:13.861388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:13.862183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:13.869223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:13.869746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:13.870278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:13.870883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:13.871341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:13.871766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:13.950687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f2e6f38ec00437ea2c7d930b9543dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba69b28f21c047339b942b183f6f7afe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:13.958476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b66dcc30-4d6f-4e32-b6b9-b536fba29fa0 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 200 len: 1614 microversion: 2.1 time: 0.101073 Aug 30 04:08:13.959186 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3188/6260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:13 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:14.026433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a7d246f7-b038-4653-909d-e6c72575133f req-3c35a289-dada-41f0-bed8-af24bcaf06be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b1694-13f2-4100-b7a1-48271742a641", "name": "network-vif-deleted", "tag": "ff7e7038-a2bb-4db2-b387-4e068a387693"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:14.044650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7d246f7-b038-4653-909d-e6c72575133f req-3c35a289-dada-41f0-bed8-af24bcaf06be service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:14.045243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7d246f7-b038-4653-909d-e6c72575133f req-3c35a289-dada-41f0-bed8-af24bcaf06be service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:14.045987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a7d246f7-b038-4653-909d-e6c72575133f req-3c35a289-dada-41f0-bed8-af24bcaf06be service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:14.060775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a7d246f7-b038-4653-909d-e6c72575133f req-3c35a289-dada-41f0-bed8-af24bcaf06be service nova] Creating event network-vif-deleted:ff7e7038-a2bb-4db2-b387-4e068a387693 for instance 9f2b1694-13f2-4100-b7a1-48271742a641 on n-h2-854924-5 Aug 30 04:08:14.066146 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a7d246f7-b038-4653-909d-e6c72575133f req-3c35a289-dada-41f0-bed8-af24bcaf06be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044224 Aug 30 04:08:14.066746 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3073/6261] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:14.980706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:14.981437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:14.989324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:14.989841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:14.990276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:14.990974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:14.991436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:14.991858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:15.008723 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 HTTP/1.1 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '9f2b1694-13f2-4100-b7a1-48271742a641'} Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:15.010378 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f8496794-6071-4ce6-95dc-a51d245c3d5c tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 404 len: 111 microversion: 2.1 time: 0.035585 Aug 30 04:08:15.014975 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3189/6262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:14 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:15.021241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25723f47-179a-44d0-b921-9f636dd5148a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '.version_select at 0x7f89784e1dc0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:15.045587 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25723f47-179a-44d0-b921-9f636dd5148a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880268833" status: 202 len: 0 microversion: 2.1 time: 0.028385 Aug 30 04:08:15.046299 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3074/6263] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 04:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880268833 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:08:18.969830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:18.970344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:18.977283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:18.977886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:18.978340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:18.979058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:18.979512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:18.979962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:18.993577 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 HTTP/1.1 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '9f2b1694-13f2-4100-b7a1-48271742a641'} Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:18.995665 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-313eb16c-0b84-4152-a3ab-2fcf3029ef31 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 404 len: 111 microversion: 2.1 time: 0.031347 Aug 30 04:08:18.999965 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3190/6264] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:18 2022] DELETE /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:19.006730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:19.007507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 9f2b1694-13f2-4100-b7a1-48271742a641] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:19.014857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:19.015358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:19.015805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:19.016502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:19.016967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:19.017428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:19.031158 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 HTTP/1.1 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '9f2b1694-13f2-4100-b7a1-48271742a641'} Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:19.032896 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 9f2b1694-13f2-4100-b7a1-48271742a641 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:19.037892 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb013beb-11eb-48a8-ba8f-3f11ac9a9371 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641" status: 404 len: 111 microversion: 2.1 time: 0.032722 Aug 30 04:08:19.038533 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3075/6265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:19 2022] GET /compute/v2.1/servers/9f2b1694-13f2-4100-b7a1-48271742a641 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:22.306049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:22.306586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:22.313615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.314016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.314458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.315188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.315646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.316075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.330356 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e HTTP/1.1 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0c609049-48cc-4023-b502-230aeaff791e'} Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:22.331909 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:22.336562 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f43d7768-716f-40f5-bb50-1adb4a37e9c7 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 404 len: 111 microversion: 2.1 time: 0.031573 Aug 30 04:08:22.337556 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3191/6266] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:22 2022] DELETE /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:22.343457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:22.344096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 0c609049-48cc-4023-b502-230aeaff791e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:22.351732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.352506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.353158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.354099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.354823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.355805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.372947 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e HTTP/1.1 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '0c609049-48cc-4023-b502-230aeaff791e'} Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.374572 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 0c609049-48cc-4023-b502-230aeaff791e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2eca5a90-1588-4255-8c08-22fe7f2d5d0a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e" status: 404 len: 111 microversion: 2.1 time: 0.036582 Aug 30 04:08:22.379499 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3076/6267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:22 2022] GET /compute/v2.1/servers/0c609049-48cc-4023-b502-230aeaff791e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:22.385839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:22.386355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:22.392910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.393470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.393921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.394638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.395100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.395533 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.411312 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 HTTP/1.1 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '4aa42eca-0fb4-4900-93b8-37fe3680acf5'} Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:22.413181 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:22.418078 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0c3c910-f6e2-4d3a-81a6-f1dbbeec4943 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 404 len: 111 microversion: 2.1 time: 0.033342 Aug 30 04:08:22.419093 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3192/6268] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:22 2022] DELETE /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:22.424393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:22.425028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 4aa42eca-0fb4-4900-93b8-37fe3680acf5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:22.433141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.433797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.434464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.435265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.435811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.436485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.452109 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 HTTP/1.1 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '4aa42eca-0fb4-4900-93b8-37fe3680acf5'} Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:22.453738 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 4aa42eca-0fb4-4900-93b8-37fe3680acf5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2bf4e787-9a5b-45f1-8c9f-d8946614dae6 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5" status: 404 len: 111 microversion: 2.1 time: 0.034840 Aug 30 04:08:22.459008 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3077/6269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:22 2022] GET /compute/v2.1/servers/4aa42eca-0fb4-4900-93b8-37fe3680acf5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:25.727233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:25.727750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:25.734722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:25.735203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:25.735643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:25.736337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:25.736818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:25.737244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:25.751336 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea HTTP/1.1 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '5579e2c3-da3a-4aa1-85ab-ce76724c91ea'} Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:25.752895 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ead388d7-308c-441c-9c44-af3c1a9df61a tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 404 len: 111 microversion: 2.1 time: 0.031077 Aug 30 04:08:25.759046 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3193/6270] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:25 2022] DELETE /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:25.764923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:25.766375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] [instance: 5579e2c3-da3a-4aa1-85ab-ce76724c91ea] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:25.774519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:25.775203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:25.775657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:25.776434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:25.776974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:25.777444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:25.793412 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] HTTP exception thrown: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Request method failure captured: Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea HTTP/1.1 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYt29A7Ate0Gaw0J5bs5LT9GGvcdByQuOO1Ruxa2AQR6V2OXn2_EUxToJzFhYj1SzfFNK3AKhjDHZslIrMvjjDrMqtowxiEYscRScrADboymqgVYM-cihOAHCKWVwq1nN8-hGC5bfOA-nSKCeOmZ4hyk-LXgXQDuO2AUR95NP6ktMRY Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ba69b28f21c047339b942b183f6f7afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ba69b28f21c047339b942b183f6f7afe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ba69b28f21c047339b942b183f6f7afe"}]}] Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ba69b28f21c047339b942b183f6f7afe Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-604407915 Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 7f2e6f38ec00437ea2c7d930b9543dfd Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-AttachVolumeNegativeTest-604407915-project Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '5579e2c3-da3a-4aa1-85ab-ce76724c91ea'} Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:25.795006 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] Returning 404 to user: Instance 5579e2c3-da3a-4aa1-85ab-ce76724c91ea could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b1c181e-7407-45ef-ab13-6bc3e0afc337 tempest-AttachVolumeNegativeTest-604407915 tempest-AttachVolumeNegativeTest-604407915-project] 10.222.0.30 "GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea" status: 404 len: 111 microversion: 2.1 time: 0.037114 Aug 30 04:08:25.800432 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3078/6271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:25 2022] GET /compute/v2.1/servers/5579e2c3-da3a-4aa1-85ab-ce76724c91ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:30.493882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08e3628b-b4e1-49f6-be48-389d4cef7cc7 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Action: 'create', calling method: .version_select at 0x7f897b163040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-808984892"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:30.789622 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08e3628b-b4e1-49f6-be48-389d4cef7cc7 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.412483 Aug 30 04:08:30.790337 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3194/6272] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Aug 30 04:08:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 04:08:30.805496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5cf88436-7a5a-4841-ba72-82bcb388d363 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897a5ba4c0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:30.858063 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5cf88436-7a5a-4841-ba72-82bcb388d363 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 200 len: 344 microversion: 2.1 time: 0.058773 Aug 30 04:08:30.858637 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3079/6273] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 04:08:30 2022] GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:31.873892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6d8cfcc1-4d26-4fc9-81bc-e78fa3b375d6 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897bd35940>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:31.920948 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6d8cfcc1-4d26-4fc9-81bc-e78fa3b375d6 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 200 len: 345 microversion: 2.1 time: 0.052767 Aug 30 04:08:31.921554 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3195/6274] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 04:08:31 2022] GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:31.934726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-908fd637-24aa-4211-a283-9da6bb8a473d tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Action: 'create', calling method: .version_select at 0x7f897a6c9700>, body: {"snapshot": {"volume_id": "2a3b059c-8415-4885-ab6e-b34ae57256f0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-775616834"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:32.084645 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-908fd637-24aa-4211-a283-9da6bb8a473d tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.154576 Aug 30 04:08:32.085315 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3080/6275] 10.222.0.30 () {60 vars in 1162 bytes} [Tue Aug 30 04:08:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:32.102789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bacc4acf-cee9-4c55-8c34-6ee51882a038 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897b22f820>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:32.133554 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bacc4acf-cee9-4c55-8c34-6ee51882a038 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 200 len: 286 microversion: 2.1 time: 0.034525 Aug 30 04:08:32.134891 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3196/6276] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:32 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:08:32.145655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-47ff464a-08cc-4e92-9f06-3a1d00d21be3 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897a5badc0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:32.178319 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-47ff464a-08cc-4e92-9f06-3a1d00d21be3 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036518 Aug 30 04:08:32.178891 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3081/6277] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 30 04:08:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:32.192191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-325aa0e7-2425-4df5-aa00-9ba9ddff3582 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897b240dc0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:32.227484 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-325aa0e7-2425-4df5-aa00-9ba9ddff3582 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 200 len: 286 microversion: 2.1 time: 0.039104 Aug 30 04:08:32.228069 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3197/6278] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:32 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:33.025251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:33.027563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:33.038011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:33.038595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:33.039151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:33.039979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:33.041591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:33.041907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:33.046838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:33.101561 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a0300ca-4fc5-4d24-8ab3-f510c7c9d21d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action" status: 200 len: 24575 microversion: 2.1 time: 0.082692 Aug 30 04:08:33.102461 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3082/6279] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:08:33 2022] POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action => generated 24575 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:33.242937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e4554c5d-cf2b-4bcc-944e-7516c97ec0fd tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897b1464c0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:33.280303 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e4554c5d-cf2b-4bcc-944e-7516c97ec0fd tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 200 len: 286 microversion: 2.1 time: 0.043126 Aug 30 04:08:33.281079 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3198/6280] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:33 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:34.294302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-733d8b0c-239a-48ac-8887-1497878793a5 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897bcc1550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.327502 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-733d8b0c-239a-48ac-8887-1497878793a5 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 200 len: 287 microversion: 2.1 time: 0.037378 Aug 30 04:08:34.328080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3083/6281] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:34 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:34.340898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3af8774-6f09-46a9-9fb7-5766b7a5f84a tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f8983d45160>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.402313 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3af8774-6f09-46a9-9fb7-5766b7a5f84a tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 202 len: 0 microversion: 2.1 time: 0.066881 Aug 30 04:08:34.403576 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3199/6282] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 30 04:08:34 2022] DELETE /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:08:34.413080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e527a45-2c48-41d0-83f9-9a0fd9513d46 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897ad9a550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.445711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e527a45-2c48-41d0-83f9-9a0fd9513d46 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 200 len: 286 microversion: 2.1 time: 0.037692 Aug 30 04:08:34.446285 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3084/6283] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:34 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:35.460524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ce4a039d-7007-429d-aa01-5becfed61544 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f8983b32700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:35.493043 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ce4a039d-7007-429d-aa01-5becfed61544 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 200 len: 286 microversion: 2.1 time: 0.038438 Aug 30 04:08:35.493672 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3200/6284] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:35 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:08:36.506602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69d4dd4f-198d-4eeb-afa3-5e33ec74f91c tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897bcc1ca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.531422 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-69d4dd4f-198d-4eeb-afa3-5e33ec74f91c tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] HTTP exception thrown: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69d4dd4f-198d-4eeb-afa3-5e33ec74f91c tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Request method failure captured: Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e HTTP/1.1 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY0-inMnW3iIAu_lof_T9kn47KHyr8JGt4oX2GJpFetKEwq9mTbWU2rzgpZehySBrBc8M96ZOxEDjUoB_zqakpOA9dECsdosppcdN_t58Iej4nMV1h4cYDzfgdHojubjQi17YgS38e7gaehc32PTxvHvcwq7r0cas3iMnYY3mdCArXg Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd52a3a4b9ee4256b9969986a74197bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}] Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 85953ab9f8794773b83aa5af55fd1a0b Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: exception: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '4b7c019c-a556-487c-88f3-b6f43624862e'} Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. (HTTP 404) (Request-ID: req-76ecedb9-2af0-4fd8-8e04-cb6756b35ab2) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:08:36.537970 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69d4dd4f-198d-4eeb-afa3-5e33ec74f91c tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Returning 404 to user: Snapshot 4b7c019c-a556-487c-88f3-b6f43624862e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69d4dd4f-198d-4eeb-afa3-5e33ec74f91c tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e" status: 404 len: 111 microversion: 2.1 time: 0.037715 Aug 30 04:08:36.543862 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3085/6285] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-snapshots/4b7c019c-a556-487c-88f3-b6f43624862e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:36.547402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=27 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:36.547402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:36.552519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b0d5f67-80f0-4b69-b1c2-dc4425a96edd tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897ba32670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.614811 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b0d5f67-80f0-4b69-b1c2-dc4425a96edd tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 202 len: 0 microversion: 2.1 time: 0.069654 Aug 30 04:08:36.615548 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3201/6286] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 04:08:36 2022] DELETE /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:08:36.624818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0247dfc-a189-4af4-b505-e8c70011af18 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897bcc1550>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.674264 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0247dfc-a189-4af4-b505-e8c70011af18 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 200 len: 344 microversion: 2.1 time: 0.054449 Aug 30 04:08:36.674879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3086/6287] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:37.689720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3ec08e9-7167-4650-bd01-9c13855b4a74 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897a9e0280>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:37.744404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3ec08e9-7167-4650-bd01-9c13855b4a74 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 200 len: 344 microversion: 2.1 time: 0.059468 Aug 30 04:08:37.751904 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3202/6288] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 04:08:37 2022] GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:38.760018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b788b611-2740-41a0-ad23-bb514507d9bc tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f8983d09b80>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:38.792502 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b788b611-2740-41a0-ad23-bb514507d9bc tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] HTTP exception thrown: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b788b611-2740-41a0-ad23-bb514507d9bc tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Request method failure captured: Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 HTTP/1.1 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY0-inMnW3iIAu_lof_T9kn47KHyr8JGt4oX2GJpFetKEwq9mTbWU2rzgpZehySBrBc8M96ZOxEDjUoB_zqakpOA9dECsdosppcdN_t58Iej4nMV1h4cYDzfgdHojubjQi17YgS38e7gaehc32PTxvHvcwq7r0cas3iMnYY3mdCArXg Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd52a3a4b9ee4256b9969986a74197bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}] Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 85953ab9f8794773b83aa5af55fd1a0b Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: exception: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2a3b059c-8415-4885-ab6e-b34ae57256f0'} Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. (HTTP 404) (Request-ID: req-98223eb5-281f-4d6f-9f15-d1b8e8be0e08) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:08:38.795022 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b788b611-2740-41a0-ad23-bb514507d9bc tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Returning 404 to user: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:38.799679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b788b611-2740-41a0-ad23-bb514507d9bc tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 404 len: 109 microversion: 2.1 time: 0.041368 Aug 30 04:08:38.810821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dc13f55-36a3-4083-b26d-a9b5b394371e tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f8983b32700>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:38.814794 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3087/6289] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 04:08:38 2022] GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:38.843455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-6dc13f55-36a3-4083-b26d-a9b5b394371e tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] HTTP exception thrown: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dc13f55-36a3-4083-b26d-a9b5b394371e tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Request method failure captured: Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 HTTP/1.1 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY0-inMnW3iIAu_lof_T9kn47KHyr8JGt4oX2GJpFetKEwq9mTbWU2rzgpZehySBrBc8M96ZOxEDjUoB_zqakpOA9dECsdosppcdN_t58Iej4nMV1h4cYDzfgdHojubjQi17YgS38e7gaehc32PTxvHvcwq7r0cas3iMnYY3mdCArXg Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd52a3a4b9ee4256b9969986a74197bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}] Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 85953ab9f8794773b83aa5af55fd1a0b Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: method: Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: exception: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '2a3b059c-8415-4885-ab6e-b34ae57256f0'} Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. (HTTP 404) (Request-ID: req-aa2b9f93-1cab-403b-99a1-1fffa2eaedd1) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:08:38.845682 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.851084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6dc13f55-36a3-4083-b26d-a9b5b394371e tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Returning 404 to user: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:38.855008 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6dc13f55-36a3-4083-b26d-a9b5b394371e tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 404 len: 109 microversion: 2.1 time: 0.047477 Aug 30 04:08:38.855789 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3203/6290] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 04:08:38 2022] DELETE /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:38.864798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc505e80-a25f-47f1-801f-653e5b17f909 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Calling method '.version_select at 0x7f897ae550d0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:38.898129 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-cc505e80-a25f-47f1-801f-653e5b17f909 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] HTTP exception thrown: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc505e80-a25f-47f1-801f-653e5b17f909 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Request method failure captured: Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 HTTP/1.1 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY0-inMnW3iIAu_lof_T9kn47KHyr8JGt4oX2GJpFetKEwq9mTbWU2rzgpZehySBrBc8M96ZOxEDjUoB_zqakpOA9dECsdosppcdN_t58Iej4nMV1h4cYDzfgdHojubjQi17YgS38e7gaehc32PTxvHvcwq7r0cas3iMnYY3mdCArXg Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cd52a3a4b9ee4256b9969986a74197bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cd52a3a4b9ee4256b9969986a74197bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cd52a3a4b9ee4256b9969986a74197bc"}]}] Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cd52a3a4b9ee4256b9969986a74197bc Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1280242506 Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 85953ab9f8794773b83aa5af55fd1a0b Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1280242506-project Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: method: Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: exception: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '2a3b059c-8415-4885-ab6e-b34ae57256f0'} Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. (HTTP 404) (Request-ID: req-5561c155-ee22-4a0b-a0f1-0a8e46ae1774) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:08:38.900118 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc505e80-a25f-47f1-801f-653e5b17f909 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] Returning 404 to user: Volume 2a3b059c-8415-4885-ab6e-b34ae57256f0 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc505e80-a25f-47f1-801f-653e5b17f909 tempest-VolumesSnapshotsTestJSON-1280242506 tempest-VolumesSnapshotsTestJSON-1280242506-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0" status: 404 len: 109 microversion: 2.1 time: 0.041592 Aug 30 04:08:38.910824 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3088/6291] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 04:08:38 2022] GET /compute/v2.1/os-volumes/2a3b059c-8415-4885-ab6e-b34ae57256f0 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:08:39.493227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:39.497986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:39.521592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.522267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.530794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.531702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.532354 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.532842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.751169 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02f603ac-e6c6-4213-9505-f69db4f461a1 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1834 microversion: 2.1 time: 0.272118 Aug 30 04:08:39.753172 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3204/6292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:39 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1834 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:39.777104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:39.779387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:39.781825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:39.788906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.789462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.790179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.790952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.791444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.793269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.950334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:39.958240 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7db0b0a8-d4db-41d3-a471-6c4190530823 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1683 microversion: 2.1 time: 0.188468 Aug 30 04:08:39.958813 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3089/6293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:39 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:40.060524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:40.062865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:40.070723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.071229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.071666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.072397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.073116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.073569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.130101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5e41268-d0e8-4d11-bdfe-a0d7a8792600 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action" status: 200 len: 32644 microversion: 2.1 time: 0.074818 Aug 30 04:08:40.140909 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3205/6294] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:08:40 2022] POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action => generated 32644 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:40.324937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:40.325559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:40.331894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.332576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.333026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.333804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.334495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.334946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.366887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7e6e44d2723f4a5486eee7bfdd437ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66aef5236f74073b0d5c0a2126bd04e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:40.367554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] flavor_id is None. Assuming migration. {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 04:08:40.368019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:08:40.619290 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5a49fa0-7215-43c8-99cd-53271851ce2c tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action" status: 202 len: 0 microversion: 2.1 time: 0.298428 Aug 30 04:08:40.620075 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3090/6295] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:08:40 2022] POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:08:40.629176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:40.629847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:40.637316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.637829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.638277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.638982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.639475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.639907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.818539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:40.830367 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5541118-10e1-4e11-a717-c7c295f9d92b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1692 microversion: 2.1 time: 0.205256 Aug 30 04:08:40.832608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3206/6296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:40 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:41.856243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:41.856979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:41.863151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:41.863666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:41.864121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:41.864845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:41.865581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:41.865901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:42.018073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:42.028387 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9ea02bf-0a9c-4f3c-a5de-225d54b32765 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1692 microversion: 2.1 time: 0.177071 Aug 30 04:08:42.029160 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3091/6297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:41 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:43.054199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:43.054199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:43.065886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:43.066857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:43.067483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:43.068403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:43.069076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:43.069699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:43.284574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:43.294412 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f79381fe-2a29-45e0-b9ed-4b64881ba64f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.246653 Aug 30 04:08:43.294993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3207/6298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:43 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:44.321097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:44.322047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:44.342486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:44.343047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:44.343446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:44.344200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:44.344671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:44.345142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:44.502599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:44.514912 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30ba8fb7-0ab2-45b4-93b4-71ddfbf6d231 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.199971 Aug 30 04:08:44.515866 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3092/6299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:44 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:45.538073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:45.538693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:45.549560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:45.550133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:45.550910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:45.551630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:45.552097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:45.552522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:45.707037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:45.715977 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-84d31598-4140-4c7e-b9bd-ddfcdb02606f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.182218 Aug 30 04:08:45.716550 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3208/6300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:45 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:46.738565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:46.739730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:46.746537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:46.747135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:46.747590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:46.748302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:46.748766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:46.749207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:46.893488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:46.902807 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1eab4ee-c3ab-4d7d-ac7d-5c75c74b2f7c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.167998 Aug 30 04:08:46.903490 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3093/6301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:46 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:47.924311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:47.924936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:47.932767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:47.933263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:47.933752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:47.934555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:47.935031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:47.935543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.094212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:48.105518 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-91ecb599-bc5b-4f26-a3dd-aab91410fa8a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.185263 Aug 30 04:08:48.106119 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3209/6302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:47 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:49.127466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:49.128114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:49.135249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:49.135761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:49.136211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:49.136924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:49.137501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:49.138019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:49.285206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:49.296327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-468bf995-532c-492e-9038-830a46443f62 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.172327 Aug 30 04:08:49.296948 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3094/6303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:49 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:50.319833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:50.320497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:50.327993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:50.328478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:50.328913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:50.329651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:50.330110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:50.330532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:50.501557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:50.514427 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76925615-a332-4b43-a5ac-1f7148e3cb5d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.198708 Aug 30 04:08:50.515026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3210/6304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:50 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:51.536061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:51.536713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:51.544466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:51.544971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:51.545450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:51.546157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:51.546622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:51.547060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:51.693752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:51.703222 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bb355be5-3aeb-48fc-80df-25defc2095a3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.171071 Aug 30 04:08:51.704037 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3095/6305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:51 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:52.724128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:52.724745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:52.733776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:52.734370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:52.734847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:52.735627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:52.736165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:52.736874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:52.895345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:52.904410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-009ae8d2-a356-41ec-9c9d-62f5922ce324 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.184137 Aug 30 04:08:52.904987 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3211/6306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:52 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:53.925946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:53.926616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:53.934787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:53.935300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:53.935753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:53.936471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:53.936940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:53.937416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:54.104783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:54.114340 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9919780f-5e96-4435-9fbb-df49aee725a1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1697 microversion: 2.1 time: 0.192244 Aug 30 04:08:54.114939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3096/6307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:53 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:55.136750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:55.138173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:55.146737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:55.147367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:55.147917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:55.148735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:55.149494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:55.149990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:55.338796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:55.347567 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ce6289a-8454-4c5e-80d1-c20657aa4547 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1696 microversion: 2.1 time: 0.215171 Aug 30 04:08:55.348167 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3212/6308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:55 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1696 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:55.708674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "name": "network-vif-unplugged", "status": "completed", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:55.722608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:55.723176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:55.723610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:55.751281 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] Creating event network-vif-unplugged:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h1-854924-5 Aug 30 04:08:55.757820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:08:55.770468 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b78c227e-770f-44db-9335-c02626952b42 req-17c84ba8-e59c-42be-8c3f-0b2606975aa9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066037 Aug 30 04:08:55.770986 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3097/6309] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:08:56.382334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:56.383078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:56.394037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:56.395239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:56.396269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:56.397397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:56.398084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:56.398584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:56.590305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:56.609558 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a4e22838-7011-4bda-ae0c-cec1fd42bbc3 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1696 microversion: 2.1 time: 0.232675 Aug 30 04:08:56.610810 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3213/6310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:56 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1696 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:57.632546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:57.633448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:57.640659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.641157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.641627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.642330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.642820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.643262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.813445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:57.826836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.827315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.827752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.841089 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] Creating event network-changed:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h1-854924-5 Aug 30 04:08:57.844501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:57.846688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:08:57.856009 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d772e7ad-739e-4636-879e-658a32c6aefc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1694 microversion: 2.1 time: 0.228754 Aug 30 04:08:57.856622 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3098/6311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:57 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1694 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:57.861570 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0a88a348-281d-4477-84c9-05670623d946 req-d24786b9-9162-47d9-a507-8377bb11085c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052783 Aug 30 04:08:57.862165 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3214/6312] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:58.881223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:58.881991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:58.889329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:58.889860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:58.890313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:58.891048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:58.891520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:58.891960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:59.034349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:59.042148 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d88492c2-6690-43f8-89b4-13ea5508bb6a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1694 microversion: 2.1 time: 0.164850 Aug 30 04:08:59.042729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3099/6313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:58 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:00.071494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:00.074140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.084745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.085411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.085982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.087678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.088429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.089010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.296785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:00.308121 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a409d6c3-8af5-432f-9122-7820f98dc1d1 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1691 microversion: 2.1 time: 0.246281 Aug 30 04:09:00.309077 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3215/6314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:00 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:00.331821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:00.333899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.345769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.346612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.347366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.348542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.349437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.350293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.506656 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-390451c6-f3b4-4ea7-9b52-85579425ee21 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action" status: 202 len: 0 microversion: 2.1 time: 0.178779 Aug 30 04:09:00.507451 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3100/6315] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:09:00 2022] POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:09:00.517387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:00.517980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.525086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.525775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.527192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.527192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.527750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.528252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.742767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:00.752647 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-094e6991-cf17-4ad0-bab3-57393ac17935 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1690 microversion: 2.1 time: 0.240601 Aug 30 04:09:00.753278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3216/6316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:00 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:01.791209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:01.791901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:01.799955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:01.800975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:01.800975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.801645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:01.802123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:01.802684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.957886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:01.961663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:01.968967 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d35b5b21-0dbf-415f-8438-33f2b5a905bd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1690 microversion: 2.1 time: 0.182831 Aug 30 04:09:01.969605 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3101/6317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:01 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:02.990480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:02.991808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:02.998603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:02.999324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:02.999762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.000483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:03.001092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:03.001804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.163364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "name": "network-vif-plugged", "status": "completed", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:03.165076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:03.177263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:03.177883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:03.178572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.183079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa4657a4-892b-407a-9a72-a3d7ffb0dd6c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1690 microversion: 2.1 time: 0.196740 Aug 30 04:09:03.193373 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3217/6318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:02 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:03.193935 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] Creating event network-vif-plugged:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h1-854924-5 Aug 30 04:09:03.203592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:09:03.221753 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9b84fefa-9382-43a4-bd8d-1e62ed5b940b req-a57213f9-40a9-4e5a-8bf7-c93e50ba0dc6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060062 Aug 30 04:09:03.222660 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3102/6319] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:04.204266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:04.205535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:04.213719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.214280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.214704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.215401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.215861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.216527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.512793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:04.521583 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-358a6273-03a9-424b-ae0a-8600d8545a8e tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1690 microversion: 2.1 time: 0.321239 Aug 30 04:09:04.522446 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3218/6320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:04 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:04.613429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "name": "network-vif-unplugged", "status": "completed", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:04.628646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.629268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.629834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.645262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] Creating event network-vif-unplugged:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:09:04.653211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:09:04.665444 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5cf987c1-b42c-4a85-b71a-fcf33158fdfd req-0d2f6ee1-c72e-432a-96fb-531740230724 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056118 Aug 30 04:09:04.667764 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3103/6321] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:05.546337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:05.547176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:05.555838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.556740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.557447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:05.558383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.558912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.559400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:05.850095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:05.860905 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9108916-d0c9-41ce-ad3c-8f0df7c56e79 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1690 microversion: 2.1 time: 0.317875 Aug 30 04:09:05.862233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3219/6322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:05 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1690 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:06.733727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:06.744080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:06.744571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:06.745022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:06.757272 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] Creating event network-changed:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:09:06.763626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:09:06.774505 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-acdac6d1-7af1-49f9-83cd-8022506a20cf req-f376ce3c-5487-4104-833e-72980c6c049b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048753 Aug 30 04:09:06.775123 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3104/6323] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:06.882413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:06.883032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:06.888043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=33 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:06.892154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:06.892644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:06.893085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:06.893873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:06.894496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:06.895099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:06.911772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=93 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:07.077820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:07.085759 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8299f46-5221-40ed-b9c8-8b9477f5d552 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1690 microversion: 2.1 time: 0.207434 Aug 30 04:09:07.086713 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3220/6324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:06 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:08.108480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:08.109943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:08.118156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.118918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.119708 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.120609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.121250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.121924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.267403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:08.276815 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fc798207-eab2-4a8b-85e5-96b2e4072b9b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1683 microversion: 2.1 time: 0.173174 Aug 30 04:09:08.277994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3105/6325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:08 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:11.091956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ba978c6e-a0b2-4412-9a98-4af3c8e3ef72 req-86817412-d6f9-4bb6-bd71-ea2d1dc77b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "name": "network-vif-plugged", "status": "completed", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:11.117708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ba978c6e-a0b2-4412-9a98-4af3c8e3ef72 req-86817412-d6f9-4bb6-bd71-ea2d1dc77b0a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.120245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ba978c6e-a0b2-4412-9a98-4af3c8e3ef72 req-86817412-d6f9-4bb6-bd71-ea2d1dc77b0a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.120761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ba978c6e-a0b2-4412-9a98-4af3c8e3ef72 req-86817412-d6f9-4bb6-bd71-ea2d1dc77b0a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.136051 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ba978c6e-a0b2-4412-9a98-4af3c8e3ef72 req-86817412-d6f9-4bb6-bd71-ea2d1dc77b0a service nova] Creating event network-vif-plugged:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:09:11.142353 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ba978c6e-a0b2-4412-9a98-4af3c8e3ef72 req-86817412-d6f9-4bb6-bd71-ea2d1dc77b0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053975 Aug 30 04:09:11.142958 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3221/6326] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:26.271084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:26.278454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:26.279538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f02ef355-94e5-41dc-91f7-fc97a5417b5e req-73150bd7-67e9-4dda-9046-6e814647ccba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e611962-2632-42e7-9ec0-04941340d065", "tag": "9a96057a-f65d-4021-9fe4-f045bc6c512a"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:26.286577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=39 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:26.288441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=18 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:26.293108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:26.293880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=7 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:26.312517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.313336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.314268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.315172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.316100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.316383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f02ef355-94e5-41dc-91f7-fc97a5417b5e req-73150bd7-67e9-4dda-9046-6e814647ccba service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.316864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f02ef355-94e5-41dc-91f7-fc97a5417b5e req-73150bd7-67e9-4dda-9046-6e814647ccba service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.317148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.317299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f02ef355-94e5-41dc-91f7-fc97a5417b5e req-73150bd7-67e9-4dda-9046-6e814647ccba service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.344272 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f02ef355-94e5-41dc-91f7-fc97a5417b5e req-73150bd7-67e9-4dda-9046-6e814647ccba service nova] Creating event network-changed:9a96057a-f65d-4021-9fe4-f045bc6c512a for instance 5e611962-2632-42e7-9ec0-04941340d065 on n-h1-854924-5 Aug 30 04:09:26.355496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f02ef355-94e5-41dc-91f7-fc97a5417b5e req-73150bd7-67e9-4dda-9046-6e814647ccba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081990 Aug 30 04:09:26.356744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:26.357947 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3222/6327] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:26.449717 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04629b2d-389f-449d-b3e6-9ecd09ba7700 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 204 len: 0 microversion: 2.1 time: 0.182497 Aug 30 04:09:26.450786 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3106/6328] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:26 2022] DELETE /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:26.461715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:26.462649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:26.470513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.471330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.471949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.472683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.473172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.473652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.904965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:26.916191 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a8192e6-e31f-4aea-a868-ebbb135eb172 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1577 microversion: 2.1 time: 0.460569 Aug 30 04:09:26.918271 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3223/6329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:26 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1577 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:27.942550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.943550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:27.951363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.951972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.952634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.953582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.954063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.954514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.264958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:28.277807 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a75d271-3cdc-4646-9ee6-33b12a671c39 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1577 microversion: 2.1 time: 0.340600 Aug 30 04:09:28.281390 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3107/6330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:27 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1577 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:29.302236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.302867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:29.311336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.311830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.312260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.312990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.313479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.314201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.345898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-faa55f6c-6d2e-4266-934f-c43300665417 req-6a5e853e-c09d-4c4b-9d9a-41ad88c1e6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e611962-2632-42e7-9ec0-04941340d065", "name": "network-vif-deleted", "tag": "9a96057a-f65d-4021-9fe4-f045bc6c512a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:29.357587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-faa55f6c-6d2e-4266-934f-c43300665417 req-6a5e853e-c09d-4c4b-9d9a-41ad88c1e6b3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.358853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-faa55f6c-6d2e-4266-934f-c43300665417 req-6a5e853e-c09d-4c4b-9d9a-41ad88c1e6b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.359530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-faa55f6c-6d2e-4266-934f-c43300665417 req-6a5e853e-c09d-4c4b-9d9a-41ad88c1e6b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.373524 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-faa55f6c-6d2e-4266-934f-c43300665417 req-6a5e853e-c09d-4c4b-9d9a-41ad88c1e6b3 service nova] Creating event network-vif-deleted:9a96057a-f65d-4021-9fe4-f045bc6c512a for instance 5e611962-2632-42e7-9ec0-04941340d065 on n-h1-854924-5 Aug 30 04:09:29.378575 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-faa55f6c-6d2e-4266-934f-c43300665417 req-6a5e853e-c09d-4c4b-9d9a-41ad88c1e6b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041339 Aug 30 04:09:29.379223 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3108/6331] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.417202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:29.445940 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7ff0b29d-cc33-4414-9c3d-674bc7e6b3a8 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1391 microversion: 2.1 time: 0.137341 Aug 30 04:09:29.445940 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3224/6332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1391 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:30.476639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.478060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:30.486782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:30.487694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:30.488955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:30.490031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:30.492151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:30.492798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:30.585798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:30.596905 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4c58e920-0050-4c7f-9f60-6d98782c3178 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1225 microversion: 2.1 time: 0.135068 Aug 30 04:09:30.597933 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3109/6333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:30 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:31.619156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.619775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:31.630323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.631138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.632445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.633676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.634460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.635388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.720230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:31.728410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fbade077-2d8a-45f8-8666-07695ee83f1d tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1225 microversion: 2.1 time: 0.113589 Aug 30 04:09:31.728992 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3225/6334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:32.493635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:32.496074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:32.509673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:32.510478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:32.511777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.512724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:32.514076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:32.514880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.584954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8e795b13-6701-4c0d-97fe-e2bf221bc928 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action" status: 200 len: 63102 microversion: 2.1 time: 0.094555 Aug 30 04:09:32.586773 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3110/6335] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:09:32 2022] POST /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029/action => generated 63102 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:32.750542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:32.751981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:32.761315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:32.761918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:32.762464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.763278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:32.763826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:32.764318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.832933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:32.849681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3bcd7317-d24f-4b92-b694-ace5e8149fa9 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1225 microversion: 2.1 time: 0.103441 Aug 30 04:09:32.866777 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3226/6336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:32 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:33.873432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.874794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:33.883839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.884342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.885141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.885885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.886409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.886902 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.925375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.926151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.926774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.927244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lazy-loading 'fault' on Instance uuid 5e611962-2632-42e7-9ec0-04941340d065 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:33.976974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:33.985744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b166c71e-e5e4-4228-ac07-939ac79cfb14 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 200 len: 1230 microversion: 2.1 time: 0.116812 Aug 30 04:09:33.986500 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3111/6337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:35.012451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:35.013035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 5e611962-2632-42e7-9ec0-04941340d065] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:35.016205 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:09:35.016400 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:09:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 (ip 10.222.0.30) !!! Aug 30 04:09:35.024044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:35.024541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:35.025333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:35.026024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:35.026529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:35.026976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:35.042374 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 5e611962-2632-42e7-9ec0-04941340d065 could not be found. Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 HTTP/1.1 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 5e611962-2632-42e7-9ec0-04941340d065 could not be found. Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '5e611962-2632-42e7-9ec0-04941340d065'} Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e611962-2632-42e7-9ec0-04941340d065 could not be found. Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e611962-2632-42e7-9ec0-04941340d065 could not be found. Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:35.044530 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e611962-2632-42e7-9ec0-04941340d065 could not be found. Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 5e611962-2632-42e7-9ec0-04941340d065 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:35.051305 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49aec82a-9fa1-4227-90c6-62b3c1ec0be6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065" status: 404 len: 111 microversion: 2.1 time: 0.037895 Aug 30 04:09:35.053079 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3227/6338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:35 2022] GET /compute/v2.1/servers/5e611962-2632-42e7-9ec0-04941340d065 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:38.771015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.772426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:38.795070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:38.796604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:38.797423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:38.799733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:38.800978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:38.803055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:38.996607 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2e6491a-db08-4f66-8d2c-6d581632cdf5 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1834 microversion: 2.1 time: 0.231171 Aug 30 04:09:38.998157 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3112/6339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:38 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1834 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:40.559897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:40.560429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:40.563221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-32b72f1c-7999-4fb2-84e3-3dfb98acd168 req-502ed77f-6630-4a53-ab2d-8e1a62035025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:40.575306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-32b72f1c-7999-4fb2-84e3-3dfb98acd168 req-502ed77f-6630-4a53-ab2d-8e1a62035025 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.576049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-32b72f1c-7999-4fb2-84e3-3dfb98acd168 req-502ed77f-6630-4a53-ab2d-8e1a62035025 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.576695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-32b72f1c-7999-4fb2-84e3-3dfb98acd168 req-502ed77f-6630-4a53-ab2d-8e1a62035025 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.582369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.582865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.583309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.584077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.584532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.584954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.595199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-32b72f1c-7999-4fb2-84e3-3dfb98acd168 req-502ed77f-6630-4a53-ab2d-8e1a62035025 service nova] Creating event network-changed:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:09:40.622041 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-32b72f1c-7999-4fb2-84e3-3dfb98acd168 req-502ed77f-6630-4a53-ab2d-8e1a62035025 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062354 Aug 30 04:09:40.625655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3113/6340] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:40.649230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:40.749825 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae91c40f-3519-418f-9e13-ec6dfb4d2696 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 204 len: 0 microversion: 2.1 time: 0.192784 Aug 30 04:09:40.751716 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3228/6341] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:40 2022] DELETE /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:40.761477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:40.762471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:40.769864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.770649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.771347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.772353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.773078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.773774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.953826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:40.962793 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-760a82ab-8f94-4542-a840-cfbc7c6696dc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1689 microversion: 2.1 time: 0.205562 Aug 30 04:09:40.963573 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3114/6342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:40 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:41.988931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:41.989803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:42.000696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.001204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.001669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.006698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.007369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.008028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.199269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:42.200457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:42.225070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.226180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.226881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.228001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.228906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.229696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.292227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:42.406951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.420523 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6ced0cee-bb42-40d8-ad6f-7cb2ba053afa tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 200 len: 1689 microversion: 2.1 time: 0.437152 Aug 30 04:09:42.437107 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3229/6343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:41 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 1689 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:42.450312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f1c541b4-dff8-40f8-8952-1af33cfe1e81 req-a48499f7-73ee-44a1-84b2-233396bd3e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3900f24c-aa4b-4197-a6c4-87d314ac0a11", "tag": "7b5c7abf-9ffe-42d9-b8f5-a451d66837b9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:42.471567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f1c541b4-dff8-40f8-8952-1af33cfe1e81 req-a48499f7-73ee-44a1-84b2-233396bd3e36 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.477190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f1c541b4-dff8-40f8-8952-1af33cfe1e81 req-a48499f7-73ee-44a1-84b2-233396bd3e36 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.478231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f1c541b4-dff8-40f8-8952-1af33cfe1e81 req-a48499f7-73ee-44a1-84b2-233396bd3e36 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.495840 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f1c541b4-dff8-40f8-8952-1af33cfe1e81 req-a48499f7-73ee-44a1-84b2-233396bd3e36 service nova] Creating event network-changed:7b5c7abf-9ffe-42d9-b8f5-a451d66837b9 for instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 on n-h1-854924-5 Aug 30 04:09:42.515058 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f1c541b4-dff8-40f8-8952-1af33cfe1e81 req-a48499f7-73ee-44a1-84b2-233396bd3e36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076068 Aug 30 04:09:42.516294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3230/6344] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:42.532968 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-96e9168c-f0fe-4fed-8d79-b0bbba108d27 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 204 len: 0 microversion: 2.1 time: 0.338820 Aug 30 04:09:42.537572 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3115/6345] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:42 2022] DELETE /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:42.550271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:42.551515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:42.572379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.572957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.573857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.574770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.575929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.576362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.729311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.738153 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3898ec77-bb96-493d-88e7-e6c4a1a4c92e tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1576 microversion: 2.1 time: 0.196078 Aug 30 04:09:42.740078 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3231/6346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:42 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:43.445935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:43.446451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 3ed4b62a-a081-4a37-ba08-8bd444bdd029] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:43.463327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.463747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.464218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.470410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.470958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.471435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.487828 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] HTTP exception thrown: Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 could not be found. Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Request method failure captured: Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 HTTP/1.1 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYxuevvbjEmzmE7LNIoiJni0CQDkjw1SEe6YrHZ0x-mMjVsIrjRCxOwnu5c96r5TkKB32fgEqJaC8sPrV2HYBnLaYWcyYTrma9Wjh6uURb3MxzmZ7rH7kNomkf-kuu3IBiLpmswnh0havRyh65NG7CoBisJezCWqtgXg2nNFXmhFo80 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_af9b246f8e4e497398b5461f56a695a5", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}] Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c6e3ddedaef54119acc2f890fe5492de Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 could not be found. Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '3ed4b62a-a081-4a37-ba08-8bd444bdd029'} Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 could not be found. Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 could not be found. Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:43.490033 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 could not be found. Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Returning 404 to user: Instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b1e26e20-2037-4f0d-8f9d-7f87115229f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029" status: 404 len: 111 microversion: 2.1 time: 0.050774 Aug 30 04:09:43.498892 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3116/6347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:43 2022] GET /compute/v2.1/servers/3ed4b62a-a081-4a37-ba08-8bd444bdd029 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:43.769133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:43.769823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:43.779735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.780475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.781078 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.781806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.782462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.782888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.243099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.254482 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63866dac-8b5a-492c-b5dc-6312bef704c2 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1576 microversion: 2.1 time: 0.489671 Aug 30 04:09:44.256649 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3232/6348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:43 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1576 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.606362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ba75103d-9fa8-4bd5-90a2-1b6e4b62df17 req-db28e47f-093c-45ab-9754-706365197a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed4b62a-a081-4a37-ba08-8bd444bdd029", "name": "network-vif-deleted", "tag": "10daa5c0-d7fe-425b-87bd-a56491945a07"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:44.623839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ba75103d-9fa8-4bd5-90a2-1b6e4b62df17 req-db28e47f-093c-45ab-9754-706365197a57 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.624630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ba75103d-9fa8-4bd5-90a2-1b6e4b62df17 req-db28e47f-093c-45ab-9754-706365197a57 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.625197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ba75103d-9fa8-4bd5-90a2-1b6e4b62df17 req-db28e47f-093c-45ab-9754-706365197a57 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.638085 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ba75103d-9fa8-4bd5-90a2-1b6e4b62df17 req-db28e47f-093c-45ab-9754-706365197a57 service nova] Creating event network-vif-deleted:10daa5c0-d7fe-425b-87bd-a56491945a07 for instance 3ed4b62a-a081-4a37-ba08-8bd444bdd029 on n-h2-854924-5 Aug 30 04:09:44.643539 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ba75103d-9fa8-4bd5-90a2-1b6e4b62df17 req-db28e47f-093c-45ab-9754-706365197a57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044386 Aug 30 04:09:44.644486 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3117/6349] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:45.280006 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:45.281617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:45.288788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.289409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.289915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.290865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.291385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.291900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.456691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.466912 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7bb3d4e6-787f-44f4-bf3c-3ce41024b395 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1457 microversion: 2.1 time: 0.193362 Aug 30 04:09:45.476439 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3233/6350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:45 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1457 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:46.496319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:46.497700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:46.523602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.526905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.527789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.537173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.538077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.538548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.675970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6e199123-1fa4-4f0f-a27a-492fba0a6246 req-2a440f27-41fa-4452-861a-142c6f17252c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3900f24c-aa4b-4197-a6c4-87d314ac0a11", "name": "network-vif-deleted", "tag": "7b5c7abf-9ffe-42d9-b8f5-a451d66837b9"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:46.711186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6e199123-1fa4-4f0f-a27a-492fba0a6246 req-2a440f27-41fa-4452-861a-142c6f17252c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.712114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.712532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6e199123-1fa4-4f0f-a27a-492fba0a6246 req-2a440f27-41fa-4452-861a-142c6f17252c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.713752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6e199123-1fa4-4f0f-a27a-492fba0a6246 req-2a440f27-41fa-4452-861a-142c6f17252c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.745223 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6e199123-1fa4-4f0f-a27a-492fba0a6246 req-2a440f27-41fa-4452-861a-142c6f17252c service nova] Creating event network-vif-deleted:7b5c7abf-9ffe-42d9-b8f5-a451d66837b9 for instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 on n-h1-854924-5 Aug 30 04:09:46.758564 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6e199123-1fa4-4f0f-a27a-492fba0a6246 req-2a440f27-41fa-4452-861a-142c6f17252c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087416 Aug 30 04:09:46.760023 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3234/6351] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:46.766055 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc38b916-71d1-464a-86c4-a93f95a9c0c4 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1224 microversion: 2.1 time: 0.280977 Aug 30 04:09:46.770477 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3118/6352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:46 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1224 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:47.798369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:47.799951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:47.818669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.819177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.824661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:47.831090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.832651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.837147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.186994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.233251 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d379c891-22cd-4812-a938-763618d9ce51 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1224 microversion: 2.1 time: 0.443758 Aug 30 04:09:48.238425 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3235/6353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:47 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1224 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:49.263621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:49.264284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:49.278318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.279346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.279839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.280674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.281159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.281642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.374476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:49.383652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eb6b6dee-252a-4cab-b043-4ed1f9646a3f tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1224 microversion: 2.1 time: 0.125250 Aug 30 04:09:49.384764 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3119/6354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:49 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:49.528328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96d96457-5ea5-49e3-85c7-b2756bf25e43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '.version_select at 0x7f8983b32b80>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:49.580839 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96d96457-5ea5-49e3-85c7-b2756bf25e43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-491656880" status: 202 len: 0 microversion: 2.1 time: 0.058594 Aug 30 04:09:49.605464 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3236/6355] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 04:09:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-491656880 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:49.624916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f7cf903-6aa5-48d8-b0d6-be34d991ea27 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: .version_select at 0x7f897a710430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-830239816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSx7pufT4d3MQKte9B6GMnhM/AIGXO0f0Fuz7UsJclM2Llho/38mSjdw9+zFmGGjcJrhjSfP/gD+ERVPuH3osxJyjvmItJ0yoE4yfhekFTEs1AzInx/tJQIIcYLlnUM4g=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:49.643102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5f7cf903-6aa5-48d8-b0d6-be34d991ea27 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:49.652194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-5f7cf903-6aa5-48d8-b0d6-be34d991ea27 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:49.688252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f7cf903-6aa5-48d8-b0d6-be34d991ea27 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067181 Aug 30 04:09:49.697657 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3120/6356] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:09:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:50.414106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.414817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:50.428981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.430384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.431050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.432219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.433531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.434481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.531484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.540040 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bcd3859a-705b-4b55-8714-c12e11b246a7 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1224 microversion: 2.1 time: 0.130485 Aug 30 04:09:50.540738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3237/6357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:50 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:51.566043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.567382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:51.580527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.586238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.586713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.587495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.587968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.588641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.792164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fe7a59ed41f4b01b1575359c771d8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27219cb68b7246e884799492355ebab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.802022 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fab5192e-1855-4a2a-8e4b-8bef3420d8c6 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 200 len: 1224 microversion: 2.1 time: 0.239876 Aug 30 04:09:51.816519 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3121/6358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:51 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 1224 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:52.824012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:52.824709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 3900f24c-aa4b-4197-a6c4-87d314ac0a11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:52.832056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.832597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.833555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.834447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.835128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.835722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.850160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 could not be found. Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 HTTP/1.1 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 could not be found. Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '3900f24c-aa4b-4197-a6c4-87d314ac0a11'} Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 could not be found. Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 could not be found. Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:52.852223 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 could not be found. Aug 30 04:09:52.857306 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:52.858519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 3900f24c-aa4b-4197-a6c4-87d314ac0a11 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:52.859367 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b8e6558-de45-4051-9add-74cfd4f2937c tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11" status: 404 len: 111 microversion: 2.1 time: 0.039244 Aug 30 04:09:52.860107 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3238/6359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:52 2022] GET /compute/v2.1/servers/3900f24c-aa4b-4197-a6c4-87d314ac0a11 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:53.679457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.682207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.688799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.689730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.690183 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.691091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.691569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.692056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.708137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 HTTP/1.1 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '0dd84d9b-3ccd-4caf-a46a-84b6254819e2'} Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:53.710517 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eb8a8f8f-d395-4ab9-bde4-5ee2b29dca13 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 404 len: 111 microversion: 2.1 time: 0.039151 Aug 30 04:09:53.717453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3122/6360] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:53 2022] DELETE /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:53.724993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.726132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] [instance: 0dd84d9b-3ccd-4caf-a46a-84b6254819e2] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.732879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.733510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.734031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.734822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.735375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.735866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.751703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] HTTP exception thrown: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Request method failure captured: Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 HTTP/1.1 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYpKhS0Eo6EXw_k-w1LxxG8wV15KSPL9oIlCj1lAGV7Dz7qZeEltI2zZzk4cbszgV6-Uz9Ou6PrbDCZmHBxzlO54j_BM1zjiA0YoADvjTrSmhuDaL-hpkv5RI5hCKAdkpl_LOZNCobFoVkgMZSIvyYNEXNOvnxHpSHcR3G6zXheFWLI Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27219cb68b7246e884799492355ebab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27219cb68b7246e884799492355ebab1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27219cb68b7246e884799492355ebab1"}]}] Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 27219cb68b7246e884799492355ebab1 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestVolumeBootPattern-2086217118 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 8fe7a59ed41f4b01b1575359c771d8e8 Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestVolumeBootPattern-2086217118-project Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0dd84d9b-3ccd-4caf-a46a-84b6254819e2'} Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:53.753619 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. Aug 30 04:09:53.760400 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:09:53.762404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Returning 404 to user: Instance 0dd84d9b-3ccd-4caf-a46a-84b6254819e2 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:53.764200 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-afe0ce43-94b3-4ebf-ad53-b5f61206dcf1 tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2" status: 404 len: 111 microversion: 2.1 time: 0.043472 Aug 30 04:09:53.769911 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3239/6361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:53 2022] GET /compute/v2.1/servers/0dd84d9b-3ccd-4caf-a46a-84b6254819e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:58.862167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-505f3541-550d-4ef4-b764-93bc53ed8ecc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] Calling method '.version_select at 0x7f897a59b310>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.878274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:58.905418 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-505f3541-550d-4ef4-b764-93bc53ed8ecc tempest-TestVolumeBootPattern-2086217118 tempest-TestVolumeBootPattern-2086217118-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-454808694" status: 202 len: 0 microversion: 2.1 time: 0.048164 Aug 30 04:09:58.909083 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3123/6362] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 04:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-454808694 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:59.189770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-726394315", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "5da1f5d6-474d-41a7-902a-1f1af90cd29c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-830239816", "security_groups": [{"name": "tempest-secgroup-smoke-966372101"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:59.204417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:59.869819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] validate_networks() for [('5da1f5d6-474d-41a7-902a-1f1af90cd29c', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:02.138532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:02.140306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:02.142203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:02.142976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:02.143779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:02.167155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.170518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.173984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.175909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.177012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.179638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.199017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:02.282512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:02.314846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:02.344337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:10:02.347825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:10:02.477044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-95c8d386-98e5-4680-a5bb-ae9a313faf72 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.291544 Aug 30 04:10:02.479288 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3240/6363] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 3295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:10:02.499831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0d906d6-9171-48aa-99f2-d4120c4b0626 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:02.502601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0d906d6-9171-48aa-99f2-d4120c4b0626 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:02.526582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:03.158051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b0d906d6-9171-48aa-99f2-d4120c4b0626 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:03.179979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0d906d6-9171-48aa-99f2-d4120c4b0626 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1265 microversion: 2.1 time: 0.691170 Aug 30 04:10:03.183058 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3124/6364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:02 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1265 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:04.204566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:04.209521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:04.220605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.221879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.224115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.225544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.230261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.230997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.452678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.471456 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-54f284b3-1ecf-41e7-a97e-29ed1e33cd2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1317 microversion: 2.1 time: 0.272068 Aug 30 04:10:04.496449 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3241/6365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:04 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:05.511552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:05.512383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:05.516507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:05.537273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.538003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.538577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.539412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.539992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.540543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.744126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:05.754826 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-767b7352-04ba-4919-a878-6ed5d5138591 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1323 microversion: 2.1 time: 0.247245 Aug 30 04:10:05.771072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3125/6366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:05 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1323 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:06.779781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:06.781261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:06.789016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.789857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.790505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.791473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.792103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.792702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.274622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-73f0d146-2c5a-48ee-84f9-b6fa1f1c0030 req-603f55ba-d8d1-4c88-8725-9dcb1dcfa8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:07.296547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-73f0d146-2c5a-48ee-84f9-b6fa1f1c0030 req-603f55ba-d8d1-4c88-8725-9dcb1dcfa8ce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.297409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-73f0d146-2c5a-48ee-84f9-b6fa1f1c0030 req-603f55ba-d8d1-4c88-8725-9dcb1dcfa8ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.298101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-73f0d146-2c5a-48ee-84f9-b6fa1f1c0030 req-603f55ba-d8d1-4c88-8725-9dcb1dcfa8ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.315041 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-73f0d146-2c5a-48ee-84f9-b6fa1f1c0030 req-603f55ba-d8d1-4c88-8725-9dcb1dcfa8ce service nova] Creating event network-changed:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h1-854924-5 Aug 30 04:10:07.324646 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-73f0d146-2c5a-48ee-84f9-b6fa1f1c0030 req-603f55ba-d8d1-4c88-8725-9dcb1dcfa8ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062720 Aug 30 04:10:07.325549 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3126/6367] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:07.371015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.385654 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9535a56d-7d81-4236-9aec-17b09cc97f50 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.609781 Aug 30 04:10:07.386476 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3242/6368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:06 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:08.414031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.415413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:08.423317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.423832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.424290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.425160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.425671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.426121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.804609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:08.813066 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2556ad55-aadb-4fd2-8b66-4565496733a7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.408182 Aug 30 04:10:08.813835 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3127/6369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:09.838260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:09.839100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:09.855646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:09.856254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:09.856954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:09.858001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:09.859132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:09.859938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.148504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:10.162471 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc68b7db-c9cc-4d8b-ab92-1e9a437b4c48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.329877 Aug 30 04:10:10.178469 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3243/6370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:09 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:11.184806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:11.186376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:11.196909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.197451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.197905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.202204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.202792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.203217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.501398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:11.513257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6c67a7fe-2483-4986-bc3f-5b17ec0fa7d9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.332740 Aug 30 04:10:11.525457 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3128/6371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:11 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:12.539076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:12.540303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:12.544305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:12.545631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:12.551192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.551954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:12.552388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:12.553276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.553770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:12.554364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:12.765306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:12.776440 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2916f11-5f6d-4051-aa41-41700d6608b4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.243470 Aug 30 04:10:12.796054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3244/6372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:12 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:13.804898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:13.805872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:13.821763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:13.824641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.825499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.826192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.827340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.829097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.829810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.007815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9f2a8f14-1f4c-4b82-9d9d-5afe47540483 req-8d28d181-e545-413d-9b3a-0d623f7bcb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "name": "network-vif-plugged", "status": "completed", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:14.030513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9f2a8f14-1f4c-4b82-9d9d-5afe47540483 req-8d28d181-e545-413d-9b3a-0d623f7bcb38 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.031888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9f2a8f14-1f4c-4b82-9d9d-5afe47540483 req-8d28d181-e545-413d-9b3a-0d623f7bcb38 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.032755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9f2a8f14-1f4c-4b82-9d9d-5afe47540483 req-8d28d181-e545-413d-9b3a-0d623f7bcb38 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.059514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9f2a8f14-1f4c-4b82-9d9d-5afe47540483 req-8d28d181-e545-413d-9b3a-0d623f7bcb38 service nova] Creating event network-vif-plugged:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h1-854924-5 Aug 30 04:10:14.068295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9f2a8f14-1f4c-4b82-9d9d-5afe47540483 req-8d28d181-e545-413d-9b3a-0d623f7bcb38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072922 Aug 30 04:10:14.069881 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3245/6373] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:14.204991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:14.216458 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d8e37bbc-c068-4bda-9d59-b450b1e05a61 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.417226 Aug 30 04:10:14.219630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3129/6374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:13 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:15.239952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:15.240803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:15.249278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:15.250007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:15.250610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.251733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:15.252194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:15.252628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.412779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.421984 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8432b18f-2699-4715-9460-5f926aecf40d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1390 microversion: 2.1 time: 0.187229 Aug 30 04:10:15.422921 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3246/6375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:15 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:16.442969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:16.443748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:16.450780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.451296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.451741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.452467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.452945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.453441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.609960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:16.618628 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-15695544-cdd1-400b-a16e-876f5fb245f9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1562 microversion: 2.1 time: 0.180323 Aug 30 04:10:16.619535 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3130/6376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:16 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:16.640398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:16.641095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:16.653154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.653832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.654493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.655573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.656389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.656941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.849686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:16.860876 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e0232c8-a7e4-444a-ae73-e4667925fb2f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1562 microversion: 2.1 time: 0.224316 Aug 30 04:10:16.862617 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3247/6377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:16 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:19.562628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:19.563162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:19.577910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.578467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.578932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.579671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.580327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.581483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.583088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0ba2d1fb-819a-49dc-b6f3-199cfc604c67 req-76cc1106-b6da-4c26-a85f-ed2e1a6cfd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:19.607004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0ba2d1fb-819a-49dc-b6f3-199cfc604c67 req-76cc1106-b6da-4c26-a85f-ed2e1a6cfd2e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.610835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0ba2d1fb-819a-49dc-b6f3-199cfc604c67 req-76cc1106-b6da-4c26-a85f-ed2e1a6cfd2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.612000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0ba2d1fb-819a-49dc-b6f3-199cfc604c67 req-76cc1106-b6da-4c26-a85f-ed2e1a6cfd2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.631457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0ba2d1fb-819a-49dc-b6f3-199cfc604c67 req-76cc1106-b6da-4c26-a85f-ed2e1a6cfd2e service nova] Creating event network-changed:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h1-854924-5 Aug 30 04:10:19.640897 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0ba2d1fb-819a-49dc-b6f3-199cfc604c67 req-76cc1106-b6da-4c26-a85f-ed2e1a6cfd2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062948 Aug 30 04:10:19.641894 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3248/6378] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:10:19.758036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:19.767334 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1d48c06-01ca-4c67-83c1-66ce9fcb63a8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1562 microversion: 2.1 time: 0.208652 Aug 30 04:10:19.777917 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3131/6379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:19 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:30.731671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:30.732741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=41 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:30.931766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:30.932367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:30.939052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.939674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.940573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.941278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.941761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.942187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.971027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:10:31.055754 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b628bb35-8f1f-450b-9d48-0e0855bde1f3 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 204 len: 0 microversion: 2.1 time: 0.325877 Aug 30 04:10:31.056480 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3249/6380] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:10:30 2022] DELETE /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:10:31.065746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:31.067110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:31.071623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:31.072351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=38 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:31.076731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:31.077241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:31.077715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:31.078428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:31.078922 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:31.080131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:31.240868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:31.250679 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2eb9be69-c61c-4a09-829d-292ed391ff66 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1733 microversion: 2.1 time: 0.189628 Aug 30 04:10:31.251263 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3132/6381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:31 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:32.272992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:32.274405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:32.282468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.283523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.283966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.284700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.285356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.285813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.580677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:32.589670 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9799225-3c1d-430d-ad7f-ea116defee39 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1733 microversion: 2.1 time: 0.321259 Aug 30 04:10:32.593902 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3250/6382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:32 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1733 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:33.431568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-39b402b5-8f7f-452f-9f21-90d5cc128a20 req-76cab376-3eb1-4657-b78d-2f6aa4d32503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4c46d6-4ccc-4082-bf99-c73d7f2640e3", "name": "network-vif-deleted", "tag": "f4315f8e-9349-4753-930f-6c3be937202a"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:33.460714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39b402b5-8f7f-452f-9f21-90d5cc128a20 req-76cab376-3eb1-4657-b78d-2f6aa4d32503 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:33.461489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39b402b5-8f7f-452f-9f21-90d5cc128a20 req-76cab376-3eb1-4657-b78d-2f6aa4d32503 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:33.462213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39b402b5-8f7f-452f-9f21-90d5cc128a20 req-76cab376-3eb1-4657-b78d-2f6aa4d32503 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:33.479101 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-39b402b5-8f7f-452f-9f21-90d5cc128a20 req-76cab376-3eb1-4657-b78d-2f6aa4d32503 service nova] Creating event network-vif-deleted:f4315f8e-9349-4753-930f-6c3be937202a for instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 on n-h2-854924-5 Aug 30 04:10:33.491415 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-39b402b5-8f7f-452f-9f21-90d5cc128a20 req-76cab376-3eb1-4657-b78d-2f6aa4d32503 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066863 Aug 30 04:10:33.497790 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3133/6383] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:33.611682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:33.613868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:33.622874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:33.623674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:33.624680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:33.625483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:33.627096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:33.627665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:33.687947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:33.688981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:33.689604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:33.690234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lazy-loading 'fault' on Instance uuid 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:33.774484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf441c81ca6846829c715d3354b40305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab0f10e3ac84795a9309e9e59e89389', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:33.788941 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39a473c6-46fe-4da2-beed-d6e20e835d5b tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 200 len: 1388 microversion: 2.1 time: 0.181696 Aug 30 04:10:33.789755 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3251/6384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:33 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 1388 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:34.819678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:34.822023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:34.835940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:34.836849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:34.837636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:34.839089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:34.840025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:34.841279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:34.862582 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] HTTP exception thrown: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Request method failure captured: Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 HTTP/1.1 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYxwG-V9EeFTX-3q6ogx6qNaNPrPOvrwXhzYke2oj5W-x_vkS5TCqoYyxJvm2CjSbux0iUMORcw35vUz2LDAJCKeK8fT1Cslh2DOlO5_S5FKuzhEkpxtFtEx59i8eU7q0vOkZ7nGJStAqXSU8RUN-PkslPXDJ5H1zUam6_5VWmZ78Fk Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 2ab0f10e3ac84795a9309e9e59e89389 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ab0f10e3ac84795a9309e9e59e89389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ab0f10e3ac84795a9309e9e59e89389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ab0f10e3ac84795a9309e9e59e89389", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ab0f10e3ac84795a9309e9e59e89389"}]}] Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 2ab0f10e3ac84795a9309e9e59e89389 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestServerBasicOps-1586472171-project Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: cf441c81ca6846829c715d3354b40305 Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestServerBasicOps-1586472171-project Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7d4c46d6-4ccc-4082-bf99-c73d7f2640e3'} Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:34.865775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Returning 404 to user: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1a2cd500-da41-4799-b40c-5df910c8c83d tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 404 len: 111 microversion: 2.1 time: 0.053150 Aug 30 04:10:34.871421 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3134/6385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:34 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:35.893201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:35.894081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:35.905925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.906815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.908099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.909026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.909882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.910633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.941253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] HTTP exception thrown: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Request method failure captured: Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 HTTP/1.1 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYxwG-V9EeFTX-3q6ogx6qNaNPrPOvrwXhzYke2oj5W-x_vkS5TCqoYyxJvm2CjSbux0iUMORcw35vUz2LDAJCKeK8fT1Cslh2DOlO5_S5FKuzhEkpxtFtEx59i8eU7q0vOkZ7nGJStAqXSU8RUN-PkslPXDJ5H1zUam6_5VWmZ78Fk Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 2ab0f10e3ac84795a9309e9e59e89389 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ab0f10e3ac84795a9309e9e59e89389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ab0f10e3ac84795a9309e9e59e89389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ab0f10e3ac84795a9309e9e59e89389", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ab0f10e3ac84795a9309e9e59e89389"}]}] Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 2ab0f10e3ac84795a9309e9e59e89389 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestServerBasicOps-1586472171-project Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: cf441c81ca6846829c715d3354b40305 Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestServerBasicOps-1586472171-project Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7d4c46d6-4ccc-4082-bf99-c73d7f2640e3'} Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:10:35.944904 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Returning 404 to user: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34f03db4-3022-47d2-ace9-5bfdb271b190 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 404 len: 111 microversion: 2.1 time: 0.059827 Aug 30 04:10:35.952228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3252/6386] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:10:35 2022] DELETE /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:35.959054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:35.959684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] [instance: 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:35.966544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.967048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.967499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.968205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.968675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.969110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.983593 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] HTTP exception thrown: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Request method failure captured: Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 HTTP/1.1 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDYxwG-V9EeFTX-3q6ogx6qNaNPrPOvrwXhzYke2oj5W-x_vkS5TCqoYyxJvm2CjSbux0iUMORcw35vUz2LDAJCKeK8fT1Cslh2DOlO5_S5FKuzhEkpxtFtEx59i8eU7q0vOkZ7nGJStAqXSU8RUN-PkslPXDJ5H1zUam6_5VWmZ78Fk Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 2ab0f10e3ac84795a9309e9e59e89389 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ab0f10e3ac84795a9309e9e59e89389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ab0f10e3ac84795a9309e9e59e89389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ab0f10e3ac84795a9309e9e59e89389", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ab0f10e3ac84795a9309e9e59e89389"}]}] Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 2ab0f10e3ac84795a9309e9e59e89389 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestServerBasicOps-1586472171 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestServerBasicOps-1586472171-project Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: cf441c81ca6846829c715d3354b40305 Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestServerBasicOps-1586472171-project Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7d4c46d6-4ccc-4082-bf99-c73d7f2640e3'} Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:35.985193 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Returning 404 to user: Instance 7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:35.990910 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0bcf52f2-1bf4-4fa0-b3a1-13c8b8fc042e tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3" status: 404 len: 111 microversion: 2.1 time: 0.031574 Aug 30 04:10:35.999189 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3135/6387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:35 2022] GET /compute/v2.1/servers/7d4c46d6-4ccc-4082-bf99-c73d7f2640e3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:10:36.178044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b0a3300-7451-4efa-a77a-e1894e429db2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] Calling method '.version_select at 0x7f897b16a670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:36.234336 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b0a3300-7451-4efa-a77a-e1894e429db2 tempest-TestServerBasicOps-1586472171 tempest-TestServerBasicOps-1586472171-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1532287498" status: 202 len: 0 microversion: 2.1 time: 0.060513 Aug 30 04:10:36.234925 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3253/6388] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 30 04:10:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1532287498 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:10:51.112897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:51.116538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:51.125360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:51.126389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:51.128305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:51.129107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:51.130199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:51.131176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:51.132629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:51.133284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:51.222888 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ca21573-114f-4fa0-b58b-a4ef549c703a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action" status: 200 len: 24566 microversion: 2.1 time: 0.116304 Aug 30 04:10:51.232184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3136/6389] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:51 2022] POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action => generated 24566 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:11:21.621057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:21.621872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:21.624641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:21.627937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:21.651372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.652967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.654411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.655835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.656649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.657381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.960339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:21.973820 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42520db7-0b2f-4b83-a6c5-b41399a86959 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1680 microversion: 2.1 time: 0.357404 Aug 30 04:11:21.975766 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3254/6390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:21 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1680 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:22.176112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:22.183529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.198139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:22.200598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:22.210036 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:11:22.210242 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action (ip 10.222.0.30) !!! Aug 30 04:11:22.213852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.214368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.214831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.215566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.216036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.217032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.314836 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3e411a9-b72d-4134-a5d7-437a70d545d4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action" status: 200 len: 32640 microversion: 2.1 time: 0.144253 Aug 30 04:11:22.315787 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3137/6391] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:22 2022] POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action => generated 32640 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:11:22.564404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:22.565034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.577271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.578283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.579042 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.580608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.586010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.587051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.910369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f042895c-7c2f-4dc8-b33e-98d593cd4f6b tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1831 microversion: 2.1 time: 0.349462 Aug 30 04:11:22.913294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3255/6392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:22 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1831 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:22.949041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:22.951725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.969628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.970133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.970604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.971322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.971788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.972227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.042241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lazy-loading 'flavor' on Instance uuid 983c3a46-02e8-4106-b6a0-db8da7c426b3 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:11:23.114402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Going to try to live migrate instance to another host {{(pid=122167) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:11:26.984947 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4cbf8a34-6bc1-4410-9ce9-8566b8f6709e tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action" status: 202 len: 0 microversion: 2.1 time: 4.039657 Aug 30 04:11:26.987634 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3138/6393] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:22 2022] POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action => generated 0 bytes in 4044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:11:27.001833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:27.003882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:27.037323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:27.041155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:27.044018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:27.045051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:27.045693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:27.046549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:27.455988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:27.482769 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28495991-91b1-4535-bdd5-98d96cf2f31f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.487195 Aug 30 04:11:27.484233 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3256/6394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:26 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:28.508866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:28.509554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:28.519245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.519639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.520313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.521311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.521913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.522299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.715082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:28.729627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c03e02d-bd0f-47a1-b718-39379874b46a tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.224571 Aug 30 04:11:28.730650 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3139/6395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:28 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:28.814292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2e05e12e-8cab-47b2-8e4e-a13b17c1f87b req-01624787-fae5-4240-a369-9c83cb4f9fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "name": "network-vif-unplugged", "status": "completed", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:28.833168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2e05e12e-8cab-47b2-8e4e-a13b17c1f87b req-01624787-fae5-4240-a369-9c83cb4f9fd4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.834434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2e05e12e-8cab-47b2-8e4e-a13b17c1f87b req-01624787-fae5-4240-a369-9c83cb4f9fd4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.834434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2e05e12e-8cab-47b2-8e4e-a13b17c1f87b req-01624787-fae5-4240-a369-9c83cb4f9fd4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.850813 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2e05e12e-8cab-47b2-8e4e-a13b17c1f87b req-01624787-fae5-4240-a369-9c83cb4f9fd4 service nova] Creating event network-vif-unplugged:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h1-854924-5 Aug 30 04:11:28.859585 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2e05e12e-8cab-47b2-8e4e-a13b17c1f87b req-01624787-fae5-4240-a369-9c83cb4f9fd4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046939 Aug 30 04:11:28.861438 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3257/6396] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:11:29.761245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:29.772596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:29.797741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:29.799201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:29.813230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:29.815256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:29.816436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:29.818354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:30.285532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:30.293486 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b628840-fd9e-412a-9e76-d1f8942805de tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.540130 Aug 30 04:11:30.295005 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3140/6397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:29 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:30.916721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5cdb355c-6b84-4e0c-a02b-e15eb824b652 req-5fb51a14-440e-4b81-865d-0af4ac5dd360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:30.954138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5cdb355c-6b84-4e0c-a02b-e15eb824b652 req-5fb51a14-440e-4b81-865d-0af4ac5dd360 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:30.954751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5cdb355c-6b84-4e0c-a02b-e15eb824b652 req-5fb51a14-440e-4b81-865d-0af4ac5dd360 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:30.955388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5cdb355c-6b84-4e0c-a02b-e15eb824b652 req-5fb51a14-440e-4b81-865d-0af4ac5dd360 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:30.976682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5cdb355c-6b84-4e0c-a02b-e15eb824b652 req-5fb51a14-440e-4b81-865d-0af4ac5dd360 service nova] Creating event network-changed:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h1-854924-5 Aug 30 04:11:31.002859 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5cdb355c-6b84-4e0c-a02b-e15eb824b652 req-5fb51a14-440e-4b81-865d-0af4ac5dd360 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094523 Aug 30 04:11:31.003741 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3258/6398] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:31.319833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:31.320579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:31.333678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:31.334149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:31.334636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:31.335468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:31.335981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:31.336617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:32.047238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:32.098778 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3f7f89a-3943-469a-b8c2-810933c062a2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.785208 Aug 30 04:11:32.124701 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3141/6399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:31 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:33.148507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:33.149933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:33.156715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:33.157221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:33.157884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:33.158754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:33.159256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:33.159688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:33.369786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:33.379789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4cdc8434-1e53-4095-879c-d1a283ff5da2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.237150 Aug 30 04:11:33.396074 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3259/6400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:33 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:34.416324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:34.417848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:34.434913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:34.435659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:34.439229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:34.442283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:34.443647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:34.444605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:34.685470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:34.696884 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-613f4148-4204-4bb8-9440-26b41bdd7acb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.288796 Aug 30 04:11:34.712314 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3142/6401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:34 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:35.723799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:35.726094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:35.745656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:35.747924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:35.749105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:35.752060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:35.753237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:35.754731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:36.189010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:36.212984 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d82a827b-96c5-4413-8d5e-e16640360806 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.496701 Aug 30 04:11:36.215466 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3260/6402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:35 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:37.251990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:37.253945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:37.262354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.263148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.263972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.265219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.265889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.266506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.608710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:37.644218 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7ed8230e-2568-4105-a0e8-f7f29be365cb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1690 microversion: 2.1 time: 0.397412 Aug 30 04:11:37.645582 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3143/6403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:37 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1690 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:38.671678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:38.672599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:38.689114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.689641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.690084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:38.690959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.691349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.691781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.045031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:39.060603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6bc190fd-59a9-4d46-a1e5-c69cbdd46080 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1680 microversion: 2.1 time: 0.392914 Aug 30 04:11:39.069239 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3261/6404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:38 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1680 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:39.105058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:39.109150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:39.127861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.129533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.130372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.132298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.132968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.134249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.562257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c77dae9b-0322-4342-a4ac-b9ce33436fc8 tempest-TestNetworkAdvancedServerOps-1099761839 tempest-TestNetworkAdvancedServerOps-1099761839-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1831 microversion: 2.1 time: 0.473424 Aug 30 04:11:39.566685 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3144/6405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:39 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1831 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:39.613068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:39.614157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:39.643310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.645519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.646342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.647594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.653467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.654623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.960251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:39.976887 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-af6b8e97-932c-4b0a-9944-f9ebcbecc873 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1680 microversion: 2.1 time: 0.378145 Aug 30 04:11:39.978213 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3262/6406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:39 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1680 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:42.212513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:42.216598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:42.227061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.227906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.228702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.229725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.231233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.232085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.303569 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fa638b05-a92c-429a-8e84-2b86505a456c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action" status: 200 len: 38634 microversion: 2.1 time: 0.098525 Aug 30 04:11:42.304663 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3145/6407] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:42 2022] POST /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3/action => generated 38634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:11:43.804884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:43.805721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:43.823373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.823634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-154e86fc-b211-40b5-8249-3c413b21e8af req-0a243867-55ee-458e-9c30-261cee6e5c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:43.824391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.824391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:43.825034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.825530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.825956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:43.836554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-154e86fc-b211-40b5-8249-3c413b21e8af req-0a243867-55ee-458e-9c30-261cee6e5c03 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.837059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-154e86fc-b211-40b5-8249-3c413b21e8af req-0a243867-55ee-458e-9c30-261cee6e5c03 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.837561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-154e86fc-b211-40b5-8249-3c413b21e8af req-0a243867-55ee-458e-9c30-261cee6e5c03 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:43.857783 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-154e86fc-b211-40b5-8249-3c413b21e8af req-0a243867-55ee-458e-9c30-261cee6e5c03 service nova] Creating event network-changed:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h2-854924-5 Aug 30 04:11:43.872547 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-154e86fc-b211-40b5-8249-3c413b21e8af req-0a243867-55ee-458e-9c30-261cee6e5c03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052377 Aug 30 04:11:43.874449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3146/6408] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:11:43.883973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:11:44.106879 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71f9bee0-0f5d-4387-bb23-0e779bbd2292 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 204 len: 0 microversion: 2.1 time: 0.306561 Aug 30 04:11:44.108564 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3263/6409] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:11:43 2022] DELETE /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:11:44.120730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:44.122056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:44.138760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:44.139812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:44.140482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:44.150537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:44.151161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:44.151691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:44.481965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:44.496281 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77af288e-0612-4196-8a43-ba283239d8db tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1686 microversion: 2.1 time: 0.380600 Aug 30 04:11:44.497854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3147/6410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:44 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1686 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:45.549803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:45.550492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:45.568034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:45.568645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:45.569292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:45.570223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:45.570911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:45.571503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:45.770929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:45.791922 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b94156d5-4b66-453a-9878-09ffdf327f32 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 200 len: 1501 microversion: 2.1 time: 0.257189 Aug 30 04:11:45.796183 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3264/6411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:45 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:45.984212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4983c06b-376a-420b-a1ee-2d8e23bd23d8 req-6846a10b-8fa5-4103-944d-cfeb5fccbb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983c3a46-02e8-4106-b6a0-db8da7c426b3", "name": "network-vif-deleted", "tag": "c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:46.005214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4983c06b-376a-420b-a1ee-2d8e23bd23d8 req-6846a10b-8fa5-4103-944d-cfeb5fccbb2c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.006997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4983c06b-376a-420b-a1ee-2d8e23bd23d8 req-6846a10b-8fa5-4103-944d-cfeb5fccbb2c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.008437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4983c06b-376a-420b-a1ee-2d8e23bd23d8 req-6846a10b-8fa5-4103-944d-cfeb5fccbb2c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.044276 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4983c06b-376a-420b-a1ee-2d8e23bd23d8 req-6846a10b-8fa5-4103-944d-cfeb5fccbb2c service nova] Creating event network-vif-deleted:c2a4e874-c7dc-44ad-a039-8d0a9bbfa0ef for instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 on n-h2-854924-5 Aug 30 04:11:46.055172 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4983c06b-376a-420b-a1ee-2d8e23bd23d8 req-6846a10b-8fa5-4103-944d-cfeb5fccbb2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.517177 Aug 30 04:11:46.056952 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3148/6412] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:46.823164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:46.826357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 983c3a46-02e8-4106-b6a0-db8da7c426b3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:46.838779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.849334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.852960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.852960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.852960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.852960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.879389 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] HTTP exception thrown: Instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 could not be found. Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Request method failure captured: Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 HTTP/1.1 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYxuevvbjEmzmE7LNIoiJni0CQDkjw1SEe6YrHZ0x-mMjVsIrjRCxOwnu5c96r5TkKB32fgEqJaC8sPrV2HYBnLaYWcyYTrma9Wjh6uURb3MxzmZ7rH7kNomkf-kuu3IBiLpmswnh0havRyh65NG7CoBisJezCWqtgXg2nNFXmhFo80 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_af9b246f8e4e497398b5461f56a695a5", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}] Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c6e3ddedaef54119acc2f890fe5492de Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 could not be found. Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '983c3a46-02e8-4106-b6a0-db8da7c426b3'} Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 could not be found. Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 could not be found. Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:11:46.882589 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 could not be found. Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Returning 404 to user: Instance 983c3a46-02e8-4106-b6a0-db8da7c426b3 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bc320aed-24db-48de-b704-cbf8bd7f10fc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3" status: 404 len: 111 microversion: 2.1 time: 0.070366 Aug 30 04:11:46.897406 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3265/6413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:46 2022] GET /compute/v2.1/servers/983c3a46-02e8-4106-b6a0-db8da7c426b3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:11:52.908754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c486961f-ab51-44bb-aa9f-3fa1b5db755c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '.version_select at 0x7f89784e1f70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:52.938138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=27 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:52.961709 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c486961f-ab51-44bb-aa9f-3fa1b5db755c tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-830239816" status: 202 len: 0 microversion: 2.1 time: 0.065849 Aug 30 04:11:52.963743 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3149/6414] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 04:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-830239816 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:11:53.005608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d007c550-8f82-4f70-8886-5607125ece0f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: .version_select at 0x7f897bd96d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-697553704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8enlhg63iZRg0houApvxyDc2DBbhARxIry3+FhEdWkIMB44zjI8iqKxvEMqb8s2IvhUN2QJFf0NBoiqBHot0j/Nsy4JPgpuY7AZyjZwafGivQu3kbOZTQrNi9CjncQ/Q=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:53.033317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:53.071718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d007c550-8f82-4f70-8886-5607125ece0f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:53.079880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-d007c550-8f82-4f70-8886-5607125ece0f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:53.142745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d007c550-8f82-4f70-8886-5607125ece0f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.144100 Aug 30 04:11:53.143690 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3266/6415] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:03.059673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:03.060531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:03.065536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1814133310", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "b09be5b2-d78a-4274-85f0-0033ceb7f8e6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-697553704", "security_groups": [{"name": "tempest-secgroup-smoke-1394384727"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:03.394390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] validate_networks() for [('b09be5b2-d78a-4274-85f0-0033ceb7f8e6', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:12:04.672493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:12:04.674090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:12:04.674884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:12:04.675887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:12:04.676404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:12:04.686068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:04.686938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:04.687805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:04.689007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:04.689815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:04.690594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:04.713912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:12:04.720890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Getting quotas for user c6e3ddedaef54119acc2f890fe5492de and project af9b246f8e4e497398b5461f56a695a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:12:04.736204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:12:04.739130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:12:04.808441 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3257c65-d106-44f5-9daa-f958b472ef8f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.753880 Aug 30 04:12:04.810994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3150/6416] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:12:04.844282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:04.845048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:04.845695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:04.850742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-898e6fc0-097f-4d54-9ed4-91a8bbffcf78 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:04.851462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-898e6fc0-097f-4d54-9ed4-91a8bbffcf78 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:05.015047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-898e6fc0-097f-4d54-9ed4-91a8bbffcf78 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:05.028980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-898e6fc0-097f-4d54-9ed4-91a8bbffcf78 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1266 microversion: 2.1 time: 0.186134 Aug 30 04:12:05.039977 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3267/6417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:04 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:06.064142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:06.070145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:06.090716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.092267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.093432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:06.094979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.096101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.097171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:06.281799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:06.332391 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc85ebce-58c2-4820-9b59-246a74b623f7 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1318 microversion: 2.1 time: 0.277176 Aug 30 04:12:06.337911 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3151/6418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:06 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:07.371738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:07.372422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:07.411213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:07.417518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:07.418629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.420259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:07.424476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:07.428548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.572024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:07.585972 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8bd56361-c665-4797-8088-45c8f834dd46 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1324 microversion: 2.1 time: 0.221714 Aug 30 04:12:07.587852 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3268/6419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:07 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:08.621289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:08.629818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:08.647713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.650129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.651396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.652907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.653818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.654953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.019064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:09.037163 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-67210372-9549-4323-96d6-0b9c0d5a8343 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.421558 Aug 30 04:12:09.060280 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3152/6420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:08 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:09.744188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-433806c0-f649-4b7e-8587-2cff2f3fbe3a req-d10f75bd-970f-4a50-a7d6-042767aaffe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:09.767023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-433806c0-f649-4b7e-8587-2cff2f3fbe3a req-d10f75bd-970f-4a50-a7d6-042767aaffe5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.768761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-433806c0-f649-4b7e-8587-2cff2f3fbe3a req-d10f75bd-970f-4a50-a7d6-042767aaffe5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.769865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-433806c0-f649-4b7e-8587-2cff2f3fbe3a req-d10f75bd-970f-4a50-a7d6-042767aaffe5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.785611 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-433806c0-f649-4b7e-8587-2cff2f3fbe3a req-d10f75bd-970f-4a50-a7d6-042767aaffe5 service nova] Creating event network-changed:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:12:09.794827 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-433806c0-f649-4b7e-8587-2cff2f3fbe3a req-d10f75bd-970f-4a50-a7d6-042767aaffe5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054150 Aug 30 04:12:09.796199 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3269/6421] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:10.075702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:10.076478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:10.086417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:10.090196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:10.090971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:10.092262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:10.096629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:10.097582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:10.406141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:10.421761 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3be1a455-452d-412d-923e-ce42df45dfca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.350055 Aug 30 04:12:10.423778 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3153/6422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:10 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:11.457837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:11.459455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:11.467707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:11.468198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:11.468972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:11.469745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:11.470206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:11.470626 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:11.656402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:11.673082 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0a1c61a-5c16-46b8-bc9c-605963d16adb tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.219608 Aug 30 04:12:11.674560 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3270/6423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:11 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:12.696905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:12.698378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:12.730780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.732186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.733416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.735310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.736724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.740362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.976891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:12.997300 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-29c56479-7a91-4117-8fac-af67623cae86 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.305426 Aug 30 04:12:12.999680 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3154/6424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:12 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:14.027345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:14.029104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:14.045120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:14.050116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:14.050886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:14.052170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:14.054033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:14.060129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:14.355964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:14.364322 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9bc92bc-7ee2-437e-9024-429f6324e2d0 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.346421 Aug 30 04:12:14.377674 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3271/6425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:14 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.387234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.388993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:15.403685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:15.405945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:15.411898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.412741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.413685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.415276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.416936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.418386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.680115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:15.689015 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-29f5affa-4705-42e9-907d-bf57ecc7b1d8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.305831 Aug 30 04:12:15.689655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3155/6426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:16.232283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:16.557827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-df7b96f5-7e3a-4dd5-a746-e88e19594436 req-39799bd8-4d38-4ddd-bdc5-e5f7bad6a23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "name": "network-vif-plugged", "status": "completed", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:16.611094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-df7b96f5-7e3a-4dd5-a746-e88e19594436 req-39799bd8-4d38-4ddd-bdc5-e5f7bad6a23e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.612194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-df7b96f5-7e3a-4dd5-a746-e88e19594436 req-39799bd8-4d38-4ddd-bdc5-e5f7bad6a23e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.617102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-df7b96f5-7e3a-4dd5-a746-e88e19594436 req-39799bd8-4d38-4ddd-bdc5-e5f7bad6a23e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.647547 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-df7b96f5-7e3a-4dd5-a746-e88e19594436 req-39799bd8-4d38-4ddd-bdc5-e5f7bad6a23e service nova] Creating event network-vif-plugged:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:12:16.660533 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-df7b96f5-7e3a-4dd5-a746-e88e19594436 req-39799bd8-4d38-4ddd-bdc5-e5f7bad6a23e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437194 Aug 30 04:12:16.665504 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3272/6427] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:16.712616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:16.713903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:16.720949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.721905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.722556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.723361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.723832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.724272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.028145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:17.041944 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b48d3781-6209-4cda-b1a1-71bde9f2daca tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.332762 Aug 30 04:12:17.055333 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3156/6428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:16 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:18.067889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:18.068907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:18.079478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:18.080248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:18.081313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:18.082566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:18.083215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:18.083772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:18.331462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:18.348910 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6c61809-38e5-48a7-93e6-8cec9e94fdf4 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1392 microversion: 2.1 time: 0.287158 Aug 30 04:12:18.350588 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3273/6429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:18 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:19.378019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:19.379109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:19.389611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.391190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.391962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.392793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.393397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.393872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.624822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:19.638606 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9df9670d-c5dc-475e-a62f-2444b58e4d43 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1563 microversion: 2.1 time: 0.265755 Aug 30 04:12:19.639566 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3157/6430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:19 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1563 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:19.674489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:19.675527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:19.686021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.686920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.687977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.689077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.689836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.690349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.915152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:19.929923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3cf4d9d9-ff66-4869-849e-3c761a8b85bc tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1563 microversion: 2.1 time: 0.262023 Aug 30 04:12:19.944849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3274/6431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:19 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:22.937292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:22.939151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:22.944448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-eb9d84cd-0650-4af8-beea-d95cf051e0f4 req-da99f10c-3be4-4c81-b353-6739b6889991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:22.963883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb9d84cd-0650-4af8-beea-d95cf051e0f4 req-da99f10c-3be4-4c81-b353-6739b6889991 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.964722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb9d84cd-0650-4af8-beea-d95cf051e0f4 req-da99f10c-3be4-4c81-b353-6739b6889991 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.965530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eb9d84cd-0650-4af8-beea-d95cf051e0f4 req-da99f10c-3be4-4c81-b353-6739b6889991 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.971435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.972311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.973125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.974724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.975334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.976630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.987912 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-eb9d84cd-0650-4af8-beea-d95cf051e0f4 req-da99f10c-3be4-4c81-b353-6739b6889991 service nova] Creating event network-changed:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:12:23.000604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-eb9d84cd-0650-4af8-beea-d95cf051e0f4 req-da99f10c-3be4-4c81-b353-6739b6889991 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061669 Aug 30 04:12:23.008958 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3275/6432] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:23.251029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:23.264729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8752bfa3-898f-4d07-982a-65c50d8ef446 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1563 microversion: 2.1 time: 0.335228 Aug 30 04:12:23.270108 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3158/6433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:22 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1563 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:27.278074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1571910172", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "771314d3-c6eb-4753-ae77-6cae05a846f2"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:27.363406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] validate_networks() for [('771314d3-c6eb-4753-ae77-6cae05a846f2', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:12:27.862416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:12:27.863198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:12:27.864350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:12:27.865104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:12:27.866296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:12:27.880340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:27.881107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:27.881828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:27.883214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:27.884724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:27.885641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:27.910349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Getting quotas for project cb332673e2d247b7863109e8c88cd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:12:27.917135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Getting quotas for user 9a5797f1cb564171b7bfde12c255ef15 and project cb332673e2d247b7863109e8c88cd0a2. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:12:27.933165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:12:27.936542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:12:27.998881 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8734f561-bae7-4876-9016-ec867c0cfd21 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899782 Aug 30 04:12:27.999778 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3276/6434] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:12:28.018277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-665edc95-6879-488d-90c1-5fd51521982e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:28.021578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-665edc95-6879-488d-90c1-5fd51521982e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:28.129238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-665edc95-6879-488d-90c1-5fd51521982e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:28.144947 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-665edc95-6879-488d-90c1-5fd51521982e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1214 microversion: 2.1 time: 0.136582 Aug 30 04:12:28.146783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3159/6435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:28 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:29.170413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:29.172911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:29.186221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.187092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.187864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.188904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.191055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.191055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.292422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:29.310642 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29ea0eba-5f9c-48c4-b597-8f80efb612d1 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1266 microversion: 2.1 time: 0.144289 Aug 30 04:12:29.330601 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3277/6436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:29 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:30.350473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:30.350473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:30.361660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:30.362179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:30.362642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:30.363376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:30.363851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:30.364304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:30.673068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:30.683103 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ab7341f-42ef-4dd3-9e1a-5a2685235137 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1314 microversion: 2.1 time: 0.338281 Aug 30 04:12:30.684366 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3160/6437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:30 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:31.015450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-7bf4962c-5e44-4532-af73-8a224b717e10 req-a5a9288b-dc39-4797-b158-8a9d26e871d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3964247b-889e-4e59-a7af-3da736f897e3", "tag": "4ef62a45-2d61-4233-ba85-17b267c21306"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:31.039592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7bf4962c-5e44-4532-af73-8a224b717e10 req-a5a9288b-dc39-4797-b158-8a9d26e871d5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.041203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7bf4962c-5e44-4532-af73-8a224b717e10 req-a5a9288b-dc39-4797-b158-8a9d26e871d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.042120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7bf4962c-5e44-4532-af73-8a224b717e10 req-a5a9288b-dc39-4797-b158-8a9d26e871d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.062133 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-7bf4962c-5e44-4532-af73-8a224b717e10 req-a5a9288b-dc39-4797-b158-8a9d26e871d5 service nova] Creating event network-changed:4ef62a45-2d61-4233-ba85-17b267c21306 for instance 3964247b-889e-4e59-a7af-3da736f897e3 on n-h2-854924-5 Aug 30 04:12:31.067640 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-7bf4962c-5e44-4532-af73-8a224b717e10 req-a5a9288b-dc39-4797-b158-8a9d26e871d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066634 Aug 30 04:12:31.068896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3278/6438] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:31.708086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:31.709500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:31.724464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.725367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.726151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.727951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.728773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.729588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.937276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:31.945807 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3dfa6f3f-b8ba-4de5-977e-d81a8f34eac8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1314 microversion: 2.1 time: 0.244963 Aug 30 04:12:31.946470 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3161/6439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:31 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:32.979463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:32.981015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:32.989366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.989865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.990297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.991026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.991476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.991897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.179849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:33.193265 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-772771d5-3cc1-4482-ab6d-b8101aa29ed6 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1314 microversion: 2.1 time: 0.223558 Aug 30 04:12:33.194362 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3279/6440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:32 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:34.218605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.219369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:34.222841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:34.230161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:34.230763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:34.231287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:34.232096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:34.232768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:34.233601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:34.237658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=63 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:34.422077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:34.433044 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-799aede0-80cb-4107-95ee-c14914f18374 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1314 microversion: 2.1 time: 0.219293 Aug 30 04:12:34.433695 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3162/6441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:34 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:35.457839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.458484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.462071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:35.470050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.470563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.471563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.472420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.472889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.473411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.477479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=53 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:35.662272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:35.688149 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cac1cd67-8d30-46ac-baf1-c9f08799577f tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1314 microversion: 2.1 time: 0.234601 Aug 30 04:12:35.689733 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3280/6442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:35 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:35.848945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-df14e65a-b640-4145-8224-774598530606 req-dcd607e1-dd7d-4a15-8dd2-99ec73a812be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3964247b-889e-4e59-a7af-3da736f897e3", "name": "network-vif-plugged", "status": "completed", "tag": "4ef62a45-2d61-4233-ba85-17b267c21306"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:35.861667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-df14e65a-b640-4145-8224-774598530606 req-dcd607e1-dd7d-4a15-8dd2-99ec73a812be service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.862169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-df14e65a-b640-4145-8224-774598530606 req-dcd607e1-dd7d-4a15-8dd2-99ec73a812be service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.862787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-df14e65a-b640-4145-8224-774598530606 req-dcd607e1-dd7d-4a15-8dd2-99ec73a812be service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.877375 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-df14e65a-b640-4145-8224-774598530606 req-dcd607e1-dd7d-4a15-8dd2-99ec73a812be service nova] Creating event network-vif-plugged:4ef62a45-2d61-4233-ba85-17b267c21306 for instance 3964247b-889e-4e59-a7af-3da736f897e3 on n-h2-854924-5 Aug 30 04:12:35.884053 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-df14e65a-b640-4145-8224-774598530606 req-dcd607e1-dd7d-4a15-8dd2-99ec73a812be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038636 Aug 30 04:12:35.885084 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3163/6443] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:36.723783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:36.724416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:36.732235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:36.732790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:36.733237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:36.733993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:36.734455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:36.734885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:36.951591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:36.961171 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8baefae-8d4c-4acc-834f-a31770bcda52 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1314 microversion: 2.1 time: 0.242548 Aug 30 04:12:36.962366 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3281/6444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:36 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:37.985618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:37.986841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:37.996310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.997131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.997923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.999302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:38.000351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:38.001055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:38.138593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:38.176182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:38.186666 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-86c69421-f77b-400a-995a-8fafd8803e9e tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1498 microversion: 2.1 time: 0.206798 Aug 30 04:12:38.187369 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3164/6445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:37 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1498 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:40.893952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.894489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:40.906169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:40.907337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:40.916581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.917088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.917572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.918292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.918749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.919178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.952638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:12:41.046461 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c33fe63e-4b7b-475f-b3fd-dd06e16fb3b8 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 204 len: 0 microversion: 2.1 time: 0.156274 Aug 30 04:12:41.047032 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3282/6446] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:40 2022] DELETE /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:41.058159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.058960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:41.068860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.069594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.070218 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.071217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.071882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.072494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.221619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:41.229619 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6b527c7-c9cf-40a1-ad21-6c99b61b51ca tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1504 microversion: 2.1 time: 0.177951 Aug 30 04:12:41.230195 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3165/6447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:41 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:42.252447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:42.253210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:42.260959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.261470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.261905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.262601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.263127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.263571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.483043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:42.492862 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69eecb85-de29-4266-a38b-52813bdc6029 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1504 microversion: 2.1 time: 0.244222 Aug 30 04:12:42.493468 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3283/6448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:42 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:43.232971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ab4f7855-32df-430b-b4c7-3ddd5d385e40 req-36697aac-6c32-443d-ad74-d3b4aa93d37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3964247b-889e-4e59-a7af-3da736f897e3", "name": "network-vif-deleted", "tag": "4ef62a45-2d61-4233-ba85-17b267c21306"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:43.244625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ab4f7855-32df-430b-b4c7-3ddd5d385e40 req-36697aac-6c32-443d-ad74-d3b4aa93d37c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.245127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ab4f7855-32df-430b-b4c7-3ddd5d385e40 req-36697aac-6c32-443d-ad74-d3b4aa93d37c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.245608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ab4f7855-32df-430b-b4c7-3ddd5d385e40 req-36697aac-6c32-443d-ad74-d3b4aa93d37c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.261656 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ab4f7855-32df-430b-b4c7-3ddd5d385e40 req-36697aac-6c32-443d-ad74-d3b4aa93d37c service nova] Creating event network-vif-deleted:4ef62a45-2d61-4233-ba85-17b267c21306 for instance 3964247b-889e-4e59-a7af-3da736f897e3 on n-h2-854924-5 Aug 30 04:12:43.269268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ab4f7855-32df-430b-b4c7-3ddd5d385e40 req-36697aac-6c32-443d-ad74-d3b4aa93d37c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039542 Aug 30 04:12:43.270256 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3166/6449] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:43.515556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:43.516221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:43.524027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.524541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.524974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.525712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.526202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.526577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.566981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.567463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.567895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.568352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lazy-loading 'fault' on Instance uuid 3964247b-889e-4e59-a7af-3da736f897e3 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:43.617968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5797f1cb564171b7bfde12c255ef15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb332673e2d247b7863109e8c88cd0a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:43.626827 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e30fb0af-e3c9-4343-bdf1-572bce05b555 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 200 len: 1304 microversion: 2.1 time: 0.116321 Aug 30 04:12:43.627549 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3284/6450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:44.660748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:44.661516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] [instance: 3964247b-889e-4e59-a7af-3da736f897e3] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:44.668605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:44.669112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:44.669598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.670341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:44.670807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:44.671248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.685195 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] HTTP exception thrown: Instance 3964247b-889e-4e59-a7af-3da736f897e3 could not be found. Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Request method failure captured: Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 HTTP/1.1 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY4o7u8KcrB5UITpwlsoNhsK_RTtyHPLMylZ-eZbTg3DQE1bgcKiTRmzJp6gAOkkWJAilw4R5Y5T9weUPmhAG7ekYmD89no0wNEsHsAsxWV80p1MqPG1FBMT_WMDyxLUQ0PAr-6AZVgEUk-1YY5ds4mSVnR7c7t25CwitFrLVXgGXXM Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: cb332673e2d247b7863109e8c88cd0a2 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-VolumesActionsTest-1007736964 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb332673e2d247b7863109e8c88cd0a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb332673e2d247b7863109e8c88cd0a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb332673e2d247b7863109e8c88cd0a2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb332673e2d247b7863109e8c88cd0a2"}]}] Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-VolumesActionsTest-1007736964 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: cb332673e2d247b7863109e8c88cd0a2 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-VolumesActionsTest-1007736964 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-VolumesActionsTest-1007736964-project Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9a5797f1cb564171b7bfde12c255ef15 Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-VolumesActionsTest-1007736964-project Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 3964247b-889e-4e59-a7af-3da736f897e3 could not be found. Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '3964247b-889e-4e59-a7af-3da736f897e3'} Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3964247b-889e-4e59-a7af-3da736f897e3 could not be found. Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3964247b-889e-4e59-a7af-3da736f897e3 could not be found. Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:44.686850 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3964247b-889e-4e59-a7af-3da736f897e3 could not be found. Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] Returning 404 to user: Instance 3964247b-889e-4e59-a7af-3da736f897e3 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be89e495-094e-420e-9570-fb859e199e57 tempest-VolumesActionsTest-1007736964 tempest-VolumesActionsTest-1007736964-project] 10.222.0.30 "GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3" status: 404 len: 111 microversion: 2.1 time: 0.033076 Aug 30 04:12:44.692492 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3167/6451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:44 2022] GET /compute/v2.1/servers/3964247b-889e-4e59-a7af-3da736f897e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:53.841337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:53.843918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:53.853403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:53.854660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:53.856372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.857288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.857933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.858797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.859310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.859748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.969516 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aaeb0b86-9ad6-4694-87b0-ee9940a76729 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace/action" status: 200 len: 24570 microversion: 2.1 time: 0.132087 Aug 30 04:12:53.970355 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3285/6452] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:53 2022] POST /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace/action => generated 24570 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:13:24.415493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:24.418266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.420412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.421078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=23 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.429789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.430291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.430744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.431454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.431918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.432358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.512805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:24.513236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:24.513742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:24.514162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:24.514589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:24.579650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.586003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.586631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.587202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.588136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.588838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.589417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.622939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb888336-0209-40c2-8e57-b4525de97616 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace/action" status: 202 len: 1137 microversion: 2.1 time: 0.212291 Aug 30 04:13:24.624133 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3168/6453] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:13:24 2022] POST /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace/action => generated 1137 bytes in 214 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 04:13:24.644625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:24.645522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.648916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.649662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.656876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.657394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.657836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.658772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.659231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.659660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.801872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:24.810724 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-14b77734-18c2-4a52-9a18-d64918eb45fd tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.171089 Aug 30 04:13:24.811298 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3286/6454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:24 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:25.043983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-32a59892-1cdd-47c7-a770-acb4449e8e57 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Action: 'create', calling method: .version_select at 0x7f897ae89820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1558876400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAxTqf6SQR0Slby6RC3a9d9bF3uhyqFxArSnVK6KhZYrVOkvvAxAKJ/O2dSbBOiPzKw1gd7XCW7HMt23npNyEr6teJ5U2GrZhUUxAD4Ffya0riu6j90ZwM5PsNq+Ic92g=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:25.060361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-32a59892-1cdd-47c7-a770-acb4449e8e57 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Getting quotas for project 7bedeefa7f044ef9ba1e43e9acf19570. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:25.065636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-32a59892-1cdd-47c7-a770-acb4449e8e57 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Getting quotas for user 04a9f3e39a304e5cab64a6df53e26a1c and project 7bedeefa7f044ef9ba1e43e9acf19570. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:25.100978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-32a59892-1cdd-47c7-a770-acb4449e8e57 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060960 Aug 30 04:13:25.102060 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3169/6455] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:13:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:25.835507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:25.836126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:25.863071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:25.863905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:25.864642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:25.865900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:25.867027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:25.867480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:26.218262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:26.227569 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-225a09f2-1752-410e-a0e4-1fed6d88b397 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.399493 Aug 30 04:13:26.241771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3287/6456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:25 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:26.584564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1762092673", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a3a15add-3ca8-4d49-8721-258aea8a5935", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1558876400", "security_groups": [{"name": "tempest-secgroup-smoke-1328413923"}], "networks": [{"uuid": "c825e820-71ca-4bf9-973d-dd112409d11f"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:26.753176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] validate_networks() for [('c825e820-71ca-4bf9-973d-dd112409d11f', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:27.254140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:27.257063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:27.271323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.272189 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.273242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.274770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.275831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.277033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.307782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:27.308526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:27.309135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:27.309899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:27.310653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:27.323513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.324159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.324917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.326004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.326576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.327283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.351170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Getting quotas for project 7bedeefa7f044ef9ba1e43e9acf19570. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:27.357538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Getting quotas for user 04a9f3e39a304e5cab64a6df53e26a1c and project 7bedeefa7f044ef9ba1e43e9acf19570. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:27.439589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:27.443966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3a15add-3ca8-4d49-8721-258aea8a5935',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:27.493306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:27.504732 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f89ba345-d97e-4e04-85ab-a955fec4b307 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.258101 Aug 30 04:13:27.505386 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3288/6457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:27 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:27.600102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ebe7c66-7607-4dad-ad5f-2cbc3d1a0e6e tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.021859 Aug 30 04:13:27.605103 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3170/6458] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:13:27.611643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8fb11aec-d920-44ba-8cbe-25abed044765 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:27.612321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8fb11aec-d920-44ba-8cbe-25abed044765 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:27.674456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8fb11aec-d920-44ba-8cbe-25abed044765 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:27.682864 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8fb11aec-d920-44ba-8cbe-25abed044765 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1099 microversion: 2.1 time: 0.075102 Aug 30 04:13:27.683635 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3289/6459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:27 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1099 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:28.528334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:28.528957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:28.535156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.535651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.536100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.536795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.537257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.537794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.689131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:28.698086 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cee42726-0584-4f95-be88-5dd9467abb00 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.174058 Aug 30 04:13:28.698673 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3171/6460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:28 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:28.708916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:28.710836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:28.719848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.720507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.721145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.722155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.722699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.723132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.804100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:28.812969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e8fed70a-6863-4a9e-a468-6a789415d066 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1197 microversion: 2.1 time: 0.109364 Aug 30 04:13:28.813898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3290/6461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:28 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:29.722785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:29.724569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:29.733760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.734271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.735231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.737979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.737979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.737979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.839238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:29.841328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:29.854302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.855179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.855956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.857181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.869557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.870712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.110437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:30.119694 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48ad4914-6496-470c-998b-78393fd31f67 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.401864 Aug 30 04:13:30.120437 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3172/6462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:29 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:30.218913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:30.229907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5c0e63de-9a9c-4e0f-9706-10e2496701cc tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1283 microversion: 2.1 time: 0.398304 Aug 30 04:13:30.230654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3291/6463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:29 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1283 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:30.628754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-990aa18a-154a-4407-8e51-2822770e0045 req-602f7b2b-dfc1-4698-affd-fe40fc5aa47e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:30.643000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-990aa18a-154a-4407-8e51-2822770e0045 req-602f7b2b-dfc1-4698-affd-fe40fc5aa47e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.643584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-990aa18a-154a-4407-8e51-2822770e0045 req-602f7b2b-dfc1-4698-affd-fe40fc5aa47e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.644367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-990aa18a-154a-4407-8e51-2822770e0045 req-602f7b2b-dfc1-4698-affd-fe40fc5aa47e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.660223 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-990aa18a-154a-4407-8e51-2822770e0045 req-602f7b2b-dfc1-4698-affd-fe40fc5aa47e service nova] Creating event network-changed:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:13:30.668417 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-990aa18a-154a-4407-8e51-2822770e0045 req-602f7b2b-dfc1-4698-affd-fe40fc5aa47e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Aug 30 04:13:30.669723 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3173/6464] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:13:31.147111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:31.149255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:31.162313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.163313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.164177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.165241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.165792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.166627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.256762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:31.257914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:31.265081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.265654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.266102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.266850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.267656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.268129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.502498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:31.515014 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-399b902c-8ffc-4469-8d4f-febb89d0d917 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.375877 Aug 30 04:13:31.517880 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3292/6465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:31 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:31.576427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:31.588214 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-64171716-97e9-4054-8bde-0ac9747490b6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1283 microversion: 2.1 time: 0.337584 Aug 30 04:13:31.598912 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3174/6466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:31 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1283 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:32.549922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:32.550544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:32.558197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:32.558691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:32.559132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:32.559828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:32.560288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:32.560717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:32.612740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:32.613296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:32.620349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:32.620854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:32.621306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:32.622146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:32.622624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:32.623064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:32.748957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:32.757481 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c6cf2a4-a5be-49e2-b81b-01be90550d19 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.211363 Aug 30 04:13:32.758311 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3293/6467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:32 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:32.802344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:32.811000 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc371b4f-49e6-4e49-bd36-fe8bb5aaf951 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1283 microversion: 2.1 time: 0.202505 Aug 30 04:13:32.811845 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3175/6468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:32 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1283 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:33.779409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:33.780253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:33.789968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.790461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.790904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.791742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.792176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.792606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.844687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:33.845374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:33.853002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.853551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.854006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.854724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.855190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.855632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.991600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.000152 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f80821f2-2b51-477f-8f2b-3c08d75239c8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.224634 Aug 30 04:13:34.001160 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3294/6469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:33 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:34.046439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.057035 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dadbe01c-21d5-4e5b-8167-7c9cfac2f630 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1283 microversion: 2.1 time: 0.216259 Aug 30 04:13:34.057733 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3176/6470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:33 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1283 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.022519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:35.023148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:35.030407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.030892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.031329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.032130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.032586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.033013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.084002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:35.084643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:35.092019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.092531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.092983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.093734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.094206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.094648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.228366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:35.237920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42b92199-ca5a-479d-a3e0-ec0a829c4816 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.219193 Aug 30 04:13:35.238518 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3295/6471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:35 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:35.273587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:35.283613 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bbf2c462-f986-463f-acdc-1b740d6f5b24 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.206206 Aug 30 04:13:35.284192 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3177/6472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:35 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:36.260788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.261414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:36.268972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.269484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.269952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.271126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.271574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.271994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.316224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.317528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:36.324502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.325000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.325474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.326186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.326652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.327089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.444260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:36.457766 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-93771a76-c358-4c27-83fc-4ef47c9bfba8 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.200925 Aug 30 04:13:36.458377 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3296/6473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:36 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:36.491241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:36.499442 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a13f57a6-6b9d-4c7e-870e-0134fe9000de tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.187909 Aug 30 04:13:36.500000 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3178/6474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:36 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:37.479578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:37.480199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:37.487050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.487541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.487973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.488666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.489117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.489570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.524415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:37.525086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:37.527913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.528623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.534869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.535375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.535859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.536574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.537036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.537498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.673010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.679187 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.682119 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ec2437e5-29e3-4047-bb5a-643b0c2dd518 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.206373 Aug 30 04:13:37.683241 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3297/6475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:37 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:37.705933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.714594 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9919cdc0-72e5-48ce-9087-682b1f9a0f12 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.194728 Aug 30 04:13:37.715174 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3179/6476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:37 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:38.704030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:38.704632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:38.712365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.712855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.713288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.714003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.714459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.714907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.734404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:38.735647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:38.743495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.744009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.744468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.745192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.745698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.748636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.946891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:38.953722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:38.955633 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7b6baa0-222b-4d01-a517-039c92de7332 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.255403 Aug 30 04:13:38.956488 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3298/6477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:38 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:38.962810 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd3c6b5d-08b8-404f-819c-727b6a5a3676 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.232228 Aug 30 04:13:38.965819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3180/6478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:38 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:39.978241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:39.978881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:39.984078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:39.984746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:39.988501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:39.988995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:39.989455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:39.990167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:39.990623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:39.991052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:39.993656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:39.994165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:39.994643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:39.995358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:39.995823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:39.996261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:40.204280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:40.207471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:40.212650 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00f8c57d-3ebe-4bcb-86ba-b668f3006059 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.232799 Aug 30 04:13:40.213254 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3181/6479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:39 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:40.217231 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8a8776dd-7400-4e14-958c-ff0ef01c2b11 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.242993 Aug 30 04:13:40.217851 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3299/6480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:39 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:41.233290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:41.234007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:41.241614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.242125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.242588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.242799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:41.243472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.243661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:41.243834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.244226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.252440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.253097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.253698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.254688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.255485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.256235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.457161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.460975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.466915 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-02ffa1be-6fc0-4f50-8def-9971e811520c tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.237481 Aug 30 04:13:41.467537 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3182/6481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:41 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:41.473947 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-75ef05da-adb8-41a7-bee4-9c73351141e9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.235033 Aug 30 04:13:41.475026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3300/6482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:41 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:42.489637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:42.490338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:42.499377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.499886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.500341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.501888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.503110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.503773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.504707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:42.506396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:42.515611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.516651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.517616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.518728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.519441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.520105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.785668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:42.792780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:42.793991 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b078a667-0246-4441-a7a7-cf9f9d9ab3e5 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.309252 Aug 30 04:13:42.794594 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3183/6483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:42 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:42.807115 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eb423b39-367c-4d63-a269-2acf41a7db93 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1691 microversion: 2.1 time: 0.307112 Aug 30 04:13:42.809462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3301/6484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:42 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:43.817233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:43.817910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:43.824914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.825451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.825910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.826631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.827101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.827544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.831061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:43.831711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:43.840370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.841444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.841902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.842625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.843088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.843520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.375701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.380126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:44.385721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e146bfdf-11ae-4d08-b605-a5721991b010 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.572338 Aug 30 04:13:44.386327 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3184/6485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:43 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:44.390468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.399502 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-236fb646-e9d9-45b1-802b-dc599cf5dd48 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1697 microversion: 2.1 time: 0.572504 Aug 30 04:13:44.400092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3302/6486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:43 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1697 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:44.404360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-39fcc59a-f698-40a9-a30a-e0fe3e02b5bf req-54a1b615-fd64-4dda-b939-19f921a6905d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "name": "network-vif-plugged", "status": "completed", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:44.415386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39fcc59a-f698-40a9-a30a-e0fe3e02b5bf req-54a1b615-fd64-4dda-b939-19f921a6905d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.415883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39fcc59a-f698-40a9-a30a-e0fe3e02b5bf req-54a1b615-fd64-4dda-b939-19f921a6905d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.416332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-39fcc59a-f698-40a9-a30a-e0fe3e02b5bf req-54a1b615-fd64-4dda-b939-19f921a6905d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.427841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-39fcc59a-f698-40a9-a30a-e0fe3e02b5bf req-54a1b615-fd64-4dda-b939-19f921a6905d service nova] Creating event network-vif-plugged:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:13:44.432975 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-39fcc59a-f698-40a9-a30a-e0fe3e02b5bf req-54a1b615-fd64-4dda-b939-19f921a6905d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045321 Aug 30 04:13:44.433868 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3185/6487] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:45.409612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:45.410330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:45.418008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.418508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.418953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.419668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.420129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.420556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.422703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:45.423438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:45.431640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.432158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.432613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.433338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.433917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.434367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.440534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:45.721164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:45.733497 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c13a73f-fa05-476d-ac32-5950e2c02267 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1271 microversion: 2.1 time: 0.327580 Aug 30 04:13:45.734505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3303/6488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:45 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1271 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:45.736683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:45.745952 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c925ad4-d1e1-494d-be35-66500eafcf82 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1697 microversion: 2.1 time: 0.327488 Aug 30 04:13:45.746859 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3186/6489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:45 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1697 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:46.537422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-10510bcf-a8b3-45e0-a270-8453d1a2cd23 req-0cea900e-f47f-4205-ba9e-4706e06652a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "name": "network-vif-unplugged", "status": "completed", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:46.551095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-10510bcf-a8b3-45e0-a270-8453d1a2cd23 req-0cea900e-f47f-4205-ba9e-4706e06652a7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.551674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-10510bcf-a8b3-45e0-a270-8453d1a2cd23 req-0cea900e-f47f-4205-ba9e-4706e06652a7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.552184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-10510bcf-a8b3-45e0-a270-8453d1a2cd23 req-0cea900e-f47f-4205-ba9e-4706e06652a7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.565070 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-10510bcf-a8b3-45e0-a270-8453d1a2cd23 req-0cea900e-f47f-4205-ba9e-4706e06652a7 service nova] Creating event network-vif-unplugged:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:13:46.572127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-10510bcf-a8b3-45e0-a270-8453d1a2cd23 req-0cea900e-f47f-4205-ba9e-4706e06652a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038591 Aug 30 04:13:46.572748 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3304/6490] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:46.756148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:46.757022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:46.765429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.766205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.767244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.768341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.770057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.770702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.773900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:46.774872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:46.782450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.782984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.783517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.784301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.784754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.785183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.011762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.020344 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-544ba207-1b30-4dbc-b475-b3e7a8364e88 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1459 microversion: 2.1 time: 0.268614 Aug 30 04:13:47.023220 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3187/6491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:46 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1459 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.026601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.040041 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a40d2f69-451a-46c3-94f2-a81a8ae1634f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1682 microversion: 2.1 time: 0.271494 Aug 30 04:13:47.041737 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3305/6492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:46 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.044116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.044781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.051823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.052382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.052833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.053576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.054066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.054502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.225187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.233051 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6e3553e-0e44-4d8b-ae72-f7968b5544e6 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1459 microversion: 2.1 time: 0.194611 Aug 30 04:13:47.233656 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3188/6493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:49.834953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-65e05ca8-c3a1-4cb1-b7a3-cbdded31330f req-2a3dad57-7242-4259-9b0f-26d7c512e172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:49.852979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-65e05ca8-c3a1-4cb1-b7a3-cbdded31330f req-2a3dad57-7242-4259-9b0f-26d7c512e172 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:49.853936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-65e05ca8-c3a1-4cb1-b7a3-cbdded31330f req-2a3dad57-7242-4259-9b0f-26d7c512e172 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:49.854569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-65e05ca8-c3a1-4cb1-b7a3-cbdded31330f req-2a3dad57-7242-4259-9b0f-26d7c512e172 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:49.867985 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-65e05ca8-c3a1-4cb1-b7a3-cbdded31330f req-2a3dad57-7242-4259-9b0f-26d7c512e172 service nova] Creating event network-changed:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:13:49.873550 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-65e05ca8-c3a1-4cb1-b7a3-cbdded31330f req-2a3dad57-7242-4259-9b0f-26d7c512e172 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258163 Aug 30 04:13:49.874242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3306/6494] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:50.741979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-71dc3c9b-d09c-48f5-944d-b1c8ca3d342d req-6b6a88cd-a49f-40ea-b415-2678e2e24ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "name": "network-vif-plugged", "status": "completed", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:50.763484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71dc3c9b-d09c-48f5-944d-b1c8ca3d342d req-6b6a88cd-a49f-40ea-b415-2678e2e24ba8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.764431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71dc3c9b-d09c-48f5-944d-b1c8ca3d342d req-6b6a88cd-a49f-40ea-b415-2678e2e24ba8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.765108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-71dc3c9b-d09c-48f5-944d-b1c8ca3d342d req-6b6a88cd-a49f-40ea-b415-2678e2e24ba8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.780706 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-71dc3c9b-d09c-48f5-944d-b1c8ca3d342d req-6b6a88cd-a49f-40ea-b415-2678e2e24ba8 service nova] Creating event network-vif-plugged:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:13:50.786764 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-71dc3c9b-d09c-48f5-944d-b1c8ca3d342d req-6b6a88cd-a49f-40ea-b415-2678e2e24ba8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049653 Aug 30 04:13:50.787934 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3189/6495] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:51.109903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-88587d05-158e-4227-8f03-902d41ee7e7e req-88c3101c-f383-4096-ada1-b04877e57604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:51.125163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88587d05-158e-4227-8f03-902d41ee7e7e req-88c3101c-f383-4096-ada1-b04877e57604 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.125631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88587d05-158e-4227-8f03-902d41ee7e7e req-88c3101c-f383-4096-ada1-b04877e57604 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.126230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-88587d05-158e-4227-8f03-902d41ee7e7e req-88c3101c-f383-4096-ada1-b04877e57604 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.139630 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-88587d05-158e-4227-8f03-902d41ee7e7e req-88c3101c-f383-4096-ada1-b04877e57604 service nova] Creating event network-changed:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:13:51.145534 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-88587d05-158e-4227-8f03-902d41ee7e7e req-88c3101c-f383-4096-ada1-b04877e57604 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045310 Aug 30 04:13:51.146137 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3307/6496] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:53.165176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a769855e-640e-480d-8460-fbfd3aba7b73 req-68ff20b8-041a-4e35-93f4-d2128c71d569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:53.175723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a769855e-640e-480d-8460-fbfd3aba7b73 req-68ff20b8-041a-4e35-93f4-d2128c71d569 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.176224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a769855e-640e-480d-8460-fbfd3aba7b73 req-68ff20b8-041a-4e35-93f4-d2128c71d569 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.176670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a769855e-640e-480d-8460-fbfd3aba7b73 req-68ff20b8-041a-4e35-93f4-d2128c71d569 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.188490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a769855e-640e-480d-8460-fbfd3aba7b73 req-68ff20b8-041a-4e35-93f4-d2128c71d569 service nova] Creating event network-changed:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:13:53.195194 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a769855e-640e-480d-8460-fbfd3aba7b73 req-68ff20b8-041a-4e35-93f4-d2128c71d569 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035809 Aug 30 04:13:53.195877 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3190/6497] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:22.976246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=46 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.977605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=14 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.981134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.982276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=24 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.982566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:22.983731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:22.987305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c316d43b-3486-4318-9ed6-951fdb96f190 req-7cbb0851-1937-4b63-b4df-f5b405729607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:22.992223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.993031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.993523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.994498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.995184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.995816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.004644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c316d43b-3486-4318-9ed6-951fdb96f190 req-7cbb0851-1937-4b63-b4df-f5b405729607 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.005589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c316d43b-3486-4318-9ed6-951fdb96f190 req-7cbb0851-1937-4b63-b4df-f5b405729607 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.006801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c316d43b-3486-4318-9ed6-951fdb96f190 req-7cbb0851-1937-4b63-b4df-f5b405729607 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.031265 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c316d43b-3486-4318-9ed6-951fdb96f190 req-7cbb0851-1937-4b63-b4df-f5b405729607 service nova] Creating event network-changed:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:14:23.031618 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:23.039494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c316d43b-3486-4318-9ed6-951fdb96f190 req-7cbb0851-1937-4b63-b4df-f5b405729607 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061710 Aug 30 04:14:23.040481 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3191/6498] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:23.151446 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01431713-aca6-43ed-b9de-383bcdfcadad tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 204 len: 0 microversion: 2.1 time: 0.178863 Aug 30 04:14:23.152400 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3308/6499] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:22 2022] DELETE /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:23.163554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.164566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.171248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.171755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.172211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.172953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.173496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.174204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.347181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.354097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:23.355120 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0e3a98c7-f13b-44e3-82e3-8908a6215443 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1584 microversion: 2.1 time: 0.196879 Aug 30 04:14:23.356900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.365500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.366356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.366991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.368013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.368742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.369246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.371567 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3192/6500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1584 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:23.447773 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-88c35e47-76d6-4dbc-8562-0393f02e17e2 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "POST /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace/action" status: 200 len: 24560 microversion: 2.1 time: 0.098583 Aug 30 04:14:23.448711 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3309/6501] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:14:23 2022] POST /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace/action => generated 24560 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:14:24.390468 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:24.391588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:24.398645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.399126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.399571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.400288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.400756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.401187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.571466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:24.582148 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8805665a-630e-4465-b789-7f5a19d388f8 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1584 microversion: 2.1 time: 0.198468 Aug 30 04:14:24.582789 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3193/6502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:24 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1584 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:25.248323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1ee6225b-89f4-439a-96ae-28d5332eb217 req-61bc4d77-492b-43ba-ab0c-5483dd544591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b701e5c2-0446-4b3c-a22d-4f0a291218fd", "name": "network-vif-deleted", "tag": "59678d1b-7d02-4eeb-a7c5-64751636845f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:25.260538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1ee6225b-89f4-439a-96ae-28d5332eb217 req-61bc4d77-492b-43ba-ab0c-5483dd544591 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.261373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1ee6225b-89f4-439a-96ae-28d5332eb217 req-61bc4d77-492b-43ba-ab0c-5483dd544591 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.262134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1ee6225b-89f4-439a-96ae-28d5332eb217 req-61bc4d77-492b-43ba-ab0c-5483dd544591 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.284090 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1ee6225b-89f4-439a-96ae-28d5332eb217 req-61bc4d77-492b-43ba-ab0c-5483dd544591 service nova] Creating event network-vif-deleted:59678d1b-7d02-4eeb-a7c5-64751636845f for instance b701e5c2-0446-4b3c-a22d-4f0a291218fd on n-h2-854924-5 Aug 30 04:14:25.289611 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1ee6225b-89f4-439a-96ae-28d5332eb217 req-61bc4d77-492b-43ba-ab0c-5483dd544591 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046310 Aug 30 04:14:25.290346 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3310/6503] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:25.604722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:25.606556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:25.613951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.614526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.614992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.615981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.616424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.616857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.691880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:25.702501 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5225516b-d6b9-40da-b1a7-a2d83fcfb2fb tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1230 microversion: 2.1 time: 0.101981 Aug 30 04:14:25.703476 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3194/6504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:25 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:26.728136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:26.728893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:26.735348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.735837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.736278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.736976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.737457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.737886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.867674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:26.876057 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e8ddff00-7159-4d47-bb80-ec209a6d8416 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1230 microversion: 2.1 time: 0.153013 Aug 30 04:14:26.876665 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3311/6505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:26 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1230 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:27.901306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:27.902216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:27.910136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:27.911105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:27.911886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:27.912862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:27.913522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:27.914441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.074905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:28.088934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9fcc76ce-5f22-40e3-b7ca-5acb24881d14 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1230 microversion: 2.1 time: 0.193568 Aug 30 04:14:28.101390 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3195/6506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:27 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1230 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:29.128578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.129210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:29.136405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.136887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.137396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.138095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.138545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.139299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.220972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a9f3e39a304e5cab64a6df53e26a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bedeefa7f044ef9ba1e43e9acf19570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:29.231903 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a3b3416-5314-4b7d-85c7-7d37c0c3613b tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 200 len: 1230 microversion: 2.1 time: 0.107163 Aug 30 04:14:29.232651 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3312/6507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:29 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:30.258235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:30.258235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] [instance: b701e5c2-0446-4b3c-a22d-4f0a291218fd] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:30.263918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:30.264427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:30.264883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:30.265938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:30.266441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:30.267435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:30.283595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] HTTP exception thrown: Instance b701e5c2-0446-4b3c-a22d-4f0a291218fd could not be found. Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Request method failure captured: Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd HTTP/1.1 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY3PZuqWnW-NAULREV2YLfVsu5_hIFmuxMLwJ5sAmZi-DyGJ9nQy3K96TGHPXfrWouhUIXW8rNsPKqc-QbXzgIgAcmXZkPaktZ_Y_btvDekNxPUcBsCu1zQhhM_6LdfERFdeYtSXB-jsE-7RAlAZScQ12lV8Qb6kLtkMu5NCDIOy0Zs Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 7bedeefa7f044ef9ba1e43e9acf19570 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestVolumeBackupRestore-1612773489 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7bedeefa7f044ef9ba1e43e9acf19570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7bedeefa7f044ef9ba1e43e9acf19570"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7bedeefa7f044ef9ba1e43e9acf19570", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7bedeefa7f044ef9ba1e43e9acf19570"}]}] Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestVolumeBackupRestore-1612773489 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 7bedeefa7f044ef9ba1e43e9acf19570 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1612773489 Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestVolumeBackupRestore-1612773489-project Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 04a9f3e39a304e5cab64a6df53e26a1c Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestVolumeBackupRestore-1612773489-project Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance b701e5c2-0446-4b3c-a22d-4f0a291218fd could not be found. Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'b701e5c2-0446-4b3c-a22d-4f0a291218fd'} Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b701e5c2-0446-4b3c-a22d-4f0a291218fd could not be found. Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b701e5c2-0446-4b3c-a22d-4f0a291218fd could not be found. Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:30.285309 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b701e5c2-0446-4b3c-a22d-4f0a291218fd could not be found. Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Returning 404 to user: Instance b701e5c2-0446-4b3c-a22d-4f0a291218fd could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bee079ff-21c4-458f-8ecd-c7903e376523 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd" status: 404 len: 111 microversion: 2.1 time: 0.037249 Aug 30 04:14:30.294775 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3196/6508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:30 2022] GET /compute/v2.1/servers/b701e5c2-0446-4b3c-a22d-4f0a291218fd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:30.471963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b5c157c6-9799-443d-9747-cf0344c13367 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] Calling method '.version_select at 0x7f897b7aa9d0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:30.494011 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b5c157c6-9799-443d-9747-cf0344c13367 tempest-TestVolumeBackupRestore-1612773489 tempest-TestVolumeBackupRestore-1612773489-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1558876400" status: 202 len: 0 microversion: 2.1 time: 0.026295 Aug 30 04:14:30.494448 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3313/6509] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 04:14:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1558876400 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:14:54.752374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:54.752946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:54.755307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d24f60b5-334b-4be1-9272-5a5507c02df4 req-a1edf4b4-6cf5-4bca-abf6-5ddc93cbd34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:54.756268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.757243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=28 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.767742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.768905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.770722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.771093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d24f60b5-334b-4be1-9272-5a5507c02df4 req-a1edf4b4-6cf5-4bca-abf6-5ddc93cbd34c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.771579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d24f60b5-334b-4be1-9272-5a5507c02df4 req-a1edf4b4-6cf5-4bca-abf6-5ddc93cbd34c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.771734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.772026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d24f60b5-334b-4be1-9272-5a5507c02df4 req-a1edf4b4-6cf5-4bca-abf6-5ddc93cbd34c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.773150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.774224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.775023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.775582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.788344 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d24f60b5-334b-4be1-9272-5a5507c02df4 req-a1edf4b4-6cf5-4bca-abf6-5ddc93cbd34c service nova] Creating event network-changed:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:14:54.794496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d24f60b5-334b-4be1-9272-5a5507c02df4 req-a1edf4b4-6cf5-4bca-abf6-5ddc93cbd34c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044425 Aug 30 04:14:54.795103 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3314/6510] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:54.811076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:54.928128 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fcae54b3-4b52-43b8-8ef6-f33b95b254da tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 204 len: 0 microversion: 2.1 time: 0.180331 Aug 30 04:14:54.928735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3197/6511] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:54 2022] DELETE /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:54.938739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:54.939757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:54.946424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.947260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.947939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.948882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.949584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.950238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.104257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:55.112964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be8191e4-53ad-4d03-82ce-e03b137c474f tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1688 microversion: 2.1 time: 0.179547 Aug 30 04:14:55.113575 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3315/6512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:54 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:56.136085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:56.136819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:56.144463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.144969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.145450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.146161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.146789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.147226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.288788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:56.297372 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2326d27b-bb35-48a8-bb22-0348b036d429 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1688 microversion: 2.1 time: 0.165138 Aug 30 04:14:56.297940 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3198/6513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:56 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:57.085713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-bae3280f-9472-4cf1-a402-aee7b46c20e1 req-9c6b2d0b-e154-4bf5-bb6f-b55b64f21342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a29b60e-973d-4919-8f72-3d7caece5ace", "name": "network-vif-deleted", "tag": "a5f14824-94f2-4532-bc93-8f7419bf4747"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:57.097105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bae3280f-9472-4cf1-a402-aee7b46c20e1 req-9c6b2d0b-e154-4bf5-bb6f-b55b64f21342 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.097697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bae3280f-9472-4cf1-a402-aee7b46c20e1 req-9c6b2d0b-e154-4bf5-bb6f-b55b64f21342 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.098194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bae3280f-9472-4cf1-a402-aee7b46c20e1 req-9c6b2d0b-e154-4bf5-bb6f-b55b64f21342 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.110581 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-bae3280f-9472-4cf1-a402-aee7b46c20e1 req-9c6b2d0b-e154-4bf5-bb6f-b55b64f21342 service nova] Creating event network-vif-deleted:a5f14824-94f2-4532-bc93-8f7419bf4747 for instance 7a29b60e-973d-4919-8f72-3d7caece5ace on n-h1-854924-5 Aug 30 04:14:57.115739 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-bae3280f-9472-4cf1-a402-aee7b46c20e1 req-9c6b2d0b-e154-4bf5-bb6f-b55b64f21342 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033763 Aug 30 04:14:57.116349 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3316/6514] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:57.319717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:57.320268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:57.326905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.327406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.327908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.328616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.329090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.329560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.362495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.363003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.363461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.363924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lazy-loading 'fault' on Instance uuid 7a29b60e-973d-4919-8f72-3d7caece5ace {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:57.406995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e3ddedaef54119acc2f890fe5492de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9b246f8e4e497398b5461f56a695a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:57.415374 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-88e3b74f-c8b0-4f7d-9768-795fb806505b tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 200 len: 1356 microversion: 2.1 time: 0.099721 Aug 30 04:14:57.417388 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3199/6515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:57 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:58.438645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:58.439345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] [instance: 7a29b60e-973d-4919-8f72-3d7caece5ace] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:58.445671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.446160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.446710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.447403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.447859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.448283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.465399 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] HTTP exception thrown: Instance 7a29b60e-973d-4919-8f72-3d7caece5ace could not be found. Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Request method failure captured: Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace HTTP/1.1 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDYxuevvbjEmzmE7LNIoiJni0CQDkjw1SEe6YrHZ0x-mMjVsIrjRCxOwnu5c96r5TkKB32fgEqJaC8sPrV2HYBnLaYWcyYTrma9Wjh6uURb3MxzmZ7rH7kNomkf-kuu3IBiLpmswnh0havRyh65NG7CoBisJezCWqtgXg2nNFXmhFo80 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/af9b246f8e4e497398b5461f56a695a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_af9b246f8e4e497398b5461f56a695a5", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/af9b246f8e4e497398b5461f56a695a5"}]}] Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: af9b246f8e4e497398b5461f56a695a5 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1555356977 Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c6e3ddedaef54119acc2f890fe5492de Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1555356977-project Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7a29b60e-973d-4919-8f72-3d7caece5ace could not be found. Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7a29b60e-973d-4919-8f72-3d7caece5ace'} Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a29b60e-973d-4919-8f72-3d7caece5ace could not be found. Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a29b60e-973d-4919-8f72-3d7caece5ace could not be found. Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:14:58.467069 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a29b60e-973d-4919-8f72-3d7caece5ace could not be found. Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Returning 404 to user: Instance 7a29b60e-973d-4919-8f72-3d7caece5ace could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-436193af-66c8-4459-93f2-a92a41ac0e2d tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace" status: 404 len: 111 microversion: 2.1 time: 0.035549 Aug 30 04:14:58.471290 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3317/6516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:58 2022] GET /compute/v2.1/servers/7a29b60e-973d-4919-8f72-3d7caece5ace => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:01.706256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4fe1e9af-cc97-42e2-9347-c098fbb27cd9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] Calling method '.version_select at 0x7f897b006430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:01.750436 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4fe1e9af-cc97-42e2-9347-c098fbb27cd9 tempest-TestNetworkAdvancedServerOps-1555356977 tempest-TestNetworkAdvancedServerOps-1555356977-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697553704" status: 202 len: 0 microversion: 2.1 time: 0.048621 Aug 30 04:15:01.751041 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3200/6517] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 04:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697553704 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:14.234432 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:15:14.234979 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:15:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Aug 30 04:15:14.235813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:14.236534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:14.356704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-975900219", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:14.431494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] validate_networks() for None {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:15.058229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:15.058655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:15.059161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:15.059576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:15.059995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:15.070140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.070645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.071106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.071904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.072366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.072795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.090903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Getting quotas for project c92c57790911475a9878bb7cd7689b88. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:15.097284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Getting quotas for user 9e20665af1864439bdd729fd1162313e and project c92c57790911475a9878bb7cd7689b88. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:15.111461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:15.113870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:15.164538 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea24987a-d313-46b7-a1ef-24555f5cb9a3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935620 Aug 30 04:15:15.165433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3318/6518] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:15:15.177478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:15.178877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:15.184318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3516fafb-b06b-4c94-8514-7e76fdbea264 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:15.184881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3516fafb-b06b-4c94-8514-7e76fdbea264 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:15.252706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3516fafb-b06b-4c94-8514-7e76fdbea264 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.261899 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3516fafb-b06b-4c94-8514-7e76fdbea264 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1221 microversion: 2.1 time: 0.087555 Aug 30 04:15:15.262525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3201/6519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:15 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:16.285402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3ca0c02-ec3f-446d-9405-f02188ab8ee6 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:16.286357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3ca0c02-ec3f-446d-9405-f02188ab8ee6 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:16.339886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e3ca0c02-ec3f-446d-9405-f02188ab8ee6 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.347750 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3ca0c02-ec3f-446d-9405-f02188ab8ee6 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1221 microversion: 2.1 time: 0.067957 Aug 30 04:15:16.348341 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3319/6520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:16 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:17.369080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bb80c20-245a-4587-93aa-58c2bb7d0fe3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:17.369694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bb80c20-245a-4587-93aa-58c2bb7d0fe3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:17.426405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6bb80c20-245a-4587-93aa-58c2bb7d0fe3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:17.433916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bb80c20-245a-4587-93aa-58c2bb7d0fe3 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1221 microversion: 2.1 time: 0.069001 Aug 30 04:15:17.434504 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3202/6521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:17 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:18.455918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.456667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:18.464025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.464517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.465111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.465710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.466169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.466594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.564096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.572915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be2f4300-0130-4be4-89a9-67df4278dbbd tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1273 microversion: 2.1 time: 0.120869 Aug 30 04:15:18.573887 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3320/6522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:19.611802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:19.612425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:19.620684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.621325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.621806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.622515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.622977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.623933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.692994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:19.708987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ee72d2a-5f62-46e2-9ac3-5ba9964019c9 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1279 microversion: 2.1 time: 0.101016 Aug 30 04:15:19.709703 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3203/6523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:19 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:20.516879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ad237694-a914-4cbf-82b7-1e8dbec75269 req-827a3fde-a33a-44b3-a425-0f7d92cb8e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfaa079-8677-47d2-8649-940eae1afad7", "tag": "ea38e417-8052-4baa-97d5-71416b2c2fbb"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:20.530439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ad237694-a914-4cbf-82b7-1e8dbec75269 req-827a3fde-a33a-44b3-a425-0f7d92cb8e67 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.531037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ad237694-a914-4cbf-82b7-1e8dbec75269 req-827a3fde-a33a-44b3-a425-0f7d92cb8e67 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.531539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ad237694-a914-4cbf-82b7-1e8dbec75269 req-827a3fde-a33a-44b3-a425-0f7d92cb8e67 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.543964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ad237694-a914-4cbf-82b7-1e8dbec75269 req-827a3fde-a33a-44b3-a425-0f7d92cb8e67 service nova] Creating event network-changed:ea38e417-8052-4baa-97d5-71416b2c2fbb for instance 0cfaa079-8677-47d2-8649-940eae1afad7 on n-h1-854924-5 Aug 30 04:15:20.550579 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ad237694-a914-4cbf-82b7-1e8dbec75269 req-827a3fde-a33a-44b3-a425-0f7d92cb8e67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038492 Aug 30 04:15:20.551548 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3321/6524] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:15:20.731512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.732290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:20.742442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.743094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.743827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.744883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.745666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.746257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.893845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.908689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31ebddca-b16a-48d8-a4e3-d025312de72a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.181187 Aug 30 04:15:20.909501 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3204/6525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:21.935013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.936284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:21.948782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.949630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.950404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.951624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.952448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.953210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.094179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:22.102212 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0cc4bdd4-1feb-47cc-befd-d3a2c3847e67 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.174861 Aug 30 04:15:22.102792 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3322/6526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:21 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:23.128508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:23.129225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:23.136251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:23.136775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:23.137219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.137971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:23.138414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:23.139341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.283151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:23.295727 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-daa855f4-89c7-48d6-b222-e10976a9d2ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.173134 Aug 30 04:15:23.296429 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3205/6527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:23 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:24.325097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.326978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:24.333602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.334001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.334446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.335133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.335575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.335996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.472826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.480565 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-37fa13a8-39dd-4373-82de-d14c976782f0 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.159919 Aug 30 04:15:24.481131 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3323/6528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:24 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:25.502524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:25.503138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:25.510328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.510832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.511282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.512005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.512469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.513416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.661125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:25.669324 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c225047f-2584-4262-a351-517e3d9e88ea tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.170721 Aug 30 04:15:25.669929 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3206/6529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:25 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:26.690700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.691320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.693308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.694838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.701629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.702121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.702563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.703267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.703721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.704146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.842651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.851570 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-93110463-9ce9-4d21-b184-1cb60cc9e15a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.164285 Aug 30 04:15:26.851716 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3324/6530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:27.049215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c07547a6-606a-417f-a2c7-4d80a4f07065 req-267be365-e0c8-4bcc-bf5a-1766c32b790e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfaa079-8677-47d2-8649-940eae1afad7", "name": "network-vif-plugged", "status": "completed", "tag": "ea38e417-8052-4baa-97d5-71416b2c2fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:27.060984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c07547a6-606a-417f-a2c7-4d80a4f07065 req-267be365-e0c8-4bcc-bf5a-1766c32b790e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.061516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c07547a6-606a-417f-a2c7-4d80a4f07065 req-267be365-e0c8-4bcc-bf5a-1766c32b790e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.061969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c07547a6-606a-417f-a2c7-4d80a4f07065 req-267be365-e0c8-4bcc-bf5a-1766c32b790e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.078213 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c07547a6-606a-417f-a2c7-4d80a4f07065 req-267be365-e0c8-4bcc-bf5a-1766c32b790e service nova] Creating event network-vif-plugged:ea38e417-8052-4baa-97d5-71416b2c2fbb for instance 0cfaa079-8677-47d2-8649-940eae1afad7 on n-h1-854924-5 Aug 30 04:15:27.084214 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c07547a6-606a-417f-a2c7-4d80a4f07065 req-267be365-e0c8-4bcc-bf5a-1766c32b790e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039219 Aug 30 04:15:27.085449 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3207/6531] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:27.883847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:27.884443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:27.892381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.892876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.893466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.894086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.894541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.894964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.045302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:28.053616 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8794dd1-f2c4-44ac-825b-0a419eeed554 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1321 microversion: 2.1 time: 0.173641 Aug 30 04:15:28.054306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3325/6532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:27 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:29.075449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.076673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.078763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:29.085924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.086536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.087078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.088034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.088553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.089038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.240430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.250627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6195d4ce-6179-4eed-9297-ced1b267df2a tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1470 microversion: 2.1 time: 0.179259 Aug 30 04:15:29.251278 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3208/6533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:29.335803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e018ca4-c237-4912-99b9-cb16561c4e10 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Calling method '.version_select at 0x7f897a5d1280>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.408965 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e018ca4-c237-4912-99b9-cb16561c4e10 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/0bf173539fe843a8baaff8b355ed6e19" status: 200 len: 371 microversion: 2.1 time: 0.137497 Aug 30 04:15:29.409600 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3326/6534] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/os-quota-sets/0bf173539fe843a8baaff8b355ed6e19 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:15:29.423440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba071e1b-d206-494e-8dd1-111523cef763 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1670037571", "id": 1616458434, "os-flavor-access:is_public": "True"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:29.443984 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba071e1b-d206-494e-8dd1-111523cef763 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.024319 Aug 30 04:15:29.444486 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3209/6535] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:29 2022] POST /compute/v2.1/flavors => generated 438 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:29.460205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1616458434"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:29.463418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.470724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.471209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.471646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.472341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.472792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.473215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.676527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64e6405588334bac97313b13b0fa64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf173539fe843a8baaff8b355ed6e19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.684569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1670037571 {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:15:29.693019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.693687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.694216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.694979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.695445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.695928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.719640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Getting quotas for project c92c57790911475a9878bb7cd7689b88. Resources: {'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:29.726411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Getting quotas for user 9e20665af1864439bdd729fd1162313e and project c92c57790911475a9878bb7cd7689b88. Resources: {'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:29.741076 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.compute.api [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] ram quota exceeded for 0bf173539fe843a8baaff8b355ed6e19, tried to resize instance. Aug 30 04:15:29.741806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Request method failure captured: Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7/action HTTP/1.1 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 39 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY7Sq9m0sy0OD9n5c9WT24dQtnjRgqElJNjgWI2BzxVEhZSvaYdlvQA0YRmGKUrIaLR-ZVQRmXDfJIlDJIHI2C8cibvXtguNxnzeNUpDINT1qCPFmmYUODabL6Fz7XhOIJzUs-QuF_OuVuyoVpW5O-r5Su_8McH-YntfglKCUk2TkbY Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 0bf173539fe843a8baaff8b355ed6e19 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851480569 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Role: admin,member,reader Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: admin,member,reader Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0bf173539fe843a8baaff8b355ed6e19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0bf173539fe843a8baaff8b355ed6e19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0bf173539fe843a8baaff8b355ed6e19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0bf173539fe843a8baaff8b355ed6e19"}]}] Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851480569 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 0bf173539fe843a8baaff8b355ed6e19 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851480569 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersAdminNegativeTestJSON-851480569-project-admin Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 64e6405588334bac97313b13b0fa64a9 Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851480569-project-admin Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: {"resize": {"flavorRef": "1616458434"}} Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '0cfaa079-8677-47d2-8649-940eae1afad7', 'body': {'resize': {'flavorRef': '1616458434'}}} Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:15:29.749634 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40e2fb64-4a94-449d-8ab5-b1f4850a4057 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7/action" status: 403 len: 118 microversion: 2.1 time: 0.296832 Aug 30 04:15:29.754754 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3327/6536] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:29 2022] POST /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7/action => generated 118 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:29.765955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e648867-7bda-49e5-8d22-26031d5ada07 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.784963 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e648867-7bda-49e5-8d22-26031d5ada07 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1616458434" status: 202 len: 0 microversion: 2.1 time: 0.025381 Aug 30 04:15:29.785591 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3210/6537] 10.222.0.30 () {58 vars in 1161 bytes} [Tue Aug 30 04:15:29 2022] DELETE /compute/v2.1/flavors/1616458434 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:29.794297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5782cbe6-e1b1-4395-b04c-659fc74809c5 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.814616 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5782cbe6-e1b1-4395-b04c-659fc74809c5 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024521 Aug 30 04:15:29.815194 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3328/6538] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:29.843948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1950f8d3-8822-46d8-9c69-f6c5c2ac43e3 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Calling method '.version_select at 0x7f897ae62430>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.928669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1950f8d3-8822-46d8-9c69-f6c5c2ac43e3 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/0bf173539fe843a8baaff8b355ed6e19" status: 200 len: 371 microversion: 2.1 time: 0.092841 Aug 30 04:15:29.929286 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3211/6539] 10.222.0.30 () {58 vars in 1242 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/os-quota-sets/0bf173539fe843a8baaff8b355ed6e19 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:15:29.942576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2904f2c2-cbf0-4781-8ba1-66b39f179625 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-290022704", "id": 962926184, "os-flavor-access:is_public": "True"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:29.962628 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2904f2c2-cbf0-4781-8ba1-66b39f179625 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023837 Aug 30 04:15:29.963144 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3329/6540] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:29 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:15:29.975330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "962926184"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:29.977767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.984090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.984587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.985041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.985799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.986266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.986706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.080978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64e6405588334bac97313b13b0fa64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf173539fe843a8baaff8b355ed6e19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.088837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-290022704 {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:15:30.099671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.100409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.101079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.102250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.103074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.103862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.126298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Getting quotas for project c92c57790911475a9878bb7cd7689b88. Resources: {'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:30.132888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Getting quotas for user 9e20665af1864439bdd729fd1162313e and project c92c57790911475a9878bb7cd7689b88. Resources: {'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:30.148437 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] cores quota exceeded for 0bf173539fe843a8baaff8b355ed6e19, tried to resize instance. Aug 30 04:15:30.148993 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Request method failure captured: Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7/action HTTP/1.1 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 38 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY7Sq9m0sy0OD9n5c9WT24dQtnjRgqElJNjgWI2BzxVEhZSvaYdlvQA0YRmGKUrIaLR-ZVQRmXDfJIlDJIHI2C8cibvXtguNxnzeNUpDINT1qCPFmmYUODabL6Fz7XhOIJzUs-QuF_OuVuyoVpW5O-r5Su_8McH-YntfglKCUk2TkbY Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 0bf173539fe843a8baaff8b355ed6e19 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851480569 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Role: admin,member,reader Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: admin,member,reader Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0bf173539fe843a8baaff8b355ed6e19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0bf173539fe843a8baaff8b355ed6e19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0bf173539fe843a8baaff8b355ed6e19", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0bf173539fe843a8baaff8b355ed6e19"}]}] Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851480569 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 0bf173539fe843a8baaff8b355ed6e19 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851480569 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-851480569-project-admin Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 64e6405588334bac97313b13b0fa64a9 Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851480569-project-admin Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: {"resize": {"flavorRef": "962926184"}} Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '0cfaa079-8677-47d2-8649-940eae1afad7', 'body': {'resize': {'flavorRef': '962926184'}}} Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:15:30.151142 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9c074fd-6c6e-4db6-9fbd-f4fefb1e5a12 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7/action" status: 403 len: 113 microversion: 2.1 time: 0.181401 Aug 30 04:15:30.155387 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3212/6541] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:29 2022] POST /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7/action => generated 113 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:30.164364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4f1775a-8ef0-443d-976a-24a67eb15899 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.184044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4f1775a-8ef0-443d-976a-24a67eb15899 tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/962926184" status: 202 len: 0 microversion: 2.1 time: 0.024946 Aug 30 04:15:30.184768 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3330/6542] 10.222.0.30 () {58 vars in 1158 bytes} [Tue Aug 30 04:15:30 2022] DELETE /compute/v2.1/flavors/962926184 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:15:30.198182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a566ae78-c3ed-4466-8531-9aa211037d5c tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.222304 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a566ae78-c3ed-4466-8531-9aa211037d5c tempest-ServersAdminNegativeTestJSON-851480569 tempest-ServersAdminNegativeTestJSON-851480569-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032730 Aug 30 04:15:30.222824 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3213/6543] 10.222.0.30 () {58 vars in 1146 bytes} [Tue Aug 30 04:15:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:30.243258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.243757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:30.249949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.250424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.250860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.251550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.252001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.252407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.280637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:30.365878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f3545e2c-f892-45e3-973d-0f1af93d1dad tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 204 len: 0 microversion: 2.1 time: 0.125632 Aug 30 04:15:30.366721 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3331/6544] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:30 2022] DELETE /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:30.374920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.375543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:30.382243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.382809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.383259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.383966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.384491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.384925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.547665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.555965 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-423bda06-59c5-4fb2-8979-4bea055bed83 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1476 microversion: 2.1 time: 0.184869 Aug 30 04:15:30.556552 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3214/6545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:30 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:31.579253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:31.580009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:31.587596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.588099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.588549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.589258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.589764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.590199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.740531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.750380 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-51c65656-c889-4229-8b20-80bce2fea0af tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1476 microversion: 2.1 time: 0.176073 Aug 30 04:15:31.750973 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3332/6546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:31 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:32.488430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-38c6d924-992d-43bd-b244-e6a83ebcfccf req-3a709bab-47a0-4c8d-b2b7-9839e2d5cbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfaa079-8677-47d2-8649-940eae1afad7", "name": "network-vif-deleted", "tag": "ea38e417-8052-4baa-97d5-71416b2c2fbb"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:32.502401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-38c6d924-992d-43bd-b244-e6a83ebcfccf req-3a709bab-47a0-4c8d-b2b7-9839e2d5cbec service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.503154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-38c6d924-992d-43bd-b244-e6a83ebcfccf req-3a709bab-47a0-4c8d-b2b7-9839e2d5cbec service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.503681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-38c6d924-992d-43bd-b244-e6a83ebcfccf req-3a709bab-47a0-4c8d-b2b7-9839e2d5cbec service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.517950 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-38c6d924-992d-43bd-b244-e6a83ebcfccf req-3a709bab-47a0-4c8d-b2b7-9839e2d5cbec service nova] Creating event network-vif-deleted:ea38e417-8052-4baa-97d5-71416b2c2fbb for instance 0cfaa079-8677-47d2-8649-940eae1afad7 on n-h1-854924-5 Aug 30 04:15:32.524889 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-38c6d924-992d-43bd-b244-e6a83ebcfccf req-3a709bab-47a0-4c8d-b2b7-9839e2d5cbec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040922 Aug 30 04:15:32.525573 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3215/6547] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:15:32.776385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:32.777585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:32.788355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.788797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.789280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.790020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.790588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.791056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.824592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.825079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.826085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.826531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lazy-loading 'fault' on Instance uuid 0cfaa079-8677-47d2-8649-940eae1afad7 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:32.875177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e20665af1864439bdd729fd1162313e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92c57790911475a9878bb7cd7689b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:32.883986 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b52329fd-b000-4b48-828d-70b364ea2397 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 200 len: 1311 microversion: 2.1 time: 0.114949 Aug 30 04:15:32.884656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3333/6548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:32 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:33.907576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:33.908490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] [instance: 0cfaa079-8677-47d2-8649-940eae1afad7] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:33.917297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.917814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.918269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.919021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.919475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.919932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.935467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] HTTP exception thrown: Instance 0cfaa079-8677-47d2-8649-940eae1afad7 could not be found. Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Request method failure captured: Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 HTTP/1.1 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY7RmdNC-WN369V9oWoQMw-gkY3Z8d_RJ_Ymkv3hU2ZJPbH94E0BuN6-5hbWa9RnJD7l3gCvKMxvLa6aYju5wJuGVZYce8Pc2Y0fdP9ZiOfW1B25GNN3u8n3CmOrDrlyCBFTtgQSU96jhCgmlBvI71PJvVHRHxrw7GLeWw1_k8e-nwo Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: c92c57790911475a9878bb7cd7689b88 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1732293963 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c92c57790911475a9878bb7cd7689b88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c92c57790911475a9878bb7cd7689b88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c92c57790911475a9878bb7cd7689b88", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c92c57790911475a9878bb7cd7689b88"}]}] Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1732293963 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: c92c57790911475a9878bb7cd7689b88 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1732293963 Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersAdminNegativeTestJSON-1732293963-project Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9e20665af1864439bdd729fd1162313e Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1732293963-project Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 0cfaa079-8677-47d2-8649-940eae1afad7 could not be found. Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '0cfaa079-8677-47d2-8649-940eae1afad7'} Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cfaa079-8677-47d2-8649-940eae1afad7 could not be found. Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cfaa079-8677-47d2-8649-940eae1afad7 could not be found. Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:33.937194 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cfaa079-8677-47d2-8649-940eae1afad7 could not be found. Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] Returning 404 to user: Instance 0cfaa079-8677-47d2-8649-940eae1afad7 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-41a91426-22e8-45d5-a989-c9e2b0382695 tempest-ServersAdminNegativeTestJSON-1732293963 tempest-ServersAdminNegativeTestJSON-1732293963-project] 10.222.0.30 "GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7" status: 404 len: 111 microversion: 2.1 time: 0.036023 Aug 30 04:15:33.941037 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3216/6549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:33 2022] GET /compute/v2.1/servers/0cfaa079-8677-47d2-8649-940eae1afad7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:41.394536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.397503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.556067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-835004996", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "15fc2985-106e-4a51-8571-4f21f69740b1"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:41.613922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] validate_networks() for [('15fc2985-106e-4a51-8571-4f21f69740b1', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:42.105442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:42.105764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:42.107528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:42.108249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:42.108700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:42.120637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.120843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.121128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.121956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.122450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.122875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.146696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Getting quotas for project 97b56030182141e99b341da01626eccf. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:42.154270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Getting quotas for user c9daf4528ec446ef8f5372a3c78ba23f and project 97b56030182141e99b341da01626eccf. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:42.171292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:42.173934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:42.229441 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-26fa7743-d50a-487f-9c42-dc5d4a671acf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844389 Aug 30 04:15:42.230114 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3334/6550] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:15:42.248845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e810404c-415b-4bac-bed8-6d05faa8bfd2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:42.250557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e810404c-415b-4bac-bed8-6d05faa8bfd2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:42.253692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:42.254639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:42.315452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e810404c-415b-4bac-bed8-6d05faa8bfd2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:42.329878 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e810404c-415b-4bac-bed8-6d05faa8bfd2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1214 microversion: 2.1 time: 0.089735 Aug 30 04:15:42.330843 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3217/6551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:42 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:43.355586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:43.356481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:43.364986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.365836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.366272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.366995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.367661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.368102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.466446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:43.475546 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dbca74b1-bb72-41b5-bdad-1d20120f4feb tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1266 microversion: 2.1 time: 0.126164 Aug 30 04:15:43.476134 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3335/6552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:43 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:44.502819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:44.505657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:44.510595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=55 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:44.542960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.544903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.546037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.548486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.550897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.551774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.777613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:44.788253 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-01995756-1057-40c7-a7f6-6d34acace2f4 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.292334 Aug 30 04:15:44.789389 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3218/6553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:44 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:45.230165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6ab993d5-171a-4455-99d4-bbad5eff433e req-09165610-736f-4795-b9da-16aa612f14b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cabaad-fe22-4d47-bb36-a859be1d3d19", "tag": "7979e170-f0d8-4612-94a6-9fcd1cd5506b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:45.239995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.250783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6ab993d5-171a-4455-99d4-bbad5eff433e req-09165610-736f-4795-b9da-16aa612f14b3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.251895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6ab993d5-171a-4455-99d4-bbad5eff433e req-09165610-736f-4795-b9da-16aa612f14b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.253017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6ab993d5-171a-4455-99d4-bbad5eff433e req-09165610-736f-4795-b9da-16aa612f14b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.265709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.276327 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6ab993d5-171a-4455-99d4-bbad5eff433e req-09165610-736f-4795-b9da-16aa612f14b3 service nova] Creating event network-changed:7979e170-f0d8-4612-94a6-9fcd1cd5506b for instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 on n-h1-854924-5 Aug 30 04:15:45.286471 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6ab993d5-171a-4455-99d4-bbad5eff433e req-09165610-736f-4795-b9da-16aa612f14b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071102 Aug 30 04:15:45.287586 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3336/6554] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:45.819492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:45.820493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:45.828904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.837900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.838426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.838863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.839890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.840991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.841552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.029576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.049032 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6dd4b97e-99e3-4201-835c-213e554c094c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.235143 Aug 30 04:15:46.050044 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3219/6555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:45 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:47.073964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:47.074715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:47.082320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.082808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.083249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.083949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.084406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.084859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.228804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.237369 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71861245-8cab-4f3b-bcb5-8fb19203d346 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.169714 Aug 30 04:15:47.237952 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3337/6556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:47 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:48.258651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:48.259761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:48.267046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.267596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.267994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.268797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.269491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.270000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.414334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:48.422776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2a9c23e-02f1-4f21-9662-7ec0a07c62cf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.168228 Aug 30 04:15:48.423372 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3220/6557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:48 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:49.443285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.443924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:49.451251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.451756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.452190 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.452877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.453324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.453769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.603038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.610896 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a30bb3e-878a-4f66-af2a-2fcb610656c1 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.171555 Aug 30 04:15:49.611477 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3338/6558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:50.635138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:50.635773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:50.643680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.644179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.644629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.645352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.645829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.646270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.779294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.787138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d5573c0-6972-4b3d-89de-97fee7857287 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.155960 Aug 30 04:15:50.787735 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3221/6559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:50 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:51.808287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.809429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.817648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.818160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.818596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.819294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.819765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.820169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.958714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:51.966797 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3344ebf-5055-4bb6-8572-1764b7b4f5c2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.162452 Aug 30 04:15:51.967388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3339/6560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:51 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:52.988006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:52.988637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:52.991458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:53.004698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.005208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.006073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.006402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.006869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.007314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.162931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:53.171288 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05edc122-099f-4deb-bcba-9e7a4afe3aba tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.187209 Aug 30 04:15:53.171893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3222/6561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:52 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:53.200059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-da22ab16-bb0b-4bb3-9eb6-fbe3aa14f7e7 req-121860d3-71c2-4fee-8724-2eaa25b97563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cabaad-fe22-4d47-bb36-a859be1d3d19", "name": "network-vif-plugged", "status": "completed", "tag": "7979e170-f0d8-4612-94a6-9fcd1cd5506b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:53.205207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:53.206061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:53.213555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da22ab16-bb0b-4bb3-9eb6-fbe3aa14f7e7 req-121860d3-71c2-4fee-8724-2eaa25b97563 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.214081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da22ab16-bb0b-4bb3-9eb6-fbe3aa14f7e7 req-121860d3-71c2-4fee-8724-2eaa25b97563 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.214512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-da22ab16-bb0b-4bb3-9eb6-fbe3aa14f7e7 req-121860d3-71c2-4fee-8724-2eaa25b97563 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.226929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-da22ab16-bb0b-4bb3-9eb6-fbe3aa14f7e7 req-121860d3-71c2-4fee-8724-2eaa25b97563 service nova] Creating event network-vif-plugged:7979e170-f0d8-4612-94a6-9fcd1cd5506b for instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 on n-h1-854924-5 Aug 30 04:15:53.232163 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-da22ab16-bb0b-4bb3-9eb6-fbe3aa14f7e7 req-121860d3-71c2-4fee-8724-2eaa25b97563 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037276 Aug 30 04:15:53.232783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3340/6562] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:54.196579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:54.197211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:54.204650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.205152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.205645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.206369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.206836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.207271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.351751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:54.359979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2bfc05dc-a98a-40c7-8f01-3b2bb6b72814 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1314 microversion: 2.1 time: 0.167639 Aug 30 04:15:54.360565 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3223/6563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:54 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:55.383948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:55.384574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:55.391253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.391747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.392192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.392893 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.393363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.393807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.539259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.552209 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fcb38dc6-5862-4bc1-8846-b84fb5304cfe tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1500 microversion: 2.1 time: 0.173145 Aug 30 04:15:55.553306 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3341/6564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:55 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:55.573523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:55.577134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:55.583508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.584019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.584478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.585206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.586290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.586290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.616590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.622749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Old instance type m1.heat2, new instance type m1.heat {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:15:55.629369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:55.629813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:55.630310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:55.630749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:55.631173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:55.698016 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0718d6c2-f0c5-495c-9ef6-971e4df7d6ab tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "POST /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19/action" status: 202 len: 0 microversion: 2.1 time: 0.128512 Aug 30 04:15:55.698649 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3224/6565] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:55 2022] POST /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:55.707377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:55.708027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:55.715368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.715508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.715952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.716732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.717258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.717808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.898688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.906783 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4cee70bf-b41f-4847-8c05-ec3ec04d853a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1509 microversion: 2.1 time: 0.203196 Aug 30 04:15:55.907507 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3342/6566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:55 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:56.932038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.932675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.940686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.941239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.941671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.942402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.942873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.943343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.108205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:57.119257 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5fe3e50e-9690-46d4-95ab-be9bddc21757 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1509 microversion: 2.1 time: 0.193861 Aug 30 04:15:57.119880 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3225/6567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:58.143198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:58.143835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:58.151141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.151638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.152085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.152794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.153284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.153745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.296592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:58.306821 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed36ac11-4e59-4bcd-a161-5b6d5294908e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.170275 Aug 30 04:15:58.307416 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3343/6568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:58 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:59.328469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:59.329965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:59.337006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:59.337591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:59.338066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:59.338794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:59.339269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:59.340237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:59.501332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:59.510032 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab900a53-e10e-448e-9da2-a38596e450c9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.185634 Aug 30 04:15:59.510639 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3226/6569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:59 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:00.532448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:00.533068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:00.539796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.540281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.540718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.541431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.541888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.542314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.679437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:00.687650 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ceab4602-e283-4ba9-bc2d-30d88fd4dc49 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.159257 Aug 30 04:16:00.688242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3344/6570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:00 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:01.708847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:01.709498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:01.717099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.717751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.718287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.719107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.719663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.720187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.864276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:01.873299 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3987f9eb-6708-49bd-b9a9-84dcefbcb7d9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.168510 Aug 30 04:16:01.873919 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3227/6571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:01 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:02.897390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:02.898241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:02.905949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.906441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.906882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:02.907573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.908028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.908451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.055134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:03.063321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e675aa6c-44d4-466f-83fa-15c221575db9 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.171801 Aug 30 04:16:03.063928 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3345/6572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:02 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:04.085625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:04.086631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:04.095399 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.095910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.096390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.097116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.097605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.098043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.251227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:04.259452 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b2b6ad5f-49c1-40f1-88ab-98b37a2a313e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.178585 Aug 30 04:16:04.260072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3228/6573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:04 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:05.282603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:05.283298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:05.290374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.290867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.291306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.292008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.293034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.293512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.434170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:05.445494 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df3bbda4-da99-4f64-baa4-89aaa41dc554 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.166805 Aug 30 04:16:05.446090 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3346/6574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:05 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:06.472916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:06.474363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:06.489642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.490715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.491538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.493077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.494203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.495136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.699276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:06.711624 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-66bcded7-c529-486d-8304-7a26bbc5ec60 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.246958 Aug 30 04:16:06.712239 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3229/6575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:06 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:07.733558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:07.734311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:07.741422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.741926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.742372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.743086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.743544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.743973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.887591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:07.897271 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-56e93015-931f-4cf8-beee-fa99098f3ed5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.167594 Aug 30 04:16:07.897885 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3347/6576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:07 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:08.918744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:08.919441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:08.927070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.927569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.928018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.928734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.929202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.929666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.063248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:09.071497 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1d224095-6b71-4b14-a950-464c21ccf217 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.156744 Aug 30 04:16:09.072072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3230/6577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:08 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:10.094369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:10.094983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:10.102586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.103079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.103751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.104461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.105430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.105857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.259023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:10.267716 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7589e12-44e3-43fa-a682-adc706ec56b2 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.177837 Aug 30 04:16:10.268309 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3348/6578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:10 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:11.289152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:11.289726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:11.296816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.297315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.297792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.298504 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.298968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.299400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.436645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:11.444831 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-98f4b246-5df7-4412-9b2f-36ebe42ec1e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.159673 Aug 30 04:16:11.445467 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3231/6579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:11 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:12.466490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:12.467109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:12.473997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:12.474479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:12.474921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.475607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:12.476057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:12.476485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.605333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:12.613004 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-25521599-51d0-4058-a54f-5f836218877f tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.150975 Aug 30 04:16:12.613614 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3349/6580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:12 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:13.635130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:13.635763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:13.642872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.643370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.643822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.644526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.644993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.645473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.778737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:13.786921 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-093a4bbd-7b43-4acd-bfb9-2f16c95dc4dd tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.156607 Aug 30 04:16:13.787469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3232/6581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:13 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:14.809817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:14.810471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:14.818472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.818969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.819411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.820116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.820579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.821009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.964829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:14.972832 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f9102092-1a7d-4ab1-9ae8-ad7777c743e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.167463 Aug 30 04:16:14.973516 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3350/6582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:14 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:15.997805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:15.998431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:16.001919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=32 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.007843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.008345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.008798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.009539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.010149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.010598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.014258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.146041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:16.154041 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-782c3660-dd46-494a-b0ea-27784f0d6386 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.160749 Aug 30 04:16:16.154626 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3233/6583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:15 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:17.175836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:17.176446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:17.179339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=30 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.185381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.185866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.186295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.186970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.187418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.187833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.191704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=82 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.316725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:17.325410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c6a501f-bb86-4c52-a0da-e7a1aa84b13e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.153425 Aug 30 04:16:17.325993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3351/6584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:17 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:18.346809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:18.347434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:18.354913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.355331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.355781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.356477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.356943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.357400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.488534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:18.497417 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-69cba784-7ad2-4ba6-9033-9307e6cae0a0 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.154571 Aug 30 04:16:18.497999 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3234/6585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:18 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:19.518201 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:19.518822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:19.525705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.526194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.526631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.527320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.527777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.528204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.661050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:19.668977 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1006dd62-8243-456b-a6d9-e99475c0b4e5 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.154706 Aug 30 04:16:19.669574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3352/6586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:19 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:20.689225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:20.689936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:20.697012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.697547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.698000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.698712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.699668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.700101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.832076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:20.840650 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f65a93a-e28c-46ca-8f38-5f6c111b73ee tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.154836 Aug 30 04:16:20.841247 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3235/6587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:20 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:21.862391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:21.863002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:21.869870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.870359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.870789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.871474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.871924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.872348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:22.002658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:22.010315 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-947dbba9-c9c7-41a5-aaf0-fcb0646bb8d6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.151847 Aug 30 04:16:22.010883 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3353/6588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:21 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:23.032144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:23.032784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:23.039877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.040386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.040842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.041579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.042058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.042503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.172450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:23.180279 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b846648c-1612-415e-867b-1b27bf49095b tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.152070 Aug 30 04:16:23.180866 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3236/6589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:23 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:24.200580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:24.201702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:24.208578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.209063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.209535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.210224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.210676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.211099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.346143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:24.355261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fb0e6814-a6a8-4744-9562-8962d5fd0dcf tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1514 microversion: 2.1 time: 0.158530 Aug 30 04:16:24.355771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3354/6590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:24 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:25.376180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:25.376857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:25.384117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:25.384562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:25.384991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:25.385724 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:25.386189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:25.386623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:25.498273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cabaad-fe22-4d47-bb36-a859be1d3d19", "name": "network-vif-unplugged", "status": "completed", "tag": "7979e170-f0d8-4612-94a6-9fcd1cd5506b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:25.509263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:25.509869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:25.510508 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:25.524426 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] Creating event network-vif-unplugged:7979e170-f0d8-4612-94a6-9fcd1cd5506b for instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 on n-h2-854924-5 Aug 30 04:16:25.525366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:25.532436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:16:25.534614 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-396ef58c-615c-4372-8e25-7404584d1a85 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1513 microversion: 2.1 time: 0.162379 Aug 30 04:16:25.535718 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3237/6591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:25 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:25.546968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-7c9b3b8b-1414-453e-a44f-ef47b7823b7f req-7ded50be-4efc-4cef-b9bf-8ac579b96c79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052006 Aug 30 04:16:25.547784 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3355/6592] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:26.556164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:26.556733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:26.564402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.564901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.565368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.566069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.566539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.566984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.694655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:26.702539 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-13bbb2ea-63f8-47d8-b64c-cb7c1c9ba19c tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1511 microversion: 2.1 time: 0.150378 Aug 30 04:16:26.703119 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3238/6593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:26 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:27.564124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cabaad-fe22-4d47-bb36-a859be1d3d19", "tag": "7979e170-f0d8-4612-94a6-9fcd1cd5506b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.574735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:27.575203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:27.576128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:27.587483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] Creating event network-changed:7979e170-f0d8-4612-94a6-9fcd1cd5506b for instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 on n-h2-854924-5 Aug 30 04:16:27.593256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:16:27.603501 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ab2b97a4-a6fc-464c-a79b-e29a9b2b3b25 req-29d9826d-0110-44be-a00a-d733048e8904 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043430 Aug 30 04:16:27.604078 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3356/6594] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.724120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.725481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:27.732495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:27.733112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:27.733685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:27.734462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:27.734939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:27.735424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:27.879586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:27.887827 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ae892ae-b93f-45a5-837d-f6b058b2de48 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1511 microversion: 2.1 time: 0.167624 Aug 30 04:16:27.894417 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3239/6595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:27 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:28.911849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:28.912563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:28.919070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:28.919558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:28.919998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:28.920691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:28.921147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:28.921602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:29.075600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:29.086915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fa1332b3-68b6-45e4-a0f8-056e41b40c4e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1508 microversion: 2.1 time: 0.179348 Aug 30 04:16:29.087922 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3357/6596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:28 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:29.113910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:29.114490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:29.125264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:29.126209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:29.126854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:29.127923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:29.131065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:29.131641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:29.160753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:29.221031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Found an unconfirmed migration during delete, id: 16, status: finished Aug 30 04:16:30.764213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cabaad-fe22-4d47-bb36-a859be1d3d19", "name": "network-vif-plugged", "status": "completed", "tag": "7979e170-f0d8-4612-94a6-9fcd1cd5506b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:30.775352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:30.775832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:30.776374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:30.788462 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] Creating event network-vif-plugged:7979e170-f0d8-4612-94a6-9fcd1cd5506b for instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 on n-h2-854924-5 Aug 30 04:16:30.793867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:16:30.805318 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-bdfe1a68-f59b-453d-b2a4-688a43d061fa req-06dd8dd9-9304-48a0-83cf-2f52272fefce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045965 Aug 30 04:16:30.806112 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3358/6597] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:31.213079 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-47dce51f-4787-4b58-988a-982cdeda877a tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 204 len: 0 microversion: 2.1 time: 2.103413 Aug 30 04:16:31.213819 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3240/6598] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:29 2022] DELETE /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 0 bytes in 2105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:31.224160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:31.225060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:31.232688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:31.233176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:31.233637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:31.234329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:31.234782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:31.235207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:31.366544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:31.374364 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-214aedf7-3974-4fe4-a44c-b544c045c69d tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1500 microversion: 2.1 time: 0.155387 Aug 30 04:16:31.374955 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3359/6599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:31 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:32.395941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:32.396673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:32.403988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:32.404492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:32.404939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:32.405679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:32.406149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:32.406589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:32.539422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9daf4528ec446ef8f5372a3c78ba23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b56030182141e99b341da01626eccf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:32.547332 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-72f8f832-b7d9-4127-bd25-a44c5cd58ec6 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 200 len: 1500 microversion: 2.1 time: 0.155697 Aug 30 04:16:32.547922 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3241/6600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:32 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:32.991324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-cdbb3407-05a9-4613-acdf-a9a019162b99 req-ea18128f-f028-46f0-bfb6-38481a2a0da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cabaad-fe22-4d47-bb36-a859be1d3d19", "name": "network-vif-deleted", "tag": "7979e170-f0d8-4612-94a6-9fcd1cd5506b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:33.004734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cdbb3407-05a9-4613-acdf-a9a019162b99 req-ea18128f-f028-46f0-bfb6-38481a2a0da8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.005326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cdbb3407-05a9-4613-acdf-a9a019162b99 req-ea18128f-f028-46f0-bfb6-38481a2a0da8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.005842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-cdbb3407-05a9-4613-acdf-a9a019162b99 req-ea18128f-f028-46f0-bfb6-38481a2a0da8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.022739 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-cdbb3407-05a9-4613-acdf-a9a019162b99 req-ea18128f-f028-46f0-bfb6-38481a2a0da8 service nova] Creating event network-vif-deleted:7979e170-f0d8-4612-94a6-9fcd1cd5506b for instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 on n-h2-854924-5 Aug 30 04:16:33.027892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-cdbb3407-05a9-4613-acdf-a9a019162b99 req-ea18128f-f028-46f0-bfb6-38481a2a0da8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 Aug 30 04:16:33.028771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3360/6601] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:33.568628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:33.569255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:33.576696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.577197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.577675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.578377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.578844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.579282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.593851 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] HTTP exception thrown: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Request method failure captured: Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 HTTP/1.1 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY7t7hdUBzYfDBCb1dTkdQTNryDyazh-U2985eDFNAHYvsbnzmgxRV_-ytQ6taIHcWgeHjk3O663ytONGDaqOn6ov2jApNpjtcb1uWE1AZXB8iia7F3fSDpbfB5yXE3dsFnWTl3kTUyE_3z9dH_2rvqcw96gPrGEfG2yzWzIfeYFrD4 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 97b56030182141e99b341da01626eccf Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/97b56030182141e99b341da01626eccf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/97b56030182141e99b341da01626eccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_97b56030182141e99b341da01626eccf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/97b56030182141e99b341da01626eccf"}]}] Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 97b56030182141e99b341da01626eccf Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1484369064-project Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c9daf4528ec446ef8f5372a3c78ba23f Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1484369064-project Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e8cabaad-fe22-4d47-bb36-a859be1d3d19'} Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:33.595559 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Returning 404 to user: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ee6e890a-c3bf-46f6-a2f0-87eb8d99ba14 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 404 len: 111 microversion: 2.1 time: 0.032349 Aug 30 04:16:33.599848 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3242/6602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:33 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:33.613511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:33.614097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:33.627698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.628177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.628606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.629282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.629755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.630173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.644413 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] HTTP exception thrown: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Request method failure captured: Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 HTTP/1.1 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY7t7hdUBzYfDBCb1dTkdQTNryDyazh-U2985eDFNAHYvsbnzmgxRV_-ytQ6taIHcWgeHjk3O663ytONGDaqOn6ov2jApNpjtcb1uWE1AZXB8iia7F3fSDpbfB5yXE3dsFnWTl3kTUyE_3z9dH_2rvqcw96gPrGEfG2yzWzIfeYFrD4 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 97b56030182141e99b341da01626eccf Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/97b56030182141e99b341da01626eccf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/97b56030182141e99b341da01626eccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_97b56030182141e99b341da01626eccf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/97b56030182141e99b341da01626eccf"}]}] Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 97b56030182141e99b341da01626eccf Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-DeleteServersTestJSON-1484369064-project Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: c9daf4528ec446ef8f5372a3c78ba23f Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-DeleteServersTestJSON-1484369064-project Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e8cabaad-fe22-4d47-bb36-a859be1d3d19'} Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:33.646125 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Returning 404 to user: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4888bde3-0dbf-4365-ba0d-9d19100e529e tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 404 len: 111 microversion: 2.1 time: 0.038262 Aug 30 04:16:33.650396 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3361/6603] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:33 2022] DELETE /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:16:33.655860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:33.656482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] [instance: e8cabaad-fe22-4d47-bb36-a859be1d3d19] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:33.662599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.663094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.663570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.664265 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.664732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.665182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.682306 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] HTTP exception thrown: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Request method failure captured: Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 HTTP/1.1 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY7t7hdUBzYfDBCb1dTkdQTNryDyazh-U2985eDFNAHYvsbnzmgxRV_-ytQ6taIHcWgeHjk3O663ytONGDaqOn6ov2jApNpjtcb1uWE1AZXB8iia7F3fSDpbfB5yXE3dsFnWTl3kTUyE_3z9dH_2rvqcw96gPrGEfG2yzWzIfeYFrD4 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 97b56030182141e99b341da01626eccf Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/97b56030182141e99b341da01626eccf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/97b56030182141e99b341da01626eccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_97b56030182141e99b341da01626eccf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/97b56030182141e99b341da01626eccf"}]}] Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 97b56030182141e99b341da01626eccf Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484369064 Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-DeleteServersTestJSON-1484369064-project Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: c9daf4528ec446ef8f5372a3c78ba23f Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-DeleteServersTestJSON-1484369064-project Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'e8cabaad-fe22-4d47-bb36-a859be1d3d19'} Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:33.683861 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] Returning 404 to user: Instance e8cabaad-fe22-4d47-bb36-a859be1d3d19 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea9f4aab-63bb-454f-a9c1-99899d0c16f3 tempest-DeleteServersTestJSON-1484369064 tempest-DeleteServersTestJSON-1484369064-project] 10.222.0.30 "GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19" status: 404 len: 111 microversion: 2.1 time: 0.033758 Aug 30 04:16:33.688594 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3243/6604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:33 2022] GET /compute/v2.1/servers/e8cabaad-fe22-4d47-bb36-a859be1d3d19 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:16:42.769878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1418238984", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "696f6051-bf71-4c2a-b918-50b18c00687b"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:42.824435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] validate_networks() for [('696f6051-bf71-4c2a-b918-50b18c00687b', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:16:43.227082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:16:43.227571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:16:43.228073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:16:43.228488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:16:43.228903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:16:43.243299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.243955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.244467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.245309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.245851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.246341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.265580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Getting quotas for project 8d120525530a45d0a05e1ed42ed86b43. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:43.270878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Getting quotas for user db86c815627a42b2a101c7f1403f89ab and project 8d120525530a45d0a05e1ed42ed86b43. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:43.283455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:16:43.285797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:16:43.332136 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a0066869-47d0-4a8f-af4d-5b0e570d097e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691174 Aug 30 04:16:43.332789 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3362/6605] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:16:43.344609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9937acb9-415d-4f4f-9ad4-aac4c83dcfdf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:43.345273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9937acb9-415d-4f4f-9ad4-aac4c83dcfdf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:43.410760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9937acb9-415d-4f4f-9ad4-aac4c83dcfdf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:43.419272 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9937acb9-415d-4f4f-9ad4-aac4c83dcfdf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1218 microversion: 2.1 time: 0.078480 Aug 30 04:16:43.432859 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3244/6606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:43 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:44.441860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:44.443111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:44.451061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:44.451750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:44.452438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:44.453145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:44.453399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:44.453746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:44.526151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:44.534611 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7ca297b-1f71-41cc-bc32-db4ff4010204 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1270 microversion: 2.1 time: 0.097711 Aug 30 04:16:44.535427 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3363/6607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:44 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:45.556256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:45.557682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:45.561445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.570656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:45.571718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:45.572546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:45.573736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:45.576079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:45.576786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:45.764242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:45.774444 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c83a2989-383e-447a-b01a-16b9dda75c32 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.221980 Aug 30 04:16:45.775067 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3245/6608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:45 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:46.119305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0b2ea0b6-1a40-45a3-8662-5cafc0a979c9 req-df13da65-008c-4eee-8281-5af7c3df1e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86be5b48-395b-49ec-a69a-dfb26fca4726", "tag": "b8b4b490-abb2-4b6c-97c9-243a55a80673"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:46.141482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0b2ea0b6-1a40-45a3-8662-5cafc0a979c9 req-df13da65-008c-4eee-8281-5af7c3df1e2d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.142334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0b2ea0b6-1a40-45a3-8662-5cafc0a979c9 req-df13da65-008c-4eee-8281-5af7c3df1e2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.143629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0b2ea0b6-1a40-45a3-8662-5cafc0a979c9 req-df13da65-008c-4eee-8281-5af7c3df1e2d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.174906 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0b2ea0b6-1a40-45a3-8662-5cafc0a979c9 req-df13da65-008c-4eee-8281-5af7c3df1e2d service nova] Creating event network-changed:b8b4b490-abb2-4b6c-97c9-243a55a80673 for instance 86be5b48-395b-49ec-a69a-dfb26fca4726 on n-h1-854924-5 Aug 30 04:16:46.182524 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0b2ea0b6-1a40-45a3-8662-5cafc0a979c9 req-df13da65-008c-4eee-8281-5af7c3df1e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069607 Aug 30 04:16:46.183345 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3364/6609] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:46.799998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:46.800541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:46.803100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:46.809760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.810941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.810941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.811431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.811861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.812296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.951622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:46.959553 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ad05062d-622e-4a5b-b895-5e07e8762ddc tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.163760 Aug 30 04:16:46.960152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3246/6610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:46 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:47.982039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:47.982743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:47.984698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:47.990419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:47.990897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:47.991961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:47.992727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:47.993188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:47.993660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:47.997704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=62 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:48.130291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:48.138449 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4338720c-215c-4bb3-865a-0f661086c7ef tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.161803 Aug 30 04:16:48.139021 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3365/6611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:47 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:49.159641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:49.160263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:49.167759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:49.168820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:49.169309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:49.170044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:49.170505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:49.170940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:49.310727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:49.319551 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c1638e76-4263-4453-985a-5d979d754c38 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.163813 Aug 30 04:16:49.320130 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3247/6612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:49 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:50.341125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:50.341758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:50.348867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:50.349371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:50.349858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:50.350577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:50.351032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:50.351451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:50.491894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:50.499736 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b646542e-5efb-4030-8387-849d2a1f540b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.163083 Aug 30 04:16:50.500346 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3366/6613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:50 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:51.521321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:51.522007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:51.528899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:51.529515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:51.529879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:51.530584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:51.531045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:51.531489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:51.670100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:51.678346 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-983306fb-be6b-4787-9003-5ebaa43e51db tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.160901 Aug 30 04:16:51.678973 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3248/6614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:51 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:52.700527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:52.701142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:52.708324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:52.708861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:52.709366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:52.710086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:52.710562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:52.711020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:52.848878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:52.857878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb5d2bc6-a6f1-40b6-baf2-648d2d47db33 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.162157 Aug 30 04:16:52.858454 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3367/6615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:52 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:53.433117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fb7f67f1-7dc0-42b8-9705-0738621d1b73 req-8010b709-6f76-46b9-b6e6-786991d7b012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86be5b48-395b-49ec-a69a-dfb26fca4726", "name": "network-vif-plugged", "status": "completed", "tag": "b8b4b490-abb2-4b6c-97c9-243a55a80673"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:53.439554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.446094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fb7f67f1-7dc0-42b8-9705-0738621d1b73 req-8010b709-6f76-46b9-b6e6-786991d7b012 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:53.446548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fb7f67f1-7dc0-42b8-9705-0738621d1b73 req-8010b709-6f76-46b9-b6e6-786991d7b012 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:53.446994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fb7f67f1-7dc0-42b8-9705-0738621d1b73 req-8010b709-6f76-46b9-b6e6-786991d7b012 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:53.459501 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fb7f67f1-7dc0-42b8-9705-0738621d1b73 req-8010b709-6f76-46b9-b6e6-786991d7b012 service nova] Creating event network-vif-plugged:b8b4b490-abb2-4b6c-97c9-243a55a80673 for instance 86be5b48-395b-49ec-a69a-dfb26fca4726 on n-h1-854924-5 Aug 30 04:16:53.464552 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fb7f67f1-7dc0-42b8-9705-0738621d1b73 req-8010b709-6f76-46b9-b6e6-786991d7b012 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035174 Aug 30 04:16:53.465149 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3249/6616] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:53.879077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:53.879801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:53.881778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.882444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.890714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:53.891200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:53.891635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:53.892404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:53.892851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:53.893271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:54.036370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:54.044525 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-305cc849-1876-4a45-a3c0-1404eaaa3379 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1318 microversion: 2.1 time: 0.169668 Aug 30 04:16:54.045155 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3368/6617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:53 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:55.068106 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.068869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.075817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.076328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.076770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.077517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.077986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.078427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.213174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:55.221689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-480b069b-7c8c-4b84-803a-102caa307b97 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1508 microversion: 2.1 time: 0.159141 Aug 30 04:16:55.222261 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3250/6618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:55.242139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.242672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.244857 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:16:55.245005 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:16:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 (ip 10.222.0.30) !!! Aug 30 04:16:55.253221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.253858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.254395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.255102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.255555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.255979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.389326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:55.397379 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2d875e3-d70a-4ce8-857a-6fe0c1c66793 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1508 microversion: 2.1 time: 0.159132 Aug 30 04:16:55.397965 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3369/6619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:55.417148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:55.419601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.425679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.426177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.426623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.427354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.427813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.428246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.497133 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfc3662a-26a8-4845-b91a-b659b4b4ba14 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "PUT /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1080 microversion: 2.1 time: 0.083732 Aug 30 04:16:55.497771 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3251/6620] 10.222.0.30 () {60 vars in 1256 bytes} [Tue Aug 30 04:16:55 2022] PUT /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1080 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:55.516127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.516745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.522906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.523398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.523832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.524531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.524981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.525433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.667500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:55.675306 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d40e25d8-3262-40a9-960d-7741765c3409 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1506 microversion: 2.1 time: 0.163962 Aug 30 04:16:55.675883 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3370/6621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:55.695597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.696224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.702908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.703402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.703849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.704550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.705014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.705478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.839616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:55.848112 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c7363c5-6029-40bb-afe8-66c57beeeb1d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1506 microversion: 2.1 time: 0.156410 Aug 30 04:16:55.848692 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3252/6622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:55.869459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:55.872541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.881240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.881769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.882207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.882927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.883380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.883804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.914906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:55.926692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Old instance type m1.heat2, new instance type m1.heat {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:16:55.936962 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:16:55.937410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:16:55.937945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:16:55.938600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:16:55.939016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:16:56.006803 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8b850c3-d214-4e5e-99ce-25ec2737105a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726/action" status: 202 len: 0 microversion: 2.1 time: 0.141574 Aug 30 04:16:56.007477 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3371/6623] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:16:55 2022] POST /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:56.016318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:56.017011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:56.023537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:56.024080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:56.024538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:56.025279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:56.025791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:56.026261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:56.538123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:56.547061 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b9a44fd-43e3-4fc9-8552-6c39d10296fa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1517 microversion: 2.1 time: 0.534917 Aug 30 04:16:56.547742 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3253/6624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:56 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1517 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:57.571444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:57.572119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:57.579404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:57.580005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:57.580531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:57.581361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:57.581963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:57.582547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:57.733373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:57.741990 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6ceb5b30-1910-484f-8a06-b66c2b91e353 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1517 microversion: 2.1 time: 0.176224 Aug 30 04:16:57.742494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3372/6625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:57 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:58.763851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:58.764483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:58.771613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:58.772115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:58.772569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:58.773278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:58.773776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:58.774240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:58.914522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:58.923632 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-286ca8ef-a008-47df-b426-2be94f0cf8af tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.164013 Aug 30 04:16:58.924255 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3254/6626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:58 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:59.945853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:59.946475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:59.953247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:59.953763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:59.954202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:59.954892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:59.955382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:59.955805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:00.091607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:00.100604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-13e8db28-ea1e-479a-a155-65e8c988902a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.157840 Aug 30 04:17:00.100604 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3373/6627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:59 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:01.121601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:01.122750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:01.130326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:01.130824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:01.131278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:01.131984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:01.132438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:01.132874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:01.268397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:01.276260 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ea2089bb-4c57-411b-98b2-2ece3efac7a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.159855 Aug 30 04:17:01.276845 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3255/6628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:01 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:02.297168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:02.297907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:02.304805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:02.305360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:02.305792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:02.306482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:02.306929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:02.307351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:02.446989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:02.455568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53282466-15f3-4521-b222-7ec28cd05496 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.162358 Aug 30 04:17:02.456144 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3374/6629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:02 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:03.476233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:03.476893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:03.484181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:03.484684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:03.485169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.485927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:03.486421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:03.486860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.625793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:03.633651 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-23e1f48f-b134-4ec4-b4af-6801e0fdb128 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.161305 Aug 30 04:17:03.634229 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3256/6630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:03 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:04.656781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:04.657427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:04.664836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:04.665337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:04.665806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:04.666517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:04.666978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:04.667443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:04.809876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:04.817700 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f3ae481-44e6-4115-835b-015738a38bf4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.165443 Aug 30 04:17:04.818273 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3375/6631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:04 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:05.839408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:05.840567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:05.847568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:05.848073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:05.848528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:05.849223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:05.849723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:05.850163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:05.987927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:05.996145 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-12eaf29d-bc1f-4b46-a55a-61ef861eb4d1 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.160555 Aug 30 04:17:05.996841 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3257/6632] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:05 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:07.018243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:07.018818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:07.025729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:07.026210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:07.026641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:07.027318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:07.028357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:07.028774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:07.160931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:07.170276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05d4cfd8-3308-45e6-8bfc-37b459138b4d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.155887 Aug 30 04:17:07.170848 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3376/6633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:07 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:08.191670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:08.192302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:08.199969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:08.200630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:08.201095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:08.202143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:08.202654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:08.203103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:08.339398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:08.347891 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a8f993bd-9392-4df2-93d9-c6399e18b4cf tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.160428 Aug 30 04:17:08.348526 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3258/6634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:08 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:09.370362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:09.370902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:09.378308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:09.378786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:09.379217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:09.379936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:09.380372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:09.380788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:09.513767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:09.521566 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-148c657f-c7f0-4afc-aea2-1214fac1a695 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.155300 Aug 30 04:17:09.522142 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3377/6635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:09 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:10.541745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:10.542377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:10.549626 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.550132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.550591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:10.551298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.551760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.552196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:10.682689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:10.694911 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-24ceda91-38fb-4ad9-a4b4-4863a89114df tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.156955 Aug 30 04:17:10.695525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3259/6636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:10 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:11.718118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:11.718771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:11.725647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:11.726139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:11.726577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:11.727276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:11.727732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:11.728158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:11.870748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:11.878980 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b99659ed-b2eb-46c1-80a3-aa2fc34bb703 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.165027 Aug 30 04:17:11.879560 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3378/6637] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:11 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:12.900928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:12.901582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:12.908984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:12.909525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:12.909982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:12.910682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:12.911145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:12.911587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:13.041892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:13.050268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f8764f6f-6dbc-4786-be9d-47c1e9f621c4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.153565 Aug 30 04:17:13.050846 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3260/6638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:12 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:14.073102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:14.074761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:14.081465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.081958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.082549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.083263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.083716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.084217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.217135 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:14.226256 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10c28de5-961b-4b37-9bbe-94c329f6c35e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.157201 Aug 30 04:17:14.226843 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3379/6639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:14 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:15.247615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:15.248162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:15.255284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.255782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.256232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.256933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.257432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.257874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.276570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:15.397208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:15.408111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-58265636-41e7-4d64-a102-658d7f946ab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.164564 Aug 30 04:17:15.408696 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3261/6640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:15 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:16.432191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:16.432809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:16.442033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:16.442528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:16.442966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:16.443670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:16.444130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:16.444566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:16.463153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:16.581751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:16.589567 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a8f762f9-78d4-4309-8625-abd26702c963 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.162385 Aug 30 04:17:16.590123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3380/6641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:16 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:17.610872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:17.611667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:17.621694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=32 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:17.621694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.621694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.621694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.621694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.623605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.623605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.764703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:17.772616 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4604f6cc-df26-4eb5-a1d2-9520bb43476c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.165716 Aug 30 04:17:17.773189 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3262/6642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:17 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:18.793736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:18.794317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:18.796975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=36 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:18.802417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.802906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.803342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.804031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.804484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.804909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.935716 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:18.943458 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0fb62c95-fd47-4294-b181-69f01e334e81 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.153790 Aug 30 04:17:18.944033 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3381/6643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:18 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:19.965827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:19.966473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:19.973565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:19.974075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:19.974529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:19.975252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:19.975757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:19.976197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.120169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:20.128748 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52da434a-9a1b-4b29-8725-534c4efeb077 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.167582 Aug 30 04:17:20.129335 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3263/6644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:19 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:21.150841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:21.151455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:21.158591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:21.159076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:21.159510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:21.160207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:21.160662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:21.161085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:21.305527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:21.317263 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4893b1ee-5f41-40dc-acc5-bdb0a664cd2f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.170169 Aug 30 04:17:21.317900 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3382/6645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:21 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:22.339878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:22.340482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:22.348044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:22.348555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:22.349008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:22.349757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:22.350227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:22.350668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:22.491038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:22.501004 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-47aa7abb-6d5b-40ba-8a31-2ff2b0a9335b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.165532 Aug 30 04:17:22.501634 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3264/6646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:22 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:23.527371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:23.527975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:23.534836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:23.535312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:23.535745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:23.536419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:23.536864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:23.537282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:23.673017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:23.680964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27396fae-7d32-4d62-abea-30e0c889b8d3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.157508 Aug 30 04:17:23.681559 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3383/6647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:23 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:24.702039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:24.702663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:24.709544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.710041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.710489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:24.711186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.711648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.712084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:24.843057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:24.851025 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6848e9b5-d371-460c-be3c-9ff7dc805e57 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1522 microversion: 2.1 time: 0.152836 Aug 30 04:17:24.851607 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3265/6648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:24 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:25.826599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86be5b48-395b-49ec-a69a-dfb26fca4726", "name": "network-vif-unplugged", "status": "completed", "tag": "b8b4b490-abb2-4b6c-97c9-243a55a80673"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:25.837056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:25.837694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:25.838211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:25.851652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] Creating event network-vif-unplugged:b8b4b490-abb2-4b6c-97c9-243a55a80673 for instance 86be5b48-395b-49ec-a69a-dfb26fca4726 on n-h2-854924-5 Aug 30 04:17:25.857260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:17:25.870830 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-2fad7094-16fa-4325-bea8-9424d452f96a req-be606435-6284-4f3d-9286-ce96144f0fea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048328 Aug 30 04:17:25.871756 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3384/6649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:25.874110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:25.874847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:25.882489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:25.882983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:25.883429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:25.884141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:25.884684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:25.885180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:26.026132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:26.035449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5d54746b-8e9b-4db9-9f95-57d8b87ce335 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1521 microversion: 2.1 time: 0.165791 Aug 30 04:17:26.036054 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3266/6650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:25 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:27.058610 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:27.059307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:27.065741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.066229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.066668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.067367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.067823 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.068249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.205334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.213177 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c6784275-3d02-4b45-a02b-3e793299ff7c tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1519 microversion: 2.1 time: 0.159822 Aug 30 04:17:27.213790 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3385/6651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:27 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:27.887044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86be5b48-395b-49ec-a69a-dfb26fca4726", "tag": "b8b4b490-abb2-4b6c-97c9-243a55a80673"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:27.897593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.898076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.898511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.910077 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] Creating event network-changed:b8b4b490-abb2-4b6c-97c9-243a55a80673 for instance 86be5b48-395b-49ec-a69a-dfb26fca4726 on n-h2-854924-5 Aug 30 04:17:27.915309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:17:27.926525 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a9ceba84-f603-4ab2-8a36-6914942ceecb req-bd50255d-af9e-4365-a922-e772571e5266 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043848 Aug 30 04:17:27.927535 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3267/6652] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:28.236232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:28.236897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:28.244521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.245011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.246101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.246808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.247262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.247686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.384458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:28.394334 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4a90853e-2fd8-45b3-a6f6-187a8b97ce55 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1516 microversion: 2.1 time: 0.162152 Aug 30 04:17:28.395222 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3386/6653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:28 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:28.415991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:28.416627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:28.423058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.423562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.424059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.425073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.425726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.426379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.496358 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0ebc402-2617-4215-960b-5e18e0aeb5e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726/action" status: 204 len: 0 microversion: 2.1 time: 0.083784 Aug 30 04:17:28.496949 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3268/6654] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:17:28 2022] POST /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:28.506090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:28.506865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:28.514901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.515484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.516460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.517301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.517937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.518364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.781595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:28.791060 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-616b5231-b5d2-4993-b79d-b91380addfc0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1516 microversion: 2.1 time: 0.289374 Aug 30 04:17:28.791862 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3387/6655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:28 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:29.821899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:29.822627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:29.829129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:29.829664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:29.830121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:29.830829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:29.831297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:29.831737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:29.963150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:29.971437 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7889deca-82e4-4313-8607-9141dc2fee56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1516 microversion: 2.1 time: 0.161585 Aug 30 04:17:29.972006 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3269/6656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:29 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:30.992402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:30.993672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:31.002034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.002265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.002713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.003811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.004071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.004564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.146623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:31.156604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8887df5a-766f-41b6-93a7-b46923db3169 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1508 microversion: 2.1 time: 0.168189 Aug 30 04:17:31.158084 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3388/6657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:30 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:31.180700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:31.181658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:31.188775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4f77611c-e24c-47f3-82c2-6679915a6673 req-ba16ebe0-db29-441d-999a-56355ab78962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86be5b48-395b-49ec-a69a-dfb26fca4726", "name": "network-vif-plugged", "status": "completed", "tag": "b8b4b490-abb2-4b6c-97c9-243a55a80673"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:31.189447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.190355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.191129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.192287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.193118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.193956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.198935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4f77611c-e24c-47f3-82c2-6679915a6673 req-ba16ebe0-db29-441d-999a-56355ab78962 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.199424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4f77611c-e24c-47f3-82c2-6679915a6673 req-ba16ebe0-db29-441d-999a-56355ab78962 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.199871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4f77611c-e24c-47f3-82c2-6679915a6673 req-ba16ebe0-db29-441d-999a-56355ab78962 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.214383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4f77611c-e24c-47f3-82c2-6679915a6673 req-ba16ebe0-db29-441d-999a-56355ab78962 service nova] Creating event network-vif-plugged:b8b4b490-abb2-4b6c-97c9-243a55a80673 for instance 86be5b48-395b-49ec-a69a-dfb26fca4726 on n-h2-854924-5 Aug 30 04:17:31.219521 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4f77611c-e24c-47f3-82c2-6679915a6673 req-ba16ebe0-db29-441d-999a-56355ab78962 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128883 Aug 30 04:17:31.220156 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3270/6658] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:31.322930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:31.330713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06a67ffc-8b02-4a2d-bf50-62fa1278c6fb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1508 microversion: 2.1 time: 0.155398 Aug 30 04:17:31.331285 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3389/6659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:31 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:31.355680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-619007bb-9024-42a5-9832-de1b7e7c0693 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'create', calling method: .version_select at 0x7f897b78e3a0>, body: {"keypair": {"name": "tempest-keypair-746299986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIReilJh5i+gjxMwDWi5Gpo0OPZk6ma5rzz4rLiXH320nJC+k9UTE0hA5lQbxQ/6u+nJkBcL7kIMH4TMyWQKY+H1sV56P9DrvKW21vmtI79qIz5FoqA4W/OXfgYyoKwuqg=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:31.371342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-619007bb-9024-42a5-9832-de1b7e7c0693 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Getting quotas for project 8d120525530a45d0a05e1ed42ed86b43. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:17:31.376650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-619007bb-9024-42a5-9832-de1b7e7c0693 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Getting quotas for user db86c815627a42b2a101c7f1403f89ab and project 8d120525530a45d0a05e1ed42ed86b43. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:17:31.406574 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-619007bb-9024-42a5-9832-de1b7e7c0693 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055718 Aug 30 04:17:31.407174 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3271/6660] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:17:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:17:32.611764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:32.612382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:32.619559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:32.620044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:32.620484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:32.621179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:32.621658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:32.622086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:32.754557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:32.763604 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aa716d84-0ca5-45bf-8e2a-f55416d698fd tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 200 len: 1508 microversion: 2.1 time: 0.155845 Aug 30 04:17:32.764179 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3390/6661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:32 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:32.793662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:32.794307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:32.801390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:32.801912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:32.802390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:32.803109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:32.803582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:32.804026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:32.833449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:32.916153 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-483b9164-64ab-4b4f-9fbc-0a33df40b699 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 204 len: 0 microversion: 2.1 time: 0.127725 Aug 30 04:17:32.916811 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3272/6662] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:32 2022] DELETE /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:32.975421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1102079498", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "696f6051-bf71-4c2a-b918-50b18c00687b"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:33.028339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] validate_networks() for [('696f6051-bf71-4c2a-b918-50b18c00687b', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:17:33.417937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:17:33.418353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:17:33.418821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:17:33.419251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:17:33.419679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:17:33.428371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.428842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.429268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.430003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.430445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.430859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.447935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Getting quotas for project 8d120525530a45d0a05e1ed42ed86b43. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:17:33.454351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Getting quotas for user db86c815627a42b2a101c7f1403f89ab and project 8d120525530a45d0a05e1ed42ed86b43. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:17:33.466556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:17:33.468831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:17:33.515259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ef8364a4-3b20-48af-813a-f362c3f4cac7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543638 Aug 30 04:17:33.515930 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3391/6663] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:17:33.529509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a0b7124-cd25-47ca-994e-5ad097632d3b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:33.530232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a0b7124-cd25-47ca-994e-5ad097632d3b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:33.586441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9a0b7124-cd25-47ca-994e-5ad097632d3b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:33.594520 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a0b7124-cd25-47ca-994e-5ad097632d3b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1218 microversion: 2.1 time: 0.069649 Aug 30 04:17:33.595102 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3273/6664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:33 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:34.617027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:34.617710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:34.627874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:34.628654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:34.629285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:34.630237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:34.630900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:34.631480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:34.758786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:34.778951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-532d0b2e-4d04-42a7-9d24-d3829f459694 req-6e8d3fcf-302e-4879-bf2b-90391fbb26ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86be5b48-395b-49ec-a69a-dfb26fca4726", "name": "network-vif-deleted", "tag": "b8b4b490-abb2-4b6c-97c9-243a55a80673"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:34.781589 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-49fc2450-a8fc-42ab-92fb-43e605b93d09 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1278 microversion: 2.1 time: 0.169392 Aug 30 04:17:34.782302 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3392/6665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:34 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:34.808401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-532d0b2e-4d04-42a7-9d24-d3829f459694 req-6e8d3fcf-302e-4879-bf2b-90391fbb26ae service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:34.810779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-532d0b2e-4d04-42a7-9d24-d3829f459694 req-6e8d3fcf-302e-4879-bf2b-90391fbb26ae service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:34.811301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-532d0b2e-4d04-42a7-9d24-d3829f459694 req-6e8d3fcf-302e-4879-bf2b-90391fbb26ae service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:34.825912 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-532d0b2e-4d04-42a7-9d24-d3829f459694 req-6e8d3fcf-302e-4879-bf2b-90391fbb26ae service nova] Creating event network-vif-deleted:b8b4b490-abb2-4b6c-97c9-243a55a80673 for instance 86be5b48-395b-49ec-a69a-dfb26fca4726 on n-h2-854924-5 Aug 30 04:17:34.831783 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-532d0b2e-4d04-42a7-9d24-d3829f459694 req-6e8d3fcf-302e-4879-bf2b-90391fbb26ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059325 Aug 30 04:17:34.832640 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3274/6666] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:17:35.804520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:35.805134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:35.812916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:35.813428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:35.814092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:35.814810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:35.815260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:35.815698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.064635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:36.072994 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-600fda3f-93af-49e5-a0e0-2c427e632bbb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1318 microversion: 2.1 time: 0.272409 Aug 30 04:17:36.073755 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3393/6667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:35 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:36.203149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-dc01847e-4c78-4fe2-b720-277325d78523 req-d6088d9e-22c0-4c8d-9438-b02ecf158800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f663e097-dc62-4465-b22a-e874c3b09814", "tag": "c7f88eb3-5233-4210-811c-5a385c9e25dc"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:36.217067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dc01847e-4c78-4fe2-b720-277325d78523 req-d6088d9e-22c0-4c8d-9438-b02ecf158800 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.217474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dc01847e-4c78-4fe2-b720-277325d78523 req-d6088d9e-22c0-4c8d-9438-b02ecf158800 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.217924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-dc01847e-4c78-4fe2-b720-277325d78523 req-d6088d9e-22c0-4c8d-9438-b02ecf158800 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.231723 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-dc01847e-4c78-4fe2-b720-277325d78523 req-d6088d9e-22c0-4c8d-9438-b02ecf158800 service nova] Creating event network-changed:c7f88eb3-5233-4210-811c-5a385c9e25dc for instance f663e097-dc62-4465-b22a-e874c3b09814 on n-h2-854924-5 Aug 30 04:17:36.237052 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-dc01847e-4c78-4fe2-b720-277325d78523 req-d6088d9e-22c0-4c8d-9438-b02ecf158800 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118062 Aug 30 04:17:36.238855 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3275/6668] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:37.096301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:37.097035 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:37.104050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.104541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.104981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.105705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.106155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.106578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.254735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:37.263254 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-271510e6-7835-4837-98ea-be8d3dfc6070 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1318 microversion: 2.1 time: 0.171071 Aug 30 04:17:37.263819 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3394/6669] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:37 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:38.285224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:38.285974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:38.294078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:38.294585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:38.295036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:38.295752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:38.296241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:38.296677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:38.437848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:38.446744 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-986d3b03-574b-4f2e-8658-de5f79c2842a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1318 microversion: 2.1 time: 0.165892 Aug 30 04:17:38.447531 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3276/6670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:38 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:39.468649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:39.469500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:39.476461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.476950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.477411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.478110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.478588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.479016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.613981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:39.622257 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9dbeb63c-9b5f-4b0b-846e-671085c284a3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1318 microversion: 2.1 time: 0.158072 Aug 30 04:17:39.622833 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3395/6671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:39 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:40.644169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:40.644792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:40.651745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:40.652236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:40.652684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:40.653390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:40.653858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:40.654290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:40.785176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:40.793327 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2befe445-5a1a-43d2-9626-8d3aedf393b7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1318 microversion: 2.1 time: 0.153114 Aug 30 04:17:40.793914 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3277/6672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:40 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:41.126663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9c9ff9b8-23a7-4397-a1d8-a8097f30a9f6 req-f8b13fa0-946a-47c8-8b07-8456f8439dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f663e097-dc62-4465-b22a-e874c3b09814", "name": "network-vif-plugged", "status": "completed", "tag": "c7f88eb3-5233-4210-811c-5a385c9e25dc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:41.142496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c9ff9b8-23a7-4397-a1d8-a8097f30a9f6 req-f8b13fa0-946a-47c8-8b07-8456f8439dac service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.142496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c9ff9b8-23a7-4397-a1d8-a8097f30a9f6 req-f8b13fa0-946a-47c8-8b07-8456f8439dac service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.142496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9c9ff9b8-23a7-4397-a1d8-a8097f30a9f6 req-f8b13fa0-946a-47c8-8b07-8456f8439dac service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:41.151733 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9c9ff9b8-23a7-4397-a1d8-a8097f30a9f6 req-f8b13fa0-946a-47c8-8b07-8456f8439dac service nova] Creating event network-vif-plugged:c7f88eb3-5233-4210-811c-5a385c9e25dc for instance f663e097-dc62-4465-b22a-e874c3b09814 on n-h2-854924-5 Aug 30 04:17:41.156748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9c9ff9b8-23a7-4397-a1d8-a8097f30a9f6 req-f8b13fa0-946a-47c8-8b07-8456f8439dac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033760 Aug 30 04:17:41.157388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3396/6673] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:41.814281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:41.814906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:41.821956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.822450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.822891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:41.823594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.824054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.824490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:41.962602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:41.970845 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c2c6585-1a99-4495-bced-a0e2ff2eea56 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1318 microversion: 2.1 time: 0.160422 Aug 30 04:17:41.971409 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3278/6674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:41 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:42.993853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:42.995254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:43.001720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.002208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.002640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.003338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.003994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.004196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.144287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:43.152292 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-67ca5898-c699-48d0-b40d-d50480c76708 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1509 microversion: 2.1 time: 0.163585 Aug 30 04:17:43.152880 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3397/6675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:42 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:43.173679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:43.174482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:43.181330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.181892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.182841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.183544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.184010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.184768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.322777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:43.325156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.332745 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c3b09bfd-40a6-452d-82ea-28ee3d3779e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1509 microversion: 2.1 time: 0.163372 Aug 30 04:17:43.333332 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3279/6676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:43 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:43.360799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:43.363253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:43.369305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.369824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.370268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.370966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.371421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.371850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.401736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:43.417621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Old instance type m1.heat2, new instance type m1.heat {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:17:43.419713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=100 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.427065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:17:43.427487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:17:43.427964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:17:43.428375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:17:43.428791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:17:43.443264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.467032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.495207 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-111df19d-ca8b-4484-8664-2f3622e44f2b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814/action" status: 202 len: 0 microversion: 2.1 time: 0.138509 Aug 30 04:17:43.495823 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3398/6677] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:17:43 2022] POST /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:43.509757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:43.510969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:43.522732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.523685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.524583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.526283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:43.526853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:43.527546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.591909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.698398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:43.706777 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9a0d1c51-e489-43be-944a-0d171110f441 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1516 microversion: 2.1 time: 0.206179 Aug 30 04:17:43.707366 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3280/6678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:43 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:44.729802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:44.730416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:44.736409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.736890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.737322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.738086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.738541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.738964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.966419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:44.974868 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9c79aa59-6b59-4cb4-8a38-8e1ec0f245a8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1516 microversion: 2.1 time: 0.250450 Aug 30 04:17:44.975452 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3399/6679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:44 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:45.997131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:45.997806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:46.004871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:46.005431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:46.005893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:46.006608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:46.007080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:46.007528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:46.143463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:46.151977 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-59c14937-0921-4466-bfdf-7a3d1a37113b tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.158794 Aug 30 04:17:46.152566 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3281/6680] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:45 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:47.173596 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:47.174199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:47.181099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.181604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.182037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:47.182721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.183198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.183625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:47.330739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:47.339196 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-827b0e3f-dfb8-4650-a63c-241d7f651271 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.169679 Aug 30 04:17:47.339771 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3400/6681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:47 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:48.360709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:48.361235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:48.364647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:48.375984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:48.376519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:48.376965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:48.377700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:48.378162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:48.378597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:48.532929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:48.541585 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b88c450-3592-4e7a-8f13-daf415c2cbaa tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.184382 Aug 30 04:17:48.542161 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3282/6682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:48 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:49.565314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:49.566136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:49.569230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.576012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:49.576497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:49.576929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:49.577647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:49.578101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:49.578521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:49.709115 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:49.717576 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea27dd20-e146-44a4-b0fd-58481178d8e3 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.157931 Aug 30 04:17:49.718174 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3401/6683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:49 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:50.739729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:50.740385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:50.747319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:50.747809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:50.748254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:50.748950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:50.749447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:50.749884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:50.891337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:50.899167 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78b579de-47f7-45cc-b27e-4203e4e8b37a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.163435 Aug 30 04:17:50.899740 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3283/6684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:50 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:51.920822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:51.921496 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:51.928435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.928919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.929368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:51.930181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.930634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.931059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:52.063831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:52.072877 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d55aa27-42c6-4e91-a45a-eed5519783ba tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.155886 Aug 30 04:17:52.073538 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3402/6685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:51 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:53.095512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:53.096302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:53.104031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:53.104572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:53.105021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:53.105760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:53.106229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:53.106664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:53.252272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:53.260547 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2f5be5af-2ad1-4cca-8581-b237b6262f0e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.169125 Aug 30 04:17:53.261259 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3284/6686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:53 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:54.282694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:54.283242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:54.290547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:54.291037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:54.291474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:54.292226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:54.292715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:54.293165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:54.427269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:54.435052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0985e0ac-9efa-4004-8d43-7e3132ce04cb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.156427 Aug 30 04:17:54.435631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3403/6687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:54 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:55.457494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:55.458123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:55.465395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:55.465937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:55.466389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:55.467100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:55.467568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:55.468009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:55.602178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:55.610038 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc665905-f46c-4340-a440-f69888b3aab9 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.157164 Aug 30 04:17:55.610609 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3285/6688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:55 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:56.631947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:56.632544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:56.639797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:56.640280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:56.640718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:56.641429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:56.641885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:56.642309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:56.773560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:56.782417 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5b669e0-1b20-4477-b4ff-423b90f538b0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.154123 Aug 30 04:17:56.783125 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3404/6689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:56 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:57.804937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:57.805591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:57.812485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:57.812990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:57.813471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:57.814188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:57.814658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:57.815099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:57.953813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:57.961522 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-001ce292-368b-4558-a1ee-6b92a32b170d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.160504 Aug 30 04:17:57.962089 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3286/6690] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:57 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:58.983227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:58.983837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:58.990685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.991166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.991598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.992273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.992745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.993160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:59.129198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:59.138099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6353bf3a-2f6e-4b7c-aecc-14bb718ef7ea tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.158766 Aug 30 04:17:59.138668 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3405/6691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:58 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:00.158540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:00.159173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:00.166181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:00.166687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:00.167142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:00.167851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:00.168323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:00.168770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:00.298200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:00.306709 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ed761b2b-deb8-4dde-adcf-9fadced43819 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.151564 Aug 30 04:18:00.307292 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3287/6692] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:00 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:01.327587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:01.328116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:01.334756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:01.335235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:01.335664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:01.336344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:01.336792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:01.337212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:01.470437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:01.478237 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d4bd6ee3-5319-4f17-a70d-372a7b68f638 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.154611 Aug 30 04:18:01.478810 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3406/6693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:01 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:02.499839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:02.500474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:02.507381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:02.507883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:02.508341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:02.509079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:02.509578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:02.510018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:02.650705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:02.659105 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4e13800-1c1a-4aa5-b139-b0d1c44f029d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.163126 Aug 30 04:18:02.659694 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3288/6694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:02 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:03.681527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:03.682140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:03.688978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:03.689492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:03.689927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:03.690606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:03.691051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:03.691469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:03.818140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:03.826532 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-73f87def-9c40-40be-9c9b-38a08990d291 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.149302 Aug 30 04:18:03.827216 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3407/6695] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:03 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:04.850590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:04.851217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:04.858791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:04.859427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:04.859746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:04.860451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:04.860921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:04.861379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:04.995439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:05.003245 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70b54516-1030-4318-89e1-175755012e9e tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.156591 Aug 30 04:18:05.003814 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3289/6696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:04 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:18:06.025204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:06.025809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:06.032702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:06.033176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:06.033669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:06.034355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:06.034801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:06.035219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:06.163765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:06.172305 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4067ec9b-89f4-4e31-86f3-d97c0d82b1f4 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.150865 Aug 30 04:18:06.173135 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3408/6697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:06 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:07.194654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:07.195280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:07.202407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:07.202908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:07.203364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:07.204074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:07.204540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:07.204979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:07.338728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:07.346602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4d94d314-3455-42be-a218-72891ca7b055 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.156014 Aug 30 04:18:07.347186 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3290/6698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:07 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:08.369816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:08.370404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:08.377808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:08.378298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:08.378732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:08.379427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:08.379877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:08.380291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:08.540815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:08.558304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e459939c-5016-4b56-bbb2-d277f231bcab tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.193327 Aug 30 04:18:08.559356 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3409/6699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:08 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:09.580559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:09.581163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:09.588890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:09.589465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:09.589932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:09.590709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:09.591223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:09.591686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:09.745597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:09.754773 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1367df6-a1bd-469f-ae60-e164ac68a01d tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.178092 Aug 30 04:18:09.755421 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3291/6700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:09 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:10.784655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:10.785558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:10.793937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:10.794423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:10.794877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:10.795607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:10.796060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:10.796489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:10.929573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:10.937864 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3c2f8fe-83ab-4516-bf1d-065e96380ea2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.157414 Aug 30 04:18:10.938433 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3410/6701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:10 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:11.959037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:11.959687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:11.966686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.967180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.967627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:11.968316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.968785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.969213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:12.113550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:12.122231 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8ff17dcc-9fad-486a-8bcd-33e8a532c299 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1521 microversion: 2.1 time: 0.167056 Aug 30 04:18:12.122822 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3292/6702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:11 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:13.062861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f663e097-dc62-4465-b22a-e874c3b09814", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f88eb3-5233-4210-811c-5a385c9e25dc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:13.074370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:13.074878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:13.075314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:13.088915 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] Creating event network-vif-unplugged:c7f88eb3-5233-4210-811c-5a385c9e25dc for instance f663e097-dc62-4465-b22a-e874c3b09814 on n-h1-854924-5 Aug 30 04:18:13.095079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] Instance f663e097-dc62-4465-b22a-e874c3b09814 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:18:13.106866 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4e69bd08-398f-4958-bb3d-e9bdb76e56cd req-dfef62b6-5bed-4f4f-bf77-f46a9238dc30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047992 Aug 30 04:18:13.107484 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3411/6703] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:18:13.144145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:13.144809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:13.154697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:13.155374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:13.155858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:13.156581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:13.157075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:13.157545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:13.296907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:13.306140 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c36425b2-a132-4a55-a48d-16f4787a7be8 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1520 microversion: 2.1 time: 0.165432 Aug 30 04:18:13.306732 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3293/6704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:13 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:14.329435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:14.330068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:14.336199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:14.337212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:14.337690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:14.338361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:14.338804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:14.339222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:14.341812 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:14.473274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:14.481018 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-284f020e-b7dc-4026-8086-42bef5ae8aa6 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1518 microversion: 2.1 time: 0.156752 Aug 30 04:18:14.481611 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3412/6705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:14 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:15.128665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f663e097-dc62-4465-b22a-e874c3b09814", "tag": "c7f88eb3-5233-4210-811c-5a385c9e25dc"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:15.139859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:15.140368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:15.140809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:15.144505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=86 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:15.154916 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] Creating event network-changed:c7f88eb3-5233-4210-811c-5a385c9e25dc for instance f663e097-dc62-4465-b22a-e874c3b09814 on n-h1-854924-5 Aug 30 04:18:15.160930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] Instance f663e097-dc62-4465-b22a-e874c3b09814 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:18:15.171861 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a8a14b80-a575-4ede-931f-cc28bb297c7a req-052deead-ee64-41d0-900d-b66a6dd2ecb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046841 Aug 30 04:18:15.172882 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3294/6706] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:15.502300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:15.502916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:15.510479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:15.510994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:15.511435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:15.512385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:15.513065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:15.513254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:15.733582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:15.741749 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aea47208-fcd6-4970-8edc-a9a23138bea7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1518 microversion: 2.1 time: 0.243402 Aug 30 04:18:15.742331 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3413/6707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:15 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1518 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:16.764984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:16.765734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:16.771969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:16.772478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:16.772931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:16.773673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:16.774763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:16.775237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:16.911111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:16.920509 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca24273c-b356-4aab-b64f-659f79b7d9c2 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1518 microversion: 2.1 time: 0.160883 Aug 30 04:18:16.921788 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3295/6708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:16 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:17.942516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:17.943250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:17.950991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:17.951562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:17.951963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:17.952677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:17.953136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:17.953590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:18.093072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:18.103767 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33939548-4229-495a-9562-043b1573589f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1515 microversion: 2.1 time: 0.163721 Aug 30 04:18:18.104721 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3414/6709] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:17 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:18.124996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:18.125579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:18.132457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:18.132959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:18.135387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:18.136108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:18.136582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:18.137327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:18.205886 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f900f654-8a29-4047-b800-08b8434ee50a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "POST /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814/action" status: 204 len: 0 microversion: 2.1 time: 0.084659 Aug 30 04:18:18.206482 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3296/6710] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:18:18 2022] POST /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:18:18.216469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:18.217089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:18.223334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:18.224213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:18.224636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:18.225464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:18.225983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:18.226412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:18.442024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:18.451397 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-116b7e78-67a7-428f-8e79-b4c0770f1c45 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1515 microversion: 2.1 time: 0.240484 Aug 30 04:18:18.451929 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3415/6711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:18 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:19.473978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:19.474811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:19.478194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=30 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:19.483751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.484248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.484839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.485576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.486044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.486477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.644648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:19.653117 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd2af7ed-5a22-433d-b999-e21bfa301e53 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1507 microversion: 2.1 time: 0.183418 Aug 30 04:18:19.653782 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3297/6712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:19 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:19.674141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:19.674696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:19.677366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=30 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:19.682729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.683211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.683651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.684340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.684816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.685243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.817223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:19.825803 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1e89bf2f-ebc9-4d16-b910-b5878b9e396a tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1507 microversion: 2.1 time: 0.155580 Aug 30 04:18:19.826664 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3416/6713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:19 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:19.846647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:19.847278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:19.853484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.853987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.854437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.855153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.855618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.856054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.919543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1fb806eb-cc14-4e5b-a491-6921dabb80fe req-3e6d663a-cd00-4b66-ab61-93e2b16a3cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f663e097-dc62-4465-b22a-e874c3b09814", "name": "network-vif-plugged", "status": "completed", "tag": "c7f88eb3-5233-4210-811c-5a385c9e25dc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:19.932647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1fb806eb-cc14-4e5b-a491-6921dabb80fe req-3e6d663a-cd00-4b66-ab61-93e2b16a3cdc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:19.933789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1fb806eb-cc14-4e5b-a491-6921dabb80fe req-3e6d663a-cd00-4b66-ab61-93e2b16a3cdc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:19.934351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1fb806eb-cc14-4e5b-a491-6921dabb80fe req-3e6d663a-cd00-4b66-ab61-93e2b16a3cdc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:19.950952 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1fb806eb-cc14-4e5b-a491-6921dabb80fe req-3e6d663a-cd00-4b66-ab61-93e2b16a3cdc service nova] Creating event network-vif-plugged:c7f88eb3-5233-4210-811c-5a385c9e25dc for instance f663e097-dc62-4465-b22a-e874c3b09814 on n-h1-854924-5 Aug 30 04:18:19.957245 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1fb806eb-cc14-4e5b-a491-6921dabb80fe req-3e6d663a-cd00-4b66-ab61-93e2b16a3cdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042554 Aug 30 04:18:19.957993 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3417/6714] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:20.017761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:20.026294 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df987c26-5226-4a6e-9d4c-c3c0afc99ebb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1507 microversion: 2.1 time: 0.183645 Aug 30 04:18:20.026883 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3298/6715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:19 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:20.046705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:20.047287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:20.053530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.054011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.054440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.055622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.056067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.056485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.081263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:18:20.155377 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4f6917d4-c012-4059-b585-caf045c22b5f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 204 len: 0 microversion: 2.1 time: 0.112653 Aug 30 04:18:20.155972 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3418/6716] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:18:20 2022] DELETE /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:18:20.173180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:20.173718 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:20.179797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.180800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.181253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.181976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.182443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.182879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.208829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:18:20.253604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.compute.api [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Instance is already in deleting state, ignoring this request Aug 30 04:18:20.254444 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a8d00f6-6fc8-466b-a02b-7e7324e4a941 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 204 len: 0 microversion: 2.1 time: 0.085325 Aug 30 04:18:20.255015 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3299/6717] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:18:20 2022] DELETE /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:18:20.264448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:20.265221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:20.279790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.280288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.280731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.281492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.281951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.282377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.415269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:20.422998 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae8a8742-5352-4259-9dd8-9023a50d12bb tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1513 microversion: 2.1 time: 0.163131 Aug 30 04:18:20.423559 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3419/6718] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:20 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:21.444137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:21.444764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:21.451942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:21.452448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:21.452901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:21.453641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:21.454111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:21.454551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:21.591434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db86c815627a42b2a101c7f1403f89ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d120525530a45d0a05e1ed42ed86b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:21.600503 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b23e32d-b56f-4977-88fc-7bc882bab6a7 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 200 len: 1513 microversion: 2.1 time: 0.160232 Aug 30 04:18:21.601099 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3300/6719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:21 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:22.127480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-16e17c02-2b98-4b25-a5b3-d42ea8ff4a17 req-62e1a3c9-1be9-432a-a367-ca0bde0f094e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f663e097-dc62-4465-b22a-e874c3b09814", "name": "network-vif-deleted", "tag": "c7f88eb3-5233-4210-811c-5a385c9e25dc"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:22.138787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-16e17c02-2b98-4b25-a5b3-d42ea8ff4a17 req-62e1a3c9-1be9-432a-a367-ca0bde0f094e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:22.139260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-16e17c02-2b98-4b25-a5b3-d42ea8ff4a17 req-62e1a3c9-1be9-432a-a367-ca0bde0f094e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:22.139687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-16e17c02-2b98-4b25-a5b3-d42ea8ff4a17 req-62e1a3c9-1be9-432a-a367-ca0bde0f094e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:22.151287 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-16e17c02-2b98-4b25-a5b3-d42ea8ff4a17 req-62e1a3c9-1be9-432a-a367-ca0bde0f094e service nova] Creating event network-vif-deleted:c7f88eb3-5233-4210-811c-5a385c9e25dc for instance f663e097-dc62-4465-b22a-e874c3b09814 on n-h1-854924-5 Aug 30 04:18:22.156555 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-16e17c02-2b98-4b25-a5b3-d42ea8ff4a17 req-62e1a3c9-1be9-432a-a367-ca0bde0f094e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032751 Aug 30 04:18:22.157232 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3420/6720] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:22.624270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:22.624893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: f663e097-dc62-4465-b22a-e874c3b09814] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:22.631905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:22.632402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:22.632854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:22.634311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:22.634714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:22.635156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:22.649000 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] HTTP exception thrown: Instance f663e097-dc62-4465-b22a-e874c3b09814 could not be found. Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Request method failure captured: Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 HTTP/1.1 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY8qsr5Z6Kb7_M5gNoE_qlw73Fs-qX4c1xkMWrrCXJn1qlMs5kWRGFAWn8rjfIErHuAh_0Ivta3U4lk7v3fr3vsKQZsG5HuGIq9EtH0eM5ogR6DYBVAFWsSziJmH62Zk0kp0ARjE9VMlRjtVa7XflFsrgHSonv1aRiFniJxpt4l9tao Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8d120525530a45d0a05e1ed42ed86b43 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d120525530a45d0a05e1ed42ed86b43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d120525530a45d0a05e1ed42ed86b43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d120525530a45d0a05e1ed42ed86b43", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d120525530a45d0a05e1ed42ed86b43"}]}] Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8d120525530a45d0a05e1ed42ed86b43 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerDiskConfigTestJSON-908488634-project Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: db86c815627a42b2a101c7f1403f89ab Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerDiskConfigTestJSON-908488634-project Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance f663e097-dc62-4465-b22a-e874c3b09814 could not be found. Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'f663e097-dc62-4465-b22a-e874c3b09814'} Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f663e097-dc62-4465-b22a-e874c3b09814 could not be found. Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f663e097-dc62-4465-b22a-e874c3b09814 could not be found. Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:22.650639 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f663e097-dc62-4465-b22a-e874c3b09814 could not be found. Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Returning 404 to user: Instance f663e097-dc62-4465-b22a-e874c3b09814 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d3725344-937c-46ff-b31b-69230475026f tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814" status: 404 len: 111 microversion: 2.1 time: 0.031854 Aug 30 04:18:22.655172 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3301/6721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:22 2022] GET /compute/v2.1/servers/f663e097-dc62-4465-b22a-e874c3b09814 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:22.661425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3f1cd47a-9d05-417b-a020-c4d18ee89a91 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '.version_select at 0x7f897a462670>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:22.685183 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3f1cd47a-9d05-417b-a020-c4d18ee89a91 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-746299986" status: 202 len: 0 microversion: 2.1 time: 0.027947 Aug 30 04:18:22.685821 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3421/6722] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 04:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-746299986 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:23.300050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:23.300569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:23.307249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.307746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.308197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.308897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.309382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.309826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.323846 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] HTTP exception thrown: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Request method failure captured: Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 HTTP/1.1 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY8qsr5Z6Kb7_M5gNoE_qlw73Fs-qX4c1xkMWrrCXJn1qlMs5kWRGFAWn8rjfIErHuAh_0Ivta3U4lk7v3fr3vsKQZsG5HuGIq9EtH0eM5ogR6DYBVAFWsSziJmH62Zk0kp0ARjE9VMlRjtVa7XflFsrgHSonv1aRiFniJxpt4l9tao Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8d120525530a45d0a05e1ed42ed86b43 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d120525530a45d0a05e1ed42ed86b43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d120525530a45d0a05e1ed42ed86b43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d120525530a45d0a05e1ed42ed86b43", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d120525530a45d0a05e1ed42ed86b43"}]}] Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8d120525530a45d0a05e1ed42ed86b43 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerDiskConfigTestJSON-908488634-project Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: db86c815627a42b2a101c7f1403f89ab Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerDiskConfigTestJSON-908488634-project Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '86be5b48-395b-49ec-a69a-dfb26fca4726'} Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:18:23.325429 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Returning 404 to user: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-85cd8b85-b86b-4b94-b915-17f2ba231000 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 404 len: 111 microversion: 2.1 time: 0.030775 Aug 30 04:18:23.329305 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3302/6723] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:18:23 2022] DELETE /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:23.336266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:23.336991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] [instance: 86be5b48-395b-49ec-a69a-dfb26fca4726] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:23.344379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.344859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.345286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.345995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.346441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.346862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.360111 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] HTTP exception thrown: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Request method failure captured: Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 HTTP/1.1 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY8qsr5Z6Kb7_M5gNoE_qlw73Fs-qX4c1xkMWrrCXJn1qlMs5kWRGFAWn8rjfIErHuAh_0Ivta3U4lk7v3fr3vsKQZsG5HuGIq9EtH0eM5ogR6DYBVAFWsSziJmH62Zk0kp0ARjE9VMlRjtVa7XflFsrgHSonv1aRiFniJxpt4l9tao Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8d120525530a45d0a05e1ed42ed86b43 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d120525530a45d0a05e1ed42ed86b43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d120525530a45d0a05e1ed42ed86b43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d120525530a45d0a05e1ed42ed86b43", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d120525530a45d0a05e1ed42ed86b43"}]}] Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8d120525530a45d0a05e1ed42ed86b43 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-908488634 Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerDiskConfigTestJSON-908488634-project Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: db86c815627a42b2a101c7f1403f89ab Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerDiskConfigTestJSON-908488634-project Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '86be5b48-395b-49ec-a69a-dfb26fca4726'} Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:23.361705 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] Returning 404 to user: Instance 86be5b48-395b-49ec-a69a-dfb26fca4726 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5bd73327-fd3b-4e8b-95a3-c5fe3d1c21e0 tempest-ServerDiskConfigTestJSON-908488634 tempest-ServerDiskConfigTestJSON-908488634-project] 10.222.0.30 "GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726" status: 404 len: 111 microversion: 2.1 time: 0.031616 Aug 30 04:18:23.365640 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3422/6724] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:23 2022] GET /compute/v2.1/servers/86be5b48-395b-49ec-a69a-dfb26fca4726 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:31.914419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d3077924-6af9-497c-bf2d-baebcdc93551 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'create', calling method: .version_select at 0x7f8983c33f70>, body: {"keypair": {"name": "tempest-keypair-807406039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXWEZMkSAe6S91Ny2FD5kBj773VUyg/EnFbh3pfC6wPAsmk77KfgfWfq/MCHN1tIw69c++65wWOFjC6D7iF0f8Nap73AUpbvU7PrgttfEUVCbmL78o3by4o9P5TiUEy8w=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:31.931069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-d3077924-6af9-497c-bf2d-baebcdc93551 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:31.936493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-d3077924-6af9-497c-bf2d-baebcdc93551 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:31.964040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d3077924-6af9-497c-bf2d-baebcdc93551 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.174869 Aug 30 04:18:31.964654 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3303/6725] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:18:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:33.641292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1444667124", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e0d6187-976f-47db-a6b4-7ebe4c1960be"}], "security_groups": [{"name": "tempest-securitygroup--374598329"}], "key_name": "tempest-keypair-807406039", "user_data": "}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:33.650891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:33.651538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:33.760132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] validate_networks() for [('4e0d6187-976f-47db-a6b4-7ebe4c1960be', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:18:34.161800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:18:34.162575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:18:34.163371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:18:34.163833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:18:34.164253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:18:34.173605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:34.174260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:34.174928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:34.176359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:34.177131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:34.177801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:34.197091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:34.202465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:34.215589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:18:34.218169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:18:34.267185 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc6e9b60-58e3-4fb1-be50-22efced07790 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.630318 Aug 30 04:18:34.267851 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3423/6726] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:18:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:18:34.276996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:34.281540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e0a37d18-3dfa-4f4e-9063-bec3e8d3a2fd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:34.282174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e0a37d18-3dfa-4f4e-9063-bec3e8d3a2fd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:34.356133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e0a37d18-3dfa-4f4e-9063-bec3e8d3a2fd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:34.364978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e0a37d18-3dfa-4f4e-9063-bec3e8d3a2fd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1238 microversion: 2.1 time: 0.089573 Aug 30 04:18:34.365845 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3304/6727] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:34 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:35.388846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:35.389712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:35.399458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:35.400202 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:35.400748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:35.401647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:35.402335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:35.402931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:35.486556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:35.497279 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-55686f8a-78a2-4084-b442-d9aed80bbcfc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1290 microversion: 2.1 time: 0.113348 Aug 30 04:18:35.497971 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3424/6728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:35 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:36.519959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:36.520599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:36.524273 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:18:36.524414 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e (ip 10.222.0.30) !!! Aug 30 04:18:36.530409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:36.530955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:36.531412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:36.532136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:36.532603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:36.533087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:36.775932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:36.783652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6862efb-8747-48c5-964d-78463ebacca2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1363 microversion: 2.1 time: 0.267922 Aug 30 04:18:36.784237 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3305/6729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:36 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:37.345074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f362ea33-a2b2-445c-bf78-95c355b782db req-25e131a1-7104-4b28-8c62-3c992b4eea2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:37.357188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f362ea33-a2b2-445c-bf78-95c355b782db req-25e131a1-7104-4b28-8c62-3c992b4eea2f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:37.357688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f362ea33-a2b2-445c-bf78-95c355b782db req-25e131a1-7104-4b28-8c62-3c992b4eea2f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:37.358112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f362ea33-a2b2-445c-bf78-95c355b782db req-25e131a1-7104-4b28-8c62-3c992b4eea2f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:37.370212 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f362ea33-a2b2-445c-bf78-95c355b782db req-25e131a1-7104-4b28-8c62-3c992b4eea2f service nova] Creating event network-changed:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h2-854924-5 Aug 30 04:18:37.375332 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f362ea33-a2b2-445c-bf78-95c355b782db req-25e131a1-7104-4b28-8c62-3c992b4eea2f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034388 Aug 30 04:18:37.375959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3425/6730] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:18:37.806062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:37.806695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:37.813654 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:37.814157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:37.814611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:37.815312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:37.815784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:37.816226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:37.948577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:37.956445 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4776047b-d23e-4295-a413-54bb73b8b389 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1363 microversion: 2.1 time: 0.155009 Aug 30 04:18:37.957019 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3306/6731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:37 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:38.979294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:38.979994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:38.986249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.986748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.987179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.987877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.988330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.988754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:39.149981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:39.158768 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7493ddfb-3fc4-43f4-8ec7-1a106ef43ec6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1363 microversion: 2.1 time: 0.185186 Aug 30 04:18:39.159356 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3426/6732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:38 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:40.181465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:40.182101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:40.189175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:40.189715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:40.190174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:40.190946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:40.191477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:40.191943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:40.328551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:40.336952 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2cad1031-e3f2-4ba6-8381-433df84c9c64 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1363 microversion: 2.1 time: 0.160384 Aug 30 04:18:40.337563 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3307/6733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:40 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:41.358250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:41.358866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:41.365529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.366014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.366450 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.367213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.367669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.368092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.464756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7f54d545-5737-41a8-904e-4c6620c0c627 req-aea613da-0ecc-4d12-a491-30dfa35acbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "name": "network-vif-plugged", "status": "completed", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:41.480833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7f54d545-5737-41a8-904e-4c6620c0c627 req-aea613da-0ecc-4d12-a491-30dfa35acbf7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.481841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7f54d545-5737-41a8-904e-4c6620c0c627 req-aea613da-0ecc-4d12-a491-30dfa35acbf7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.482585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7f54d545-5737-41a8-904e-4c6620c0c627 req-aea613da-0ecc-4d12-a491-30dfa35acbf7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.495426 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-7f54d545-5737-41a8-904e-4c6620c0c627 req-aea613da-0ecc-4d12-a491-30dfa35acbf7 service nova] Creating event network-vif-plugged:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h2-854924-5 Aug 30 04:18:41.500711 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7f54d545-5737-41a8-904e-4c6620c0c627 req-aea613da-0ecc-4d12-a491-30dfa35acbf7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040866 Aug 30 04:18:41.501890 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3308/6734] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:41.509447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:41.518160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7e319292-8257-418f-a782-b3ecbe1dd5c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1363 microversion: 2.1 time: 0.163917 Aug 30 04:18:41.518990 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3427/6735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:41 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:42.541833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:42.542572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:42.549149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:42.549683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:42.550135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:42.550847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:42.551327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:42.551766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:42.683463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:42.691290 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d67998de-3eff-46d3-888f-487076b294ef tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1363 microversion: 2.1 time: 0.154814 Aug 30 04:18:42.691861 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3309/6736] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:42 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:43.711805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:43.712418 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:43.719191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.719669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.720099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.720782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.721230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.721685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.854867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:43.863065 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2625848-ce94-4d13-adda-e37ec1524219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1549 microversion: 2.1 time: 0.155094 Aug 30 04:18:43.863631 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3428/6737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:43 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:43.886055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:43.886860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:43.893710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.894207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.894684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.895383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.895853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.896284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.973303 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-caac66ea-5c1c-4430-b855-a73a89b17c55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091685 Aug 30 04:18:43.973939 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3310/6738] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:18:43 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:44.922211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0a1f9396-c5c6-4631-a635-dcc8c08c0a9f req-d8f58b0d-78f2-4020-8a0d-67aa1c17000b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:44.927335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:44.928005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:44.935652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0a1f9396-c5c6-4631-a635-dcc8c08c0a9f req-d8f58b0d-78f2-4020-8a0d-67aa1c17000b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:44.936124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0a1f9396-c5c6-4631-a635-dcc8c08c0a9f req-d8f58b0d-78f2-4020-8a0d-67aa1c17000b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:44.936547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0a1f9396-c5c6-4631-a635-dcc8c08c0a9f req-d8f58b0d-78f2-4020-8a0d-67aa1c17000b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:44.947765 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0a1f9396-c5c6-4631-a635-dcc8c08c0a9f req-d8f58b0d-78f2-4020-8a0d-67aa1c17000b service nova] Creating event network-changed:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h2-854924-5 Aug 30 04:18:44.952814 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0a1f9396-c5c6-4631-a635-dcc8c08c0a9f req-d8f58b0d-78f2-4020-8a0d-67aa1c17000b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034335 Aug 30 04:18:44.953451 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3429/6739] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:14.586627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:14.588772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:14.589477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=30 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:14.593653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.594289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.603391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.603896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.604375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.605084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.605604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.606046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.742188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.750207 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-36c3b45b-8a7c-4a58-9836-9420662c5cc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1668 microversion: 2.1 time: 0.164496 Aug 30 04:19:14.750783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3311/6740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:14.769648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:14.770507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=30 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:14.774527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.775218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.782363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.782839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.783266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.783938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.784402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.784801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.917302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.925110 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-40795296-d7ae-40d2-986e-2ec8cc99e4c3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1668 microversion: 2.1 time: 0.157587 Aug 30 04:19:14.925707 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3430/6741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:14.945561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.946122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.952075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.952564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.953048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.953772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.954232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.954668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.087312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.095612 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-be454c4a-60a0-42ef-bf50-5e24fbded900 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1668 microversion: 2.1 time: 0.154152 Aug 30 04:19:15.096203 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3312/6742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:15.116527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:15.118771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.124741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.125230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.125700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.126381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.126835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.127253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.155542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.161532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:19:15.168520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:15.168943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:15.169446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:15.169853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:15.170265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:15.233490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28f6dc5c-8261-4f1e-95d0-d8de06cdd3d0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e/action" status: 202 len: 0 microversion: 2.1 time: 0.120696 Aug 30 04:19:15.234005 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3431/6743] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:15 2022] POST /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:19:15.242205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:15.242835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.248958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.249492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.249952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.250662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.251131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.251571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.405755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.413775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-784ca30e-d6d2-48a6-9310-8112892de81f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1677 microversion: 2.1 time: 0.175338 Aug 30 04:19:15.414434 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3313/6744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:15 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:16.437528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:16.438958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:16.446886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.447436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.447871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.448799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.449126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.449625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.624378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.632442 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fff0fcb7-8d8f-4a73-9cd5-227a3934d3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1677 microversion: 2.1 time: 0.200782 Aug 30 04:19:16.633055 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3432/6745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:16 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:17.655177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:17.655847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:17.663694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.664189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.664638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.665483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.665950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.666392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.801827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.810635 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-083afe98-db71-457c-a02d-4ac0e58eb4fa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.159475 Aug 30 04:19:17.811238 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3314/6746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:17 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:18.833283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:18.833924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:18.841023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.841550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.841992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.842686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.843149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.843558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.986067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:18.999190 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc8b8a61-387e-4541-914a-8f9ec391c7d3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.169765 Aug 30 04:19:19.000126 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3433/6747] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:18 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:20.022914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:20.023476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:20.030712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.031213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.031667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.032381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.032847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.033289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.168413 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:20.176254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-48be6211-e23f-4582-be00-c7cdcff875e9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.157401 Aug 30 04:19:20.176854 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3315/6748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:20 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:21.199397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:21.200015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:21.206971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:21.207463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:21.207898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:21.209504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:21.209969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:21.210769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:21.346786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:21.355178 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7c93e06c-ac0a-49aa-bde5-289302971662 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.159897 Aug 30 04:19:21.355761 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3434/6749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:21 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:22.381931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:22.382467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:22.390850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.391354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.391844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.392560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.393039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.393545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.525750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.533609 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0971e50d-8a32-435a-bd05-7df334612c91 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.156377 Aug 30 04:19:22.534188 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3316/6750] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:22 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:23.555007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.555654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:23.562807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.563293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.563732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.564419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.564874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.565292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.696256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.704718 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5654f9f8-8120-4404-a2be-8651d8080f5e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.153564 Aug 30 04:19:23.705292 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3435/6751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:24.728049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:24.728670 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:24.735675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.736167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.736616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.737312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.737804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.738829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.867274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:24.875026 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94fcf196-5909-4562-8302-6840f46fd4cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.151474 Aug 30 04:19:24.875595 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3317/6752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:24 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:25.896063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:25.896671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:25.903961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.904451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.904891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.905613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.906063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.906488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.039504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.047767 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a4e60548-c2d4-44c5-8f78-7b730b51f23f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.155597 Aug 30 04:19:26.048350 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3436/6753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:25 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:27.070599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:27.071224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:27.077899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.078391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.078838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.079532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.079997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.080434 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.543408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.551181 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4cb405d-0f77-4621-b335-e7560b4be8b2 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.485224 Aug 30 04:19:27.552407 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3318/6754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:27 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:28.573650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:28.574263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:28.581095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.581601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.582036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.582713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.583214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.583633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.800493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.808276 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58dd219b-fb15-4a20-844e-c8016668204c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1682 microversion: 2.1 time: 0.238629 Aug 30 04:19:28.808846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3437/6755] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:28 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:29.576296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "name": "network-vif-unplugged", "status": "completed", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:29.586451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.586957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.587407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.600244 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] Creating event network-vif-unplugged:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h1-854924-5 Aug 30 04:19:29.605951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:19:29.618093 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-00af0f2b-aa21-40af-8362-5c3e1a4cfc4e req-b77642f1-91eb-4356-bfcd-9cf4db7696f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112449 Aug 30 04:19:29.618708 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3319/6756] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:29.830724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:29.831445 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:29.838536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.839107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.839608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.840301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.840750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.841168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.993210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:30.002089 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-22246916-7039-4b2e-aec0-b1c353443ddb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1681 microversion: 2.1 time: 0.175211 Aug 30 04:19:30.002785 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3438/6757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:29 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:31.026853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:31.027579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:31.033842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.034340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.034789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.035488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.035955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.036392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.222881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.230842 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2b1a84c9-8cec-46ca-96b1-793593312dc7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1679 microversion: 2.1 time: 0.209176 Aug 30 04:19:31.231408 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3320/6758] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:31 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:31.633139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:31.643469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.643939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.644366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.655860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] Creating event network-changed:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h1-854924-5 Aug 30 04:19:31.661134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:19:31.671697 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a1c9264a-baf4-4385-b19c-1300222b2df1 req-163fd5ee-82a0-4b7b-971f-43c515efe71f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042818 Aug 30 04:19:31.672275 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3439/6759] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:32.252294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.252966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.259892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.260393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.261100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.261840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.262308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.262746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.400179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.408317 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16d7ec90-c704-4a82-a311-46f61324ca71 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1679 microversion: 2.1 time: 0.159929 Aug 30 04:19:32.408893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3321/6760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:33.432919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:33.433967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:33.441295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.443170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.443931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.444769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.445315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.445768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.608071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.617032 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5351990f-9b77-43f4-9d94-cef25ac0bdb7 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1679 microversion: 2.1 time: 0.189265 Aug 30 04:19:33.617679 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3440/6761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:33 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:34.640513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:34.641182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.648798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.649303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.649786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.650493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.651393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.651393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.790412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.799169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-955e9ddd-51d5-4cbc-b88b-09a25e1660c6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1676 microversion: 2.1 time: 0.162926 Aug 30 04:19:34.799800 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3322/6762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:34 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:34.820378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:34.820929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.827794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.828281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.828720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.829444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.829899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.830333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.896939 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52e9aee6-8462-416a-a795-cb73971a2e04 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e/action" status: 204 len: 0 microversion: 2.1 time: 0.080659 Aug 30 04:19:34.897535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3441/6763] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:34 2022] POST /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:19:34.908008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:34.908924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.918235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.919014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.919446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.920828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.921311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.921788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.134200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.143217 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b36a0c02-38c7-4a6c-af2b-b82aaf5ef6b9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1676 microversion: 2.1 time: 0.239594 Aug 30 04:19:35.143812 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3323/6764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:34 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:36.167356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.168169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.175953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.177142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.177645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.178459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.179027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.179467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.183854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "name": "network-vif-plugged", "status": "completed", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:36.199766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.200632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.201241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.218463 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] Creating event network-vif-plugged:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h1-854924-5 Aug 30 04:19:36.227202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:19:36.242255 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e7c796ed-1365-4caf-b060-fa7766a2b666 req-ee8ff5fd-b852-45e7-94df-4b2de1e904c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064106 Aug 30 04:19:36.243430 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3324/6765] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:36.378786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.388655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e961ac7b-2554-4660-b18e-b5d7b5012000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1676 microversion: 2.1 time: 0.226286 Aug 30 04:19:36.389286 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3442/6766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:37.413843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.414565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.420849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.421367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.421863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.422573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.423048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.423495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.586589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.595238 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b01995a-298e-4f16-be17-69d8ab4d354a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1668 microversion: 2.1 time: 0.186474 Aug 30 04:19:37.595867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3325/6767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:37.616960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.617652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.624959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.625488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.625940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.626645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.627102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.627566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.768777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.776704 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0355818e-a48d-4c95-ab6c-bae44afed73c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1668 microversion: 2.1 time: 0.164381 Aug 30 04:19:37.777283 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3443/6768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:37.797754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.798506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.805729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.806255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.806716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.807435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.807903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.808343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.960605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.968428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f45bb96c-9e28-4fb4-8fd2-d2be4113d670 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1668 microversion: 2.1 time: 0.175037 Aug 30 04:19:37.968945 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3326/6769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:37.988682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.989792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.995777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.996254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.996682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.997382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.997830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.998246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.013400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:38.025995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:19:38.105706 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-08822049-62af-4bc2-8923-8d4b90534372 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 204 len: 0 microversion: 2.1 time: 0.120292 Aug 30 04:19:38.106535 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3444/6770] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:19:37 2022] DELETE /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:19:38.114882 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:38.115510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:38.121652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.122154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.122605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.123305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.123771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.124214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.259171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.267885 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2637f7e0-c772-4d0c-a372-8898e318bd88 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1674 microversion: 2.1 time: 0.156869 Aug 30 04:19:38.268482 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3327/6771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:38 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:39.289873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.290476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.297472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.297965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.298408 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.299112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.299564 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.299988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.442432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.450362 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8e07df95-315f-4359-8402-3c58b2791ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1674 microversion: 2.1 time: 0.164944 Aug 30 04:19:39.450933 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3445/6772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:40.401450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fa10cfc0-def9-4c27-9a79-3e2aca0f0934 req-5d794d6f-d8a7-4617-a003-7a7ab609090a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101bb6fe-4879-4baa-9bad-8e63d4b95b2e", "name": "network-vif-deleted", "tag": "bb38425f-1e66-4aad-ac9b-f22e4f3ee28b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:40.413542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fa10cfc0-def9-4c27-9a79-3e2aca0f0934 req-5d794d6f-d8a7-4617-a003-7a7ab609090a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.414443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fa10cfc0-def9-4c27-9a79-3e2aca0f0934 req-5d794d6f-d8a7-4617-a003-7a7ab609090a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.415051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fa10cfc0-def9-4c27-9a79-3e2aca0f0934 req-5d794d6f-d8a7-4617-a003-7a7ab609090a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.421109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:40.432163 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fa10cfc0-def9-4c27-9a79-3e2aca0f0934 req-5d794d6f-d8a7-4617-a003-7a7ab609090a service nova] Creating event network-vif-deleted:bb38425f-1e66-4aad-ac9b-f22e4f3ee28b for instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e on n-h1-854924-5 Aug 30 04:19:40.437618 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fa10cfc0-def9-4c27-9a79-3e2aca0f0934 req-5d794d6f-d8a7-4617-a003-7a7ab609090a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039836 Aug 30 04:19:40.438297 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3328/6773] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:40.476464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.477996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.485802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.486585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.487378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.488278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.489424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.490010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.524913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.525617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.526099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.526561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lazy-loading 'fault' on Instance uuid 101bb6fe-4879-4baa-9bad-8e63d4b95b2e {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:19:40.586319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.594839 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c65b497-ec6b-420e-89bc-b8d8b0bc7471 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 200 len: 1328 microversion: 2.1 time: 0.124592 Aug 30 04:19:40.595423 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3446/6774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:41.620173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.620801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.627083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.627578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.628024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.628714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.629176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.629632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.643087 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e HTTP/1.1 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '101bb6fe-4879-4baa-9bad-8e63d4b95b2e'} Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:41.644728 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa2e1639-cd48-4a21-97ef-c527637ac7d9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 404 len: 111 microversion: 2.1 time: 0.031242 Aug 30 04:19:41.649702 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3329/6775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:41.657896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.658506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.665776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.666260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.666695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.667380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.667836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.668255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.682575 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e HTTP/1.1 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '101bb6fe-4879-4baa-9bad-8e63d4b95b2e'} Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:41.684233 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3fd21416-ee3f-44e9-b856-7a24ccf77b83 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 404 len: 111 microversion: 2.1 time: 0.031605 Aug 30 04:19:41.688455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3447/6776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:41.735506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1986487929", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "4e0d6187-976f-47db-a6b4-7ebe4c1960be"}], "security_groups": [{"name": "tempest-securitygroup--374598329"}], "key_name": "tempest-keypair-807406039", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:41.847362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] validate_networks() for [('4e0d6187-976f-47db-a6b4-7ebe4c1960be', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:42.298291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:42.298729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:42.299216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:42.299638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:42.300066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:42.309262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.309793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.310245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.310984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.311452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.311890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.330066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:42.339117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:42.352451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:42.354842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:42.404719 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-370334d9-7102-4d6a-b166-bbb7c268a3cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673083 Aug 30 04:19:42.405582 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3330/6777] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:42.417056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4cf152b0-cb1d-4238-b461-e9b3d80e80b4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.417737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4cf152b0-cb1d-4238-b461-e9b3d80e80b4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.475181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4cf152b0-cb1d-4238-b461-e9b3d80e80b4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.482468 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4cf152b0-cb1d-4238-b461-e9b3d80e80b4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1238 microversion: 2.1 time: 0.069275 Aug 30 04:19:42.485303 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3448/6778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:42 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:43.506014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:43.507499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:43.515534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.516052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.516513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.517277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.517784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.518230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.582692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.591897 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1244ca8-588b-47c7-8550-1fd4f3675182 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1234 microversion: 2.1 time: 0.091547 Aug 30 04:19:43.592690 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3331/6779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:44.614793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.615436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.623926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.624515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.624986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.625777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.626254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.626678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.700673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.710244 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe9b9a14-ab3d-4373-93ac-1eb2cda91deb tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1296 microversion: 2.1 time: 0.100019 Aug 30 04:19:44.710984 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3449/6780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:44 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:45.570778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-82831c50-afba-4948-97d4-f6cdf394625c req-bbb696ba-7edc-43ca-b50b-28b2b38b1181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:45.578669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:45.590601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-82831c50-afba-4948-97d4-f6cdf394625c req-bbb696ba-7edc-43ca-b50b-28b2b38b1181 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.591315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-82831c50-afba-4948-97d4-f6cdf394625c req-bbb696ba-7edc-43ca-b50b-28b2b38b1181 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.592086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-82831c50-afba-4948-97d4-f6cdf394625c req-bbb696ba-7edc-43ca-b50b-28b2b38b1181 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.608976 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-82831c50-afba-4948-97d4-f6cdf394625c req-bbb696ba-7edc-43ca-b50b-28b2b38b1181 service nova] Creating event network-changed:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h1-854924-5 Aug 30 04:19:45.616978 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-82831c50-afba-4948-97d4-f6cdf394625c req-bbb696ba-7edc-43ca-b50b-28b2b38b1181 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049757 Aug 30 04:19:45.617770 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3332/6781] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:45.732595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.733238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.736221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:45.742080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.742573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.743009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.743717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.744167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.744589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.893458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.902434 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9e980f90-d6f7-4669-a36d-7cad523821b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.173733 Aug 30 04:19:45.903033 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3450/6782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:46.926354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.927234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:46.934797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.935295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.935740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.936445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.936923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.937383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.074476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.085246 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2a06547a-0e5e-4035-aa1a-f16a339ff5ec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.164614 Aug 30 04:19:47.085867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3333/6783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:48.109929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.110546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.118047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.118534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.118955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.119635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.120093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.120511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.255287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.263323 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7864645-73a0-4671-aa7b-d68d9d899d5b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.157276 Aug 30 04:19:48.263880 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3451/6784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:49.284751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.286041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.293470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.293978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.294431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.295141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.295612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.296053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.435910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.443648 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5997a2be-22c4-4c99-96d3-661cbb53a419 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.162959 Aug 30 04:19:49.444226 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3334/6785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:50.478014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.478631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.486447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.486941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.487406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.488857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.489477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.489805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.648013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.655834 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50e53526-8552-4a08-a82b-ab991d87ac92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.181713 Aug 30 04:19:50.656399 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3452/6786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:51.679337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.679872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:51.687184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.687688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.688150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.688840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.689306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.689764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.820788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.828730 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-58b90b24-69f1-4b2f-8278-8134db847990 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.153960 Aug 30 04:19:51.829369 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3335/6787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:52.302148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-15454017-aac3-4053-a788-794f29dc6088 req-7885d927-f594-478f-8e21-b0c7e6b0b6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "name": "network-vif-plugged", "status": "completed", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:52.313536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15454017-aac3-4053-a788-794f29dc6088 req-7885d927-f594-478f-8e21-b0c7e6b0b6d3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.314036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15454017-aac3-4053-a788-794f29dc6088 req-7885d927-f594-478f-8e21-b0c7e6b0b6d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.314513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15454017-aac3-4053-a788-794f29dc6088 req-7885d927-f594-478f-8e21-b0c7e6b0b6d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.332292 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-15454017-aac3-4053-a788-794f29dc6088 req-7885d927-f594-478f-8e21-b0c7e6b0b6d3 service nova] Creating event network-vif-plugged:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h1-854924-5 Aug 30 04:19:52.338110 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-15454017-aac3-4053-a788-794f29dc6088 req-7885d927-f594-478f-8e21-b0c7e6b0b6d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040441 Aug 30 04:19:52.338728 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3453/6788] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:52.853900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:52.854592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:52.857043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:52.858051 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:52.867246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.867794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.868377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.869420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.870230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.871053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.029635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.040995 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ca2d1610-eb68-45f1-9006-80d2fce97707 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1363 microversion: 2.1 time: 0.191703 Aug 30 04:19:53.041634 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3336/6789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:52 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:54.064085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.064783 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.067518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:54.074643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.075438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.075873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.076582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.077028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.077468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.259530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.268848 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9d2c1750-4e78-48ab-913c-f103c9e72a92 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1549 microversion: 2.1 time: 0.209015 Aug 30 04:19:54.269505 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3454/6790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1549 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:54.296257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.297193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.310574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.311487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.312279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.313686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.314671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.315391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.429303 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c054734-bd54-464a-888b-95a18bd03894 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140825 Aug 30 04:19:54.429974 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3337/6791] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:55.590370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-edb8dbcf-9a7b-4013-95f5-919fd8e2e692 req-1b7cc50d-2b67-465e-903c-24a7fa16225a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:55.602709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-edb8dbcf-9a7b-4013-95f5-919fd8e2e692 req-1b7cc50d-2b67-465e-903c-24a7fa16225a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.603636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-edb8dbcf-9a7b-4013-95f5-919fd8e2e692 req-1b7cc50d-2b67-465e-903c-24a7fa16225a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.604146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-edb8dbcf-9a7b-4013-95f5-919fd8e2e692 req-1b7cc50d-2b67-465e-903c-24a7fa16225a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.617099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-edb8dbcf-9a7b-4013-95f5-919fd8e2e692 req-1b7cc50d-2b67-465e-903c-24a7fa16225a service nova] Creating event network-changed:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h1-854924-5 Aug 30 04:19:55.622588 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-edb8dbcf-9a7b-4013-95f5-919fd8e2e692 req-1b7cc50d-2b67-465e-903c-24a7fa16225a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036044 Aug 30 04:19:55.623214 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3455/6792] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:09.682089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.683297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=40 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.684975 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:21:09.685235 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action (ip 10.222.0.30) !!! Aug 30 04:21:09.697752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef9f3016-de04-4297-9959-900683b507dd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:09.714635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9f3016-de04-4297-9959-900683b507dd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.715147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9f3016-de04-4297-9959-900683b507dd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.715599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef9f3016-de04-4297-9959-900683b507dd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.742886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef9f3016-de04-4297-9959-900683b507dd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Going to try to stop instance {{(pid=122167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:21:09.792922 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef9f3016-de04-4297-9959-900683b507dd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action" status: 202 len: 0 microversion: 2.1 time: 0.114812 Aug 30 04:21:09.793626 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3338/6793] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:09 2022] POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:21:09.801572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=11 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.802327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.803542 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:21:09.803781 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 (ip 10.222.0.30) !!! Aug 30 04:21:09.809542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:09.810306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:09.832680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.833474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.834195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.835038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.835514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.835968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.001786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.010543 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0bc95df0-6281-4579-8fa1-469624638eec tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.211475 Aug 30 04:21:10.011164 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3456/6794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:09 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:11.040534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.041258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.048238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.048732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.049176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.049901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.050367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.050800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.193402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.201684 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-59a1853f-27e7-4812-bffa-0410c3cbb869 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.166283 Aug 30 04:21:11.202689 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3339/6795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:12.224952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:12.225528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:12.232009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.232482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.232908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.233662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.234067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.234484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.382226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.392713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-159d568a-282b-467e-a523-490889407b22 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.171913 Aug 30 04:21:12.393668 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3457/6796] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:12 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:13.414160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.414835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.422411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.422927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.423416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.424150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.424631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.425077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.612867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.621175 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-002a191d-a998-4532-94b2-b258d5baef57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.211135 Aug 30 04:21:13.621835 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3340/6797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:13 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:14.642858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.643475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.651331 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.651838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.652282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.652983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.653470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.653902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.783674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.791612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8f98221b-361f-460f-bbfb-2f123d063966 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.153303 Aug 30 04:21:14.792179 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3458/6798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:15.813178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.813827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.820971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.821578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.822056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.822772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.823236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.823666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.957483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.965472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-716766b8-99b4-47d8-990f-2cc9006609ba tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.156116 Aug 30 04:21:15.966972 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3341/6799] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:16.989983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:16.991129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.001224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.001738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.002173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.002873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.003319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.003742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.151218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.160047 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-686af247-6cba-4aaa-a8af-9a77e9134cb0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.176755 Aug 30 04:21:17.160634 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3459/6800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:16 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:18.184887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.186068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.195330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.195855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.196297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.197012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.197521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.197962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.334521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.342763 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-045bdcf5-bac2-419c-b7a2-4e610b707219 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.164679 Aug 30 04:21:18.343356 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3342/6801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:19.365336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.366088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.372713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.373193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.373661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.374353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.375426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.375847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.537141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.545302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-09f42e4e-2d96-40c4-8ff8-79b56587ff8c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.183882 Aug 30 04:21:19.546183 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3460/6802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:20.568146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.569001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.576862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.577535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.578707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.579480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.580079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.580558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.735798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.743875 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4a36df5-bfd2-4d8a-aece-98d645463271 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1655 microversion: 2.1 time: 0.179676 Aug 30 04:21:20.744458 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3343/6803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:20.767106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:20.769553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.776983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.777559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.778049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.778954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.779454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.779888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.812790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.819604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Old instance type m1.heat2, new instance type m1.heat {{(pid=122168) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:21:20.826488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:20.826912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:20.827385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:20.827842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:20.828259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:20.896018 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ea1cb37d-fa22-4812-add8-9417de131d6b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action" status: 202 len: 0 microversion: 2.1 time: 0.133574 Aug 30 04:21:20.896645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3461/6804] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:20 2022] POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:21:20.904967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.905640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.912543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.913131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.913889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.914295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.914860 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.915200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.092584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.101920 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d1802d15-f92a-4654-9697-e20d6b9d2a7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.200788 Aug 30 04:21:21.102521 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3344/6805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:22.125395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.126033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.132155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.132632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.133058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.133768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.134214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.134633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.269913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.278102 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1651c1fd-e4a1-43f7-bc4b-388461990725 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.157896 Aug 30 04:21:22.278678 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3462/6806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:23.300015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:23.300716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:23.308445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.308999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.309486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.310186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.310655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.311365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.466793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.476481 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-14975927-1dc3-444e-9099-88d820e87c13 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.181454 Aug 30 04:21:23.477097 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3345/6807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:23 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:24.498687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.499327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.507693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.508192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.508636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.509359 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.509819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.510497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.647593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.656074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1a15edf3-c836-4b74-847e-5209d46f86a0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1678 microversion: 2.1 time: 0.161148 Aug 30 04:21:24.656654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3463/6808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:25.676757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.677442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.684236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.684729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.685171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.685898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.686361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.686797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.820199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.829040 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-53aa5aa8-6bd6-460b-a87d-503a62d5cfe5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1683 microversion: 2.1 time: 0.156221 Aug 30 04:21:25.829685 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3346/6809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:26.850736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.851357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.858611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.859112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.859552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.860255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.860713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.861140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.035819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.044063 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1da6bf27-17f2-4e97-b25f-8c98b5dd0206 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1683 microversion: 2.1 time: 0.197332 Aug 30 04:21:27.044636 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3464/6810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:27.396900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "name": "network-vif-unplugged", "status": "completed", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:27.407258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.407884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.408438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.421361 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] Creating event network-vif-unplugged:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h2-854924-5 Aug 30 04:21:27.426858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:21:27.438370 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9e235dd4-54ae-4940-8f5f-d583bf59c05a req-c3968b89-1a0f-4024-ab91-cf8079b61f6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045290 Aug 30 04:21:27.438981 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3347/6811] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:28.066562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:28.067587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:28.075033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.075516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.075953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.076650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.077098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.077576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.356406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:28.364125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c06da1e5-0625-4852-9a46-9a897be6aafa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1682 microversion: 2.1 time: 0.302367 Aug 30 04:21:28.364712 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3465/6812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:28 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1682 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:29.387677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:29.388311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:29.394545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.395043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.395496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.396289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.396762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.397203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.534706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.542764 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75d7a368-cf55-4e07-bf86-2dd677a41615 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1680 microversion: 2.1 time: 0.160585 Aug 30 04:21:29.543347 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3348/6813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:29 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:29.785319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:29.795107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.795572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.795996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.070921 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] Creating event network-changed:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h2-854924-5 Aug 30 04:21:30.076512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:21:30.088085 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f70864c2-b3bc-4fef-b3f7-8e70968f358c req-9b11013f-1957-404c-9676-6ffe658c3a65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306371 Aug 30 04:21:30.088889 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3466/6814] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:30.567376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.568011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.574987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.575495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.575948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.576657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.577623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.577623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.744845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.753644 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-59bd9f23-e32f-4495-8922-db6fd4118488 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1676 microversion: 2.1 time: 0.190393 Aug 30 04:21:30.754259 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3349/6815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:30.775329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:30.775986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.784055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.784566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.785003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.785742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.786295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.786720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.844853 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33ac51e0-3de3-4313-a739-ea712bfd71bf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action" status: 204 len: 0 microversion: 2.1 time: 0.073706 Aug 30 04:21:30.845866 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3467/6816] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:30 2022] POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:21:30.854000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.854630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.861130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.861641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.862168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.862820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.863415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.863818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.005611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.014167 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b34a9d1-dfcb-42e7-9f87-92de7d1330d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1676 microversion: 2.1 time: 0.164053 Aug 30 04:21:31.014742 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3350/6817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:32.035880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.036519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:32.043522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.044004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.044433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.045111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.045592 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.046548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.191270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:32.200316 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78fbd1e5-be9b-4038-a3e9-a2a8d6b40126 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1676 microversion: 2.1 time: 0.168737 Aug 30 04:21:32.201221 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3468/6818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:32.329061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9973b9cc-b1b1-40b9-81cc-9fea07f7a20a req-77ae8d17-5b6d-43a8-81ee-9325c6a20e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "name": "network-vif-plugged", "status": "completed", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:32.343283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9973b9cc-b1b1-40b9-81cc-9fea07f7a20a req-77ae8d17-5b6d-43a8-81ee-9325c6a20e3e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.343786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9973b9cc-b1b1-40b9-81cc-9fea07f7a20a req-77ae8d17-5b6d-43a8-81ee-9325c6a20e3e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.344234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9973b9cc-b1b1-40b9-81cc-9fea07f7a20a req-77ae8d17-5b6d-43a8-81ee-9325c6a20e3e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.358158 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9973b9cc-b1b1-40b9-81cc-9fea07f7a20a req-77ae8d17-5b6d-43a8-81ee-9325c6a20e3e service nova] Creating event network-vif-plugged:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h2-854924-5 Aug 30 04:21:32.364553 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9973b9cc-b1b1-40b9-81cc-9fea07f7a20a req-77ae8d17-5b6d-43a8-81ee-9325c6a20e3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039879 Aug 30 04:21:32.365174 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3351/6819] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:33.222595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.223117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.229990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.230476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.230914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.231599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.232057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.232480 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.363612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.371382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0888d09b-8138-4539-90b2-6c7fe98be011 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1655 microversion: 2.1 time: 0.152827 Aug 30 04:21:33.371945 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3469/6820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:33.394210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.394949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.401244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.401833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.402287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.402990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.403462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.403903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.543604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.551987 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9ca9135f-d490-43e4-acc6-9b5f42c4b3c0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1655 microversion: 2.1 time: 0.163540 Aug 30 04:21:33.552580 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3352/6821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.572966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-36652d9e-da99-4f56-a365-37826929fbe4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:33.579066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36652d9e-da99-4f56-a365-37826929fbe4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.579558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36652d9e-da99-4f56-a365-37826929fbe4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.580008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-36652d9e-da99-4f56-a365-37826929fbe4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.593314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:33.602980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-36652d9e-da99-4f56-a365-37826929fbe4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:21:33.646142 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-36652d9e-da99-4f56-a365-37826929fbe4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action" status: 202 len: 0 microversion: 2.1 time: 0.076906 Aug 30 04:21:33.646716 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3470/6822] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:33 2022] POST /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:21:33.655371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.655997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.662237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.662782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.663201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.664251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.664853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.665470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.878090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.887143 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b6fb5ea9-e909-4164-8e39-edcc8e31814b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1664 microversion: 2.1 time: 0.235441 Aug 30 04:21:33.888394 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3353/6823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1664 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:34.908688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.909426 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.916748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.917230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.917687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.918375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.918822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.919239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.089690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.097731 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c46c19fe-c0df-4466-945c-0024034e324f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1668 microversion: 2.1 time: 0.193268 Aug 30 04:21:35.098259 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3471/6824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1668 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:35.118523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.119125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.127155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.127263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.127623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.128327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.128796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.129237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.148074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:35.156791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:35.233870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6e21599-c4e7-411b-a120-145a0bd00e68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 204 len: 0 microversion: 2.1 time: 0.118363 Aug 30 04:21:35.235147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3354/6825] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:21:35 2022] DELETE /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:21:35.243624 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.244230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.250231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.251236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.251669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.252351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.252808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.253233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.384350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.392512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71d66064-e74b-4b89-99b4-fae34904175e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1674 microversion: 2.1 time: 0.152860 Aug 30 04:21:35.393066 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3472/6826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:36.414674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.415387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.423015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.423515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.423962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.424675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.425137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.425606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.590781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.599326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c5a6abf-1b3e-4390-b3ea-77454c602c98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1674 microversion: 2.1 time: 0.189065 Aug 30 04:21:36.599910 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3355/6827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:37.440027 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-05e58eeb-70ea-4199-8ac0-2510b271df71 req-418d95c8-d505-4df4-b379-aefe32b0f252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51181607-ab4b-4ca2-8db8-ff4ca5445b86", "name": "network-vif-deleted", "tag": "82bcd4fd-625d-4cc9-9858-bee92fc23b62"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:37.451351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-05e58eeb-70ea-4199-8ac0-2510b271df71 req-418d95c8-d505-4df4-b379-aefe32b0f252 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.452243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-05e58eeb-70ea-4199-8ac0-2510b271df71 req-418d95c8-d505-4df4-b379-aefe32b0f252 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.452679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-05e58eeb-70ea-4199-8ac0-2510b271df71 req-418d95c8-d505-4df4-b379-aefe32b0f252 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.465667 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-05e58eeb-70ea-4199-8ac0-2510b271df71 req-418d95c8-d505-4df4-b379-aefe32b0f252 service nova] Creating event network-vif-deleted:82bcd4fd-625d-4cc9-9858-bee92fc23b62 for instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 on n-h2-854924-5 Aug 30 04:21:37.471573 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-05e58eeb-70ea-4199-8ac0-2510b271df71 req-418d95c8-d505-4df4-b379-aefe32b0f252 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Aug 30 04:21:37.472119 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3473/6828] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:37.620862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.621542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.631277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.631799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.632342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.633321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.634020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.634456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.673505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.674156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.674611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.675511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lazy-loading 'fault' on Instance uuid 51181607-ab4b-4ca2-8db8-ff4ca5445b86 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:21:37.731263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.749923 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f0990f63-1c27-4482-87cb-d09ff19be4c9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 200 len: 1328 microversion: 2.1 time: 0.132616 Aug 30 04:21:37.750882 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3356/6829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 1328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:38.777981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.778855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.786346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.787037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.787609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.788396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.788914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.789425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.804966 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 HTTP/1.1 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '51181607-ab4b-4ca2-8db8-ff4ca5445b86'} Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:38.806820 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-14b3293e-8048-4ca0-a0b8-a462d6625885 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 404 len: 111 microversion: 2.1 time: 0.035521 Aug 30 04:21:38.824633 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3474/6830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:21:38.827048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.827688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.834887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.835419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.836007 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.836760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.837235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.837704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.861027 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 HTTP/1.1 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '51181607-ab4b-4ca2-8db8-ff4ca5445b86'} Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:38.862801 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-676f686d-5b37-4cdb-9807-0124132429d4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 404 len: 111 microversion: 2.1 time: 0.042692 Aug 30 04:21:38.867034 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3357/6831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:21:38.915427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-799634664", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "4e0d6187-976f-47db-a6b4-7ebe4c1960be"}], "security_groups": [{"name": "tempest-securitygroup--374598329"}], "key_name": "tempest-keypair-807406039", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:39.033473 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] validate_networks() for [('4e0d6187-976f-47db-a6b4-7ebe4c1960be', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:21:39.508133 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:39.508566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:39.509093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:39.509546 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:39.510227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:39.520286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.520779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.521221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.521973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.522431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.522861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.540738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:39.546572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:39.559097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:39.561517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:39.613961 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f09151ba-50cf-4c3b-adfe-d188f720dd24 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702253 Aug 30 04:21:39.617499 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3475/6832] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:39.627046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-295c9c2b-e25c-4081-b33a-2c079ba73499 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.627936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-295c9c2b-e25c-4081-b33a-2c079ba73499 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.801306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-295c9c2b-e25c-4081-b33a-2c079ba73499 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.813855 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-295c9c2b-e25c-4081-b33a-2c079ba73499 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1237 microversion: 2.1 time: 0.190544 Aug 30 04:21:39.814667 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3358/6833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1237 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:40.835943 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.837172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.842240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:40.846816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.847332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.847769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.848487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.848928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.849378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.958485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.966964 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58d1d9b7-7009-491a-95e4-7c19b36458f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1295 microversion: 2.1 time: 0.134769 Aug 30 04:21:40.967680 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3476/6834] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1295 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:41.988887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:41.990184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:41.993561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:41.999791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.000323 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.000771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.001508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.001974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.002411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.167334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9537b6b8-24e9-42ea-8221-aca4b7735fb6 req-ea3142ac-f2db-45ff-872a-bbe367eadcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:42.179311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9537b6b8-24e9-42ea-8221-aca4b7735fb6 req-ea3142ac-f2db-45ff-872a-bbe367eadcb4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.180393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9537b6b8-24e9-42ea-8221-aca4b7735fb6 req-ea3142ac-f2db-45ff-872a-bbe367eadcb4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.180894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9537b6b8-24e9-42ea-8221-aca4b7735fb6 req-ea3142ac-f2db-45ff-872a-bbe367eadcb4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.193992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9537b6b8-24e9-42ea-8221-aca4b7735fb6 req-ea3142ac-f2db-45ff-872a-bbe367eadcb4 service nova] Creating event network-changed:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:21:42.199079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9537b6b8-24e9-42ea-8221-aca4b7735fb6 req-ea3142ac-f2db-45ff-872a-bbe367eadcb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039271 Aug 30 04:21:42.199773 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3477/6835] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:42.316402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.324703 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-065eed6d-31cc-45fd-9fc3-39f76f03985e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.340411 Aug 30 04:21:42.325425 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3359/6836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:41 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:43.349253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.350079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.356317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.356803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.357241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.357958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.358415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.358842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.488442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.496978 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5bc3ec9d-aca2-4b7f-877e-160a2d4d42f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.153362 Aug 30 04:21:43.497597 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3478/6837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:44.519360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:44.520116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:44.527189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.527692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.528148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.528854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.529325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.529804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.675986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.684054 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-84f24cca-4ec1-45b2-839a-3b7a928affb8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.169209 Aug 30 04:21:44.684627 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3360/6838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:44 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:45.705337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.706166 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.713818 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.714304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.714742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.715437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.715891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.716459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.964878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.973521 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-628cfcee-53d4-491f-8646-6b0cb3b2e91b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.272052 Aug 30 04:21:45.974092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3479/6839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.995772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.996401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.003659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.004160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.004609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.005311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.005802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.006243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.139132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.148170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c6227fb6-d47c-4a75-8b98-b28eaefe628a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.156458 Aug 30 04:21:47.148770 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3361/6840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:48.170301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:48.170946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:48.177961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.178463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.178902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.179608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.180067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.180494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.316223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:48.324459 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cebb5f6f-43d5-491b-a5d3-ea4596f572c8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.158133 Aug 30 04:21:48.325042 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3480/6841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:48.762247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-a0cbfa26-1d4d-4d0e-b0b1-04db2b9bc7b3 req-b0b67243-7e5f-411b-93e6-bcf71d33b759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "name": "network-vif-plugged", "status": "completed", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:48.773430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a0cbfa26-1d4d-4d0e-b0b1-04db2b9bc7b3 req-b0b67243-7e5f-411b-93e6-bcf71d33b759 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.773947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a0cbfa26-1d4d-4d0e-b0b1-04db2b9bc7b3 req-b0b67243-7e5f-411b-93e6-bcf71d33b759 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.774447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-a0cbfa26-1d4d-4d0e-b0b1-04db2b9bc7b3 req-b0b67243-7e5f-411b-93e6-bcf71d33b759 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.786573 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-a0cbfa26-1d4d-4d0e-b0b1-04db2b9bc7b3 req-b0b67243-7e5f-411b-93e6-bcf71d33b759 service nova] Creating event network-vif-plugged:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:21:48.791473 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-a0cbfa26-1d4d-4d0e-b0b1-04db2b9bc7b3 req-b0b67243-7e5f-411b-93e6-bcf71d33b759 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Aug 30 04:21:48.792135 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3362/6842] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:49.347358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.347967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:49.355059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.355631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.356129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.356824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.357279 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.357735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.489468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.498770 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-52f6a9fb-45bc-4d1c-b32d-24b942106809 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.155559 Aug 30 04:21:49.499839 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3481/6843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:50.528768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:50.534209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.534930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:50.541534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.542035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.542489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.543189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.543659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.544099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.684700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.692733 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6934ffd2-fe35-4a19-b2ac-9f07b1edce9c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1362 microversion: 2.1 time: 0.165831 Aug 30 04:21:50.693305 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3363/6844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:51.714835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.715534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.717641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:51.718898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:51.726365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.726850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.727284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.727980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.728428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.728848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.860605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:51.870559 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33dccf0c-42ce-4271-ad5e-256fb8e1153c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1549 microversion: 2.1 time: 0.159686 Aug 30 04:21:51.871158 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3482/6845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:51.898300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.899148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.909918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.910759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.911863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.912676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.913647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.914410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.008402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52b59fa0-8c75-47a1-8cc5-31765b267660 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117886 Aug 30 04:21:52.009172 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3364/6846] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:53.365058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-27154f10-be90-428e-802c-f4523614d12b req-3a762034-068b-401c-aa32-0537e361e495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:53.377921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-27154f10-be90-428e-802c-f4523614d12b req-3a762034-068b-401c-aa32-0537e361e495 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.378405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-27154f10-be90-428e-802c-f4523614d12b req-3a762034-068b-401c-aa32-0537e361e495 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.378837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-27154f10-be90-428e-802c-f4523614d12b req-3a762034-068b-401c-aa32-0537e361e495 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.394304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-27154f10-be90-428e-802c-f4523614d12b req-3a762034-068b-401c-aa32-0537e361e495 service nova] Creating event network-changed:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:21:53.399432 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-27154f10-be90-428e-802c-f4523614d12b req-3a762034-068b-401c-aa32-0537e361e495 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040915 Aug 30 04:21:53.400088 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3483/6847] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:07.403351 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:07.404032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:07.405182 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:23:07.405310 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:23:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/action (ip 10.222.0.30) !!! Aug 30 04:23:07.413387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:07.415624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:07.431559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.432060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.432512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.433224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.433723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.434184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.465787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:07.471635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:23:07.478257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:07.478694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:07.479175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:07.479595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:07.480019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:07.544720 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb67dd08-448e-4303-b93e-0c22ffdfd3e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/action" status: 202 len: 0 microversion: 2.1 time: 0.143798 Aug 30 04:23:07.546337 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3365/6848] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:07 2022] POST /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:07.554046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=15 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:07.554909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:07.560026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:07.560734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:07.569177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.569927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.570364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.571067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.571521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.571948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.734076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:07.742013 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ff42e3e-cd1e-4db7-9006-41301f9f974b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1677 microversion: 2.1 time: 0.190689 Aug 30 04:23:07.742592 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3484/6849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:07 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:08.765227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.765869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:08.773130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.773723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.774328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.775313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.776031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.776500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.921285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.930262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-893622de-9a4f-4f45-8ace-9f199326db5d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1677 microversion: 2.1 time: 0.169424 Aug 30 04:23:08.930453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3366/6850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:08 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:09.951463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:09.952082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:09.961956 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.962446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.962885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:09.963593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.964050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.964474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.096767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:10.104835 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e2829ba-a031-49b3-8ff6-200931644242 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.157249 Aug 30 04:23:10.105444 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3485/6851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:09 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:11.127449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:11.128059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:11.135271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.135771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.136228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.136923 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.137419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.137861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.270785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:11.278608 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-65149aba-4d2d-441e-8a2d-85734428afbd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.155122 Aug 30 04:23:11.279187 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3367/6852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:11 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:12.301095 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:12.301738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:12.308151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:12.308643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:12.309082 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:12.309807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:12.310266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:12.310693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:12.451883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:12.459638 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f325f6ec-e56e-43a9-8d49-23724abb490c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.162727 Aug 30 04:23:12.460219 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3486/6853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:12 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:13.481110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:13.481795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:13.488952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.489500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.490280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.490726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.491200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.491641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.627562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:13.635847 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4de00935-e84d-436c-a275-6814f06b5ac5 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.158646 Aug 30 04:23:13.636432 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3368/6854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:13 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:14.658235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:14.658851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:14.666125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.666629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.667134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.667944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.668458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.668951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.827171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.835523 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-041f1b8a-567e-40d3-907c-cc24c65d1e65 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.181967 Aug 30 04:23:14.836129 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3487/6855] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:14 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:15.858362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:15.858985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:15.866667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.867177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.867632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.868368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.868831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.869281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.010555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.018692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-693be14a-0d63-4fad-bfa8-63425e7a3f98 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.165128 Aug 30 04:23:16.019276 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3369/6856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:15 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:17.040682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.041315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:17.048621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.049097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.049567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.050244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.050720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.051142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.183768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:17.191634 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbf6c60c-1258-4404-b22a-bd0dd2a9206d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.154934 Aug 30 04:23:17.192201 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3488/6857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:18.220716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.221830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.234284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.234782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.235533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.236111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.236735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.236735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.370308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.377999 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e5cdf3e3-4183-4932-b74a-7ed3a5cad10b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.163168 Aug 30 04:23:18.378565 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3370/6858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:18 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:19.400094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:19.400616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:19.413837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.414313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.414747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.415441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.415892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.416663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.560431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.568297 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c8d482b-e854-4b07-b1b9-46ad06175b5a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.172309 Aug 30 04:23:19.568867 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3489/6859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:19 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:20.602752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:20.603585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:20.611169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:20.611668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:20.612122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:20.612830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:20.613294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:20.613757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:20.748580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:20.756571 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d484853f-8cd3-4d1b-8b90-fdfe99f58769 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.157781 Aug 30 04:23:20.757098 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3371/6860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:20 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:21.778942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:21.779562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:21.787291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.787779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.788214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.788913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.789392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.789822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.927025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:21.935379 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a089d35-8ca7-457f-bd87-d24e74b2f22c tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.160445 Aug 30 04:23:21.935966 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3490/6861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:21 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:22.958867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:22.959550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:22.967480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.968108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.968581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.969518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.970013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.971423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.117248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.131627 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-599f30b5-6c78-4cec-8a2e-3601a11b713b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.176452 Aug 30 04:23:23.132670 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3372/6862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:22 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:24.161509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:24.162126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:24.169060 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.169586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.170021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.170724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.171169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.172223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.322710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.331660 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e3ef1dce-2ed7-4c8d-8953-289b43b23142 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.179069 Aug 30 04:23:24.332262 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3491/6863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:24 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:25.355982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:25.356581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:25.364624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.365127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.365600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.366314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.366782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.367220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.506876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.518454 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-899ac5a0-3abb-4153-8f73-3dc00a53a3b3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.166617 Aug 30 04:23:25.519487 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3373/6864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:25 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:26.551946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:26.552645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:26.560280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.560771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.561219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.561974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.562433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.562988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.735990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.746101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-796e10d9-fde1-4144-beed-d445f754988b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1682 microversion: 2.1 time: 0.198375 Aug 30 04:23:26.746691 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3492/6865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:26 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:27.431044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "name": "network-vif-unplugged", "status": "completed", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:27.440984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.441578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.442112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.454666 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] Creating event network-vif-unplugged:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h2-854924-5 Aug 30 04:23:27.460353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:23:27.471899 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2054bb64-2d23-4571-a6f7-9a745f2537c9 req-50061ea0-c111-4e4a-abdb-19980cd452f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108010 Aug 30 04:23:27.472509 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3374/6866] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:27.769213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:27.770148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:27.778071 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.778607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.779662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.781243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.781753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.782199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.027148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.036068 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a7184df9-685b-4488-9f5e-663969357251 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1681 microversion: 2.1 time: 0.271042 Aug 30 04:23:28.036680 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3493/6867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:27 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:29.064726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:29.065766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.072460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.072970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.073469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.074200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.074671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.075113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.222526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.230533 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-09c1e60d-23ae-41a3-ae42-3f79196e3e7a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1679 microversion: 2.1 time: 0.174033 Aug 30 04:23:29.231112 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3375/6868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:29 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:29.493521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:29.504200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.505073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.505558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.519570 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] Creating event network-changed:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h2-854924-5 Aug 30 04:23:29.525991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:23:29.537361 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f69190e6-6549-4f28-892e-9cf351f3c265 req-82d18a8d-0c1c-4cbc-b191-1e16d47bf08a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047516 Aug 30 04:23:29.538123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3494/6869] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:30.252712 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:30.253636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:30.260498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.260999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.261787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.262517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.262995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.263438 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.407765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.415852 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-14eb5856-d93b-4688-a4c2-2fab020e6980 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1676 microversion: 2.1 time: 0.167371 Aug 30 04:23:30.416492 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3376/6870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:30 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:30.437937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:30.438691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:30.445474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.445963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.446400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.447092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.447648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.448076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.488153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.488153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.489830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.489830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.489830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.490191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.520436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:30.526312 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:30.640958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-21573914-3810-43df-9213-26d80e10aed6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/action" status: 202 len: 0 microversion: 2.1 time: 0.207114 Aug 30 04:23:30.641998 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3495/6871] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:30 2022] POST /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:30.653326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:30.654651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:30.662905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.663957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.664936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.665991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.666887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.667814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.896787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.906940 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6ef0ac6e-debf-415a-ba08-55b2de933c7e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.258828 Aug 30 04:23:30.909455 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3377/6872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:30 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:31.992798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:31.993530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.000773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.001255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.001712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.002406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.002858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.003277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.156070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.165093 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a32b8f2e-d138-4652-bfd0-783e37bcf284 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.226741 Aug 30 04:23:32.165714 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3496/6873] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:31 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:32.952625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "name": "network-vif-plugged", "status": "completed", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:32.962985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.963483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.963929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.976501 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] Creating event network-vif-plugged:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h2-854924-5 Aug 30 04:23:32.982575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:23:32.997186 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-cf22da8e-1266-4e91-a43b-8a80f0da9951 req-170f2266-db00-4b0b-ab99-2d5ab6208d0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113648 Aug 30 04:23:32.997850 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3378/6874] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:33.192912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:33.194699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:33.205055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.205886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.206578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.207649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.208501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.209015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.397689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.406377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:33.411789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5c93e59a-6d2c-4306-aa36-bf5c640c3f7b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.222370 Aug 30 04:23:33.412809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3497/6875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:33 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:34.196734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "name": "network-vif-unplugged", "status": "completed", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:34.208344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.208839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.209284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.221716 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] Creating event network-vif-unplugged:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:23:34.227977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:23:34.240689 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-c2478cd8-db6b-4a77-99fb-fa302d26c4cf req-4be71e5b-3a2f-456c-883c-1e284f5dc8b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128591 Aug 30 04:23:34.241368 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3379/6876] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:34.435647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:34.436448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:34.445745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.446253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.446695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.447406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.447864 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.448299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.609867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.618279 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1044f1c0-bbd1-48b2-b578-b829efeb0179 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.186898 Aug 30 04:23:34.618868 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3498/6877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:34 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:35.644270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.645127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:35.654329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.655066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.656368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.657118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.657621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.658059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.806442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.815252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f442754-d549-447e-ae05-a2c43ec2e913 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.178041 Aug 30 04:23:35.816605 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3380/6878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:35 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:36.260803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:36.272470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.273017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.273565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.288792 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] Creating event network-changed:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:23:36.294516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:23:36.306490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-201d834b-e8b1-4694-9ff4-0e21a748153a req-f6b6d859-16dc-4306-984f-27515e0bb14f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049662 Aug 30 04:23:36.307099 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3499/6879] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:36.848616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.849678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.857443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.857945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.858618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.859650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.859934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.860240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.866097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:37.010039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.019915 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a96087a-572b-4675-ab44-16772359fd84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.175563 Aug 30 04:23:37.020579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3381/6880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:38.042157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:38.042983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:38.047529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:38.052746 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:38.053637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:38.054555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:38.055609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:38.056310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:38.056877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:38.269386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:38.284035 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72785d54-9f26-4f96-ad7d-cc082d8c6a38 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1675 microversion: 2.1 time: 0.245701 Aug 30 04:23:38.302089 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3500/6881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:38 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:39.325668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.327866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:39.343938 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=39 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:39.347206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.348369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.350310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.353024 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.354212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.355391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.547603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:39.557667 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0eb300f-ee45-4f07-b397-99d62e626a8f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1668 microversion: 2.1 time: 0.240066 Aug 30 04:23:39.558472 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3382/6882] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:39.596847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.598625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:39.612199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.613208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.614030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.615057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.615516 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.616230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.771263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:39.780975 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-101ea2ec-e94c-4326-884f-b085107dd3f8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1668 microversion: 2.1 time: 0.189329 Aug 30 04:23:39.781930 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3501/6883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1668 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:39.802691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.804529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:39.809791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.810450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.810997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.812329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.812895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.813542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.989428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:39.997887 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d282188-4c27-4eef-8d84-80326571cc07 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1668 microversion: 2.1 time: 0.199263 Aug 30 04:23:39.998615 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3383/6884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1668 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:40.028953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.029357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.036149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.036650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.037091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.037842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.038298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.038722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.068476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:40.178225 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-05680e2f-214a-4c4c-a36a-9619c79c5293 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 204 len: 0 microversion: 2.1 time: 0.153737 Aug 30 04:23:40.179431 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3502/6885] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:40 2022] DELETE /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:40.190495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.191093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.198107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.198693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.199194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.199979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.200517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.201045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.346640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.355530 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc3b947f-c0fe-483d-a064-dcdfba1bf7d6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1674 microversion: 2.1 time: 0.170201 Aug 30 04:23:40.356126 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3384/6886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:40 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:41.316018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-43e3d337-5d1c-4123-abe5-abe2ac4a14c3 req-fb4929f7-b83d-4584-9114-5955e2b231b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "name": "network-vif-plugged", "status": "completed", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:41.325578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:41.339432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-43e3d337-5d1c-4123-abe5-abe2ac4a14c3 req-fb4929f7-b83d-4584-9114-5955e2b231b1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.340303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-43e3d337-5d1c-4123-abe5-abe2ac4a14c3 req-fb4929f7-b83d-4584-9114-5955e2b231b1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.341069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-43e3d337-5d1c-4123-abe5-abe2ac4a14c3 req-fb4929f7-b83d-4584-9114-5955e2b231b1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.363603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-43e3d337-5d1c-4123-abe5-abe2ac4a14c3 req-fb4929f7-b83d-4584-9114-5955e2b231b1 service nova] Creating event network-vif-plugged:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:23:41.372871 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-43e3d337-5d1c-4123-abe5-abe2ac4a14c3 req-fb4929f7-b83d-4584-9114-5955e2b231b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063556 Aug 30 04:23:41.378999 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3503/6887] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:41.381467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:41.382337 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:41.401446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.402645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.403442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.404224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.404814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.405527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.598563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:41.607394 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e8d45339-e257-4538-a423-320f6499d1ce tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1674 microversion: 2.1 time: 0.232367 Aug 30 04:23:41.608171 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3385/6888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:41 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:42.640385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:42.644098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:42.665490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.666034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.666424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.667330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.667794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.668255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.702519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d458f184-8518-46f9-97c9-eda634f46266 req-b2ed8bf9-84e6-427a-a34e-862ef97d9e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47960601-2575-49e9-ac0f-89ddd7d084b0", "name": "network-vif-deleted", "tag": "519c73b6-f490-418d-9989-6bcc25cda50b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:42.719412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d458f184-8518-46f9-97c9-eda634f46266 req-b2ed8bf9-84e6-427a-a34e-862ef97d9e15 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.719919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d458f184-8518-46f9-97c9-eda634f46266 req-b2ed8bf9-84e6-427a-a34e-862ef97d9e15 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.720368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d458f184-8518-46f9-97c9-eda634f46266 req-b2ed8bf9-84e6-427a-a34e-862ef97d9e15 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.734067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d458f184-8518-46f9-97c9-eda634f46266 req-b2ed8bf9-84e6-427a-a34e-862ef97d9e15 service nova] Creating event network-vif-deleted:519c73b6-f490-418d-9989-6bcc25cda50b for instance 47960601-2575-49e9-ac0f-89ddd7d084b0 on n-h1-854924-5 Aug 30 04:23:42.741201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d458f184-8518-46f9-97c9-eda634f46266 req-b2ed8bf9-84e6-427a-a34e-862ef97d9e15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043270 Aug 30 04:23:42.743856 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3386/6889] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:42.768555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:42.785100 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-92f49529-8f1c-4559-95cb-acdd976aef21 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 200 len: 1607 microversion: 2.1 time: 0.154151 Aug 30 04:23:42.789413 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3504/6890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:42 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 1607 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:43.823087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.824303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:43.834362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.835059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.835555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.836655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.837426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.838037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.861917 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 HTTP/1.1 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '47960601-2575-49e9-ac0f-89ddd7d084b0'} Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:43.863819 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d38c5946-b9ec-4da3-83ae-503f70b98dcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 404 len: 111 microversion: 2.1 time: 0.049611 Aug 30 04:23:43.871518 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3387/6891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:43.890257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.891263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:43.910860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.911361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.911825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.912529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.912988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.913462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.929907 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 HTTP/1.1 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '47960601-2575-49e9-ac0f-89ddd7d084b0'} Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:43.931630 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e7ec060-ae65-4c2a-889d-423274bd4da9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 404 len: 111 microversion: 2.1 time: 0.050979 Aug 30 04:23:43.941259 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3505/6892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:43.997232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-402795961", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "4e0d6187-976f-47db-a6b4-7ebe4c1960be"}], "security_groups": [{"name": "tempest-securitygroup--374598329"}], "key_name": "tempest-keypair-807406039", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:44.129723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] validate_networks() for [('4e0d6187-976f-47db-a6b4-7ebe4c1960be', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:23:44.602770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:44.603384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:44.604178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:44.604789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:44.605483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:44.626560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.627417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.628160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.629416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.630266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.630864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.651750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:44.658245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:44.673593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:44.676756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:44.737600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4f7fa953-3c28-4a35-8028-06505ef0908b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745372 Aug 30 04:23:44.741696 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3388/6893] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:23:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:23:44.752345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12811115-0a90-4e7c-a4a8-128c0132b3bc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.753527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-12811115-0a90-4e7c-a4a8-128c0132b3bc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:44.825678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-12811115-0a90-4e7c-a4a8-128c0132b3bc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:44.843222 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12811115-0a90-4e7c-a4a8-128c0132b3bc tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1237 microversion: 2.1 time: 0.096303 Aug 30 04:23:44.844033 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3506/6894] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:45.883294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.884025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.893910 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.894801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.895515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.896631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.897391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.898080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.021763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.040525 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c2e1328c-2366-4ae8-bcc7-d34685134d84 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1289 microversion: 2.1 time: 0.164233 Aug 30 04:23:46.041851 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3389/6895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:47.077894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.078927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:47.089238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.090011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.090575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.091543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.092094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.093390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.361814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:47.377003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77b19fbf-513c-40fe-83f1-11f8277585cd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1362 microversion: 2.1 time: 0.303368 Aug 30 04:23:47.378695 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3507/6896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:48.026293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d155d6ec-d029-48cb-9138-92b367746cbe req-8592e6f8-cb2d-40a6-9695-f393fc447d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:48.041109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d155d6ec-d029-48cb-9138-92b367746cbe req-8592e6f8-cb2d-40a6-9695-f393fc447d44 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.041818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d155d6ec-d029-48cb-9138-92b367746cbe req-8592e6f8-cb2d-40a6-9695-f393fc447d44 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.042423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d155d6ec-d029-48cb-9138-92b367746cbe req-8592e6f8-cb2d-40a6-9695-f393fc447d44 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.056425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d155d6ec-d029-48cb-9138-92b367746cbe req-8592e6f8-cb2d-40a6-9695-f393fc447d44 service nova] Creating event network-changed:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:23:48.063505 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d155d6ec-d029-48cb-9138-92b367746cbe req-8592e6f8-cb2d-40a6-9695-f393fc447d44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040882 Aug 30 04:23:48.064756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3390/6897] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:48.399671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:48.400300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:48.407759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.408258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.408708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.409477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.409949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.410376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.628379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:48.641847 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3faed6b1-b70f-43ef-bee5-ecf4d85a1220 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1362 microversion: 2.1 time: 0.245629 Aug 30 04:23:48.643147 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3508/6898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:48 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:49.676027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:49.676740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:49.683188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.683615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.684059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.684761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.685223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.685682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.944115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:49.952246 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de5b9cb7-72c1-41ec-bee3-2e371dfe414e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1362 microversion: 2.1 time: 0.281806 Aug 30 04:23:49.952836 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3391/6899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:49 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:50.974416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.975150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:50.982393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.982941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.983555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.984398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.984860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.985314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.137724 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.146532 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-250b938e-85a5-41c5-a235-8528801e075e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1362 microversion: 2.1 time: 0.175979 Aug 30 04:23:51.147129 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3509/6900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:52.168251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.168794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.176655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.177159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.177642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.178355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.178828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.179273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.327965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:52.336311 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3bcc5307-f9a5-4a4c-8c65-ee2be89723af tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1362 microversion: 2.1 time: 0.172469 Aug 30 04:23:52.336919 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3392/6901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:52.911870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-31e52c62-cb31-4f7c-96fc-069a7ba1d6ff req-7bfb79a9-676a-4732-89d0-f2303212fd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "name": "network-vif-plugged", "status": "completed", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:52.928065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31e52c62-cb31-4f7c-96fc-069a7ba1d6ff req-7bfb79a9-676a-4732-89d0-f2303212fd2e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.928538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31e52c62-cb31-4f7c-96fc-069a7ba1d6ff req-7bfb79a9-676a-4732-89d0-f2303212fd2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.928966 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-31e52c62-cb31-4f7c-96fc-069a7ba1d6ff req-7bfb79a9-676a-4732-89d0-f2303212fd2e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.950603 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-31e52c62-cb31-4f7c-96fc-069a7ba1d6ff req-7bfb79a9-676a-4732-89d0-f2303212fd2e service nova] Creating event network-vif-plugged:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:23:52.959680 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-31e52c62-cb31-4f7c-96fc-069a7ba1d6ff req-7bfb79a9-676a-4732-89d0-f2303212fd2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054401 Aug 30 04:23:52.960303 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3510/6902] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:53.358664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.359306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:53.366638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.367138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.367597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.368315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.368777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.369212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.525983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:53.536929 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05264f93-c846-444c-9bf4-b1c414c97e90 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1362 microversion: 2.1 time: 0.182107 Aug 30 04:23:53.537554 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3393/6903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:53 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:54.559365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.560067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.568495 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.568987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.569463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.570192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.570649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.571081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.720437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:54.732988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0d4acc3-8419-44e3-a7d2-fb130687e27a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1548 microversion: 2.1 time: 0.177069 Aug 30 04:23:54.734077 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3511/6904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:54.758730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.758730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.762045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:54.762734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:54.768266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.768770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.769227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.769978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.770547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.771033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.860284 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c4cf1c0a-2b30-4b4f-a134-07bacf56fff9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105443 Aug 30 04:23:54.861106 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3394/6905] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:56.342604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fe5b9694-30bf-4be0-9ea8-9a44d403778e req-6716f813-098b-4211-b234-702df219a3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:56.347820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:56.354631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fe5b9694-30bf-4be0-9ea8-9a44d403778e req-6716f813-098b-4211-b234-702df219a3a0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.355109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fe5b9694-30bf-4be0-9ea8-9a44d403778e req-6716f813-098b-4211-b234-702df219a3a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.355542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fe5b9694-30bf-4be0-9ea8-9a44d403778e req-6716f813-098b-4211-b234-702df219a3a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.367993 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fe5b9694-30bf-4be0-9ea8-9a44d403778e req-6716f813-098b-4211-b234-702df219a3a0 service nova] Creating event network-changed:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:23:56.373780 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fe5b9694-30bf-4be0-9ea8-9a44d403778e req-6716f813-098b-4211-b234-702df219a3a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035285 Aug 30 04:23:56.374982 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3512/6906] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:32.933069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:32.934074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=64 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:32.938419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:32.939116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:32.947027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.947590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.948063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.948781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.949256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.950219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.098367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:33.106847 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2f57de56-63f0-4aea-8f22-569e606cc4df tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1667 microversion: 2.1 time: 0.175715 Aug 30 04:24:33.107440 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3395/6907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:32 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:33.129003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54b17e0c-bef5-4a43-b4e7-d8eaf8dc7505"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:33.131520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:33.134276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:33.135052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:33.143797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.144290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.144728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.145456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.145917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.146352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.407987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5e0cb7b-1926-4535-a0fd-4cc0b254f7a8 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283188 Aug 30 04:24:33.408626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3513/6908] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:24:33 2022] POST /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:44.364669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:44.367029 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:44.369946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:44.370628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:44.377150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.377686 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.378142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.378861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.379331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.379773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.413416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.420859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:24:44.428380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:24:44.428811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:24:44.429296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:24:44.429743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:24:44.430167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:24:44.506412 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e32109e-e5b4-492e-b5af-373dddeced49 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/action" status: 202 len: 0 microversion: 2.1 time: 0.145972 Aug 30 04:24:44.507085 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3396/6909] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:24:44 2022] POST /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:24:44.516116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:44.517043 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:44.522002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:44.522622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:44.535782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.535782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.535782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.535782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.535782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.535782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.725717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.734219 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-889a5d23-25f9-4b39-b1b2-744f0c71efee tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1722 microversion: 2.1 time: 0.220357 Aug 30 04:24:44.734810 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3514/6910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:44 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:45.757569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:45.758206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:45.765630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.766140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.766596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.767308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.767782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.768225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.926917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:45.939994 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7badf90b-2f8f-4c55-aab7-9b4aee1df753 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1722 microversion: 2.1 time: 0.187507 Aug 30 04:24:45.948122 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3397/6911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:45 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:46.962419 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:46.963058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:46.970304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:46.971072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:46.971506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:46.972197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:46.972644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:46.973102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.117442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.130813 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7be2eac-2ad0-4620-85d1-9f0599b7ff29 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.172294 Aug 30 04:24:47.131584 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3515/6912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:46 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:48.153474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:48.154110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:48.156759 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:24:48.156886 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:24:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 (ip 10.222.0.30) !!! Aug 30 04:24:48.164059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.164547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.164991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.165738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.166200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.166632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.306715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:48.315588 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-68056433-897d-4fc1-928d-0fb2d05bd014 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.166200 Aug 30 04:24:48.316187 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3398/6913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:48 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:49.337840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:49.338489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:49.341684 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:24:49.341830 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 (ip 10.222.0.30) !!! Aug 30 04:24:49.342842 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:24:49.342983 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 (ip 10.222.0.30) !!! Aug 30 04:24:49.351261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.351646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.352074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.352769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.353221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.353667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.489988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.499090 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fe2aecf2-f753-45a8-af60-0ab243c2b2c1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.165137 Aug 30 04:24:49.499673 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3516/6914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:49 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:50.521751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.522393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.529839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.530338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.530786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.531489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.531945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.532378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.663896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:50.672934 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-08f35fa4-480b-4f6b-8a50-5419b479f326 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.155253 Aug 30 04:24:50.673542 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3399/6915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:51.694396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:51.695068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:51.702768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.703285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.703752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.704483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.705009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.705537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.851871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:51.860947 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd701b14-d08d-4cdc-b05e-3b32f4361a94 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.170455 Aug 30 04:24:51.861556 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3517/6916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:51 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:52.883177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:52.889397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:52.892162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.892660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.893109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.893863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.894333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.894770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.023612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.032169 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3b2e3d3-119f-4854-9b86-7eddf1e5a03a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.152999 Aug 30 04:24:53.032756 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3400/6917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:52 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:54.057225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:54.057872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:54.065289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.065809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.066254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.066946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.067405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.067834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.205007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:54.213857 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1c885cef-5cd9-4bf6-adab-fe7f2a6a3054 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.162629 Aug 30 04:24:54.214468 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3518/6918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:54 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:55.236061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:55.236688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:55.243816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.244346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.244805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.245549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.246759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.247785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.379813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.388867 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-175be5f9-9db9-42f1-b43e-8ff04a17b0f9 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.156789 Aug 30 04:24:55.389465 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3401/6919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:55 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:56.411532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:56.412173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:56.419087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.419575 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.420014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.420715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.421172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.421637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.564059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:56.573079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3de309b5-f92e-4f87-a47a-40119c27df34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.165984 Aug 30 04:24:56.573709 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3519/6920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:56 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:57.596741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:57.597489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:57.604407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.604956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.605366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.606151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.606615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.607044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.748835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.757552 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d878d8e1-8da6-4e47-bf7f-ebf7fbc2fdb6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.165382 Aug 30 04:24:57.758129 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3402/6921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:57 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:58.780778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:58.781701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:58.789155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.789766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.790273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.791090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.791651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.792139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.932337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:58.949747 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5d2ef40-3553-48cc-b5ec-cf1ceb700eed tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.173178 Aug 30 04:24:58.950562 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3520/6922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:58 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:59.971653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:59.972397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:59.979260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.979755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.980233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.980939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.981422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.981865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.122285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:00.130784 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-321586d5-7d55-4b2e-940c-82d3e7c85f57 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1727 microversion: 2.1 time: 0.163021 Aug 30 04:25:00.131361 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3403/6923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:59 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:01.075599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "name": "network-vif-unplugged", "status": "completed", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:01.090146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.090146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.090146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.102438 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] Creating event network-vif-unplugged:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h1-854924-5 Aug 30 04:25:01.109151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:25:01.122652 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b5c23dbd-5873-4578-8f2a-4f8cb7229ad3 req-a01966ee-5fb5-4b3b-a612-a9b1cb6c734c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050894 Aug 30 04:25:01.123449 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3521/6924] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:01.153756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:01.154786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:01.163788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.171451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.171946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.173240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.173754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.174400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.342222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:01.351187 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1332640d-c08d-4f80-a84a-428a21ac235a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1726 microversion: 2.1 time: 0.202883 Aug 30 04:25:01.357421 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3404/6925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:01 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:02.374638 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:02.375389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:02.382605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:02.383096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:02.383534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:02.384481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:02.385099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:02.385562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:02.524503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:02.533304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-79f83300-9f93-48fa-90bc-1e9fe61f001a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.163707 Aug 30 04:25:02.533914 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3522/6926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:02 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:03.142240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:03.148461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.148956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.149425 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.163472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] Creating event network-changed:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h1-854924-5 Aug 30 04:25:03.173360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:25:03.186336 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-27a378f5-47ad-419c-a4c9-9a52bb4cfda0 req-5efd5974-6605-4999-ad55-2fed615f85c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052567 Aug 30 04:25:03.186959 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3405/6927] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:03.556151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:03.557848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:03.565577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.566492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.567159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.568971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.569762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.570421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.015937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:04.024902 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5b650d5c-4427-4236-a524-a40776161f33 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.473398 Aug 30 04:25:04.025742 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3523/6928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:03 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:05.047887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:05.048736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:05.055098 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.055594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.056093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.056799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.057264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.057754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.197083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:05.207007 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bf2c5e8c-ca99-4448-bbef-cd1a6425fe68 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.163942 Aug 30 04:25:05.207757 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3406/6929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:05 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:06.230566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:06.231120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:06.238040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.238524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.238957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.239653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.240104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.240528 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.375262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:06.383607 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-601e3401-e0f8-426f-a474-f11409566956 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.157290 Aug 30 04:25:06.398615 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3524/6930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:06 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:07.406940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:07.407561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:07.414502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.414997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.415443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.416135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.416595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.417028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.554198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:07.562447 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7c8743de-f933-4441-90cb-8a6437a3c2de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.159569 Aug 30 04:25:07.563037 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3407/6931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:07 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:08.584140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:08.584766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:08.591754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.592415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.592810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.593384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.593836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.594258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.733954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:08.742242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6b591df-6a27-4b55-bfa2-3646b98e6108 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.162194 Aug 30 04:25:08.742817 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3525/6932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:08 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:09.764600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:09.765224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:09.772113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.772612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.773060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:09.773782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.774254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.774695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:09.910182 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:09.918439 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a9efb0b7-9574-4b92-8403-4c2695d8568e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.157881 Aug 30 04:25:09.919011 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3408/6933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:09 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:10.940155 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:10.940772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:10.947682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:10.948167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:10.948606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:10.949315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:10.949792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:10.950222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.079995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:11.088874 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b199fa73-a2e3-4547-9537-41a82d2a7962 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.152624 Aug 30 04:25:11.089896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3526/6934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:10 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:12.109689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:12.110320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:12.117213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.117750 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.118202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.118903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.119373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.119809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.252625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:12.261177 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6bdb42f5-0eac-498f-ac96-0e4472e16da1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.155402 Aug 30 04:25:12.262297 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3409/6935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:12 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:13.284104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:13.284723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:13.291659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.292145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.292589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.293278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.293766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.294195 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.430146 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.438508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8c087137-9f17-4585-85c6-28892d3d4ab6 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.158420 Aug 30 04:25:13.439105 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3527/6936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:13 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:14.460737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:14.461394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:14.464487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=33 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:14.470210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.470707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.471164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.471880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.472377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.472818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.475783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:14.617204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:14.628466 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dd0c3161-61a1-4f04-81ff-9a2a4e497e31 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.171667 Aug 30 04:25:14.629080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3410/6937] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:14 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:15.649897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:15.650507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:15.654037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=29 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:15.659684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:15.660173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:15.660605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:15.661297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:15.661984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:15.662239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:15.667640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=83 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:15.801138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.810233 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d459b304-143a-4f33-8ae0-4853da9d5dfd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1724 microversion: 2.1 time: 0.164202 Aug 30 04:25:15.810818 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3528/6938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:15 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:16.832611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:16.833232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:16.840205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.840701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.841150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.841879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.842360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.842795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.980225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:16.989102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6a2c5295-d11d-4683-ac08-fa42402fb4f3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1721 microversion: 2.1 time: 0.160509 Aug 30 04:25:16.989918 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3411/6939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:16 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:17.010275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:17.011329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:17.018490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.018984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.019425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.020134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.020591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.021020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.081536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.082070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.082513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.083303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.083705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.084141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.107047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for project 8e3423b61f744b488824933df837c9d0. Resources: {'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:17.112414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Getting quotas for user 4ee1bbb21c374fc293e82998a02c3dec and project 8e3423b61f744b488824933df837c9d0. Resources: {'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:17.216897 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ffc265d7-7a84-49ba-a3e6-2b75e7069c37 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "POST /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/action" status: 202 len: 0 microversion: 2.1 time: 0.210245 Aug 30 04:25:17.217536 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3529/6940] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:25:17 2022] POST /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:25:17.226897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:17.227523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:17.233989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.234490 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.235093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.235980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.236624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.237237 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.376033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:17.385369 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a01410f-2719-45b5-9cb2-b7c22b679dda tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.163526 Aug 30 04:25:17.386028 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3412/6941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:17 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:18.409080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:18.409782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:18.420366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.420859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.421295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.422028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.422561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.422984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.556432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:18.564805 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53f748cd-fbbd-4277-aaaa-9affdfb32c6e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.160026 Aug 30 04:25:18.565392 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3530/6942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:18 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:19.587354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:19.588023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:19.595279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.595737 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.596196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.596928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.597432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.597883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.688825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "name": "network-vif-plugged", "status": "completed", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:19.702336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.702817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.703250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.716895 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] Creating event network-vif-plugged:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h1-854924-5 Aug 30 04:25:19.723001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:25:19.736407 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-71f5c2a5-fc3a-49e9-8a39-16e0ad836032 req-a11ca6b4-cc4c-412e-9b79-9459bdaa996f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053951 Aug 30 04:25:19.737436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3531/6943] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:19.746962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:19.756214 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ab566f80-8d84-4ad5-8c56-84add5c5a2f0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.172858 Aug 30 04:25:19.756795 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3413/6944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:19 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:20.780687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:20.781656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:20.791271 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.791784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.792242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.792961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.793993 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.794122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.948248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:20.957747 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d87df394-05dc-4bcc-8cae-bd20152d9f5f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.182428 Aug 30 04:25:20.957747 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3532/6945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:20 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:21.978941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:21.979577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:21.987115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.987648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.988101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:21.988848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.989319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.989781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.135261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:22.144248 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3874f927-269e-4e0c-92ca-43254583fbcd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.169860 Aug 30 04:25:22.144837 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3414/6946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:21 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:22.835062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "name": "network-vif-unplugged", "status": "completed", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:22.847203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.847801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.848242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.864476 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] Creating event network-vif-unplugged:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:25:22.870487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:25:22.881955 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-ec123eb0-7c54-4366-a5aa-49aa0a60db1d req-b84d04c5-15be-431a-8b10-73d9f03b5008 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051942 Aug 30 04:25:22.882906 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3533/6947] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:23.167207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:23.167848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:23.175075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:23.175593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:23.176053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:23.176892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:23.177396 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:23.177850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:23.455346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:23.463772 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9027b607-9f8d-4bd1-a8e7-b36437c9db9e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.300430 Aug 30 04:25:23.464364 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3415/6948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:23 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:24.494159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:24.495668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:24.502948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.503444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.503885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:24.504896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.505443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.505875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:24.662052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:24.677669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d2cd83a3-470c-42e4-9889-c787207247b0 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.188946 Aug 30 04:25:24.678458 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3534/6949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:24 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:24.918873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:24.930445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.930945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.931389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:24.944581 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] Creating event network-changed:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:25:24.950465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:25:24.961472 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b0d8ae2e-d4a7-424d-9433-3f39f6b7c9a0 req-f797eddd-f9af-43d0-b0ec-d6781a1576df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046341 Aug 30 04:25:24.962209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3416/6950] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:25.698948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:25.699560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:25.707332 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:25.708045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:25.708647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:25.709532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:25.710105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:25.710534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:25.922420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:25.930972 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17206ebb-dd4b-440e-ae8f-f25275f95829 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.236005 Aug 30 04:25:25.931555 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3535/6951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:25 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:26.954275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:26.955017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:26.961679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:26.962201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:26.962770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:26.963546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:26.963987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:26.964432 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:27.105221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:27.113817 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0edf0f34-c006-45f3-b852-7a08f253091e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.165312 Aug 30 04:25:27.114408 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3417/6952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:26 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:28.135741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:28.136393 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:28.139248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:28.144715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.145193 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.145652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.146342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.146787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.147225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.286416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:28.302016 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-908acae7-0977-482d-93d7-8142c077544f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.170138 Aug 30 04:25:28.303178 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3536/6953] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:28 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:29.325463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:29.326639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:29.334993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:29.335493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:29.335954 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.336667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:29.337141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:29.337691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.481058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:29.490501 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ac6554e5-fefc-4c87-a3dd-c520e7ccb266 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.169732 Aug 30 04:25:29.491106 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3418/6954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:29 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:30.512455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:30.513100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:30.519725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:30.520205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:30.520636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:30.521318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:30.521787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:30.522211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:30.654897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:30.663164 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a6c9b18f-2d13-43e4-a20e-665e4199971a tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.155120 Aug 30 04:25:30.663735 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3537/6955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:30 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:31.686033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:31.686722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:31.694048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.694545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.695020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:31.695721 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.696181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.696662 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:31.826975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:31.835326 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-94dfcfb3-99b7-4dd6-8307-a2fb8b65dd55 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.153991 Aug 30 04:25:31.835906 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3419/6956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:31 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:32.856879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:32.857522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:32.864401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.864884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.865318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.866033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.866485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.866918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.029710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.038539 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8510a0b6-18fa-46b6-9ed6-bfe35cfd5c34 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.185575 Aug 30 04:25:33.039128 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3538/6957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:32 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:34.060557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:34.061172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:34.068363 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.068874 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.069319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.070061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.070530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.070975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.217631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:34.226356 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7d39a671-32dd-4e4c-a3f7-b122fa7e8e0f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.169716 Aug 30 04:25:34.226950 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3420/6958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:34 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:35.247000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:35.248313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:35.255656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:35.256147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:35.256619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:35.257321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:35.257807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:35.258239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:35.433845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:35.447329 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5573180a-b3cd-4422-ae64-a0f6c6404055 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1720 microversion: 2.1 time: 0.204195 Aug 30 04:25:35.448234 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3539/6959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:35 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:36.471732 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:36.472359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:36.479505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.480009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.480470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.481190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.482374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.483009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.623014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:36.631381 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ecf4168e-dfce-4ab2-814d-b816ddadaf87 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1713 microversion: 2.1 time: 0.163671 Aug 30 04:25:36.631962 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3421/6960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:36 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:36.652306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:36.653087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:36.660490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.661015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.661513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.662220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.662682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.663110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.809805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:36.818635 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-325f3f91-c414-479b-b897-c6e45bd09bf3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1713 microversion: 2.1 time: 0.170289 Aug 30 04:25:36.819210 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3540/6961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:36 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1713 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:36.848894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:36.849546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:36.855484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.856004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.856449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.857825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.858293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.858728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.992383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.001962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b0bbf522-8cf2-42ff-9d4e-aa000c2aebd4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1713 microversion: 2.1 time: 0.156778 Aug 30 04:25:37.002479 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3422/6962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:36 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:37.022373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:37.022879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:37.029307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.029868 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.030307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.031000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.031454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.031889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.058356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:37.083142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:37.144218 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a77f64bd-46fa-455d-84aa-423c0cb6730d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 204 len: 0 microversion: 2.1 time: 0.125272 Aug 30 04:25:37.145005 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3541/6963] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:37 2022] DELETE /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:37.153264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:37.154964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:37.161088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.161746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.162284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.163147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.163636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.164074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.297036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.305643 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa45c73d-86e7-4b33-b6ec-e8fe729adb51 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1719 microversion: 2.1 time: 0.156110 Aug 30 04:25:37.306213 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3423/6964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:37 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:37.500039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-84663a44-ff9a-474e-8dc4-69f4d9e1dd58 req-9a1d98b4-3c3f-4cca-a693-9bbdf67207d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "name": "network-vif-plugged", "status": "completed", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:37.512365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-84663a44-ff9a-474e-8dc4-69f4d9e1dd58 req-9a1d98b4-3c3f-4cca-a693-9bbdf67207d9 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.512799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-84663a44-ff9a-474e-8dc4-69f4d9e1dd58 req-9a1d98b4-3c3f-4cca-a693-9bbdf67207d9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.513246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-84663a44-ff9a-474e-8dc4-69f4d9e1dd58 req-9a1d98b4-3c3f-4cca-a693-9bbdf67207d9 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.529067 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-84663a44-ff9a-474e-8dc4-69f4d9e1dd58 req-9a1d98b4-3c3f-4cca-a693-9bbdf67207d9 service nova] Creating event network-vif-plugged:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:25:37.534248 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-84663a44-ff9a-474e-8dc4-69f4d9e1dd58 req-9a1d98b4-3c3f-4cca-a693-9bbdf67207d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039490 Aug 30 04:25:37.534864 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3542/6965] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:38.329113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.329890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:38.336820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.337324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.337814 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.338582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.339058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.339500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.480344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:38.489056 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c0b47a57-f3dd-4e25-98ce-91b3975901e3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1719 microversion: 2.1 time: 0.164514 Aug 30 04:25:38.489679 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3424/6966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:38 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:39.511828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:39.512663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:39.520461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.520959 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.521455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.522180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.522635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.523065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.608745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:39.624867 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1cfae3f2-abed-4e31-a026-00dca2116b7f tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1652 microversion: 2.1 time: 0.117626 Aug 30 04:25:39.625515 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3543/6967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:39 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1652 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:39.707536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-023e861f-ac06-42bf-b6c1-58aea94698ed req-f91de090-6a06-48b9-a5a2-b53507d00d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7416a94c-9812-438b-8d78-87dfd4a524a5", "name": "network-vif-deleted", "tag": "471333b1-10e4-4076-9319-14ca7e362d5f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:39.721286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-023e861f-ac06-42bf-b6c1-58aea94698ed req-f91de090-6a06-48b9-a5a2-b53507d00d02 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.722189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-023e861f-ac06-42bf-b6c1-58aea94698ed req-f91de090-6a06-48b9-a5a2-b53507d00d02 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.723003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-023e861f-ac06-42bf-b6c1-58aea94698ed req-f91de090-6a06-48b9-a5a2-b53507d00d02 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.738571 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-023e861f-ac06-42bf-b6c1-58aea94698ed req-f91de090-6a06-48b9-a5a2-b53507d00d02 service nova] Creating event network-vif-deleted:471333b1-10e4-4076-9319-14ca7e362d5f for instance 7416a94c-9812-438b-8d78-87dfd4a524a5 on n-h2-854924-5 Aug 30 04:25:39.744371 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-023e861f-ac06-42bf-b6c1-58aea94698ed req-f91de090-6a06-48b9-a5a2-b53507d00d02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040611 Aug 30 04:25:39.744991 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3425/6968] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:40.650373 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:40.652583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:40.661076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.661633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.662425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.663400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.664058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.664667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.739475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.753737 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-631dd4ef-ada3-481e-b520-3aecb2eb63de tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1368 microversion: 2.1 time: 0.107393 Aug 30 04:25:40.757455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3544/6969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:40 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:41.778889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.779617 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:41.786395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.786801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.787276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.787999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.788466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.788909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.857292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:41.867358 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e3843b4-9b36-44e4-bef1-798e15f2c51b tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1368 microversion: 2.1 time: 0.093807 Aug 30 04:25:41.868064 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3426/6970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:41 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:42.891224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:42.892022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:42.899036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.899521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.899951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.900641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.901088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.901535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.968563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:42.979643 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-70f5750f-75db-41c9-b0c6-c690460e2000 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1368 microversion: 2.1 time: 0.092751 Aug 30 04:25:42.980576 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3545/6971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:42 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:44.005329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:44.006004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:44.015001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.015517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.016295 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.017200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.017714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.018166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.102616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1bbb21c374fc293e82998a02c3dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3423b61f744b488824933df837c9d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:44.105400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:44.113651 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c51884d-4c87-4b85-8a80-cb5eeecc99f1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 200 len: 1368 microversion: 2.1 time: 0.113776 Aug 30 04:25:44.114423 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3427/6972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:43 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:45.136176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:45.136784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:45.144442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.144923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.145405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.146063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.146519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.146939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.164275 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 HTTP/1.1 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7416a94c-9812-438b-8d78-87dfd4a524a5'} Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:45.166420 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f107f20c-4e04-4c9e-bb24-716ccd0a986d tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 404 len: 111 microversion: 2.1 time: 0.035896 Aug 30 04:25:45.170982 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3546/6973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:45 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:45.229000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:45.231231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:45.234325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=36 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:45.239897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.240456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.240904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.241640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.242104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.242539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.255982 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-volume_attachments HTTP/1.1 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '7416a94c-9812-438b-8d78-87dfd4a524a5'} Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:45.257755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-638599f6-1284-429a-be26-3b2f6559a7e4 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034566 Aug 30 04:25:45.262446 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3428/6974] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:25:45 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:25:48.594339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.594957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.599100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:48.605902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.606617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.607148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.608003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.608561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.609134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.627872 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 HTTP/1.1 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '7416a94c-9812-438b-8d78-87dfd4a524a5'} Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.631008 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a684d8ce-7c54-4893-b910-73e71f3f66cf tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 404 len: 111 microversion: 2.1 time: 0.042982 Aug 30 04:25:48.639272 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3547/6975] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:48 2022] DELETE /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.644130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.644774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 7416a94c-9812-438b-8d78-87dfd4a524a5] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.654843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.655358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.655816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.656556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.657160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.657939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.673696 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 HTTP/1.1 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '7416a94c-9812-438b-8d78-87dfd4a524a5'} Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.675382 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 7416a94c-9812-438b-8d78-87dfd4a524a5 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0a990b2d-9bea-4ac8-9484-1b8ff45f15bd tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5" status: 404 len: 111 microversion: 2.1 time: 0.037061 Aug 30 04:25:48.679558 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3429/6976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/servers/7416a94c-9812-438b-8d78-87dfd4a524a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.686538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.687090 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.696691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.697386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.697931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.699443 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.700573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.701084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.716214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 HTTP/1.1 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '47960601-2575-49e9-ac0f-89ddd7d084b0'} Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.717827 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-337626ff-9725-4ce1-bf65-b6e706727238 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 404 len: 111 microversion: 2.1 time: 0.037524 Aug 30 04:25:48.724987 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3548/6977] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:48 2022] DELETE /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.730502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.730502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 47960601-2575-49e9-ac0f-89ddd7d084b0] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.745780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.746301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.746897 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.748123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.748539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.749010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.764964 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 HTTP/1.1 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '47960601-2575-49e9-ac0f-89ddd7d084b0'} Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.766694 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 47960601-2575-49e9-ac0f-89ddd7d084b0 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-75419912-65b8-4251-83fe-35f23a1652e1 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0" status: 404 len: 111 microversion: 2.1 time: 0.043753 Aug 30 04:25:48.771755 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3430/6978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/servers/47960601-2575-49e9-ac0f-89ddd7d084b0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.780369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.780981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.791346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.792369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.792981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.794360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.795167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.796033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.816939 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 HTTP/1.1 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '51181607-ab4b-4ca2-8db8-ff4ca5445b86'} Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.818586 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3790aff-37a6-413d-aa1c-a30215069257 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 404 len: 111 microversion: 2.1 time: 0.044948 Aug 30 04:25:48.822816 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3549/6979] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:48 2022] DELETE /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.830563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.831213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 51181607-ab4b-4ca2-8db8-ff4ca5445b86] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.838963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.838963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.839264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.840013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.840487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.840933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.855894 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 HTTP/1.1 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '51181607-ab4b-4ca2-8db8-ff4ca5445b86'} Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.858175 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 51181607-ab4b-4ca2-8db8-ff4ca5445b86 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5a7155c4-5425-4517-9432-85cf26c3ecaa tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86" status: 404 len: 111 microversion: 2.1 time: 0.034382 Aug 30 04:25:48.862078 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3431/6980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/servers/51181607-ab4b-4ca2-8db8-ff4ca5445b86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.870435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.871876 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.880246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.882789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.883227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.885587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.886333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.887100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.909045 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e HTTP/1.1 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '101bb6fe-4879-4baa-9bad-8e63d4b95b2e'} Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.910729 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.916169 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ebc94eff-1f63-4961-9da6-cfacb844ca2e tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 404 len: 111 microversion: 2.1 time: 0.047421 Aug 30 04:25:48.917392 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3550/6981] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:48 2022] DELETE /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.923268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.924038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] [instance: 101bb6fe-4879-4baa-9bad-8e63d4b95b2e] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.931088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.931567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.932036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.932808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.933999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.933999 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.949752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] HTTP exception thrown: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Request method failure captured: Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e HTTP/1.1 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDY-X2wNOiO9xBgtAKdZotzq2VeqTbiDk1ipiLWTVV6_TBH1bz8rW64s5ex2DaNXbnOfXArZStAtKK8V41Lefx2REevh9e8_w8dPWZ7Msj2QQJWJIZImYmOYnNH_OQusMTa8viZTOCoNlIbHTcGBUlCqzJRH6hduul-zfFzR4hcCgpTs Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8e3423b61f744b488824933df837c9d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8e3423b61f744b488824933df837c9d0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8e3423b61f744b488824933df837c9d0"}]}] Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 8e3423b61f744b488824933df837c9d0 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1792249845 Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 4ee1bbb21c374fc293e82998a02c3dec Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServerActionsTestJSON-1792249845-project Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '101bb6fe-4879-4baa-9bad-8e63d4b95b2e'} Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:48.951371 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Returning 404 to user: Instance 101bb6fe-4879-4baa-9bad-8e63d4b95b2e could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-726a42be-2b0c-4ef4-9853-a8fa57036157 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e" status: 404 len: 111 microversion: 2.1 time: 0.035331 Aug 30 04:25:48.955873 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3432/6982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/servers/101bb6fe-4879-4baa-9bad-8e63d4b95b2e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:48.961988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0440e4c4-f880-4580-9846-258e34335ca3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] Calling method '.version_select at 0x7f897b1b55e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:49.004831 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0440e4c4-f880-4580-9846-258e34335ca3 tempest-ServerActionsTestJSON-1792249845 tempest-ServerActionsTestJSON-1792249845-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807406039" status: 202 len: 0 microversion: 2.1 time: 0.042893 Aug 30 04:25:49.004831 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3551/6983] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 04:25:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807406039 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:25:59.612824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=9 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:59.613546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=11 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:59.794498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1112380076", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "5f88fda5-181b-4a70-be82-61d8dae1a21b"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:59.876898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] validate_networks() for [('5f88fda5-181b-4a70-be82-61d8dae1a21b', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:26:00.379881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:00.380414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:00.380974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:00.381548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:00.382120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:00.392195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.392699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.393159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.393945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.394408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.394850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.413500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Getting quotas for project 5060efd8ce034f4690be06b3a9e4f6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:00.420099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Getting quotas for user 53ff20fe894b4eb1af645a99141bdffe and project 5060efd8ce034f4690be06b3a9e4f6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:00.433762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:00.436118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:00.488850 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6f571734-52f1-4537-a041-7a9b4513fe2e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882281 Aug 30 04:26:00.489884 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3433/6984] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:25:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:00.499420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:00.500687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:00.505257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aff3d2ad-c265-4334-9317-e61562f90af0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:00.505856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aff3d2ad-c265-4334-9317-e61562f90af0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:00.576800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aff3d2ad-c265-4334-9317-e61562f90af0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:00.585695 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aff3d2ad-c265-4334-9317-e61562f90af0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1217 microversion: 2.1 time: 0.087942 Aug 30 04:26:00.586300 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3552/6985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:00 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:01.608985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:01.609709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:01.616848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.617372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.617820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.618530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.618997 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.619431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.715277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:01.728603 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af6d910a-f9f4-4b2b-be9d-2b63427cf1b1 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1269 microversion: 2.1 time: 0.123997 Aug 30 04:26:01.730164 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3434/6986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:01 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:02.753056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:02.756137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:02.764503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:02.765403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:02.766066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:02.767031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:02.767710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:02.768358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:02.946766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:02.955338 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-78b6b75b-8955-4137-93a1-2541a1ee9fcf tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.206281 Aug 30 04:26:02.956088 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3553/6987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:02 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:03.472781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-223fd1c8-1a2d-46d9-8bf0-888cc626a206 req-f0aa125e-6cb2-4db8-9968-fa8927297117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32", "tag": "9fb4fe95-c589-442d-87f7-b6c49245af6e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:03.486758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-223fd1c8-1a2d-46d9-8bf0-888cc626a206 req-f0aa125e-6cb2-4db8-9968-fa8927297117 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.488313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-223fd1c8-1a2d-46d9-8bf0-888cc626a206 req-f0aa125e-6cb2-4db8-9968-fa8927297117 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.489423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-223fd1c8-1a2d-46d9-8bf0-888cc626a206 req-f0aa125e-6cb2-4db8-9968-fa8927297117 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.521178 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-223fd1c8-1a2d-46d9-8bf0-888cc626a206 req-f0aa125e-6cb2-4db8-9968-fa8927297117 service nova] Creating event network-changed:9fb4fe95-c589-442d-87f7-b6c49245af6e for instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 on n-h1-854924-5 Aug 30 04:26:03.529136 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-223fd1c8-1a2d-46d9-8bf0-888cc626a206 req-f0aa125e-6cb2-4db8-9968-fa8927297117 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068879 Aug 30 04:26:03.531132 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3435/6988] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:03.978535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:03.979301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:03.986208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.986704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.987143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.988034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.988492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.988915 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.151431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:04.161190 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c77a7e38-ada8-4bfb-85a8-6a9904328c69 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.186525 Aug 30 04:26:04.161975 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3554/6989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:03 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:05.188238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:05.189411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:05.201533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.202332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.203192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.204335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.204926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.205390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.371827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.383102 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-452a367c-fc2b-4684-b1e6-4a4ee860d107 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.203038 Aug 30 04:26:05.384160 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3436/6990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:05 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:06.406884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.407806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.416708 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.417222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.417737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.418865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.419559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.420025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.649377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.659933 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bbbef908-9c88-4ec7-8e34-0be6bc5eb484 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.258595 Aug 30 04:26:06.660531 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3555/6991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:07.686208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:07.687268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:07.698585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.699816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.700376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.701385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.702081 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.702652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.836764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:07.845262 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dcf631dc-89c0-422d-bd8e-779d83fdc656 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.163105 Aug 30 04:26:07.845880 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3437/6992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:07 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:08.866790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:08.867447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:08.874784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.875264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.875700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.876389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.876839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.877261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.331425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:09.339164 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b78a385-85ca-422f-af66-eeb06eb38bbb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.476332 Aug 30 04:26:09.340325 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3556/6993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:08 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:09.864102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-202ee8ed-042a-4660-928d-42caf73a0c63 req-3b6a0961-e4f8-47e6-8e14-498fb7eaa6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32", "name": "network-vif-plugged", "status": "completed", "tag": "9fb4fe95-c589-442d-87f7-b6c49245af6e"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:09.875739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-202ee8ed-042a-4660-928d-42caf73a0c63 req-3b6a0961-e4f8-47e6-8e14-498fb7eaa6d5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.876379 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-202ee8ed-042a-4660-928d-42caf73a0c63 req-3b6a0961-e4f8-47e6-8e14-498fb7eaa6d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.876841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-202ee8ed-042a-4660-928d-42caf73a0c63 req-3b6a0961-e4f8-47e6-8e14-498fb7eaa6d5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.890515 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-202ee8ed-042a-4660-928d-42caf73a0c63 req-3b6a0961-e4f8-47e6-8e14-498fb7eaa6d5 service nova] Creating event network-vif-plugged:9fb4fe95-c589-442d-87f7-b6c49245af6e for instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 on n-h1-854924-5 Aug 30 04:26:09.895725 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-202ee8ed-042a-4660-928d-42caf73a0c63 req-3b6a0961-e4f8-47e6-8e14-498fb7eaa6d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Aug 30 04:26:09.896853 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3438/6994] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:10.361676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.362196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:10.369142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.369664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.370101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.370781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.371233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.371656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.501514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.509481 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ba09fe14-6c3f-45f9-9911-9c35a024f096 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1317 microversion: 2.1 time: 0.151988 Aug 30 04:26:10.510047 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3557/6995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:10 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:11.530917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:11.531657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:11.533648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.534445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.541305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.541764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.542211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.543397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.543858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.544294 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.684998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:11.692751 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1ba7002e-bc4f-4e77-b0b3-d62677247f18 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.166082 Aug 30 04:26:11.693325 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3439/6996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:11 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:11.751998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-769866533", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "5f88fda5-181b-4a70-be82-61d8dae1a21b"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:11.761023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:11.811696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] validate_networks() for [('5f88fda5-181b-4a70-be82-61d8dae1a21b', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:26:12.275109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:12.275527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:12.276001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:12.276409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:12.276820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:12.286448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.286930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.287378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.288088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.288539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.288963 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.305611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Getting quotas for project 5060efd8ce034f4690be06b3a9e4f6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:12.310897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Getting quotas for user 53ff20fe894b4eb1af645a99141bdffe and project 5060efd8ce034f4690be06b3a9e4f6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:12.323029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:12.325832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:12.373437 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c4792c13-f7a0-4bfb-88bd-81b0523ddd6c tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625311 Aug 30 04:26:12.374123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3558/6997] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:12.386231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30180a9a-87b0-4893-860e-8bb00e125b82 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:12.387420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30180a9a-87b0-4893-860e-8bb00e125b82 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:12.441886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-30180a9a-87b0-4893-860e-8bb00e125b82 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:12.450685 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30180a9a-87b0-4893-860e-8bb00e125b82 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1216 microversion: 2.1 time: 0.069138 Aug 30 04:26:12.451719 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3440/6998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:12 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:13.472283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:13.472892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:13.482666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.484131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.484756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.485552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.486205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.486842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.567631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:13.576003 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-affce429-e7eb-4cbb-9f09-bb0c8d16facb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1274 microversion: 2.1 time: 0.107810 Aug 30 04:26:13.582589 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3559/6999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:13 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:14.596225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.597124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:14.607829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.608704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.609370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.610239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.610799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.611305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.820607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:14.832806 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1fbcb3dc-7af2-4789-83c0-437a1e2f718d tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1316 microversion: 2.1 time: 0.240380 Aug 30 04:26:14.833446 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3441/7000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:14.849643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-eff0fd81-53a2-494a-988d-095257ec346c req-4bb6cac3-3b7d-4fd8-a31b-fdce33f99bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74039432-bfa4-4e74-afda-1d67fae6feb6", "tag": "fe74e41d-8921-48d7-b2e4-a598d69a58f0"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:14.861591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eff0fd81-53a2-494a-988d-095257ec346c req-4bb6cac3-3b7d-4fd8-a31b-fdce33f99bbd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.862079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eff0fd81-53a2-494a-988d-095257ec346c req-4bb6cac3-3b7d-4fd8-a31b-fdce33f99bbd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.862514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-eff0fd81-53a2-494a-988d-095257ec346c req-4bb6cac3-3b7d-4fd8-a31b-fdce33f99bbd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.874710 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-eff0fd81-53a2-494a-988d-095257ec346c req-4bb6cac3-3b7d-4fd8-a31b-fdce33f99bbd service nova] Creating event network-changed:fe74e41d-8921-48d7-b2e4-a598d69a58f0 for instance 74039432-bfa4-4e74-afda-1d67fae6feb6 on n-h2-854924-5 Aug 30 04:26:14.879657 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-eff0fd81-53a2-494a-988d-095257ec346c req-4bb6cac3-3b7d-4fd8-a31b-fdce33f99bbd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036250 Aug 30 04:26:14.880274 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3560/7001] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:15.855330 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:15.856038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:15.863313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.863806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.864250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.864946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.865440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.865879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.010469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:16.018724 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c0c98c5-2991-49a7-b917-86d62b23066f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1316 microversion: 2.1 time: 0.167377 Aug 30 04:26:16.019318 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3442/7002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:15 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:17.047301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:17.048580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:17.056789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.057280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.057747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.058464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.058921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.059346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.215389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:17.226155 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3b9e4cfa-672e-416d-bf18-e5fb42933324 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1316 microversion: 2.1 time: 0.188984 Aug 30 04:26:17.226743 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3561/7003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:17 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:18.248435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.249180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:18.256278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.256783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.257232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.257978 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.258445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.259136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.407154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:18.416687 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-19f00d47-8309-4ddf-a59b-6105ac17bf79 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1316 microversion: 2.1 time: 0.172981 Aug 30 04:26:18.417313 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3443/7004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:18 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:19.438998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:19.439621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:19.446979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:19.447474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:19.447912 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:19.448639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:19.449665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:19.450098 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:19.602897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:19.612036 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b9cb9a76-a040-4a73-8b78-c0df7e84be3f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1316 microversion: 2.1 time: 0.176868 Aug 30 04:26:19.612729 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3562/7005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:19 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:19.741195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5f134fbf-5dc4-458c-b1ee-9b96dfc57c31 req-007a52c1-d089-437e-bb71-5c0df52ec167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74039432-bfa4-4e74-afda-1d67fae6feb6", "name": "network-vif-plugged", "status": "completed", "tag": "fe74e41d-8921-48d7-b2e4-a598d69a58f0"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:19.760286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5f134fbf-5dc4-458c-b1ee-9b96dfc57c31 req-007a52c1-d089-437e-bb71-5c0df52ec167 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:19.760929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5f134fbf-5dc4-458c-b1ee-9b96dfc57c31 req-007a52c1-d089-437e-bb71-5c0df52ec167 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:19.761444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5f134fbf-5dc4-458c-b1ee-9b96dfc57c31 req-007a52c1-d089-437e-bb71-5c0df52ec167 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:19.781538 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5f134fbf-5dc4-458c-b1ee-9b96dfc57c31 req-007a52c1-d089-437e-bb71-5c0df52ec167 service nova] Creating event network-vif-plugged:fe74e41d-8921-48d7-b2e4-a598d69a58f0 for instance 74039432-bfa4-4e74-afda-1d67fae6feb6 on n-h2-854924-5 Aug 30 04:26:19.787756 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5f134fbf-5dc4-458c-b1ee-9b96dfc57c31 req-007a52c1-d089-437e-bb71-5c0df52ec167 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053193 Aug 30 04:26:19.789213 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3444/7006] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:20.639212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.639828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:20.647010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:20.647515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:20.647949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:20.648672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:20.649127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:20.649574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:20.792147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:20.800403 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39d78a40-d462-4a7d-afcd-c9886723f3ee tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1316 microversion: 2.1 time: 0.165534 Aug 30 04:26:20.806462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3563/7007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:21.824107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:21.824818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:21.830957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:21.831484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:21.831932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:21.832625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:21.833123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:21.833589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:21.967595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:21.975428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3b4b4294-c44d-4397-8316-434ad0a9797a tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1506 microversion: 2.1 time: 0.157033 Aug 30 04:26:21.976010 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3445/7008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:21 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:21.995990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:21.996490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:22.003645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.004136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.004582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:22.005278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.005827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.006301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:22.035585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:22.139131 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86ce9057-e261-4073-97b1-876d953829d0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 204 len: 0 microversion: 2.1 time: 0.146657 Aug 30 04:26:22.139817 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3564/7009] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:21 2022] DELETE /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:22.148060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.148691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:22.157937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.158482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.158933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:22.159641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.160099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.160534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:22.288748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:22.297097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a260c43b-c20e-443a-bddc-b46083c5e3c7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1512 microversion: 2.1 time: 0.152966 Aug 30 04:26:22.297717 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3446/7010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:22 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:23.321049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:23.321049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:23.322317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:23.323143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:23.330762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.331251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.331688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.332382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.332835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.333260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.543860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:23.552036 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2f2282c4-ab68-4860-833d-b06700c7a97f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 200 len: 1512 microversion: 2.1 time: 0.236593 Aug 30 04:26:23.552540 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3565/7011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:23 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:23.936698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2fc00197-b425-4984-a8cd-221d4ddec610 req-6332f9b6-0b41-4842-8eac-a954c1709773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74039432-bfa4-4e74-afda-1d67fae6feb6", "name": "network-vif-deleted", "tag": "fe74e41d-8921-48d7-b2e4-a598d69a58f0"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:23.951026 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:23.958538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2fc00197-b425-4984-a8cd-221d4ddec610 req-6332f9b6-0b41-4842-8eac-a954c1709773 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.959578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2fc00197-b425-4984-a8cd-221d4ddec610 req-6332f9b6-0b41-4842-8eac-a954c1709773 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.960261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2fc00197-b425-4984-a8cd-221d4ddec610 req-6332f9b6-0b41-4842-8eac-a954c1709773 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.978592 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2fc00197-b425-4984-a8cd-221d4ddec610 req-6332f9b6-0b41-4842-8eac-a954c1709773 service nova] Creating event network-vif-deleted:fe74e41d-8921-48d7-b2e4-a598d69a58f0 for instance 74039432-bfa4-4e74-afda-1d67fae6feb6 on n-h2-854924-5 Aug 30 04:26:23.985881 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2fc00197-b425-4984-a8cd-221d4ddec610 req-6332f9b6-0b41-4842-8eac-a954c1709773 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055841 Aug 30 04:26:23.986678 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3447/7012] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:24.574576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.575328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.582591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.583084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.583527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.584235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.584693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.585124 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.599342 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] HTTP exception thrown: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 HTTP/1.1 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '74039432-bfa4-4e74-afda-1d67fae6feb6'} Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:24.600983 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 404 to user: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e22ea26f-4c32-421d-b94e-b583c79bdecb tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 404 len: 111 microversion: 2.1 time: 0.032434 Aug 30 04:26:24.605829 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3566/7013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:24.612734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.613469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.619947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.620940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.621411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.622110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.622577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.623020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.765781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.773954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-df82c9f2-4e0b-467c-9454-a7e7b568ae00 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.165595 Aug 30 04:26:24.774530 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3448/7014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:24.794554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf444ab-f966-4bcf-b2b4-d93cce732cde tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:24.796958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cbf444ab-f966-4bcf-b2b4-d93cce732cde tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 79b37ebe-f694-428e-8160-9f5c8015cc16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.802490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-cbf444ab-f966-4bcf-b2b4-d93cce732cde tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] HTTP exception thrown: Instance 79b37ebe-f694-428e-8160-9f5c8015cc16 could not be found. Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf444ab-f966-4bcf-b2b4-d93cce732cde tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/79b37ebe-f694-428e-8160-9f5c8015cc16/action HTTP/1.1 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 32 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: {"resize": {"flavorRef": "452"}} Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 79b37ebe-f694-428e-8160-9f5c8015cc16 could not be found. Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '79b37ebe-f694-428e-8160-9f5c8015cc16', 'body': {'resize': {'flavorRef': '452'}}} Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b37ebe-f694-428e-8160-9f5c8015cc16 could not be found. Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:24.804047 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b37ebe-f694-428e-8160-9f5c8015cc16 could not be found. Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b37ebe-f694-428e-8160-9f5c8015cc16 could not be found. Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cbf444ab-f966-4bcf-b2b4-d93cce732cde tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 404 to user: Instance 79b37ebe-f694-428e-8160-9f5c8015cc16 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cbf444ab-f966-4bcf-b2b4-d93cce732cde tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "POST /compute/v2.1/servers/79b37ebe-f694-428e-8160-9f5c8015cc16/action" status: 404 len: 111 microversion: 2.1 time: 0.015410 Aug 30 04:26:24.809232 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3567/7015] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:26:24 2022] POST /compute/v2.1/servers/79b37ebe-f694-428e-8160-9f5c8015cc16/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:24.814918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.815546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.821632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.822132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.822583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.823291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.823793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.824231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.952714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.961108 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0ac6d2f9-c34e-4326-9e35-21830ccda381 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.150110 Aug 30 04:26:24.961717 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3449/7016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:24.982162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.982774 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.989733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.990220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.990661 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.991351 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.991935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.992233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.129681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.137919 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1ec1695f-8bac-4c5a-b21a-246caea35c78 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.160112 Aug 30 04:26:25.138608 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3568/7017] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:25.158689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d485f4b5-15cd-484c-b41c-ed867e93c73a"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:25.161245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.168035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.168612 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.169222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.170047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.170543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.171015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.213644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.221063 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] HTTP exception thrown: Flavor d485f4b5-15cd-484c-b41c-ed867e93c73a could not be found. Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: request: POST /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32/action HTTP/1.1 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 65 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: {"resize": {"flavorRef": "d485f4b5-15cd-484c-b41c-ed867e93c73a"}} Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: exception: Flavor d485f4b5-15cd-484c-b41c-ed867e93c73a could not be found. Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32', 'body': {'resize': {'flavorRef': 'd485f4b5-15cd-484c-b41c-ed867e93c73a'}}} Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.227458 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d485f4b5-15cd-484c-b41c-ed867e93c73a could not be found. Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d485f4b5-15cd-484c-b41c-ed867e93c73a could not be found. Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d485f4b5-15cd-484c-b41c-ed867e93c73a could not be found. Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 400 to user: Flavor d485f4b5-15cd-484c-b41c-ed867e93c73a could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-15cf8e0e-9d72-4fc1-9afd-2cdfe46027b7 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "POST /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32/action" status: 400 len: 107 microversion: 2.1 time: 0.074533 Aug 30 04:26:25.232494 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3450/7018] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:26:25 2022] POST /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32/action => generated 107 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:25.238494 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.239114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.246705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.247578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.248375 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.249571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.250276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.250747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.382787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.391648 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3ec4923d-55f7-4574-a23c-a42c2e3413e6 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.157010 Aug 30 04:26:25.392220 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3569/7019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:25.413933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.414625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.420848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.421410 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.421888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.422637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.423107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.423568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.560107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.568004 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cd8e038d-eb12-47ca-8ec7-c06a689f1b36 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.158309 Aug 30 04:26:25.568580 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3451/7020] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:25.588907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-410adb77-559e-4084-b617-97cf4c5479f5 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-410adb77-559e-4084-b617-97cf4c5479f5 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: request: POST /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32/action HTTP/1.1 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 29 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: {"resize": {"flavorRef": ""}} Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32', 'body': {'resize': {'flavorRef': ''}}} Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi '' Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.593598 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-410adb77-559e-4084-b617-97cf4c5479f5 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-410adb77-559e-4084-b617-97cf4c5479f5 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "POST /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32/action" status: 400 len: 113 microversion: 2.1 time: 0.010251 Aug 30 04:26:25.598650 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3570/7021] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:26:25 2022] POST /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:26:25.603597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.604217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.610711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.611203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.611959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.613010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.613138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.613588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.748908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.756821 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-597c8110-d4ae-4f14-bde3-2524ac020633 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1506 microversion: 2.1 time: 0.157020 Aug 30 04:26:25.757420 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3452/7022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:25.782595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.783206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.793919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.794542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.794982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.795683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.796140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.796583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.810774 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] HTTP exception thrown: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: request: DELETE /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 HTTP/1.1 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '74039432-bfa4-4e74-afda-1d67fae6feb6'} Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:25.812368 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 404 to user: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e947c19c-3273-4087-be0f-0a477c9d7242 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 404 len: 111 microversion: 2.1 time: 0.036697 Aug 30 04:26:25.816261 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3571/7023] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:25 2022] DELETE /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:26:25.822508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.823135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: 74039432-bfa4-4e74-afda-1d67fae6feb6] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.829094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.829622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.830066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.830752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.831217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.831648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.845767 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] HTTP exception thrown: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 HTTP/1.1 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '74039432-bfa4-4e74-afda-1d67fae6feb6'} Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.847314 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 404 to user: Instance 74039432-bfa4-4e74-afda-1d67fae6feb6 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-02b044e3-6535-44be-843b-06547a10665e tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6" status: 404 len: 111 microversion: 2.1 time: 0.030146 Aug 30 04:26:25.851420 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3453/7024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/74039432-bfa4-4e74-afda-1d67fae6feb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:25.858423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.858950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.864894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.865397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.865836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.866527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.866981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.867407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.887286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:25.896548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:25.987649 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-557de3cb-f422-4ca6-90b4-379c61afc6f0 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 204 len: 0 microversion: 2.1 time: 0.132789 Aug 30 04:26:25.988307 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3572/7025] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:25 2022] DELETE /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:26:25.996981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.997735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:26.006630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.007127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.007525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.008839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.009275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.009599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.152385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.156077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=100 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:26.161449 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c91900c9-c43c-4c7c-832e-3b61cc1124f2 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1512 microversion: 2.1 time: 0.168651 Aug 30 04:26:26.162050 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3454/7026] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:27.184349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.184975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.192010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.192500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.192938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.193682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.194137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.194565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.338054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:27.346196 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-62ac2cda-8a20-4ccd-9893-403437efa6d3 tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1512 microversion: 2.1 time: 0.166719 Aug 30 04:26:27.346786 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3573/7027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:28.368429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:28.369723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:28.379608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:28.380500 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:28.381533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:28.382842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:28.383912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:28.384611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:28.537776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ff20fe894b4eb1af645a99141bdffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5060efd8ce034f4690be06b3a9e4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:28.546804 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1760f3f4-ba85-480f-bf4a-08a85584940b tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 200 len: 1512 microversion: 2.1 time: 0.183109 Aug 30 04:26:28.547413 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3455/7028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:28 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:28.917871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fa59be1f-211d-440c-9c0e-16a65b5e23ab req-a8d75aad-2f8c-4f02-a35e-5f84a44dea8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32", "name": "network-vif-deleted", "tag": "9fb4fe95-c589-442d-87f7-b6c49245af6e"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:28.928581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fa59be1f-211d-440c-9c0e-16a65b5e23ab req-a8d75aad-2f8c-4f02-a35e-5f84a44dea8a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:28.929062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fa59be1f-211d-440c-9c0e-16a65b5e23ab req-a8d75aad-2f8c-4f02-a35e-5f84a44dea8a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:28.929525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fa59be1f-211d-440c-9c0e-16a65b5e23ab req-a8d75aad-2f8c-4f02-a35e-5f84a44dea8a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:28.941449 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fa59be1f-211d-440c-9c0e-16a65b5e23ab req-a8d75aad-2f8c-4f02-a35e-5f84a44dea8a service nova] Creating event network-vif-deleted:9fb4fe95-c589-442d-87f7-b6c49245af6e for instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 on n-h1-854924-5 Aug 30 04:26:28.947204 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fa59be1f-211d-440c-9c0e-16a65b5e23ab req-a8d75aad-2f8c-4f02-a35e-5f84a44dea8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032814 Aug 30 04:26:28.950119 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3574/7029] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:29.568529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.569100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] [instance: bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.575909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.576404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.576849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.577572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.578037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.578470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.591602 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] HTTP exception thrown: Instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 could not be found. Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Request method failure captured: Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 HTTP/1.1 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZFXDQM7bs8SQvd_PIAEcRLg4132PzOycPiOZVmX8_Phjnl5PHkzqwH4fGwb8meKLHp8WwnBatLUM6JKzXFMpOCRbu-Pg64DCgkvcwk_zp-4SzUejruLpZDtSaLcJlP_-ASar86V2vSKTEsQOp9iMsywGBfEyzhiiT01qaXpDsu6OKw Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5060efd8ce034f4690be06b3a9e4f6d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5060efd8ce034f4690be06b3a9e4f6d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5060efd8ce034f4690be06b3a9e4f6d1"}]}] Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 5060efd8ce034f4690be06b3a9e4f6d1 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1614533120 Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 53ff20fe894b4eb1af645a99141bdffe Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-ServersNegativeTestJSON-1614533120-project Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 could not be found. Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32'} Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 could not be found. Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 could not be found. Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.593130 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 could not be found. Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] Returning 404 to user: Instance bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de2e6a2e-9573-47b9-a34d-fdea08acf93f tempest-ServersNegativeTestJSON-1614533120 tempest-ServersNegativeTestJSON-1614533120-project] 10.222.0.30 "GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32" status: 404 len: 111 microversion: 2.1 time: 0.030052 Aug 30 04:26:29.597829 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3456/7030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/servers/bb8e65bf-a4bc-4bd2-9e4f-23427d8c0f32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:01.836720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:01.837699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:02.048662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae13c2a7-0322-4ff1-9c72-2727d30083d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: .version_select at 0x7f897b48daf0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-980255896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBOwkzKCO8z6RQYWyOBVx1Bz+EoEI4cz9ZG9mYk7EdZEpN3QczIf1r/ClKvbbJS+38S1BeEkevM7fKWLreH6qKdhGJRbXReDhVECfSs6UXjc/+3tocK8Xcxlg1nQN5Wsw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:02.092126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ae13c2a7-0322-4ff1-9c72-2727d30083d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:02.099286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ae13c2a7-0322-4ff1-9c72-2727d30083d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for user 9473af6ef78d4ab08ea93be235ee2796 and project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:02.136895 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae13c2a7-0322-4ff1-9c72-2727d30083d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.303273 Aug 30 04:27:02.137724 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3575/7031] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:27:01 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:02.194062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-563284617", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-980255896", "networks": [{"uuid": "fdd56106-82eb-4842-818c-9b807505a8d8"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:02.212487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:02.213777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:02.457747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] validate_networks() for [('fdd56106-82eb-4842-818c-9b807505a8d8', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:27:02.840979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:02.841479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:02.841992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:02.842414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:02.842837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:02.851697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.852187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.852641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.853441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.853909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.854352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.872754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:02.878046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for user 9473af6ef78d4ab08ea93be235ee2796 and project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:02.892519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:02.894949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:02.942887 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-99e5c084-2dbc-409b-b941-f5d6c38613e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752898 Aug 30 04:27:02.943559 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3457/7032] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:02.959670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c0d90d5c-df93-4327-901a-8518dfec45aa tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:02.960486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c0d90d5c-df93-4327-901a-8518dfec45aa tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:03.136250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c0d90d5c-df93-4327-901a-8518dfec45aa tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:03.143450 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c0d90d5c-df93-4327-901a-8518dfec45aa tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1261 microversion: 2.1 time: 0.191841 Aug 30 04:27:03.144026 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3576/7033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:02 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:04.165911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:04.166560 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:04.184378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:04.186331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:04.187391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.190276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:04.191242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:04.191705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:04.264542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:04.275600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9808b9e4-9f5d-4f7e-ac4c-bce0e80bbd9e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1321 microversion: 2.1 time: 0.114719 Aug 30 04:27:04.285163 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3458/7034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:04 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1321 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:05.302371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.303198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:05.312595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.313582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.314089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.315036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.315510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.315946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.476565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.486996 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d049418b-a074-44eb-8bd2-d32abe9c6298 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.192506 Aug 30 04:27:05.501635 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3577/7035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:05 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:05.671474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-f9612a87-9cbe-4ada-9f0f-30a01e29cb12 req-781e8fe0-0db6-40d5-8cfe-4eeec85d296a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc075b2-bd06-4bc4-9c0a-cf6e51a93f11", "tag": "b79223c3-6d67-4e99-86b7-a39df9a56bb3"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:05.687373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f9612a87-9cbe-4ada-9f0f-30a01e29cb12 req-781e8fe0-0db6-40d5-8cfe-4eeec85d296a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.688441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f9612a87-9cbe-4ada-9f0f-30a01e29cb12 req-781e8fe0-0db6-40d5-8cfe-4eeec85d296a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.689479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-f9612a87-9cbe-4ada-9f0f-30a01e29cb12 req-781e8fe0-0db6-40d5-8cfe-4eeec85d296a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.711576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-f9612a87-9cbe-4ada-9f0f-30a01e29cb12 req-781e8fe0-0db6-40d5-8cfe-4eeec85d296a service nova] Creating event network-changed:b79223c3-6d67-4e99-86b7-a39df9a56bb3 for instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 on n-h1-854924-5 Aug 30 04:27:05.718664 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-f9612a87-9cbe-4ada-9f0f-30a01e29cb12 req-781e8fe0-0db6-40d5-8cfe-4eeec85d296a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050875 Aug 30 04:27:05.719413 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3459/7036] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:06.512998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.513683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.522617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.523116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.523559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.524282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.524750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.525880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.667031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:06.675627 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7cdf41f-ce45-4628-a38c-f6b57d09b82e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.167051 Aug 30 04:27:06.676471 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3578/7037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:07.697480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:07.698200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:07.704771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:07.705280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:07.705757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.706474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:07.706941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:07.707380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.849756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:07.858791 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f9af9cd6-27be-4be0-93ab-0ea9f5bfde97 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.166443 Aug 30 04:27:07.859382 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3460/7038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:07 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:08.880243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.881007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:08.889492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.889982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.890425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.891143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.891636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.892041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.032906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:09.045701 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c7c8b87a-0b9e-4198-b3f0-1abd631f0778 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.169277 Aug 30 04:27:09.046295 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3579/7039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.071038 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.072317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:10.079427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.079925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.080372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.081083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.081578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.082043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.234316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.241909 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-257a2c9f-57fe-4b41-81d2-fd67066beb13 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.175493 Aug 30 04:27:10.242556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3461/7040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:11.268929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:11.269571 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:11.276065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.276553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.276991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.277824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.278277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.278697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.409272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:11.417702 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-de364134-95ad-4114-a4c6-fcd9ebb7ace2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.152772 Aug 30 04:27:11.418490 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3580/7041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:11 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:12.236015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-eb42ee11-1986-45bd-bf85-8e780f82c99d req-8b0a7be6-40bf-4e20-9ad6-6f61d081ecfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc075b2-bd06-4bc4-9c0a-cf6e51a93f11", "name": "network-vif-plugged", "status": "completed", "tag": "b79223c3-6d67-4e99-86b7-a39df9a56bb3"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:12.247537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-eb42ee11-1986-45bd-bf85-8e780f82c99d req-8b0a7be6-40bf-4e20-9ad6-6f61d081ecfd service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.248043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-eb42ee11-1986-45bd-bf85-8e780f82c99d req-8b0a7be6-40bf-4e20-9ad6-6f61d081ecfd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.248743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-eb42ee11-1986-45bd-bf85-8e780f82c99d req-8b0a7be6-40bf-4e20-9ad6-6f61d081ecfd service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.263747 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-eb42ee11-1986-45bd-bf85-8e780f82c99d req-8b0a7be6-40bf-4e20-9ad6-6f61d081ecfd service nova] Creating event network-vif-plugged:b79223c3-6d67-4e99-86b7-a39df9a56bb3 for instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 on n-h1-854924-5 Aug 30 04:27:12.268953 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-eb42ee11-1986-45bd-bf85-8e780f82c99d req-8b0a7be6-40bf-4e20-9ad6-6f61d081ecfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036667 Aug 30 04:27:12.269622 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3462/7042] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:12.439287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:12.439907 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:12.447848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.448335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.448767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.449489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:12.449944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:12.450365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.912554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.921387 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-237893fc-8cfc-4ccb-b1c8-496eac9be2d2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1361 microversion: 2.1 time: 0.486320 Aug 30 04:27:12.922065 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3581/7043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:12 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1361 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:13.941125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:13.942155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:13.948027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:13.948709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:13.956122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.956625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.957079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.957824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.958289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.958728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.092200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:14.100158 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f7daef16-9679-458e-9575-c552aa364f09 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1553 microversion: 2.1 time: 0.159954 Aug 30 04:27:14.100742 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3463/7044] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:13 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:14.121227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:14.121914 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:14.123826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:14.130177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.130670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.131109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.131836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.132291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.132720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.271468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:14.279738 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f739b74-41f2-4787-98c7-224b928aa44b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1553 microversion: 2.1 time: 0.163045 Aug 30 04:27:14.280319 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3582/7045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:14 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:15.921196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fb9064d-c3b4-4c7e-8512-78a14fd78952"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:15.923689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:15.930728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.931795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.932239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.932947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:15.933426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:15.933862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.201467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-51bb8a3d-c388-4419-a739-0992f71ecdd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284096 Aug 30 04:27:16.202098 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3464/7046] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:27:15 2022] POST /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:26.944000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:26.944587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:26.948002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:26.948764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=36 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:26.954637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.955125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.955582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.956275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.956725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.957148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.041625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lazy-loading 'services' on Instance uuid afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:27:27.117025 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f2bd602d-a597-4a71-81e2-87057ada249a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments/0fb9064d-c3b4-4c7e-8512-78a14fd78952" status: 202 len: 0 microversion: 2.1 time: 0.176846 Aug 30 04:27:27.117957 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3583/7047] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:27:26 2022] DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments/0fb9064d-c3b4-4c7e-8512-78a14fd78952 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:27:27.127489 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:27.129861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:27.134353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:27.134998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:27.139228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.139715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.140667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.141409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.142004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.142442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.176128 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c9c85b1-a432-4308-bd31-50abab7754a2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052946 Aug 30 04:27:27.176697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3465/7048] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:27 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:28.190364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:28.192795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:28.199892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.200380 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.200822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.201559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.202021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.202446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.236375 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27410758-081d-414b-ac38-529e1cfd0c74 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051247 Aug 30 04:27:28.236953 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3584/7049] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:28 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:29.248633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:29.251082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:29.259286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.259788 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.260242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.260970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.261618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.262132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.308116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4a9caad4-9a37-42f9-84b5-f6045e3fc2db tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063517 Aug 30 04:27:29.308738 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3466/7050] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:29 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:30.320424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:30.322731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.329461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.329953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.330387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.331298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.332118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.332553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.364732 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a170df37-5acb-4604-b868-ceb6e0430407 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048344 Aug 30 04:27:30.365208 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3585/7051] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:30 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:31.377666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:31.379914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:31.388067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.388573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.389027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.389765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.390234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.390672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.421368 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-724a1c0c-18a1-4a5d-8376-b62b67f0e677 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Aug 30 04:27:31.421940 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3467/7052] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:31 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:32.433838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:32.436107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:32.443180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.443674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.444110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.444819 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.445402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.445800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.479392 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f08f9579-7341-4a2c-b94f-f1a58e2e0629 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049512 Aug 30 04:27:32.479981 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3586/7053] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:32 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:27:32.491298 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:32.491862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:32.499876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.500386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.500836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.501588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:32.502084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:32.502554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.597808 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] HTTP exception thrown: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 is not attached to volume 0fb9064d-c3b4-4c7e-8512-78a14fd78952 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Request method failure captured: Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments/0fb9064d-c3b4-4c7e-8512-78a14fd78952 HTTP/1.1 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZGQN-dTj0kWMoDvabd1LuEvtJ8SMVVUz6W28TW3QXJvo5gWAArh2Bh-vZijqDwp3-QmEJaTfPN-h2uhlyCR0YlTBdikC-RYoI9g4wEw_dODZdVH-q5srvE1sK5C2eCohtFet_oowKqtVgSugacQcaWKNwxY8lw9N377Fc6360qFFJg Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9fd8cb9d47b349c28acfafe3da1ef76d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}] Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9473af6ef78d4ab08ea93be235ee2796 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 is not attached to volume 0fb9064d-c3b4-4c7e-8512-78a14fd78952 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': 'afc075b2-bd06-4bc4-9c0a-cf6e51a93f11', 'id': '0fb9064d-c3b4-4c7e-8512-78a14fd78952'} Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0fb9064d-c3b4-4c7e-8512-78a14fd78952. Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 is not attached to volume 0fb9064d-c3b4-4c7e-8512-78a14fd78952 Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:32.611594 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 is not attached to volume 0fb9064d-c3b4-4c7e-8512-78a14fd78952 Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Returning 404 to user: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 is not attached to volume 0fb9064d-c3b4-4c7e-8512-78a14fd78952 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9dd77c4b-5ba4-48f7-8e89-b05d9b841afe tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments/0fb9064d-c3b4-4c7e-8512-78a14fd78952" status: 404 len: 154 microversion: 2.1 time: 0.126447 Aug 30 04:27:32.615996 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3468/7054] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:27:32 2022] DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11/os-volume_attachments/0fb9064d-c3b4-4c7e-8512-78a14fd78952 => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:35.981672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.982399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:35.989292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.989866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.990310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.991014 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.991477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.991935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.019188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:27:36.114561 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-efe86cc3-c588-4021-b3a2-85adb2f9495e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 204 len: 0 microversion: 2.1 time: 0.136741 Aug 30 04:27:36.115090 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3587/7055] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:27:35 2022] DELETE /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:36.125879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.126713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.135561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.136076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.136533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.137260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.137754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.138225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.288128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.297374 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-51ca47ba-cf5d-48fc-b8b7-57f1c5fb7986 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1559 microversion: 2.1 time: 0.176555 Aug 30 04:27:36.298094 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3469/7056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.320149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.321467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.328442 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.328925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.329379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.330072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.330522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.330948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.470444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.479593 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc2a3e69-7af6-4663-be5f-98cdef7c1d8d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1559 microversion: 2.1 time: 0.163742 Aug 30 04:27:37.480175 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3588/7057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:38.507946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.510401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.527506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.528513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.529497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.531493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.544251 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.548097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.578854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d3ffdd4b-1cd5-4acb-8979-af7316f91b6f req-7d503a0e-c7d6-408c-88a7-2da018e5669c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc075b2-bd06-4bc4-9c0a-cf6e51a93f11", "name": "network-vif-deleted", "tag": "b79223c3-6d67-4e99-86b7-a39df9a56bb3"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:38.605040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d3ffdd4b-1cd5-4acb-8979-af7316f91b6f req-7d503a0e-c7d6-408c-88a7-2da018e5669c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.605835 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d3ffdd4b-1cd5-4acb-8979-af7316f91b6f req-7d503a0e-c7d6-408c-88a7-2da018e5669c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.606671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d3ffdd4b-1cd5-4acb-8979-af7316f91b6f req-7d503a0e-c7d6-408c-88a7-2da018e5669c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.624478 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d3ffdd4b-1cd5-4acb-8979-af7316f91b6f req-7d503a0e-c7d6-408c-88a7-2da018e5669c service nova] Creating event network-vif-deleted:b79223c3-6d67-4e99-86b7-a39df9a56bb3 for instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 on n-h1-854924-5 Aug 30 04:27:38.635892 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d3ffdd4b-1cd5-4acb-8979-af7316f91b6f req-7d503a0e-c7d6-408c-88a7-2da018e5669c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069485 Aug 30 04:27:38.637468 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3589/7058] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:38.668666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:38.678521 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-078996aa-f2cd-4276-936d-c65080209529 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 200 len: 1517 microversion: 2.1 time: 0.179054 Aug 30 04:27:38.689898 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3470/7059] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:39.701637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.702484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: afc075b2-bd06-4bc4-9c0a-cf6e51a93f11] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:39.709101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.709631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.710087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.713441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.714499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.715629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.733874 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] HTTP exception thrown: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 could not be found. Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Request method failure captured: Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 HTTP/1.1 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZGQN-dTj0kWMoDvabd1LuEvtJ8SMVVUz6W28TW3QXJvo5gWAArh2Bh-vZijqDwp3-QmEJaTfPN-h2uhlyCR0YlTBdikC-RYoI9g4wEw_dODZdVH-q5srvE1sK5C2eCohtFet_oowKqtVgSugacQcaWKNwxY8lw9N377Fc6360qFFJg Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9fd8cb9d47b349c28acfafe3da1ef76d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}] Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9473af6ef78d4ab08ea93be235ee2796 Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 could not be found. Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'afc075b2-bd06-4bc4-9c0a-cf6e51a93f11'} Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 could not be found. Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 could not be found. Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:39.735583 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 could not be found. Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Returning 404 to user: Instance afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-726c2e25-02ad-4848-98c1-7475dc3d5ec6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11" status: 404 len: 111 microversion: 2.1 time: 0.040540 Aug 30 04:27:39.740350 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3590/7060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:39 2022] GET /compute/v2.1/servers/afc075b2-bd06-4bc4-9c0a-cf6e51a93f11 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:39.746165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f65e7bf8-485d-4f92-9a1f-cebd9e86418c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '.version_select at 0x7f89784f3820>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.771423 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f65e7bf8-485d-4f92-9a1f-cebd9e86418c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-980255896" status: 202 len: 0 microversion: 2.1 time: 0.029179 Aug 30 04:27:39.772167 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3471/7061] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 04:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-980255896 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:27:39.791846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-885f4bb3-fc67-4a66-8711-8f0523f760ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: .version_select at 0x7f897b240790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1188389649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn0uDMOH4J/rjbxePXRqscHoPWE6NPcZOXXTCI2MtJKWGFMKKkV9QRaAqrS5qRSbe1jL/tkXjU0GoAtxmwEP1Wpm7c0hubS2bvnyio/MpFHfQOF1eLNoeN/KxdyRCtczw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:39.817290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-885f4bb3-fc67-4a66-8711-8f0523f760ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:39.825417 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-885f4bb3-fc67-4a66-8711-8f0523f760ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for user 9473af6ef78d4ab08ea93be235ee2796 and project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:39.854746 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-885f4bb3-fc67-4a66-8711-8f0523f760ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.067129 Aug 30 04:27:39.855360 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3591/7062] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:27:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:39.906517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-191258660", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1188389649", "networks": [{"uuid": "fdd56106-82eb-4842-818c-9b807505a8d8"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:39.965769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] validate_networks() for [('fdd56106-82eb-4842-818c-9b807505a8d8', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:27:40.361244 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:40.361595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:40.362031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:40.362466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:40.362752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:40.372247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.372735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.373176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.373951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.374411 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.374842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.393066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:40.398377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for user 9473af6ef78d4ab08ea93be235ee2796 and project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:40.410801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:40.413245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:40.462271 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cf158524-8902-467b-86d7-dfc0c6c9e955 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559657 Aug 30 04:27:40.462964 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3472/7063] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:40.474165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10ff009e-9bc0-4301-a606-3d1332a08f70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.474779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10ff009e-9bc0-4301-a606-3d1332a08f70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.542258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-10ff009e-9bc0-4301-a606-3d1332a08f70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.553870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10ff009e-9bc0-4301-a606-3d1332a08f70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1262 microversion: 2.1 time: 0.083501 Aug 30 04:27:40.554849 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3592/7064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:41.588863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:41.589418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:41.595688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.596188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.596842 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.597583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.598048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.598495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.668587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:41.677597 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a29f719a-6dfa-4252-9b25-c02a087d543f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1314 microversion: 2.1 time: 0.094228 Aug 30 04:27:41.689556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3473/7065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:41 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1314 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:42.701577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:42.702515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:42.710616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.711032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.711717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.712625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.713092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.713556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.856713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.865010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9903a8c8-cdf8-4d09-8648-7d4dd8e85fd1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.167663 Aug 30 04:27:42.865707 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3593/7066] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:42 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:43.270250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-643e98c7-3409-49c0-9bed-07d74894c02d req-ddbf1380-e95a-452e-bfbf-bfb4cc3c05c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6c12a8-4bb5-4cae-818d-2a87d771f430", "tag": "955a3b2c-20cc-4898-a1fa-33994afc4e7d"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:43.288689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-643e98c7-3409-49c0-9bed-07d74894c02d req-ddbf1380-e95a-452e-bfbf-bfb4cc3c05c2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.289234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-643e98c7-3409-49c0-9bed-07d74894c02d req-ddbf1380-e95a-452e-bfbf-bfb4cc3c05c2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.290264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-643e98c7-3409-49c0-9bed-07d74894c02d req-ddbf1380-e95a-452e-bfbf-bfb4cc3c05c2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.305151 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-643e98c7-3409-49c0-9bed-07d74894c02d req-ddbf1380-e95a-452e-bfbf-bfb4cc3c05c2 service nova] Creating event network-changed:955a3b2c-20cc-4898-a1fa-33994afc4e7d for instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 on n-h1-854924-5 Aug 30 04:27:43.310687 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-643e98c7-3409-49c0-9bed-07d74894c02d req-ddbf1380-e95a-452e-bfbf-bfb4cc3c05c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047605 Aug 30 04:27:43.311825 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3474/7067] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:43.887688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.888286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.898488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.898488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.898488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.899657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.900242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.900574 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.038643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:44.047004 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0ffbd6f5-08b0-42cc-b4c8-230896e0f894 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.163975 Aug 30 04:27:44.047740 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3594/7068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:45.069697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.070941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.077271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.077804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.078255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.078965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.079431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.079877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.220521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:45.229536 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9f621359-f952-4b4d-8c2c-2169a0600cc3 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.164913 Aug 30 04:27:45.230117 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3475/7069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:45 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:46.250667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:46.251198 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:46.258995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.259487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.259917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.260613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.261066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.261522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.412675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:46.420826 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6f62bf13-2536-401d-b18b-ccbad95164ce tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.174115 Aug 30 04:27:46.421435 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3595/7070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:46 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:47.444097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.444792 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.451459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.451958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.452407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.453103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.453595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.454094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.590590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:47.598305 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5246554c-7551-4fea-a63f-b5a0958bcda7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.158894 Aug 30 04:27:47.598888 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3476/7071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:48.619361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:48.619988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:48.627222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.627719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.628161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.628866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.629321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.629776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.771630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:48.780294 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-86cd842d-fdb9-4a6c-a084-c72ccbeaec9f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.164997 Aug 30 04:27:48.781064 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3596/7072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:48 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:49.801249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:49.801900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:49.811306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.811807 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.812252 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.812957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.813450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.813886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.965705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:49.973861 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b923054b-6642-4266-bfb1-085a444e0186 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.176416 Aug 30 04:27:49.974440 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3477/7073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:49 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:50.416715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-027482a6-fa4e-423d-8507-5cc2f64c001e req-84bbc5d0-ba7c-483f-8d6b-0534beca6103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6c12a8-4bb5-4cae-818d-2a87d771f430", "name": "network-vif-plugged", "status": "completed", "tag": "955a3b2c-20cc-4898-a1fa-33994afc4e7d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:50.427547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-027482a6-fa4e-423d-8507-5cc2f64c001e req-84bbc5d0-ba7c-483f-8d6b-0534beca6103 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.428037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-027482a6-fa4e-423d-8507-5cc2f64c001e req-84bbc5d0-ba7c-483f-8d6b-0534beca6103 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.428500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-027482a6-fa4e-423d-8507-5cc2f64c001e req-84bbc5d0-ba7c-483f-8d6b-0534beca6103 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.440591 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-027482a6-fa4e-423d-8507-5cc2f64c001e req-84bbc5d0-ba7c-483f-8d6b-0534beca6103 service nova] Creating event network-vif-plugged:955a3b2c-20cc-4898-a1fa-33994afc4e7d for instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 on n-h1-854924-5 Aug 30 04:27:50.446196 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-027482a6-fa4e-423d-8507-5cc2f64c001e req-84bbc5d0-ba7c-483f-8d6b-0534beca6103 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Aug 30 04:27:50.446990 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3597/7074] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:50.997068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:50.997751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:50.999996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:51.000676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:51.008030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.008777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.009227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.009994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.010554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.011049 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.141827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:51.149567 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4dfcedfe-dd80-4b4e-9406-c1c33162d283 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.156940 Aug 30 04:27:51.150147 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3478/7075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:50 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:52.167978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:52.173409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:52.174158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:52.181412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:52.181904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:52.182338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:52.183034 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:52.183489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:52.183916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:52.336457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:52.344583 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-527b2117-64c8-4624-b5c6-cb9619822a96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1362 microversion: 2.1 time: 0.177623 Aug 30 04:27:52.345148 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3598/7076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:52 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:53.366135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:53.366849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.373743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.374246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.374701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.375400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.375867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.376305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.504915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:53.513503 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6fb69ebb-4800-4a83-907e-c29c9630159d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1555 microversion: 2.1 time: 0.151266 Aug 30 04:27:53.514094 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3479/7077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:53 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:53.534103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:53.534723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.541658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.542148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.542588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.543336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.543791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.544218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.685144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:53.693510 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fa9e64ce-3334-46c5-b101-00aaf7b73ba0 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1555 microversion: 2.1 time: 0.163170 Aug 30 04:27:53.694123 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3599/7078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:53 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:55.231795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ccd30a6-e30f-4c3a-8651-17fe8c9dff79"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:55.234178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:55.241077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:55.241615 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:55.242094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:55.242796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:55.243256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:55.243692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:55.525714 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-563501c5-2a93-4c54-89b1-9102f01a4de6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297698 Aug 30 04:27:55.526434 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3480/7079] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:27:55 2022] POST /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:06.271300 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:06.271842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:06.275427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:06.276423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:06.287769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.288560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.289844 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.291050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.291858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.292588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.387544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lazy-loading 'services' on Instance uuid cf6c12a8-4bb5-4cae-818d-2a87d771f430 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:06.462626 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-01441e64-1b16-470f-8e40-1d9d59ef8c4f tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments/6ccd30a6-e30f-4c3a-8651-17fe8c9dff79" status: 202 len: 0 microversion: 2.1 time: 0.195538 Aug 30 04:28:06.463242 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3600/7080] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:28:06 2022] DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments/6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:28:06.470044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:06.471320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:06.476537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:06.478565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:06.487571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.487571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.491046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.491046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.491046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.491046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.523598 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3e35cb1d-98ae-4125-8b3b-529ef3448c58 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055476 Aug 30 04:28:06.524185 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3481/7081] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:06 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:07.540003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:07.543951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:07.551973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:07.552469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:07.552908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:07.553651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:07.554212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:07.554585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:07.595807 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30bf8ebd-19c2-4873-b547-c7acd11cefaf tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063125 Aug 30 04:28:07.596654 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3601/7082] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:07 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:08.609089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:08.611429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:08.619846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.620356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.620805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.621567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.622036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.622479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.669229 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3cee38d4-3771-48c5-9d2f-ae3d3942152b tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064357 Aug 30 04:28:08.670022 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3482/7083] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:08 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:09.683796 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:09.686212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:09.693572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:09.694065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:09.694501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:09.695230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:09.695685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:09.696107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:09.727807 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3a070d38-c44c-48e5-a856-bd6eb31acb84 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049402 Aug 30 04:28:09.728440 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3602/7084] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:09 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:10.740288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:10.742591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:10.749403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.749901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.750349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.751045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.751505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.751935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.783018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d4a146bc-8c64-4b9b-baf7-11b3e3bb94ff tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 Aug 30 04:28:10.783608 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3483/7085] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:10 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:11.796949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:11.799281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:11.808298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.808298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.808298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.808897 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.809381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.809795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.848786 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd898b1b-ed3a-4224-9663-4026b85903c4 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056312 Aug 30 04:28:11.849406 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3603/7086] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:11 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:28:11.861146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:11.861773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:11.871186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.872084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.872855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.874154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.875022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.875815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.972164 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] HTTP exception thrown: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 is not attached to volume 6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Request method failure captured: Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments/6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 HTTP/1.1 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZGQN-dTj0kWMoDvabd1LuEvtJ8SMVVUz6W28TW3QXJvo5gWAArh2Bh-vZijqDwp3-QmEJaTfPN-h2uhlyCR0YlTBdikC-RYoI9g4wEw_dODZdVH-q5srvE1sK5C2eCohtFet_oowKqtVgSugacQcaWKNwxY8lw9N377Fc6360qFFJg Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9fd8cb9d47b349c28acfafe3da1ef76d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}] Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9473af6ef78d4ab08ea93be235ee2796 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 is not attached to volume 6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': 'cf6c12a8-4bb5-4cae-818d-2a87d771f430', 'id': '6ccd30a6-e30f-4c3a-8651-17fe8c9dff79'} Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6ccd30a6-e30f-4c3a-8651-17fe8c9dff79. Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 is not attached to volume 6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:11.973865 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 is not attached to volume 6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Returning 404 to user: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 is not attached to volume 6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-babcddb4-5817-4083-8c7d-21ab3a8ad9e8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments/6ccd30a6-e30f-4c3a-8651-17fe8c9dff79" status: 404 len: 154 microversion: 2.1 time: 0.118447 Aug 30 04:28:11.978786 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3484/7087] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:28:11 2022] DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430/os-volume_attachments/6ccd30a6-e30f-4c3a-8651-17fe8c9dff79 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:28:15.402097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:15.402097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.409117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.409637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.410072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.410776 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.411321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.411655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.438743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:15.527005 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f1ad140-8c27-4108-90b3-4ecee8790282 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 204 len: 0 microversion: 2.1 time: 0.128735 Aug 30 04:28:15.527615 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3604/7088] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:15 2022] DELETE /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:28:15.541517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:15.542756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.556157 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.557037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.557848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.559175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.560016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.560576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.721918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:15.736170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dd930cca-5be0-48ea-bc37-852410904d70 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1561 microversion: 2.1 time: 0.202658 Aug 30 04:28:15.741528 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3485/7089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:15 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:16.761837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:16.763140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:16.770296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.770793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.771234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.771941 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.772401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.772930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.920520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:16.928868 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-918a03d2-49f4-4e4b-be62-fe292512f381 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1561 microversion: 2.1 time: 0.173626 Aug 30 04:28:16.930087 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3605/7090] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:16 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:17.953212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:17.953875 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:17.961534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.962044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.962491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.963207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.963671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.964110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.100586 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:18.109162 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8bf18a17-328d-4b68-9644-5f6132500368 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1561 microversion: 2.1 time: 0.159838 Aug 30 04:28:18.109162 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3486/7091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:17 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:18.774651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-15a89fd7-eb15-49c4-b435-9133d4f583a9 req-233a9d10-f7a8-4b70-9ae2-9ae2f6ca31aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6c12a8-4bb5-4cae-818d-2a87d771f430", "name": "network-vif-deleted", "tag": "955a3b2c-20cc-4898-a1fa-33994afc4e7d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:18.785285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15a89fd7-eb15-49c4-b435-9133d4f583a9 req-233a9d10-f7a8-4b70-9ae2-9ae2f6ca31aa service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.785797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15a89fd7-eb15-49c4-b435-9133d4f583a9 req-233a9d10-f7a8-4b70-9ae2-9ae2f6ca31aa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.786224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-15a89fd7-eb15-49c4-b435-9133d4f583a9 req-233a9d10-f7a8-4b70-9ae2-9ae2f6ca31aa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.802143 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-15a89fd7-eb15-49c4-b435-9133d4f583a9 req-233a9d10-f7a8-4b70-9ae2-9ae2f6ca31aa service nova] Creating event network-vif-deleted:955a3b2c-20cc-4898-a1fa-33994afc4e7d for instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 on n-h1-854924-5 Aug 30 04:28:18.807945 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-15a89fd7-eb15-49c4-b435-9133d4f583a9 req-233a9d10-f7a8-4b70-9ae2-9ae2f6ca31aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Aug 30 04:28:18.809488 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3606/7092] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:19.130921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:19.131542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:19.139290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.139785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.140233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.140930 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.141418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.141855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.175186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.175940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.176566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.177483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lazy-loading 'fault' on Instance uuid cf6c12a8-4bb5-4cae-818d-2a87d771f430 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:19.229942 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.236089 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0d5ddec2-f82b-49e8-aa98-47d7db60bb17 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 200 len: 1352 microversion: 2.1 time: 0.109329 Aug 30 04:28:19.236676 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3487/7093] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:19 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:20.260755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.261434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: cf6c12a8-4bb5-4cae-818d-2a87d771f430] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.267884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.268381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.268853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.269666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.270123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.270604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.287391 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] HTTP exception thrown: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 could not be found. Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Request method failure captured: Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 HTTP/1.1 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZGQN-dTj0kWMoDvabd1LuEvtJ8SMVVUz6W28TW3QXJvo5gWAArh2Bh-vZijqDwp3-QmEJaTfPN-h2uhlyCR0YlTBdikC-RYoI9g4wEw_dODZdVH-q5srvE1sK5C2eCohtFet_oowKqtVgSugacQcaWKNwxY8lw9N377Fc6360qFFJg Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9fd8cb9d47b349c28acfafe3da1ef76d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}] Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 9473af6ef78d4ab08ea93be235ee2796 Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 could not be found. Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'cf6c12a8-4bb5-4cae-818d-2a87d771f430'} Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 could not be found. Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 could not be found. Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:20.289740 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 could not be found. Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Returning 404 to user: Instance cf6c12a8-4bb5-4cae-818d-2a87d771f430 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fea0467a-3b4c-4215-bf41-7e95332f5c3a tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430" status: 404 len: 111 microversion: 2.1 time: 0.035947 Aug 30 04:28:20.294676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3607/7094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/cf6c12a8-4bb5-4cae-818d-2a87d771f430 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:20.300154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fbe5983b-5469-4f19-acd6-9073ab6ef8e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '.version_select at 0x7f89784dca60>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.321823 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fbe5983b-5469-4f19-acd6-9073ab6ef8e1 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1188389649" status: 202 len: 0 microversion: 2.1 time: 0.025393 Aug 30 04:28:20.322411 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3488/7095] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 04:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1188389649 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:28:20.342002 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-39a81afc-15f9-478f-a46f-482271e95880 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: .version_select at 0x7f897b50b940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1484355604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOahD5bMkTiwivJD2NEFR5HjOIuNZga4tqPEjjrSqrfbgcDKTGudOZ8ObI0wJ8VdkXvcuv+VU5JK5JTtQW7bjF/z+PJJ6lcm0AsrK9TaYWS70/XYEiGFK+E2VBWRUmqGA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:20.358740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-39a81afc-15f9-478f-a46f-482271e95880 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:20.363865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-39a81afc-15f9-478f-a46f-482271e95880 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for user 9473af6ef78d4ab08ea93be235ee2796 and project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:20.389635 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-39a81afc-15f9-478f-a46f-482271e95880 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051469 Aug 30 04:28:20.390253 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3608/7096] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:28:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:20.442254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1959331729", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1484355604", "networks": [{"uuid": "fdd56106-82eb-4842-818c-9b807505a8d8"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:20.497604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] validate_networks() for [('fdd56106-82eb-4842-818c-9b807505a8d8', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:28:20.907389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:20.907827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:20.908342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:20.908772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:20.909230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:20.918542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.919045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.919499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.920241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.920715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.921153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.938278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:20.943810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Getting quotas for user 9473af6ef78d4ab08ea93be235ee2796 and project 9fd8cb9d47b349c28acfafe3da1ef76d. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:20.963118 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:20.965521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:21.014755 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-848ecfb6-aa62-4025-9969-4db6da2b0035 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576548 Aug 30 04:28:21.015417 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3489/7097] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:28:21.035089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29ef6612-d61e-4828-b4c0-50bffefe8209 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.036208 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29ef6612-d61e-4828-b4c0-50bffefe8209 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.100157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-29ef6612-d61e-4828-b4c0-50bffefe8209 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.108898 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29ef6612-d61e-4828-b4c0-50bffefe8209 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1263 microversion: 2.1 time: 0.081054 Aug 30 04:28:21.109500 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3609/7098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:22.130643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.132148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.141422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.142084 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.142657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.143482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.144056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.144585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.230486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:22.239018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a2b6a12f-e9aa-42b3-bad7-c52dfcda21c6 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1323 microversion: 2.1 time: 0.112476 Aug 30 04:28:22.239719 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3490/7099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:23.261107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:23.261808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:23.269069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.269519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.269975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.270690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.271150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.271582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.515104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.523947 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-be52edf2-7e61-49c0-bcd4-9c71ba62c2af tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.267351 Aug 30 04:28:23.524452 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3610/7100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:23 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:23.674871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6b882d73-9622-4f67-be32-60182b4db28a req-6cc7e06c-6df5-46f3-b237-30c6c468f4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5db641-40e7-480f-9fb6-68530c470869", "tag": "5841b600-da77-4879-8655-c86fc9c06f89"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:23.690503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6b882d73-9622-4f67-be32-60182b4db28a req-6cc7e06c-6df5-46f3-b237-30c6c468f4aa service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.691398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6b882d73-9622-4f67-be32-60182b4db28a req-6cc7e06c-6df5-46f3-b237-30c6c468f4aa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.692190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6b882d73-9622-4f67-be32-60182b4db28a req-6cc7e06c-6df5-46f3-b237-30c6c468f4aa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.706511 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6b882d73-9622-4f67-be32-60182b4db28a req-6cc7e06c-6df5-46f3-b237-30c6c468f4aa service nova] Creating event network-changed:5841b600-da77-4879-8655-c86fc9c06f89 for instance 5b5db641-40e7-480f-9fb6-68530c470869 on n-h2-854924-5 Aug 30 04:28:23.712954 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6b882d73-9622-4f67-be32-60182b4db28a req-6cc7e06c-6df5-46f3-b237-30c6c468f4aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042114 Aug 30 04:28:23.713828 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3491/7101] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:24.546583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:24.547320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:24.555109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.555600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.556037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.556735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.557188 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.557642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.698000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.706153 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4012a980-1bb0-46ed-b75d-51ed3d163871 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.164207 Aug 30 04:28:24.706736 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3611/7102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:24 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:25.730124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:25.730851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:25.737166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.737711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.738167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.738880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.739377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.739794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.873913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.881678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a62ab51d-5e94-4146-b4d7-36e7f65d97f8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.157655 Aug 30 04:28:25.882811 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3492/7103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:25 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:26.903951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.904606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.915416 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.915909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.916348 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.917061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.917558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.917988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.051872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:27.060827 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-30d4777b-f81e-4054-b94c-ad57ca1712f2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.160762 Aug 30 04:28:27.061432 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3612/7104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:28.082696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:28.083384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:28.102523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.103168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.103627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.104358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.104824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.105475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.266917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:28.275625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4ea71c77-9f13-477a-b781-00ba77502b51 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.197090 Aug 30 04:28:28.276224 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3493/7105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:28 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:29.297677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:29.298313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:29.305954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.306451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.306891 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.307602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.308059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.308497 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.445580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.453605 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63e34547-7f48-4c40-863a-7d191a83d950 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.159770 Aug 30 04:28:29.454197 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3613/7106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:29 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:30.208791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b21051b8-3b5a-4f8e-b80c-999826fb020b req-95fad638-9525-4e96-9c3a-fdc386e17414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5db641-40e7-480f-9fb6-68530c470869", "name": "network-vif-plugged", "status": "completed", "tag": "5841b600-da77-4879-8655-c86fc9c06f89"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:30.220683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b21051b8-3b5a-4f8e-b80c-999826fb020b req-95fad638-9525-4e96-9c3a-fdc386e17414 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.221233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b21051b8-3b5a-4f8e-b80c-999826fb020b req-95fad638-9525-4e96-9c3a-fdc386e17414 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.221791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b21051b8-3b5a-4f8e-b80c-999826fb020b req-95fad638-9525-4e96-9c3a-fdc386e17414 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.234452 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b21051b8-3b5a-4f8e-b80c-999826fb020b req-95fad638-9525-4e96-9c3a-fdc386e17414 service nova] Creating event network-vif-plugged:5841b600-da77-4879-8655-c86fc9c06f89 for instance 5b5db641-40e7-480f-9fb6-68530c470869 on n-h2-854924-5 Aug 30 04:28:30.239451 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b21051b8-3b5a-4f8e-b80c-999826fb020b req-95fad638-9525-4e96-9c3a-fdc386e17414 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034400 Aug 30 04:28:30.240072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3494/7107] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:30.475134 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.475883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.482525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.483012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.483449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.484151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.484604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.485028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.621816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.629832 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2c827fe-d8d5-4971-a3c2-68617211928d tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1363 microversion: 2.1 time: 0.158744 Aug 30 04:28:30.630429 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3614/7108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:31.648739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:31.649888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:31.655699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.656420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.663255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.663753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.664202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.664903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.665394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.665834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.802624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.810830 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4249f25-227b-426d-8bfd-bba10e67660e tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1555 microversion: 2.1 time: 0.163119 Aug 30 04:28:31.811434 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3495/7109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:31.836087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.836934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.840256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:31.848557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.849081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.849577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.850491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.850949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.851407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.988057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.996134 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2a74bb66-f3ac-43c3-8fb7-8398df8a3826 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1555 microversion: 2.1 time: 0.165296 Aug 30 04:28:31.996723 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3615/7110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:33.501386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1204730a-1b50-4cd0-ae36-88398ad5b4d2"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:33.503765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:33.511812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.512250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.512698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.513455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.513921 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.514360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.787075 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fb2e54d7-86ab-4934-b18e-2dec06d31781 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "POST /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289697 Aug 30 04:28:33.787844 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3496/7111] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:28:33 2022] POST /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:44.529215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.530111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.534001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:44.534725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:44.542358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.542948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.543370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.544106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.544563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.544987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.641698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lazy-loading 'services' on Instance uuid 5b5db641-40e7-480f-9fb6-68530c470869 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:44.720734 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da311b89-5955-4a33-a2ce-de74487d9316 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments/1204730a-1b50-4cd0-ae36-88398ad5b4d2" status: 202 len: 0 microversion: 2.1 time: 0.196051 Aug 30 04:28:44.721330 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3616/7112] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:28:44 2022] DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments/1204730a-1b50-4cd0-ae36-88398ad5b4d2 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:28:44.728010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:44.728904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:44.733380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.735985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.744935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.745486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.745941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.746675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.747164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.747639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.782512 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e7631c1e-dfa4-4748-8795-67ef361a6cd5 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056389 Aug 30 04:28:44.783076 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3497/7113] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:45.796298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.799145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.805683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.806167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.806600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.807842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.808341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.808761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.841106 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d35549df-efda-4bc1-80ee-e7f538be64c2 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049962 Aug 30 04:28:45.841717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3617/7114] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:46.853815 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:46.856624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:46.863481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.863985 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.864436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.865158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.865656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.866111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.904227 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa9f2514-9866-4f53-9632-ab20ff678b96 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054574 Aug 30 04:28:46.904817 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3498/7115] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:46 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:47.918177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:47.920583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:47.929182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.929715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.930156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.930872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.931328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.931758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.965298 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ac62b87e-84f4-4804-9fd5-648e87f4202c tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052020 Aug 30 04:28:47.966055 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3618/7116] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:47 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:48.980516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:48.982903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.996735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.997087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.997804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.999181 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.999771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.000420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.044447 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6f5008b-485e-4303-b501-6f49314c8c02 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068223 Aug 30 04:28:49.045080 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3499/7117] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:48 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:50.058683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.060809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.068264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.068756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.069200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.069951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.070407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.070837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.108758 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-295cf5d5-a44e-40eb-acdd-9aa8f38569b8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054305 Aug 30 04:28:50.109335 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3619/7118] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:50 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:28:50.124031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.124607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.132288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.132786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.133239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.134231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.134699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.135133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.227983 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] HTTP exception thrown: Instance 5b5db641-40e7-480f-9fb6-68530c470869 is not attached to volume 1204730a-1b50-4cd0-ae36-88398ad5b4d2 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Request method failure captured: Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments/1204730a-1b50-4cd0-ae36-88398ad5b4d2 HTTP/1.1 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZGQN-dTj0kWMoDvabd1LuEvtJ8SMVVUz6W28TW3QXJvo5gWAArh2Bh-vZijqDwp3-QmEJaTfPN-h2uhlyCR0YlTBdikC-RYoI9g4wEw_dODZdVH-q5srvE1sK5C2eCohtFet_oowKqtVgSugacQcaWKNwxY8lw9N377Fc6360qFFJg Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9fd8cb9d47b349c28acfafe3da1ef76d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}] Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9473af6ef78d4ab08ea93be235ee2796 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 5b5db641-40e7-480f-9fb6-68530c470869 is not attached to volume 1204730a-1b50-4cd0-ae36-88398ad5b4d2 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '5b5db641-40e7-480f-9fb6-68530c470869', 'id': '1204730a-1b50-4cd0-ae36-88398ad5b4d2'} Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1204730a-1b50-4cd0-ae36-88398ad5b4d2. Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5db641-40e7-480f-9fb6-68530c470869 is not attached to volume 1204730a-1b50-4cd0-ae36-88398ad5b4d2 Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:50.230143 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5db641-40e7-480f-9fb6-68530c470869 is not attached to volume 1204730a-1b50-4cd0-ae36-88398ad5b4d2 Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Returning 404 to user: Instance 5b5db641-40e7-480f-9fb6-68530c470869 is not attached to volume 1204730a-1b50-4cd0-ae36-88398ad5b4d2 {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-acec56a0-2dc4-4205-aeb8-2169d84e4396 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments/1204730a-1b50-4cd0-ae36-88398ad5b4d2" status: 404 len: 154 microversion: 2.1 time: 0.112604 Aug 30 04:28:50.234271 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3500/7119] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:28:50 2022] DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869/os-volume_attachments/1204730a-1b50-4cd0-ae36-88398ad5b4d2 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:53.616243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:53.616875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:53.624226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.624811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.625317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.626066 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.626519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.626945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.660792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:53.747404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-64d15559-6da6-4bb0-b2a7-2c0003510948 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 204 len: 0 microversion: 2.1 time: 0.134987 Aug 30 04:28:53.748126 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3620/7120] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:53 2022] DELETE /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:28:53.759509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:53.760471 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:53.768973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.769547 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.769961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.771111 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.771609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.772066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.912369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:53.921402 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-742427c5-6eff-4860-91d3-5b478e856cbd tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1561 microversion: 2.1 time: 0.168101 Aug 30 04:28:53.921998 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3501/7121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:53 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:54.944704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.945589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:54.952960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.953493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.953940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.954651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.955110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.955540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.102921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.111206 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d5c06e8d-df54-48bf-af59-68802ee6f279 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1561 microversion: 2.1 time: 0.170890 Aug 30 04:28:55.111794 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3621/7122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:54 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:55.895816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6e9a6aba-a0be-4bfc-8dfc-48eafec508e2 req-a654ec0d-a5c1-4ad4-9c3b-401b92325d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5db641-40e7-480f-9fb6-68530c470869", "name": "network-vif-deleted", "tag": "5841b600-da77-4879-8655-c86fc9c06f89"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:55.907680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6e9a6aba-a0be-4bfc-8dfc-48eafec508e2 req-a654ec0d-a5c1-4ad4-9c3b-401b92325d1d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.908325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6e9a6aba-a0be-4bfc-8dfc-48eafec508e2 req-a654ec0d-a5c1-4ad4-9c3b-401b92325d1d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.908891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6e9a6aba-a0be-4bfc-8dfc-48eafec508e2 req-a654ec0d-a5c1-4ad4-9c3b-401b92325d1d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.923100 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6e9a6aba-a0be-4bfc-8dfc-48eafec508e2 req-a654ec0d-a5c1-4ad4-9c3b-401b92325d1d service nova] Creating event network-vif-deleted:5841b600-da77-4879-8655-c86fc9c06f89 for instance 5b5db641-40e7-480f-9fb6-68530c470869 on n-h2-854924-5 Aug 30 04:28:55.928397 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6e9a6aba-a0be-4bfc-8dfc-48eafec508e2 req-a654ec0d-a5c1-4ad4-9c3b-401b92325d1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110972 Aug 30 04:28:55.929020 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3502/7123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:56.132542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.133165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.140787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.141270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.141743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.142432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.142885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.143942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.177425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.177969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.178410 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.178862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lazy-loading 'fault' on Instance uuid 5b5db641-40e7-480f-9fb6-68530c470869 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:56.225656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9473af6ef78d4ab08ea93be235ee2796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cb9d47b349c28acfafe3da1ef76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.236480 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a7278e1c-4e02-4af9-9182-f6babeea5534 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 200 len: 1353 microversion: 2.1 time: 0.107650 Aug 30 04:28:56.237336 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3622/7124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 1353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:57.259810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.261154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] [instance: 5b5db641-40e7-480f-9fb6-68530c470869] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.267353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.267844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.268290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.268980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.269479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.269918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.282759 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] HTTP exception thrown: Instance 5b5db641-40e7-480f-9fb6-68530c470869 could not be found. Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Request method failure captured: Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 HTTP/1.1 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZGQN-dTj0kWMoDvabd1LuEvtJ8SMVVUz6W28TW3QXJvo5gWAArh2Bh-vZijqDwp3-QmEJaTfPN-h2uhlyCR0YlTBdikC-RYoI9g4wEw_dODZdVH-q5srvE1sK5C2eCohtFet_oowKqtVgSugacQcaWKNwxY8lw9N377Fc6360qFFJg Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9fd8cb9d47b349c28acfafe3da1ef76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9fd8cb9d47b349c28acfafe3da1ef76d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9fd8cb9d47b349c28acfafe3da1ef76d"}]}] Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: 9fd8cb9d47b349c28acfafe3da1ef76d Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-83574165 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 9473af6ef78d4ab08ea93be235ee2796 Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestEncryptedCinderVolumes-83574165-project Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 5b5db641-40e7-480f-9fb6-68530c470869 could not be found. Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '5b5db641-40e7-480f-9fb6-68530c470869'} Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5db641-40e7-480f-9fb6-68530c470869 could not be found. Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5db641-40e7-480f-9fb6-68530c470869 could not be found. Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.284449 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5db641-40e7-480f-9fb6-68530c470869 could not be found. Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Returning 404 to user: Instance 5b5db641-40e7-480f-9fb6-68530c470869 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f00b57d4-5b35-4130-a5bc-9e5cc9221eb7 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869" status: 404 len: 111 microversion: 2.1 time: 0.031443 Aug 30 04:28:57.289543 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3503/7125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/5b5db641-40e7-480f-9fb6-68530c470869 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:57.295221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2b1a250d-d540-45f0-8ad3-89da804a5ca8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] Calling method '.version_select at 0x7f897b240040>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.316041 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2b1a250d-d540-45f0-8ad3-89da804a5ca8 tempest-TestEncryptedCinderVolumes-83574165 tempest-TestEncryptedCinderVolumes-83574165-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1484355604" status: 202 len: 0 microversion: 2.1 time: 0.025193 Aug 30 04:28:57.316651 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3623/7126] 10.222.0.30 () {58 vars in 1278 bytes} [Tue Aug 30 04:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1484355604 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:25.514563 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d20ae1ec-f5c2-4f65-8d97-9a2f2ec00576 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'create', calling method: .version_select at 0x7f897a5a95e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1726363966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDYvHKaICbGXbNrZWTmpVZQTSXsPKp7jE9zPxwO+xAC8hL8UsG8J2xhHlprUWd6QfXNWW/tCOdt4P3nT+GHhXRzYsCzmcJ4GhtHLd03u5VO6OKdMpHxCRA4VHEbKYMmpQ=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:25.520481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:25.521175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=34 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:25.533746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-d20ae1ec-f5c2-4f65-8d97-9a2f2ec00576 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:25.538949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-d20ae1ec-f5c2-4f65-8d97-9a2f2ec00576 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for user 2a0bf65c3ada4b048aeed7a3062a5164 and project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:25.564427 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d20ae1ec-f5c2-4f65-8d97-9a2f2ec00576 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053920 Aug 30 04:29:25.565025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3504/7127] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:29:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:25.616538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:25.617292 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:25.622336 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-321978120", "imageRef": "5883d3cf-44dc-47f0-a6b4-a8500e77bc16", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1726363966", "networks": [{"uuid": "d20cef75-37fc-49f8-88b3-830c6bcb64df"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:25.681590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] validate_networks() for [('d20cef75-37fc-49f8-88b3-830c6bcb64df', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:29:26.065700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:26.066126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:26.066602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:26.067013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:26.067428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:26.077322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.077842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.078278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.079010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:26.079465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:26.079899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.098853 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:26.105309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for user 2a0bf65c3ada4b048aeed7a3062a5164 and project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:26.119110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:26.121640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5883d3cf-44dc-47f0-a6b4-a8500e77bc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:26.169768 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca7ab6d5-ced6-4ece-b9c6-538e2e34f9d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555396 Aug 30 04:29:26.170545 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3624/7128] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:29:26.181308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-716434a4-b14f-4bd0-924e-0b1b72773e4f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:26.182113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-716434a4-b14f-4bd0-924e-0b1b72773e4f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:26.243849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-716434a4-b14f-4bd0-924e-0b1b72773e4f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.252501 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-716434a4-b14f-4bd0-924e-0b1b72773e4f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1258 microversion: 2.1 time: 0.075203 Aug 30 04:29:26.253061 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3505/7129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:26 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:27.277142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.277833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.285566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.286053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.286490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.287181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.287630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.288048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.357084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.366514 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5577fe51-e5ee-4da0-9071-083d8ed2451f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1318 microversion: 2.1 time: 0.093301 Aug 30 04:29:27.367970 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3625/7130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:28.391781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:28.393156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:28.407374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.407678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.411375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.412983 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.414872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.417220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.698507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:28.711031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b15b8890-faac-4747-a84e-d269981526b2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.323354 Aug 30 04:29:28.712185 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3506/7131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:28 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:29.735297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:29.735934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:29.743883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.744367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.744798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.745518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.745969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.746389 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.912980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.920669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8d3cee45-c848-45c3-8617-dc6ad61a1ddf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.189281 Aug 30 04:29:29.921237 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3626/7132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:29 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:30.942791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:30.943412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.951345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.951781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.952240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.952962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.953456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.954100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.105855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:31.113943 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f332122-10e4-42bd-9a92-a9d867532c3b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.175583 Aug 30 04:29:31.114655 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3507/7133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:30 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:32.136452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:32.137055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:32.144665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.145173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.145767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.146463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.146910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.147411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.288374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.296207 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-38bc1897-010f-4d5d-a3ef-e66418972a24 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.164364 Aug 30 04:29:32.296783 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3627/7134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:32 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:33.319759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.320832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:33.329143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.329926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.330123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.330804 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.331319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.331663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.483032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:33.491104 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-676fa681-2687-4665-a839-ce867690c4e8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.177854 Aug 30 04:29:33.491748 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3508/7135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:34.512360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:34.513877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:34.521580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.522072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.522531 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.523185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.523635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.524053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.671756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.681920 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae1ae1db-5a83-4649-8795-7a8581ee91dd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.174122 Aug 30 04:29:34.689703 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3628/7136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:34 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:35.704566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.705180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.712859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.713376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.713823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.714522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.714987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.715423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.865466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:35.873333 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8aba739-bcbd-4c44-8f96-d6fa15971a7e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.172685 Aug 30 04:29:35.873922 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3509/7137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:36.894282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.894909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.897686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:36.898543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:36.904552 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.905088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.905558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.906263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.906722 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.907210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.040940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.048716 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06da4a4e-87c5-4366-a9df-ce00b3a3c992 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.158550 Aug 30 04:29:37.049288 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3629/7138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:38.070549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:38.071707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:38.073600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.079653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.080145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.080589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.081291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.081774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.082207 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.232349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.241134 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5ed1346b-8a6e-44e4-9a5c-0b4d50e67809 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.174625 Aug 30 04:29:38.241776 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3510/7139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:39.263794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:39.265284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:39.273325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.275008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.275692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.278366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.279913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.280666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.433080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:39.441079 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3c70c99f-96d1-4560-a508-4ceaaea8f743 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.181613 Aug 30 04:29:39.441738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3630/7140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:39 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.462623 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:40.463258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:40.470128 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.470611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.471054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.471742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.472205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.472635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.605028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.612759 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9e9b9320-e0cf-4a93-821d-4dc65df3c7a6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.154025 Aug 30 04:29:40.613489 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3511/7141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:41.635080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.636213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:41.642478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.642957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.643388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.644079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.644532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.644954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.781318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:41.789538 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1356691b-9df3-4334-9f8d-e72edb4a3a6a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.159150 Aug 30 04:29:41.790163 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3631/7142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:41 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:42.810856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.811549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:42.818820 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.819327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.819962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.820690 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.822315 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.822753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.962733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.972911 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6376b7d5-1d93-4897-a8b8-e1d8b933e4de tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.166035 Aug 30 04:29:42.973558 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3512/7143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:43.440474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3e6cfce3-44ee-4f5e-97f4-86a849036788 req-aa721983-fb88-4c1e-b55c-b249cd18b7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:43.450995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3e6cfce3-44ee-4f5e-97f4-86a849036788 req-aa721983-fb88-4c1e-b55c-b249cd18b7de service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.451485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3e6cfce3-44ee-4f5e-97f4-86a849036788 req-aa721983-fb88-4c1e-b55c-b249cd18b7de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.451925 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3e6cfce3-44ee-4f5e-97f4-86a849036788 req-aa721983-fb88-4c1e-b55c-b249cd18b7de service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.463842 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3e6cfce3-44ee-4f5e-97f4-86a849036788 req-aa721983-fb88-4c1e-b55c-b249cd18b7de service nova] Creating event network-changed:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:29:43.470252 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3e6cfce3-44ee-4f5e-97f4-86a849036788 req-aa721983-fb88-4c1e-b55c-b249cd18b7de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215058 Aug 30 04:29:43.471165 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3632/7144] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:43.993657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:43.994309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.001185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.001716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.002170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.002872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.003332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.003761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.150470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.158447 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c5009e6b-417d-49fd-af46-8e0fa660453b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.168655 Aug 30 04:29:44.159036 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3513/7145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:43 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:45.180762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.181506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.188836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.189327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.189883 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.190609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.191069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.191493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.325175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:45.333038 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a48ab777-bbcb-4566-a42a-5a8535772865 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.156573 Aug 30 04:29:45.333656 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3633/7146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:46.354406 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:46.355211 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:46.362284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.362784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.363226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.363926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.364385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.364819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.493587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.501164 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-391bf768-1264-4283-bb3e-0737d9a4e2a7 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.151441 Aug 30 04:29:46.501766 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3514/7147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:46 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:47.523407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:47.524535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:47.531456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.531936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.532372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.533083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.533569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.533992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.672841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.681280 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d15b7bc8-6e2e-4034-b53c-4c2a76353511 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.162255 Aug 30 04:29:47.681933 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3634/7148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:47 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:48.706981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.708523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.722190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.722704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.723163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.723888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.724362 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.724805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.856197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.864112 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-de35948a-6609-4825-b70a-eca514e1f713 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.164540 Aug 30 04:29:48.864687 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3515/7149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:49.886239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:49.886869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:49.893723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.894209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.894646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.895391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.895843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.896267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.033291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.040667 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7b074513-da4b-4eb1-b2b9-e230d9608449 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.159112 Aug 30 04:29:50.041264 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3635/7150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:49 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:51.065507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:51.066183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:51.075842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.076344 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.076784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.077556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.078008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.078431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.079100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3f66a017-3663-4886-ba6d-4acb32aaf1a7 req-fdfe31c5-9177-4200-a455-b403cadb2128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "name": "network-vif-plugged", "status": "completed", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:51.088819 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3f66a017-3663-4886-ba6d-4acb32aaf1a7 req-fdfe31c5-9177-4200-a455-b403cadb2128 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.089327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3f66a017-3663-4886-ba6d-4acb32aaf1a7 req-fdfe31c5-9177-4200-a455-b403cadb2128 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.089796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3f66a017-3663-4886-ba6d-4acb32aaf1a7 req-fdfe31c5-9177-4200-a455-b403cadb2128 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.104818 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3f66a017-3663-4886-ba6d-4acb32aaf1a7 req-fdfe31c5-9177-4200-a455-b403cadb2128 service nova] Creating event network-vif-plugged:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:29:51.109888 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3f66a017-3663-4886-ba6d-4acb32aaf1a7 req-fdfe31c5-9177-4200-a455-b403cadb2128 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096785 Aug 30 04:29:51.110869 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3516/7151] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:51.216206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:51.224385 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2d31062-be9b-48ed-97a6-e5ac59db8f9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.164638 Aug 30 04:29:51.225399 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3636/7152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:51 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:52.249134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:52.249798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:52.256347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.256848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.257297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.258889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.259430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.259868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.399261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:52.407198 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-916fc370-18d4-48f2-bb2c-5e9070ce71d8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1358 microversion: 2.1 time: 0.163301 Aug 30 04:29:52.407916 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3517/7153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:52 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.428841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.429519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.436972 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.437500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.437944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.438647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.439108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.439785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.591015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.599612 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d43d0301-51dd-4699-a43d-8d5acbb424a8 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1549 microversion: 2.1 time: 0.174551 Aug 30 04:29:53.600241 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3637/7154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.621331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.621979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.629694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.630195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.630979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.631497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.631839 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.632280 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.765424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.773742 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8f89526-3d5e-4f00-916b-23ae22974a9c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1549 microversion: 2.1 time: 0.156860 Aug 30 04:29:53.774331 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3518/7155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.800532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.805939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.806948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Searching by: {'deleted': False, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0'} {{(pid=122168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:29:53.814076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.814570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.815017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.815800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.816260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.816691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.844214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.multi_cell_list [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:29:53.874805 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-935e583e-b528-429f-90ce-af0e81ac0200 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.078026 Aug 30 04:29:53.875416 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3638/7156] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:53.887915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.888548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.894727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.895231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.895680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.896422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.896891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.897329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.047947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:54.057143 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8984ba8b-4c52-4583-a9c6-a212531e2de3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1549 microversion: 2.1 time: 0.173897 Aug 30 04:29:54.057790 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3519/7157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:55.653170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "995a571c-8518-415e-85d2-6c3742f73e5d"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:55.655579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.658590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:55.664672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.665168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.665639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.666404 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.666865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.667296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.670814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=85 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:55.953753 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-987ff74b-1a42-4d84-81e8-d90748a46300 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304358 Aug 30 04:29:55.954294 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3639/7158] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:29:55 2022] POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:09.011514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.012144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.014834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:09.015515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=80 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:09.022636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.023141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.023590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.024353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.024824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.025258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.158933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:09.167985 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4b75a64d-ee3f-4339-b81b-09bc49c8f41a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1595 microversion: 2.1 time: 0.160839 Aug 30 04:30:09.168586 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3520/7159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1595 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:10.933390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-088fa15b-2003-4074-92f1-93d6d549526f req-ed3c53f8-dea0-4aaa-99b3-e1ca0dd17f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:10.945896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:10.947132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:10.948817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:10.961768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-088fa15b-2003-4074-92f1-93d6d549526f req-ed3c53f8-dea0-4aaa-99b3-e1ca0dd17f54 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.962766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-088fa15b-2003-4074-92f1-93d6d549526f req-ed3c53f8-dea0-4aaa-99b3-e1ca0dd17f54 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.963281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-088fa15b-2003-4074-92f1-93d6d549526f req-ed3c53f8-dea0-4aaa-99b3-e1ca0dd17f54 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.979125 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-088fa15b-2003-4074-92f1-93d6d549526f req-ed3c53f8-dea0-4aaa-99b3-e1ca0dd17f54 service nova] Creating event network-changed:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:30:10.985206 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-088fa15b-2003-4074-92f1-93d6d549526f req-ed3c53f8-dea0-4aaa-99b3-e1ca0dd17f54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060786 Aug 30 04:30:10.986228 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3640/7160] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:12.152445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1465687984"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:12.153171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.162088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.162605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.163061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.163832 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.164309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.164752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.312347 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.network.security_group_api [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Adding security group 0e82ff8c-d888-41b9-8608-8bd3153a42d2 to port 01695204-c298-4b26-beac-79882fbc30da Aug 30 04:30:12.647488 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5966f645-2964-493c-bf95-67b40d202ad2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action" status: 202 len: 0 microversion: 2.1 time: 0.499707 Aug 30 04:30:12.648308 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3521/7161] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:30:12 2022] POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:30:12.658251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.658958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.667376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.667888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.668330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.669414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.669882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.670316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.831501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.839969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-24631419-2f0b-4b1e-9448-bee2fddf1b1d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1760 microversion: 2.1 time: 0.187234 Aug 30 04:30:12.840541 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3641/7162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:13.009279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b28c0380-2414-4a0f-aa99-cf8ba3a16cb3 req-9c25d87e-1f3f-4e65-958c-2b66f6c18971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:13.018746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b28c0380-2414-4a0f-aa99-cf8ba3a16cb3 req-9c25d87e-1f3f-4e65-958c-2b66f6c18971 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.019316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b28c0380-2414-4a0f-aa99-cf8ba3a16cb3 req-9c25d87e-1f3f-4e65-958c-2b66f6c18971 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.019831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b28c0380-2414-4a0f-aa99-cf8ba3a16cb3 req-9c25d87e-1f3f-4e65-958c-2b66f6c18971 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.040785 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b28c0380-2414-4a0f-aa99-cf8ba3a16cb3 req-9c25d87e-1f3f-4e65-958c-2b66f6c18971 service nova] Creating event network-changed:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:30:13.046137 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b28c0380-2414-4a0f-aa99-cf8ba3a16cb3 req-9c25d87e-1f3f-4e65-958c-2b66f6c18971 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040857 Aug 30 04:30:13.046830 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3522/7163] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:47.748840 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:32:47.749850 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:32:47.750569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:47.751301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:47.754218 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 04:32:47.754399 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action (ip 10.222.0.30) !!! Aug 30 04:32:47.756486 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 04:32:47.756610 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action (ip 10.222.0.30) !!! Aug 30 04:32:47.766829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:47.769657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.780385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.780869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.781309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.782062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.782517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.783013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.855596 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a76913f4-37d4-4553-9c69-258d10c5c923 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action" status: 202 len: 0 microversion: 2.1 time: 0.108351 Aug 30 04:32:47.856387 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3642/7164] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:47 2022] POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:47.862769 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99726791-41d9-4ddb-ab1a-77643d1de9ab] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:32:47.863770 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fc55d3c-812f-4698-b96a-6eee9a1778ca] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:32:47.864449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:47.865277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:47.867270 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:32:47.867270 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 (ip 10.222.0.30) !!! Aug 30 04:32:47.868276 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:32:47.868392 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 (ip 10.222.0.30) !!! Aug 30 04:32:47.875768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.877228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.886993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.887604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.888062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.888765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.889233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.889697 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.140305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:48.148729 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eb135bc5-76cb-4cd0-a011-de8f116b3c52 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1762 microversion: 2.1 time: 0.287962 Aug 30 04:32:48.149311 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3523/7165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1762 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:49.172880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.173667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.188149 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40150. Aug 30 04:32:49.194025 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.194515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.194955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.195666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.196120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.196548 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.202262 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40148. Aug 30 04:32:49.410768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.419214 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1fe5e8d3-8be8-49c4-b197-3b1902f58640 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1760 microversion: 2.1 time: 0.252747 Aug 30 04:32:49.419780 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3643/7166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1760 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:34.183622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:34.184412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:34.185409 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:34:34.185551 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action (ip 10.222.0.30) !!! Aug 30 04:34:34.201823 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fc55d3c-812f-4698-b96a-6eee9a1778ca] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40180. Aug 30 04:34:34.202797 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] [99726791-41d9-4ddb-ab1a-77643d1de9ab] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40178. Aug 30 04:34:34.242146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1465687984"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:34.242719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.249834 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.250324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.250767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.251488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.251950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.252386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.382027 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.network.security_group_api [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Removing security group 0e82ff8c-d888-41b9-8608-8bd3153a42d2 from port 01695204-c298-4b26-beac-79882fbc30da Aug 30 04:34:34.707623 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e28810db-65bb-4678-881c-b603e96e8911 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action" status: 202 len: 0 microversion: 2.1 time: 0.526776 Aug 30 04:34:34.708994 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3524/7167] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:34:34 2022] POST /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:34.721950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:34.723059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:34.810366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-aa35cb7c-ee1d-4ab6-b155-09b68c44f58d req-1a5f2dd5-b4af-46e3-abe1-6ae36dcbda76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:34.829820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-aa35cb7c-ee1d-4ab6-b155-09b68c44f58d req-1a5f2dd5-b4af-46e3-abe1-6ae36dcbda76 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.831287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-aa35cb7c-ee1d-4ab6-b155-09b68c44f58d req-1a5f2dd5-b4af-46e3-abe1-6ae36dcbda76 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.832171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-aa35cb7c-ee1d-4ab6-b155-09b68c44f58d req-1a5f2dd5-b4af-46e3-abe1-6ae36dcbda76 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.850042 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-aa35cb7c-ee1d-4ab6-b155-09b68c44f58d req-1a5f2dd5-b4af-46e3-abe1-6ae36dcbda76 service nova] Creating event network-changed:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:34:34.858900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-aa35cb7c-ee1d-4ab6-b155-09b68c44f58d req-1a5f2dd5-b4af-46e3-abe1-6ae36dcbda76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145850 Aug 30 04:34:34.860963 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3644/7168] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:36.344189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.344695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.351845 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.352277 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.352723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.353460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.353937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.354360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.435124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lazy-loading 'services' on Instance uuid 870be1ac-1779-4345-9874-2f2c678a82e4 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:34:36.510576 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c05ce327-3268-47bc-b854-de4837e6302d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments/995a571c-8518-415e-85d2-6c3742f73e5d" status: 202 len: 0 microversion: 2.1 time: 0.170115 Aug 30 04:34:36.511479 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3525/7169] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:34:36 2022] DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments/995a571c-8518-415e-85d2-6c3742f73e5d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:36.522245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.526685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.534120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.535320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.535764 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.536664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.537121 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.537600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.570116 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8ccfd65d-d593-4694-b78f-706b446cd5e9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053373 Aug 30 04:34:36.570699 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3645/7170] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:36.894269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2ff2daac-2de5-44a8-af1f-54724cc7a523 req-f4323303-a147-4be2-a3eb-0d77c57b5790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:36.904028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2ff2daac-2de5-44a8-af1f-54724cc7a523 req-f4323303-a147-4be2-a3eb-0d77c57b5790 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.904511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2ff2daac-2de5-44a8-af1f-54724cc7a523 req-f4323303-a147-4be2-a3eb-0d77c57b5790 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.904952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2ff2daac-2de5-44a8-af1f-54724cc7a523 req-f4323303-a147-4be2-a3eb-0d77c57b5790 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.916974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2ff2daac-2de5-44a8-af1f-54724cc7a523 req-f4323303-a147-4be2-a3eb-0d77c57b5790 service nova] Creating event network-changed:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:34:36.923292 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2ff2daac-2de5-44a8-af1f-54724cc7a523 req-f4323303-a147-4be2-a3eb-0d77c57b5790 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034059 Aug 30 04:34:36.923942 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3526/7171] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:37.587940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:37.601226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:37.610107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.610927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.611363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.612255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.612706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.613118 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.648987 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f8f5dfd-91bc-45df-b0c3-c0eb64303702 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069107 Aug 30 04:34:37.649968 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3646/7172] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:37 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:38.666631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.669408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.682537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.683349 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.684317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.686193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.687422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.688353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.735949 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6bb0d26-99cb-4430-93f3-27fd215379eb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077050 Aug 30 04:34:38.736675 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3527/7173] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:39.749044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:39.751383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:39.758591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.759335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.759781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.760479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.760936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.761376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.793289 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0e40500d-fbb5-493c-8181-0643fc10c50f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048756 Aug 30 04:34:39.793903 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3647/7174] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:40.807095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.809311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.816452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.816956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.817435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.818175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.818624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.819061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.850303 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5c19c0d-a420-46da-9115-afccc45b2c1a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Aug 30 04:34:40.850777 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3528/7175] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:40 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:41.863157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.865318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.872129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.872604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.873674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.874361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.874809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.875226 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.904022 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5f900b3f-3a76-4153-8c2a-ffdc53a9373b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044811 Aug 30 04:34:41.904581 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3648/7176] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:34:41.915022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.915523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.923015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.923505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.923945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.924635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.925117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.925705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.001436 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] HTTP exception thrown: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 is not attached to volume 995a571c-8518-415e-85d2-6c3742f73e5d Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Request method failure captured: Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments/995a571c-8518-415e-85d2-6c3742f73e5d HTTP/1.1 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZIWIZm_m7Z2BoTLe9lg4xZDXJoTiyBevICnqsMPzr80jhdUM9AMhOWSPBKP6vOX3K6vvXn54idefx0YIwaIa6WqxVt2Vyb1jwwIp4L7p0evaYE9zIyvfK_VjFfNd_WbqKFknFKcLZ1-6RzhNZiqTXhdm5DD524I-u29i2bFZBrqyfo Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dbb7a98b7c644b70b65de81fb9acaad0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}] Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 2a0bf65c3ada4b048aeed7a3062a5164 Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 is not attached to volume 995a571c-8518-415e-85d2-6c3742f73e5d Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '870be1ac-1779-4345-9874-2f2c678a82e4', 'id': '995a571c-8518-415e-85d2-6c3742f73e5d'} Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 995a571c-8518-415e-85d2-6c3742f73e5d. Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 is not attached to volume 995a571c-8518-415e-85d2-6c3742f73e5d Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:42.003072 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 is not attached to volume 995a571c-8518-415e-85d2-6c3742f73e5d Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Returning 404 to user: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 is not attached to volume 995a571c-8518-415e-85d2-6c3742f73e5d {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d1ac06b-749f-41b7-b403-00469ee0db10 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments/995a571c-8518-415e-85d2-6c3742f73e5d" status: 404 len: 154 microversion: 2.1 time: 0.093461 Aug 30 04:34:42.007799 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3529/7177] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4/os-volume_attachments/995a571c-8518-415e-85d2-6c3742f73e5d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:45.252343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.253044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.260577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.261068 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.261547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.262249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.262695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.263162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.290998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:45.366645 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e42c5e5-1e88-49c3-b8d6-193c90ceb87a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 204 len: 0 microversion: 2.1 time: 0.117780 Aug 30 04:34:45.367168 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3649/7178] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:45 2022] DELETE /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:45.376426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.377053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.385433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.385944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.386391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.387104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.387565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.387996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.527439 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.535935 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccbbb788-54ef-4037-9e8d-f885e221d81b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1555 microversion: 2.1 time: 0.163612 Aug 30 04:34:45.536512 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3530/7179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:45 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:46.558621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:46.559362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:46.567673 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.568170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.568612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.569310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.569791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.570212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.708946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.719388 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8cb92551-efcd-4aa1-96e4-95c4cc454d15 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1555 microversion: 2.1 time: 0.165010 Aug 30 04:34:46.719979 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3650/7180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:46 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.741276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.742826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.751311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.751911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.752440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.753210 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.753796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.754329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.831051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-5e643b31-665c-4e45-b81a-937aa70d71c2 req-b0069321-e374-4adf-a472-425f96c1edee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "870be1ac-1779-4345-9874-2f2c678a82e4", "name": "network-vif-deleted", "tag": "01695204-c298-4b26-beac-79882fbc30da"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:47.832535 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.841153 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-379a73c0-ab35-4838-be45-12ccec2cb4c9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 200 len: 1513 microversion: 2.1 time: 0.103647 Aug 30 04:34:47.841966 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3531/7181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 1513 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.842529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e643b31-665c-4e45-b81a-937aa70d71c2 req-b0069321-e374-4adf-a472-425f96c1edee service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.843357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e643b31-665c-4e45-b81a-937aa70d71c2 req-b0069321-e374-4adf-a472-425f96c1edee service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.844125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-5e643b31-665c-4e45-b81a-937aa70d71c2 req-b0069321-e374-4adf-a472-425f96c1edee service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.863261 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-5e643b31-665c-4e45-b81a-937aa70d71c2 req-b0069321-e374-4adf-a472-425f96c1edee service nova] Creating event network-vif-deleted:01695204-c298-4b26-beac-79882fbc30da for instance 870be1ac-1779-4345-9874-2f2c678a82e4 on n-h1-854924-5 Aug 30 04:34:47.868290 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-5e643b31-665c-4e45-b81a-937aa70d71c2 req-b0069321-e374-4adf-a472-425f96c1edee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096178 Aug 30 04:34:47.868959 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3651/7182] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:48.861893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.862519 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 870be1ac-1779-4345-9874-2f2c678a82e4] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.869430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.869926 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.870376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.871071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.871540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.871969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.886734 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] HTTP exception thrown: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 could not be found. Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Request method failure captured: Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 HTTP/1.1 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZIWIZm_m7Z2BoTLe9lg4xZDXJoTiyBevICnqsMPzr80jhdUM9AMhOWSPBKP6vOX3K6vvXn54idefx0YIwaIa6WqxVt2Vyb1jwwIp4L7p0evaYE9zIyvfK_VjFfNd_WbqKFknFKcLZ1-6RzhNZiqTXhdm5DD524I-u29i2bFZBrqyfo Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dbb7a98b7c644b70b65de81fb9acaad0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}] Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 2a0bf65c3ada4b048aeed7a3062a5164 Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 could not be found. Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '870be1ac-1779-4345-9874-2f2c678a82e4'} Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 could not be found. Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 could not be found. Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.889002 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 could not be found. Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Returning 404 to user: Instance 870be1ac-1779-4345-9874-2f2c678a82e4 could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f173ebf2-0257-44db-a843-c520f3ec1674 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4" status: 404 len: 111 microversion: 2.1 time: 0.032582 Aug 30 04:34:48.893775 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3532/7183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/870be1ac-1779-4345-9874-2f2c678a82e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:48.902906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f6616649-ff73-4482-896e-805d33879c1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '.version_select at 0x7f897be115e0>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.926260 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f6616649-ff73-4482-896e-805d33879c1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1726363966" status: 202 len: 0 microversion: 2.1 time: 0.029879 Aug 30 04:34:48.926846 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3652/7184] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 04:34:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1726363966 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:58.177771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e49e1e6a-ce2e-4981-bddf-8205e7a91e41 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'create', calling method: .version_select at 0x7f897a569790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1609635380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9Y186FeAQ0+rTqlyM90yiHfsNL8exflYrzgEXSa+RFhdUSUbWFkQT+ahdFy8muFaoAI6/TMTbSbvAEg+d5ZQJABDExmKt6fhWyq+q+I+vHUm4ulgZ18ENFTjOqzMoYzQ=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.194152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e49e1e6a-ce2e-4981-bddf-8205e7a91e41 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:58.200146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e49e1e6a-ce2e-4981-bddf-8205e7a91e41 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for user 2a0bf65c3ada4b048aeed7a3062a5164 and project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:58.227500 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e49e1e6a-ce2e-4981-bddf-8205e7a91e41 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053593 Aug 30 04:34:58.228100 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3533/7185] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:58.276955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:58.281788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1323129869", "imageRef": "4c3230f1-4cdb-4155-898e-0c00b9375d50", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1609635380", "networks": [{"uuid": "d20cef75-37fc-49f8-88b3-830c6bcb64df"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.334145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] validate_networks() for [('d20cef75-37fc-49f8-88b3-830c6bcb64df', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:34:58.772383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:58.772824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:58.773304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:58.773742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:58.774157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:58.783132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.783617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.784051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.784775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.785227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.785680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.803490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:58.808867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Getting quotas for user 2a0bf65c3ada4b048aeed7a3062a5164 and project dbb7a98b7c644b70b65de81fb9acaad0. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:58.821739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:58.824074 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c3230f1-4cdb-4155-898e-0c00b9375d50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:58.870741 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ec5d55c-ea42-4b03-a70f-a0f247cac832 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595524 Aug 30 04:34:58.871315 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3653/7186] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:34:58.879702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:58.884482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a80eae68-c3d2-4303-ab3a-deeb872335e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:58.885209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a80eae68-c3d2-4303-ab3a-deeb872335e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:58.942073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a80eae68-c3d2-4303-ab3a-deeb872335e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:58.948848 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a80eae68-c3d2-4303-ab3a-deeb872335e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1259 microversion: 2.1 time: 0.070612 Aug 30 04:34:58.949630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3534/7187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:58 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:59.970978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:59.971756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:59.978715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.979214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.979643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.980321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:59.980768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:59.981186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.046401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:00.055602 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7f4228a0-2114-44fb-92a9-5d1aa77d9313 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1311 microversion: 2.1 time: 0.089992 Aug 30 04:35:00.056217 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3654/7188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:59 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:01.077652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:01.078878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:01.089915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.090674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.094202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.095220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.095719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.096171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.244212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:01.252126 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e50826ad-b75a-4077-b077-741f76b5c0cd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.178355 Aug 30 04:35:01.252931 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3535/7189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:01 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:02.274225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:02.274838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:02.281911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.282469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.282980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.283758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:02.284274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:02.285007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.430184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:02.438886 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e7f41a1d-93d9-4a78-b6a0-4d9c37002ef6 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.168454 Aug 30 04:35:02.439515 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3655/7190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:02 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:03.461116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.461873 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.468927 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.469449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.469896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.470601 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.471058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.471485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.613447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:03.621188 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8e9fadff-a984-4935-b353-07ff8b076f12 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.164658 Aug 30 04:35:03.621827 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3536/7191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:03 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:04.647901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:04.648821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:04.657203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.657827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.658277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.659185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.659486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.659919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.836521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:04.850471 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aed402a3-665c-49fc-bf9d-93c4bfe79443 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.208593 Aug 30 04:35:04.852061 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3656/7192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:04 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:05.877545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:05.878180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:05.880068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:05.886382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.887184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.888404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.889199 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.889768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.890297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.144627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:06.155986 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b3e95aaa-5098-42ac-b560-2b96e6d9fd6d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.282529 Aug 30 04:35:06.156598 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3537/7193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:05 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:07.192530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:07.193378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:07.196472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:07.203206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:07.203206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:07.203206 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:07.204205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:07.204655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:07.205077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:07.392530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:07.401486 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d117e819-a975-4c60-bc4d-f410eb3f247d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.212666 Aug 30 04:35:07.413370 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3657/7194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:07 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:08.427484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:08.428110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.435527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.436019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.436454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.437184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.437669 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.438102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.565611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:08.573211 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-739750f0-3c39-4e05-a653-996a05c8cf17 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.149694 Aug 30 04:35:08.573808 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3538/7195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:08 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:09.595013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.596456 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.599232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:09.599947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:09.605707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.606192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.606631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.607324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.607778 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.608205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.741493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:09.749822 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-89818472-4b7c-472e-bd2b-e66f00071fed tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.158818 Aug 30 04:35:09.750394 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3658/7196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:09 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:10.771470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:10.772123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:10.773982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:10.780823 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.781317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.781787 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.782483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.782946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.783377 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.918482 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:10.926192 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-935fb123-f546-445d-8f23-b8d3697277da tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.158646 Aug 30 04:35:10.926769 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3539/7197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:10 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:11.946755 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:11.947429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:11.954243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.954723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.955154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.955834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.956288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.956710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:12.083583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:12.092053 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3d7dc0ec-6116-4cf2-b9d1-5c600b5a5037 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.149146 Aug 30 04:35:12.092676 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3659/7198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:11 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:13.113177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:13.113827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:13.121015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.121551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.122565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.123272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:13.124014 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:13.124454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.260559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:13.268898 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90dbe954-bdfa-49b1-a28e-09db8d0a3a75 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.159615 Aug 30 04:35:13.269505 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3540/7199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:13 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:14.289634 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:14.290265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:14.297091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.297617 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.298061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.298768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.299231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.299668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.348090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-55a9120b-d79c-4d43-8d30-41e652ed3aa5 req-bf376d15-cc7e-4578-a08b-7915a9b780d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:14.359424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-55a9120b-d79c-4d43-8d30-41e652ed3aa5 req-bf376d15-cc7e-4578-a08b-7915a9b780d3 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.360266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-55a9120b-d79c-4d43-8d30-41e652ed3aa5 req-bf376d15-cc7e-4578-a08b-7915a9b780d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.360891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-55a9120b-d79c-4d43-8d30-41e652ed3aa5 req-bf376d15-cc7e-4578-a08b-7915a9b780d3 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.373380 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-55a9120b-d79c-4d43-8d30-41e652ed3aa5 req-bf376d15-cc7e-4578-a08b-7915a9b780d3 service nova] Creating event network-changed:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:35:14.380529 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-55a9120b-d79c-4d43-8d30-41e652ed3aa5 req-bf376d15-cc7e-4578-a08b-7915a9b780d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035768 Aug 30 04:35:14.381210 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3541/7200] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:14.447474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:14.456320 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-75d49d69-4815-4a3d-8c88-814ed706ff1f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.170617 Aug 30 04:35:14.456925 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3660/7201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:14 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:15.479154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:15.479866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:15.486200 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:15.486722 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:15.487178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:15.487884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:15.488356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:15.488799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:15.623340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:15.631050 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-11f7d3bd-65cf-4d85-8689-5b21c7f9bc5c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.157156 Aug 30 04:35:15.631628 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3542/7202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:15 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:16.651798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:16.652394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:16.659659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:16.660151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:16.660585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:16.661264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:16.661735 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:16.662159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:16.797866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:16.805548 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e1dcd99-e449-4db2-82c9-4d45e18febff tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.157620 Aug 30 04:35:16.806115 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3661/7203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:16 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:17.826431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:17.826969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:17.834469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:17.834965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:17.835412 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:17.836105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:17.836572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:17.837003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:17.964736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:17.973005 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b048dc2-9df7-40f3-8164-0ea0e39eb4d9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.150547 Aug 30 04:35:17.973630 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3543/7204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:17 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:18.994681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:18.995305 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:19.002867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:19.003356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:19.003798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:19.004654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:19.005171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:19.005635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:19.160342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:19.169230 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b51a080-e18b-472d-951b-ab6f9f0598cf tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.177964 Aug 30 04:35:19.169863 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3662/7205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:18 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:20.191113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:20.191739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:20.198650 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:20.199139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:20.199582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:20.200273 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:20.200731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:20.201159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:20.330267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:20.337894 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6b45bb1b-e848-4a22-90ec-36e982f7a1a0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.150692 Aug 30 04:35:20.338475 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3544/7206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:20 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:20.822900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c80b1d87-e101-478d-abb5-cbd7995ecfb9 req-2a0d0840-63c3-4f13-ba96-972039e7ea0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "name": "network-vif-plugged", "status": "completed", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:20.833898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c80b1d87-e101-478d-abb5-cbd7995ecfb9 req-2a0d0840-63c3-4f13-ba96-972039e7ea0b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:20.834391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c80b1d87-e101-478d-abb5-cbd7995ecfb9 req-2a0d0840-63c3-4f13-ba96-972039e7ea0b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:20.834815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c80b1d87-e101-478d-abb5-cbd7995ecfb9 req-2a0d0840-63c3-4f13-ba96-972039e7ea0b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:20.847068 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c80b1d87-e101-478d-abb5-cbd7995ecfb9 req-2a0d0840-63c3-4f13-ba96-972039e7ea0b service nova] Creating event network-vif-plugged:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:35:20.853039 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c80b1d87-e101-478d-abb5-cbd7995ecfb9 req-2a0d0840-63c3-4f13-ba96-972039e7ea0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089592 Aug 30 04:35:20.853677 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3663/7207] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:21.360647 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:21.361203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:21.368354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:21.368886 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:21.369366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:21.370094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:21.372324 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:21.372851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:21.511068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:21.520057 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0c05498f-8555-47e3-a5bc-45c5dd03fb7d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.164043 Aug 30 04:35:21.520675 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3545/7208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:21 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:22.546029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:22.546821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:22.555996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:22.556485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:22.556923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:22.557782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:22.558268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:22.559244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:22.695997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:22.704632 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-202092c1-832a-4bdf-a725-72a29aa9574f tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1359 microversion: 2.1 time: 0.166235 Aug 30 04:35:22.705410 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3664/7209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:22 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:23.725005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:23.725581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:23.732397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.732887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.733331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.734047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.734506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.734937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.867595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:23.875309 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7e094330-a12b-44e2-bf0a-1a6cae09a2cb tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1550 microversion: 2.1 time: 0.154369 Aug 30 04:35:23.875905 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3546/7210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:23 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:23.896307 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:23.896947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:23.904507 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.904987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.905463 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.906154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.906602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.907021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.041475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.049664 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cabee11d-c34e-4e8c-9338-273af5ae1c81 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1550 microversion: 2.1 time: 0.157218 Aug 30 04:35:24.050280 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3665/7211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:23 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:24.069912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:24.075090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.075854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Searching by: {'deleted': False, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0'} {{(pid=122167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:35:24.081110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.081630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.082068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.082972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.083238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.083664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.108022 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.multi_cell_list [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:35:24.142365 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1e7af90c-7e48-42c6-9bcd-028baffc3156 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075598 Aug 30 04:35:24.143674 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3547/7212] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 04:35:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:24.155000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:24.155611 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:24.161595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.162075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.162505 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.163186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.163640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.164058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.321590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.331483 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-3473de65-5acc-4666-a2b0-2664c02f5d20 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1550 microversion: 2.1 time: 0.180272 Aug 30 04:35:24.332069 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3666/7213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:24 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1550 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:25.862816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d73c9dda-bd3b-4ae2-87a2-38a78ad8441c"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:25.865166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:25.872033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:25.872523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:25.872966 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:25.873689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:25.874155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:25.874584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.154307 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04464d9f-57d3-448d-ab94-8215b9893dec tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295303 Aug 30 04:35:26.154992 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3548/7214] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 04:35:25 2022] POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:36.932667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:36.933898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:36.936832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=19 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:36.937521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=76 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:36.944093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.944587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.945053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.945791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.946246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.946675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.089222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:37.098182 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72bd8cdb-fb71-494c-b81f-8c4b0deac8d0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1596 microversion: 2.1 time: 0.169264 Aug 30 04:35:37.098769 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3667/7215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:36 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1596 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:38.793424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:38.794524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=23 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:38.796170 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:38.812773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6c7af508-b111-4879-a5b0-29f14414ea0f req-3dff8b8b-eb6f-4603-8cd6-21f82c678099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:38.828749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6c7af508-b111-4879-a5b0-29f14414ea0f req-3dff8b8b-eb6f-4603-8cd6-21f82c678099 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.829254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6c7af508-b111-4879-a5b0-29f14414ea0f req-3dff8b8b-eb6f-4603-8cd6-21f82c678099 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.829726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6c7af508-b111-4879-a5b0-29f14414ea0f req-3dff8b8b-eb6f-4603-8cd6-21f82c678099 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:38.849475 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6c7af508-b111-4879-a5b0-29f14414ea0f req-3dff8b8b-eb6f-4603-8cd6-21f82c678099 service nova] Creating event network-changed:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:35:38.859734 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6c7af508-b111-4879-a5b0-29f14414ea0f req-3dff8b8b-eb6f-4603-8cd6-21f82c678099 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069157 Aug 30 04:35:38.866078 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3549/7216] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:40.043732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1845811952"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:40.044285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:40.051142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.051648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.052301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.053102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.053689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.054123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.196149 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Adding security group ef31bc99-0a29-455f-992c-3cac04542160 to port a2f92f1b-68a9-4874-a01c-dbed7638b37f Aug 30 04:35:40.519849 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f57588c1-9af6-4660-86e7-0e41afa62893 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action" status: 202 len: 0 microversion: 2.1 time: 0.479790 Aug 30 04:35:40.523739 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3668/7217] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:35:40 2022] POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:40.531253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:40.532010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:40.540869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.541403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.542059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.543417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.543894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.544353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.699436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:40.708724 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2be70654-8bf3-43d2-84a9-237f39b5f033 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1760 microversion: 2.1 time: 0.183408 Aug 30 04:35:40.709447 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3550/7218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:40 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:40.877392 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e7d56917-f3f4-474e-9cfd-2e0842ee4bf6 req-1982b399-8de8-4401-b9f7-a38f44a35750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:40.887512 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e7d56917-f3f4-474e-9cfd-2e0842ee4bf6 req-1982b399-8de8-4401-b9f7-a38f44a35750 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.887995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e7d56917-f3f4-474e-9cfd-2e0842ee4bf6 req-1982b399-8de8-4401-b9f7-a38f44a35750 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.888437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e7d56917-f3f4-474e-9cfd-2e0842ee4bf6 req-1982b399-8de8-4401-b9f7-a38f44a35750 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.900779 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e7d56917-f3f4-474e-9cfd-2e0842ee4bf6 req-1982b399-8de8-4401-b9f7-a38f44a35750 service nova] Creating event network-changed:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:35:40.905989 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e7d56917-f3f4-474e-9cfd-2e0842ee4bf6 req-1982b399-8de8-4401-b9f7-a38f44a35750 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032311 Aug 30 04:35:40.906880 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3669/7219] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:51.773205 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:51.774121 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:51.775901 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:36:51.776191 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action (ip 10.222.0.30) !!! Aug 30 04:36:51.781754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:51.784082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.794350 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.794838 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.795283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.795988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.796448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.796885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.873383 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d6665dcf-9d1c-4c7a-87a4-4d4a32066100 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action" status: 202 len: 0 microversion: 2.1 time: 0.101804 Aug 30 04:36:51.874483 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3551/7220] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:36:51 2022] POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:36:51.881506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:51.882698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:51.889467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:51.890349 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.898490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.899231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.900241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.900961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.901461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.901899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.058026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:52.067745 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7fedd2b-b445-4b96-9450-a863b502461a tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1752 microversion: 2.1 time: 0.189041 Aug 30 04:36:52.068404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3670/7221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:51 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:53.093156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:53.094078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:53.104230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.105780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.106235 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.107360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.108243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.108891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.276523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.285642 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e46eb1ea-7552-4b50-99fc-0d533a8377f4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.197928 Aug 30 04:36:53.286231 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3552/7222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:54.307598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.308136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:54.315031 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.315598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.315949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.316644 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.317100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.317568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.477732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:54.490741 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9bbaa288-7849-48c3-bdee-6bedebfe163c tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.186882 Aug 30 04:36:54.491621 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3671/7223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:54 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:55.522931 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:55.523543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:55.530733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:55.531230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:55.531674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:55.532382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:55.532836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:55.533266 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:55.677100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:55.686382 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c45d795-3e08-4a72-a517-0ecf24390d1b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.167324 Aug 30 04:36:55.687014 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3553/7224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:55 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:56.711289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:56.712486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:56.720238 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.720731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.721167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.721904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.722352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.722773 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.879157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:56.888667 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-185e222f-6b90-4b40-85e6-c7e1127d1c29 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.181571 Aug 30 04:36:56.889255 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3672/7225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:56 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:57.910158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:57.910783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:57.918513 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:57.919010 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:57.919460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:57.920169 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:57.920629 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:57.921065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:58.067384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:58.075798 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f330c54c-2507-48ef-9788-d0b655213afd tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.169527 Aug 30 04:36:58.076364 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3554/7226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:57 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:59.097607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:59.098240 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:59.105178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:59.105706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:59.106156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:59.106867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:59.107328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:59.107759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:59.256178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:59.265415 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e144291-32c6-4f66-b3ab-65405c42ad9b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.171794 Aug 30 04:36:59.265985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3673/7227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:59 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:00.287565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:00.288155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:00.295935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:00.296427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:00.296871 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:00.297616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:00.298079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:00.298511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:00.481008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:00.489541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dea87a51-13f9-40a4-bcae-0ec15f3d7145 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.206018 Aug 30 04:37:00.490124 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3555/7228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:00 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:01.512280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:01.513010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:01.520379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.520878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.521335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.522064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.522515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.523239 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.703799 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:01.714259 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-80ee0ba1-e049-4735-868e-62ad2935e7d2 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.206473 Aug 30 04:37:01.714923 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3674/7229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:01 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:02.738676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:02.739326 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:02.747036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:02.747530 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:02.747971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:02.748678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:02.749143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:02.749676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:02.897282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:02.905609 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00666089-3d0e-4f45-9111-a563f081b5e4 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.171082 Aug 30 04:37:02.906184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3556/7230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:02 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:03.928093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:03.928705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:03.938353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.938842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.939281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.939988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.940444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.940866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:04.095825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:04.105227 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9f49e00-59cd-47e8-a86e-e69ffe852be9 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1757 microversion: 2.1 time: 0.180979 Aug 30 04:37:04.105853 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3675/7231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:03 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:05.127797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:05.128418 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:05.135230 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.135731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.136225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.137094 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.137607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.138042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.305070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:05.313299 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2443907a-ae30-47be-b893-874589ad5d1e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1760 microversion: 2.1 time: 0.189565 Aug 30 04:37:05.314636 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3557/7232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:05 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1760 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:08.960176 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:38:08.961105 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:38:08.961945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=12 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:08.962681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=36 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:08.966731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1845811952"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:08.967265 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:08.974304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.974717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.975145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.975845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.976295 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.976713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.171984 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.network.security_group_api [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Removing security group ef31bc99-0a29-455f-992c-3cac04542160 from port a2f92f1b-68a9-4874-a01c-dbed7638b37f Aug 30 04:38:09.520639 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0490ef55-837b-4ba0-8d28-0a5f18484834 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action" status: 202 len: 0 microversion: 2.1 time: 0.562312 Aug 30 04:38:09.521890 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3676/7233] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:38:08 2022] POST /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:09.527896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.529164 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.534430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-da4495ea-9777-4a74-8b13-f9e42eceaae2 req-7ed95ea3-e4c1-4e73-bf8b-d8dfefa14e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:09.560012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-da4495ea-9777-4a74-8b13-f9e42eceaae2 req-7ed95ea3-e4c1-4e73-bf8b-d8dfefa14e5b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.560818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-da4495ea-9777-4a74-8b13-f9e42eceaae2 req-7ed95ea3-e4c1-4e73-bf8b-d8dfefa14e5b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.561549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-da4495ea-9777-4a74-8b13-f9e42eceaae2 req-7ed95ea3-e4c1-4e73-bf8b-d8dfefa14e5b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.587682 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-da4495ea-9777-4a74-8b13-f9e42eceaae2 req-7ed95ea3-e4c1-4e73-bf8b-d8dfefa14e5b service nova] Creating event network-changed:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:38:09.599108 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-da4495ea-9777-4a74-8b13-f9e42eceaae2 req-7ed95ea3-e4c1-4e73-bf8b-d8dfefa14e5b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072294 Aug 30 04:38:09.600358 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3558/7234] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:11.199178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:11.200119 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:11.210976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.211488 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.211984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.213161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.213814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.214256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.222356 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40630. Aug 30 04:38:11.238354 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40628. Aug 30 04:38:11.329986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lazy-loading 'services' on Instance uuid 32693c64-bf62-404c-906e-019aaa7e5d48 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:38:11.423446 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [bd9a9c46-90cf-4bc4-bd1c-f72946a24fef] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:38:11.615336 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e0335ca9-204c-4a28-a66f-41b4c4552522 req-6f950501-ce6d-4a07-b263-d26f7d9c246a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:11.627195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e0335ca9-204c-4a28-a66f-41b4c4552522 req-6f950501-ce6d-4a07-b263-d26f7d9c246a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.627701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e0335ca9-204c-4a28-a66f-41b4c4552522 req-6f950501-ce6d-4a07-b263-d26f7d9c246a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.628156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e0335ca9-204c-4a28-a66f-41b4c4552522 req-6f950501-ce6d-4a07-b263-d26f7d9c246a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.641191 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e0335ca9-204c-4a28-a66f-41b4c4552522 req-6f950501-ce6d-4a07-b263-d26f7d9c246a service nova] Creating event network-changed:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:38:11.646488 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e0335ca9-204c-4a28-a66f-41b4c4552522 req-6f950501-ce6d-4a07-b263-d26f7d9c246a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035206 Aug 30 04:38:11.647106 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3559/7235] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:12.431376 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [bd9a9c46-90cf-4bc4-bd1c-f72946a24fef] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40642. Aug 30 04:38:12.435033 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-10cf13de-0686-4c13-a161-961b650f7918 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments/d73c9dda-bd3b-4ae2-87a2-38a78ad8441c" status: 202 len: 0 microversion: 2.1 time: 1.244877 Aug 30 04:38:12.435675 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3677/7236] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:38:11 2022] DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments/d73c9dda-bd3b-4ae2-87a2-38a78ad8441c => generated 0 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:12.446575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:12.448879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:12.458768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.459274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.459891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.460613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.461077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.461561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.494605 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b57a6add-7c51-41f4-b348-8d163922935b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052341 Aug 30 04:38:12.495191 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3560/7237] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:12 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:13.513523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.516989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.524424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.524424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.525370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.526102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.526589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.527021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.560878 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d99b8245-bc58-43d5-95a9-2cccca5e2f3d tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056006 Aug 30 04:38:13.561830 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3678/7238] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:14.576105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.578375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.585618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.586123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.586580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.587359 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.587837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.588278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.623496 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9c593b25-b974-4245-9a3f-dc63e6a93612 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051418 Aug 30 04:38:14.626035 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3561/7239] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:14 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:15.637703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:15.640444 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:15.647513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.648013 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.648457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.649168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.649670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.650093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.688877 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f84871ea-596e-4448-a1c7-ae36ac0a6538 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055760 Aug 30 04:38:15.689797 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3679/7240] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:15 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:16.703917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:16.706272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:16.713212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.713735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.714177 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.714880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.715344 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.715771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.747715 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aaa90a28-8ec7-45d8-a7e8-135f50257dba tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Aug 30 04:38:16.748314 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3562/7241] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:16 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:17.763589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.766501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.776040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.777149 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.777994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.779504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.780100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.780589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.818666 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-66e797ce-44af-4961-aa46-276bab4928e3 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060316 Aug 30 04:38:17.819247 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3680/7242] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:38:17.830446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.831000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.838518 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.839076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.839579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.840347 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.840862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.842050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.072215 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] HTTP exception thrown: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 is not attached to volume d73c9dda-bd3b-4ae2-87a2-38a78ad8441c Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Request method failure captured: Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: request: DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments/d73c9dda-bd3b-4ae2-87a2-38a78ad8441c HTTP/1.1 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZIWIZm_m7Z2BoTLe9lg4xZDXJoTiyBevICnqsMPzr80jhdUM9AMhOWSPBKP6vOX3K6vvXn54idefx0YIwaIa6WqxVt2Vyb1jwwIp4L7p0evaYE9zIyvfK_VjFfNd_WbqKFknFKcLZ1-6RzhNZiqTXhdm5DD524I-u29i2bFZBrqyfo Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dbb7a98b7c644b70b65de81fb9acaad0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}] Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 2a0bf65c3ada4b048aeed7a3062a5164 Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 is not attached to volume d73c9dda-bd3b-4ae2-87a2-38a78ad8441c Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'server_id': '32693c64-bf62-404c-906e-019aaa7e5d48', 'id': 'd73c9dda-bd3b-4ae2-87a2-38a78ad8441c'} Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d73c9dda-bd3b-4ae2-87a2-38a78ad8441c. Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 is not attached to volume d73c9dda-bd3b-4ae2-87a2-38a78ad8441c Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:18.075405 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 is not attached to volume d73c9dda-bd3b-4ae2-87a2-38a78ad8441c Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Returning 404 to user: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 is not attached to volume d73c9dda-bd3b-4ae2-87a2-38a78ad8441c {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db3859de-c801-4a72-a98d-32e84f0b9147 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments/d73c9dda-bd3b-4ae2-87a2-38a78ad8441c" status: 404 len: 154 microversion: 2.1 time: 0.251028 Aug 30 04:38:18.082625 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3563/7243] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 04:38:17 2022] DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48/os-volume_attachments/d73c9dda-bd3b-4ae2-87a2-38a78ad8441c => generated 154 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:21.367016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.367601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.375503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.376039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.376482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.377245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.377811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.378274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.405275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:21.485808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4ca2267c-bd32-40b8-b26b-52df58d87dc0 tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 204 len: 0 microversion: 2.1 time: 0.122428 Aug 30 04:38:21.486422 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3681/7244] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:21 2022] DELETE /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:21.495102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.495774 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.504532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.505040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.505532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.506247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.506720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.507162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.656461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:21.664467 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-740924b3-a935-449f-8fc7-160c0a21d2ac tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1556 microversion: 2.1 time: 0.173544 Aug 30 04:38:21.665078 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3564/7245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:21 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:22.686973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:22.687677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:22.694779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.695274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.695720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.696424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.696886 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.697320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.847934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:22.856371 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2c7ad697-5e64-432e-8d5b-970e1522f84e tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1556 microversion: 2.1 time: 0.173790 Aug 30 04:38:22.856980 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3682/7246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:22 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:23.878112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:23.880651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:23.894592 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.895515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.896255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.897824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.898526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.899126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.920256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-dc2e286a-ad1e-4b04-a4cd-3c8560150bd2 req-024acaab-c299-4675-a3ad-0ca0c1b7b9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32693c64-bf62-404c-906e-019aaa7e5d48", "name": "network-vif-deleted", "tag": "a2f92f1b-68a9-4874-a01c-dbed7638b37f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:23.948434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dc2e286a-ad1e-4b04-a4cd-3c8560150bd2 req-024acaab-c299-4675-a3ad-0ca0c1b7b9e8 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.949274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dc2e286a-ad1e-4b04-a4cd-3c8560150bd2 req-024acaab-c299-4675-a3ad-0ca0c1b7b9e8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.951916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dc2e286a-ad1e-4b04-a4cd-3c8560150bd2 req-024acaab-c299-4675-a3ad-0ca0c1b7b9e8 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.968976 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-dc2e286a-ad1e-4b04-a4cd-3c8560150bd2 req-024acaab-c299-4675-a3ad-0ca0c1b7b9e8 service nova] Creating event network-vif-deleted:a2f92f1b-68a9-4874-a01c-dbed7638b37f for instance 32693c64-bf62-404c-906e-019aaa7e5d48 on n-h1-854924-5 Aug 30 04:38:23.975253 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-dc2e286a-ad1e-4b04-a4cd-3c8560150bd2 req-024acaab-c299-4675-a3ad-0ca0c1b7b9e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059062 Aug 30 04:38:23.976304 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3683/7247] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:23.993196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0bf65c3ada4b048aeed7a3062a5164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7a98b7c644b70b65de81fb9acaad0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:24.004377 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f262bfc-74a5-46dc-8769-184ea58a95ab tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 200 len: 1514 microversion: 2.1 time: 0.130076 Aug 30 04:38:24.005334 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3565/7248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:23 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 1514 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:25.027947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:25.028561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [instance: 32693c64-bf62-404c-906e-019aaa7e5d48] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:25.034924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.035412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.035852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.036586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.037041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.037503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.050902 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] HTTP exception thrown: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 could not be found. Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Request method failure captured: Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 HTTP/1.1 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZIWIZm_m7Z2BoTLe9lg4xZDXJoTiyBevICnqsMPzr80jhdUM9AMhOWSPBKP6vOX3K6vvXn54idefx0YIwaIa6WqxVt2Vyb1jwwIp4L7p0evaYE9zIyvfK_VjFfNd_WbqKFknFKcLZ1-6RzhNZiqTXhdm5DD524I-u29i2bFZBrqyfo Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dbb7a98b7c644b70b65de81fb9acaad0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dbb7a98b7c644b70b65de81fb9acaad0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dbb7a98b7c644b70b65de81fb9acaad0"}]}] Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: dbb7a98b7c644b70b65de81fb9acaad0 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestMinimumBasicScenario-889231428 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 2a0bf65c3ada4b048aeed7a3062a5164 Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestMinimumBasicScenario-889231428-project Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 could not be found. Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '32693c64-bf62-404c-906e-019aaa7e5d48'} Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 could not be found. Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 could not be found. Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:25.052543 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 could not be found. Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Returning 404 to user: Instance 32693c64-bf62-404c-906e-019aaa7e5d48 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc0202bc-6bb0-4df5-8c4c-a0098581816b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48" status: 404 len: 111 microversion: 2.1 time: 0.031301 Aug 30 04:38:25.057579 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3684/7249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:25 2022] GET /compute/v2.1/servers/32693c64-bf62-404c-906e-019aaa7e5d48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:25.063321 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-61e9c550-0e2b-4bab-bb23-58838910150b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] Calling method '.version_select at 0x7f897ae7b790>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:25.068051 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-61e9c550-0e2b-4bab-bb23-58838910150b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [b3d1b355-481b-4834-98b2-8aef1d06fbab] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:38:26.078486 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [None req-61e9c550-0e2b-4bab-bb23-58838910150b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] [b3d1b355-481b-4834-98b2-8aef1d06fbab] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40686. Aug 30 04:38:26.101038 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-61e9c550-0e2b-4bab-bb23-58838910150b tempest-TestMinimumBasicScenario-889231428 tempest-TestMinimumBasicScenario-889231428-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1609635380" status: 202 len: 0 microversion: 2.1 time: 1.041762 Aug 30 04:38:26.102122 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3566/7250] 10.222.0.30 () {58 vars in 1272 bytes} [Tue Aug 30 04:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1609635380 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:36.128470 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:38:36.129034 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.30) !!! Aug 30 04:38:36.129735 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:38:36.129875 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.30) !!! Aug 30 04:38:36.130717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:36.131396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:36.313646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-da94dc04-ea0b-4d8e-974f-fa64bc1f0bb6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: .version_select at 0x7f897b7b1f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1870169349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbAKvL1D7JQlPHT0s679Gbd0omD7Rj8eo5pIztnEJI3WVWF3eFEeWzypytUFEi1+SkRCiXVQabMV+RPOscmixq9VRsq7YLjUlAgwMXf0eaAXJNMo2XjkXJgrbYcfd8oOw=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:36.328831 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-da94dc04-ea0b-4d8e-974f-fa64bc1f0bb6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:36.333944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-da94dc04-ea0b-4d8e-974f-fa64bc1f0bb6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:36.364470 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-da94dc04-ea0b-4d8e-974f-fa64bc1f0bb6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.242408 Aug 30 04:38:36.365130 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3685/7251] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:38:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:42.967894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=40 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:42.969031 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:42.974603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-475921713", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "5fc3f648-aebe-43f4-a024-bbdde77b0801"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1870169349", "security_groups": [{"name": "tempest-secgroup-smoke-136396379"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:43.162062 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] validate_networks() for [('5fc3f648-aebe-43f4-a024-bbdde77b0801', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:38:43.784160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:43.784898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:43.786573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:43.787354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:43.787925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:43.799671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.800477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.801035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:43.801963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.802543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.803232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:43.825093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:43.833232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:43.853995 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:43.857616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:43.908948 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7feeb9ec-01b7-48e7-929f-e751408ed6f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.944837 Aug 30 04:38:43.915986 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3567/7252] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:38:43.923172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-65532021-f949-428a-9fe6-eddd97b75ad1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:43.924539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-65532021-f949-428a-9fe6-eddd97b75ad1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:43.988780 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-65532021-f949-428a-9fe6-eddd97b75ad1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:44.000512 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-65532021-f949-428a-9fe6-eddd97b75ad1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1266 microversion: 2.1 time: 0.083021 Aug 30 04:38:44.001679 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3686/7253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:43 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:45.022531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8f149c3d-43e7-418b-96ec-4e3c68e294f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:45.023988 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8f149c3d-43e7-418b-96ec-4e3c68e294f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:45.090903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8f149c3d-43e7-418b-96ec-4e3c68e294f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:45.101568 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8f149c3d-43e7-418b-96ec-4e3c68e294f1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1266 microversion: 2.1 time: 0.082955 Aug 30 04:38:45.102235 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3568/7254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:45 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:46.123615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-391caa50-6038-418c-a209-69016ac0938b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:46.124224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-391caa50-6038-418c-a209-69016ac0938b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:46.195834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-391caa50-6038-418c-a209-69016ac0938b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:46.207355 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-391caa50-6038-418c-a209-69016ac0938b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1266 microversion: 2.1 time: 0.088043 Aug 30 04:38:46.213406 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3687/7255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:46 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:47.228582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c21c62a8-8236-49e1-8f56-ad4d230daab0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.229254 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c21c62a8-8236-49e1-8f56-ad4d230daab0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:47.295079 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c21c62a8-8236-49e1-8f56-ad4d230daab0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:47.302585 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c21c62a8-8236-49e1-8f56-ad4d230daab0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1266 microversion: 2.1 time: 0.077966 Aug 30 04:38:47.303164 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3569/7256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:48.325077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:48.326218 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:48.333288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:48.333804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:48.334253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:48.334958 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:48.335414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:48.336009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:48.403145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:48.411241 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-760b04e4-f333-4133-b719-2f7dcf3e368d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1270 microversion: 2.1 time: 0.090081 Aug 30 04:38:48.411843 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3688/7257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:48 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:49.432913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:49.434233 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:49.442628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:49.443131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:49.443584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:49.444290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:49.444755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:49.445188 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:49.528799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:49.537962 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-16f1921a-b7f6-402d-8e3f-4bb4f98924b5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1324 microversion: 2.1 time: 0.108304 Aug 30 04:38:49.538802 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3570/7258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:49 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1324 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:50.559692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:50.560430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:50.567302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.567862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.568304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.568991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.569469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.569896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.784670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:50.792928 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-839ea1b8-e39c-4159-8149-dd92239455ea tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1391 microversion: 2.1 time: 0.237564 Aug 30 04:38:50.793573 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3689/7259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:50 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:50.812619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9bfb7c5e-17a3-4d75-be97-34d08a8b6965 req-6c0548d0-1f05-43fc-845d-651fb0aff5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e95f14-510f-4a87-816b-d3d1793eea85", "tag": "b56e5983-d251-4217-b85f-b9065790072b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:50.830109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9bfb7c5e-17a3-4d75-be97-34d08a8b6965 req-6c0548d0-1f05-43fc-845d-651fb0aff5ce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.830607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9bfb7c5e-17a3-4d75-be97-34d08a8b6965 req-6c0548d0-1f05-43fc-845d-651fb0aff5ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.831597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9bfb7c5e-17a3-4d75-be97-34d08a8b6965 req-6c0548d0-1f05-43fc-845d-651fb0aff5ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.844868 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9bfb7c5e-17a3-4d75-be97-34d08a8b6965 req-6c0548d0-1f05-43fc-845d-651fb0aff5ce service nova] Creating event network-changed:b56e5983-d251-4217-b85f-b9065790072b for instance 58e95f14-510f-4a87-816b-d3d1793eea85 on n-h2-854924-5 Aug 30 04:38:50.850804 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9bfb7c5e-17a3-4d75-be97-34d08a8b6965 req-6c0548d0-1f05-43fc-845d-651fb0aff5ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045859 Aug 30 04:38:50.851432 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3571/7260] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:51.814405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:51.815019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:51.821926 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:51.822412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:51.822847 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.823538 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:51.823989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:51.824984 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.966627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:51.974958 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06f5008d-a0a0-412a-b662-64e9c6fd43f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1391 microversion: 2.1 time: 0.164599 Aug 30 04:38:51.975551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3690/7261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:51 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:53.006989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:53.007798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:53.015497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.016090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.016542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:53.017301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.017799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.018238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:53.169704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:53.178697 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77cf73e5-0570-419c-a7f8-ff5d81308448 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1391 microversion: 2.1 time: 0.176592 Aug 30 04:38:53.179293 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3572/7262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:53 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:54.200466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:54.201073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:54.208012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.208498 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.208932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.209653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.210109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.210660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.357009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:54.365390 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f440279c-c371-4f32-a1d2-c7929c6b58e3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1391 microversion: 2.1 time: 0.168817 Aug 30 04:38:54.365981 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3691/7263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:54 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:54.947147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-01ca9d73-ae91-463a-a41e-c28ba20b639e req-9b111075-eeda-4fcf-92db-69e5ba6fa32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e95f14-510f-4a87-816b-d3d1793eea85", "name": "network-vif-plugged", "status": "completed", "tag": "b56e5983-d251-4217-b85f-b9065790072b"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:54.955695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:54.962852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-01ca9d73-ae91-463a-a41e-c28ba20b639e req-9b111075-eeda-4fcf-92db-69e5ba6fa32a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.963352 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-01ca9d73-ae91-463a-a41e-c28ba20b639e req-9b111075-eeda-4fcf-92db-69e5ba6fa32a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.963798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-01ca9d73-ae91-463a-a41e-c28ba20b639e req-9b111075-eeda-4fcf-92db-69e5ba6fa32a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.978003 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-01ca9d73-ae91-463a-a41e-c28ba20b639e req-9b111075-eeda-4fcf-92db-69e5ba6fa32a service nova] Creating event network-vif-plugged:b56e5983-d251-4217-b85f-b9065790072b for instance 58e95f14-510f-4a87-816b-d3d1793eea85 on n-h2-854924-5 Aug 30 04:38:54.983347 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-01ca9d73-ae91-463a-a41e-c28ba20b639e req-9b111075-eeda-4fcf-92db-69e5ba6fa32a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043411 Aug 30 04:38:54.983969 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3573/7264] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:55.386977 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:55.387543 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:55.394793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:55.395281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:55.395719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:55.396409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:55.396888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:55.397311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:55.541453 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:55.552129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d881ab52-e134-46cd-a03b-6fd5a2d82212 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1391 microversion: 2.1 time: 0.169451 Aug 30 04:38:55.552710 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3692/7265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:55 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:56.575918 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:56.576548 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:56.583050 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:56.583555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:56.584008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.584781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:56.585300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:56.585656 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.733133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:56.741109 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-615dfff0-1f87-458a-a7bb-2f8ab283d0ca tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1562 microversion: 2.1 time: 0.171035 Aug 30 04:38:56.741715 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3574/7266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:56 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:56.763477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:56.764460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:56.774657 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:56.780817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:56.781381 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:56.781824 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.782530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:56.782982 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:56.783435 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.915518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:56.923858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2112278f-470b-40df-878e-8778a0eeb9bf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1562 microversion: 2.1 time: 0.165861 Aug 30 04:38:56.924424 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3693/7267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:56 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:58.899329 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:58.900648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:58.902704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6f5a1011-8da8-4bfa-bdcb-fa83020b72fe req-90e26a9c-b8ef-48e6-9c0b-a47edf07f966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e95f14-510f-4a87-816b-d3d1793eea85", "tag": "b56e5983-d251-4217-b85f-b9065790072b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:58.903405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:58.910998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:58.911830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:58.912288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:58.912993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:58.913496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:58.914171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:58.917385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f5a1011-8da8-4bfa-bdcb-fa83020b72fe req-90e26a9c-b8ef-48e6-9c0b-a47edf07f966 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:58.918597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f5a1011-8da8-4bfa-bdcb-fa83020b72fe req-90e26a9c-b8ef-48e6-9c0b-a47edf07f966 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:58.918974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6f5a1011-8da8-4bfa-bdcb-fa83020b72fe req-90e26a9c-b8ef-48e6-9c0b-a47edf07f966 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:58.931052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6f5a1011-8da8-4bfa-bdcb-fa83020b72fe req-90e26a9c-b8ef-48e6-9c0b-a47edf07f966 service nova] Creating event network-changed:b56e5983-d251-4217-b85f-b9065790072b for instance 58e95f14-510f-4a87-816b-d3d1793eea85 on n-h2-854924-5 Aug 30 04:38:58.938228 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6f5a1011-8da8-4bfa-bdcb-fa83020b72fe req-90e26a9c-b8ef-48e6-9c0b-a47edf07f966 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040037 Aug 30 04:38:58.940166 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3694/7268] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:59.156604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:59.165233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dcd38cda-18b7-442f-865b-f933d84ad3aa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1562 microversion: 2.1 time: 0.269852 Aug 30 04:38:59.166025 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3575/7269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:58 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1562 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:22.430278 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:22.431023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=38 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:22.435283 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:22.437572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:22.444957 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.445493 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.445934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.446625 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.447081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.447504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.501751 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-29033c14-dd95-440f-8bbe-3cd1871aa9cb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action" status: 200 len: 24563 microversion: 2.1 time: 0.073499 Aug 30 04:39:22.502415 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3695/7270] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:22 2022] POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action => generated 24563 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:39:28.865957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:28.866579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:28.868495 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:28.869256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=30 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:28.875144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:28.875642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:28.876091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:28.876786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:28.877245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:28.877699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.205648 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c8a2f728-5515-425f-9af5-2f2aa8fd6a26 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action" status: 202 len: 0 microversion: 2.1 time: 0.343700 Aug 30 04:39:29.206308 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3576/7271] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:28 2022] POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:29.217141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:29.218157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:29.226366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.226871 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.227598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.228318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.228784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.229213 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.375931 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:29.384183 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ae09d0f7-a030-4ef9-850a-ebd4dc207156 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1686 microversion: 2.1 time: 0.172109 Aug 30 04:39:29.384777 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3696/7272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:29 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:30.409116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:30.409856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:30.416138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:30.416635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:30.417080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:30.418401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:30.418865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:30.419300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:30.553012 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:30.561111 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1c02faeb-d3b6-4aa0-af09-855136764662 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1666 microversion: 2.1 time: 0.157319 Aug 30 04:39:30.562193 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3577/7273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:30 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:31.654100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:31.656258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:31.663080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.663558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.663991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.664671 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.665117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.665591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.719755 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4dbc2a06-9a93-4869-8350-b6ee47eb8d5e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action" status: 200 len: 32636 microversion: 2.1 time: 0.069969 Aug 30 04:39:31.720440 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3697/7274] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:31 2022] POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action => generated 32636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:39:31.732616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:31.733174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:31.740112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.740618 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.741075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.741893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.742368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.742812 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.809375 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-daf08b0f-254f-48c4-b6b6-5d233fe40348 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action" status: 202 len: 0 microversion: 2.1 time: 0.081169 Aug 30 04:39:31.810130 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3578/7275] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:31 2022] POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:31.819137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:31.819836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:31.828384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.829245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.830356 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.831579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.832388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.833141 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.993909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:32.003490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d4fdb2d7-5bf3-42af-910b-daf4e317524c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1673 microversion: 2.1 time: 0.188741 Aug 30 04:39:32.004073 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3698/7276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:31 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:33.028797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:33.029533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:33.035798 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.036292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.036741 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.037469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.037936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.038367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.168940 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:33.176939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fd0575c8-b041-4927-92a0-78b6fd5168fb tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1681 microversion: 2.1 time: 0.153820 Aug 30 04:39:33.177538 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3579/7277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:33 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:33.275366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:33.278103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:33.285800 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.286341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.286863 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.287765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.288412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.288842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.341240 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-69587376-924b-41bd-8b0e-ab40e8999799 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action" status: 200 len: 36117 microversion: 2.1 time: 0.069607 Aug 30 04:39:33.341929 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3699/7278] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:33 2022] POST /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85/action => generated 36117 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:39:34.481836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-bdb41a7a-2bea-4778-8622-190f7d306b28 req-09399587-e0c9-4863-a728-1a351b13efdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e95f14-510f-4a87-816b-d3d1793eea85", "tag": "b56e5983-d251-4217-b85f-b9065790072b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:34.487124 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:34.488543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:34.495447 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bdb41a7a-2bea-4778-8622-190f7d306b28 req-09399587-e0c9-4863-a728-1a351b13efdc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.495691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.496632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.496832 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bdb41a7a-2bea-4778-8622-190f7d306b28 req-09399587-e0c9-4863-a728-1a351b13efdc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.497077 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-bdb41a7a-2bea-4778-8622-190f7d306b28 req-09399587-e0c9-4863-a728-1a351b13efdc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.497246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.498271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.498856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.499401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.510574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-bdb41a7a-2bea-4778-8622-190f7d306b28 req-09399587-e0c9-4863-a728-1a351b13efdc service nova] Creating event network-changed:b56e5983-d251-4217-b85f-b9065790072b for instance 58e95f14-510f-4a87-816b-d3d1793eea85 on n-h2-854924-5 Aug 30 04:39:34.516705 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-bdb41a7a-2bea-4778-8622-190f7d306b28 req-09399587-e0c9-4863-a728-1a351b13efdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039941 Aug 30 04:39:34.517156 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3700/7279] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:34.531704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:34.624992 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d273948-aa09-4b24-8423-afff95994436 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 204 len: 0 microversion: 2.1 time: 0.152597 Aug 30 04:39:34.629099 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3580/7280] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:34 2022] DELETE /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:34.637727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:34.638605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:34.647976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.650045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.650045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.650045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.652481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.652481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.840606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:34.848959 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b06abfc3-fcbb-44d6-90d7-2af435ec2d76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1687 microversion: 2.1 time: 0.217866 Aug 30 04:39:34.849692 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3701/7281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:34 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1687 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:35.872392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:35.873034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:35.883501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:35.884017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:35.884477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:35.885488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:35.885963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:35.887042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.095585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:36.106974 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4098dd17-a1e1-4c1b-97a2-5745e0ca0be0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1687 microversion: 2.1 time: 0.239111 Aug 30 04:39:36.107556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3581/7282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:35 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1687 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:36.729763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a442312d-3314-4a47-9493-01b9f7e7b126 req-27110e20-9023-4533-a8c1-894e8514d79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e95f14-510f-4a87-816b-d3d1793eea85", "name": "network-vif-deleted", "tag": "b56e5983-d251-4217-b85f-b9065790072b"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:36.741820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a442312d-3314-4a47-9493-01b9f7e7b126 req-27110e20-9023-4533-a8c1-894e8514d79d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.742220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a442312d-3314-4a47-9493-01b9f7e7b126 req-27110e20-9023-4533-a8c1-894e8514d79d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.742659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a442312d-3314-4a47-9493-01b9f7e7b126 req-27110e20-9023-4533-a8c1-894e8514d79d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.756157 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-a442312d-3314-4a47-9493-01b9f7e7b126 req-27110e20-9023-4533-a8c1-894e8514d79d service nova] Creating event network-vif-deleted:b56e5983-d251-4217-b85f-b9065790072b for instance 58e95f14-510f-4a87-816b-d3d1793eea85 on n-h2-854924-5 Aug 30 04:39:36.761519 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a442312d-3314-4a47-9493-01b9f7e7b126 req-27110e20-9023-4533-a8c1-894e8514d79d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Aug 30 04:39:36.762141 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3702/7283] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:37.129593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:37.130236 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:37.140103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.140962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.141840 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.143249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.144175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.144934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.184956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.185498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.185973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.186422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lazy-loading 'fault' on Instance uuid 58e95f14-510f-4a87-816b-d3d1793eea85 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:39:37.231175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:37.240850 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bfae6308-9f61-42cf-bed4-a2e993c85669 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 200 len: 1356 microversion: 2.1 time: 0.115973 Aug 30 04:39:37.241820 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3582/7284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:37 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 1356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:38.265910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:38.266612 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 58e95f14-510f-4a87-816b-d3d1793eea85] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:38.274056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.274609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.275325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.276319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.277046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.277741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.301496 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] HTTP exception thrown: Instance 58e95f14-510f-4a87-816b-d3d1793eea85 could not be found. Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Request method failure captured: Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 HTTP/1.1 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZRL22nVBzbm3CobZJc6yka_o5v-67PC-bWX0Fv7oU6SBha3R5SoSBS-zaO48OkKbzZhhyF1rtO0jR2TNTLib9REZlLAkAbE4-kBKQUs2eElp5XzenzW-HvhpKy9SE2bNeMbKQgncyE9qMUa5h7K8l7n35Ab1ySzv9fPOzJoR8XlcSU Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6fb4d23dbd2412da3453aa9224e08ce", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}] Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a85abcae77c2416f80f9a0c00551e528 Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 58e95f14-510f-4a87-816b-d3d1793eea85 could not be found. Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '58e95f14-510f-4a87-816b-d3d1793eea85'} Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e95f14-510f-4a87-816b-d3d1793eea85 could not be found. Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e95f14-510f-4a87-816b-d3d1793eea85 could not be found. Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:39:38.303684 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e95f14-510f-4a87-816b-d3d1793eea85 could not be found. Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Returning 404 to user: Instance 58e95f14-510f-4a87-816b-d3d1793eea85 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-76dcb0e1-b18d-41e9-8294-812d7eb5175c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85" status: 404 len: 111 microversion: 2.1 time: 0.044618 Aug 30 04:39:38.310809 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3703/7285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:38 2022] GET /compute/v2.1/servers/58e95f14-510f-4a87-816b-d3d1793eea85 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:42.065327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-03588ae4-340f-4742-b502-7ccb9967d3c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '.version_select at 0x7f897a663280>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:42.098294 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-03588ae4-340f-4742-b502-7ccb9967d3c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1870169349" status: 202 len: 0 microversion: 2.1 time: 0.037244 Aug 30 04:39:42.098909 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3583/7286] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Aug 30 04:39:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1870169349 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:39:42.132752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-226419fa-dc1c-4d38-819e-58263d114109 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: .version_select at 0x7f897b6efb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-413603656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNw8Zo1IqpqiI2Q7QSoVbNJZ7uR2lV6xjFSx+DNWQMhGigvxsgLXYy88qoYJ5fgrHUc0/+DTZBTPk5E6vWAr+7PW3IwSj3gMoIbQwVEF05oE/QBO6gJ/wMlMhKriBtQqg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:42.149869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-226419fa-dc1c-4d38-819e-58263d114109 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:42.155736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-226419fa-dc1c-4d38-819e-58263d114109 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:42.180542 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-226419fa-dc1c-4d38-819e-58263d114109 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051542 Aug 30 04:39:42.181180 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3704/7287] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:39:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:48.522509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-592162918", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "be3d7185-589d-46f4-b378-b2dc9632a068"}], "key_name": "tempest-TestNetworkAdvancedServerOps-413603656", "security_groups": [{"name": "tempest-secgroup-smoke-2027810601"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:48.535559 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:48.660660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] validate_networks() for [('be3d7185-589d-46f4-b378-b2dc9632a068', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:39:49.208193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:39:49.208975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:39:49.209888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:39:49.210619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:39:49.211196 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:39:49.222981 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.223613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.224166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.225075 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.225659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.226422 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.245671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:49.253748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:49.271994 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:39:49.276109 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:39:49.346863 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-30934882-8735-4029-91b5-c5c70e5bafc6 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828499 Aug 30 04:39:49.348209 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3584/7288] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:39:49.357369 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=36 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:49.362500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9dbae540-d1b0-4db6-b8b4-dcca7b655f61 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.363586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9dbae540-d1b0-4db6-b8b4-dcca7b655f61 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.438053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9dbae540-d1b0-4db6-b8b4-dcca7b655f61 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:49.445733 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9dbae540-d1b0-4db6-b8b4-dcca7b655f61 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1265 microversion: 2.1 time: 0.090034 Aug 30 04:39:49.446304 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3705/7289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:50.472501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5958b490-75b1-427a-85ad-b4472ca1629d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.473711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5958b490-75b1-427a-85ad-b4472ca1629d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.568442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5958b490-75b1-427a-85ad-b4472ca1629d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:50.582130 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5958b490-75b1-427a-85ad-b4472ca1629d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1265 microversion: 2.1 time: 0.114726 Aug 30 04:39:50.583861 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3585/7290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:51.605033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a2a96860-7c04-48f3-901d-345f05087c76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:51.606131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a2a96860-7c04-48f3-901d-345f05087c76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:51.687161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a2a96860-7c04-48f3-901d-345f05087c76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:51.695109 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a2a96860-7c04-48f3-901d-345f05087c76 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1265 microversion: 2.1 time: 0.094644 Aug 30 04:39:51.695689 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3706/7291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:51 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:52.718186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-eec07b02-a257-4e64-83ce-e026b2016017 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:52.718968 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-eec07b02-a257-4e64-83ce-e026b2016017 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:52.776651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-eec07b02-a257-4e64-83ce-e026b2016017 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:52.783930 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-eec07b02-a257-4e64-83ce-e026b2016017 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1265 microversion: 2.1 time: 0.069807 Aug 30 04:39:52.784556 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3586/7292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:52 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:53.806718 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:53.807335 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:53.811374 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:53.816905 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.817425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.817873 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.818578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.819037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.819469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.882940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:53.891530 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-711ae4a1-0b43-4d4d-94d3-9de716e7aaaf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1269 microversion: 2.1 time: 0.088825 Aug 30 04:39:53.892117 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3707/7293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:53 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:54.912449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:54.913239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:54.920484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.921053 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.921509 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.922262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.922706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.923146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.996427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:55.005652 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1f5a00fe-8af2-4b7f-9be2-9554ca09830a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1323 microversion: 2.1 time: 0.097019 Aug 30 04:39:55.007184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3587/7294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:54 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1323 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:56.034747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:56.035686 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:56.044046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:56.045275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:56.045583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:56.046460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:56.046928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:56.047383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:56.199799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-3987be41-e0a3-458b-a86a-fdf74c6e2a06 req-d924c86c-8964-4904-870c-bfb83bffb86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e190e3a8-31ed-4e7a-a721-92b0a1aa2a16", "tag": "4613cc53-5659-40e0-8e15-6c3dc5165cee"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:56.226070 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3987be41-e0a3-458b-a86a-fdf74c6e2a06 req-d924c86c-8964-4904-870c-bfb83bffb86d service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:56.227144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3987be41-e0a3-458b-a86a-fdf74c6e2a06 req-d924c86c-8964-4904-870c-bfb83bffb86d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:56.228550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-3987be41-e0a3-458b-a86a-fdf74c6e2a06 req-d924c86c-8964-4904-870c-bfb83bffb86d service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:56.234436 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:56.245990 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-44037c6c-cd8b-4606-a68b-df89f6919c4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1391 microversion: 2.1 time: 0.217597 Aug 30 04:39:56.246719 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3708/7295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:56 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:56.248233 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-3987be41-e0a3-458b-a86a-fdf74c6e2a06 req-d924c86c-8964-4904-870c-bfb83bffb86d service nova] Creating event network-changed:4613cc53-5659-40e0-8e15-6c3dc5165cee for instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 on n-h2-854924-5 Aug 30 04:39:56.263044 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-3987be41-e0a3-458b-a86a-fdf74c6e2a06 req-d924c86c-8964-4904-870c-bfb83bffb86d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169313 Aug 30 04:39:56.263778 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3588/7296] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:57.267547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:57.268160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:57.275249 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:57.275737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:57.276675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:57.277386 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:57.277843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:57.278270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:57.410998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:57.419839 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-563b8ec3-1856-4d59-bce4-f688deb8cef8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1391 microversion: 2.1 time: 0.156119 Aug 30 04:39:57.420377 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3709/7297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:57 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:58.442021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:58.442751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:58.449172 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.449715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.450174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:58.450890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.451364 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.451805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:58.597578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:58.605948 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7cdb7682-514c-438d-9d5e-3b119ca11ab1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1391 microversion: 2.1 time: 0.169345 Aug 30 04:39:58.606523 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3589/7298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:58 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:59.705519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:59.706165 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:59.713084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:59.713678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:59.714123 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:59.715061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:59.715525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:59.715953 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:59.859051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:59.866898 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8761bdf2-099d-4517-8438-836a075b74f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1391 microversion: 2.1 time: 0.166179 Aug 30 04:39:59.867465 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3710/7299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:59 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:00.889086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:00.889863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:00.891883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:00.893800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:00.901308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:00.901944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:00.902578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:00.903368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:00.903868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:00.904342 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:01.060506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:01.069289 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1b803682-c75d-47b1-90bf-e63ab543bd17 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1391 microversion: 2.1 time: 0.184804 Aug 30 04:40:01.069923 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3590/7300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:00 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:01.220504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-fbdbafd6-1349-4f68-bdd3-ca6283712976 req-cf3073d9-1f2f-44d3-aee4-35fab0627839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e190e3a8-31ed-4e7a-a721-92b0a1aa2a16", "name": "network-vif-plugged", "status": "completed", "tag": "4613cc53-5659-40e0-8e15-6c3dc5165cee"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:01.232174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fbdbafd6-1349-4f68-bdd3-ca6283712976 req-cf3073d9-1f2f-44d3-aee4-35fab0627839 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:01.232680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fbdbafd6-1349-4f68-bdd3-ca6283712976 req-cf3073d9-1f2f-44d3-aee4-35fab0627839 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:01.233243 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-fbdbafd6-1349-4f68-bdd3-ca6283712976 req-cf3073d9-1f2f-44d3-aee4-35fab0627839 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:01.244787 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-fbdbafd6-1349-4f68-bdd3-ca6283712976 req-cf3073d9-1f2f-44d3-aee4-35fab0627839 service nova] Creating event network-vif-plugged:4613cc53-5659-40e0-8e15-6c3dc5165cee for instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 on n-h2-854924-5 Aug 30 04:40:01.250099 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-fbdbafd6-1349-4f68-bdd3-ca6283712976 req-cf3073d9-1f2f-44d3-aee4-35fab0627839 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033393 Aug 30 04:40:01.250907 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3711/7301] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:02.091772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:02.092313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:02.099797 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:02.100077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:02.100533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:02.101291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:02.101790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:02.102234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:02.235429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:02.243203 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ff921f4e-eed7-42a1-8a06-e2c2b4c0dd85 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1391 microversion: 2.1 time: 0.155713 Aug 30 04:40:02.243785 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3591/7302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:02 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:03.262376 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:03.267487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.268182 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:03.274668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.275148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.275581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.276779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.277229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.277677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.422384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:03.430459 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33f7ce2f-af3d-4ddd-8d1b-f3f2402de7f7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1564 microversion: 2.1 time: 0.169284 Aug 30 04:40:03.431044 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3712/7303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:03.452582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.453296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:03.455145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:03.461485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.461991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.462447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.463165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.464143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.464585 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.929089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:03.938200 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b5664bb9-18b8-4576-a8db-112a0a84fe51 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1564 microversion: 2.1 time: 0.491335 Aug 30 04:40:03.938782 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3592/7304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1564 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:05.629040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:05.630894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:05.640001 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.640667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.641110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.641991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.642561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.642920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.688161 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2e41e6ba-70c3-4c9f-a316-b31da9598d5e req-3faaf2f5-1877-4fbb-a4b5-98db7c4eea16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e190e3a8-31ed-4e7a-a721-92b0a1aa2a16", "tag": "4613cc53-5659-40e0-8e15-6c3dc5165cee"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:05.699332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2e41e6ba-70c3-4c9f-a316-b31da9598d5e req-3faaf2f5-1877-4fbb-a4b5-98db7c4eea16 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.699879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2e41e6ba-70c3-4c9f-a316-b31da9598d5e req-3faaf2f5-1877-4fbb-a4b5-98db7c4eea16 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.700327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2e41e6ba-70c3-4c9f-a316-b31da9598d5e req-3faaf2f5-1877-4fbb-a4b5-98db7c4eea16 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.714600 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2e41e6ba-70c3-4c9f-a316-b31da9598d5e req-3faaf2f5-1877-4fbb-a4b5-98db7c4eea16 service nova] Creating event network-changed:4613cc53-5659-40e0-8e15-6c3dc5165cee for instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 on n-h2-854924-5 Aug 30 04:40:05.720544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2e41e6ba-70c3-4c9f-a316-b31da9598d5e req-3faaf2f5-1877-4fbb-a4b5-98db7c4eea16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100609 Aug 30 04:40:05.721561 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3593/7305] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:05.820487 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:05.837321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-61d2fc6e-5c08-4add-9b41-467a18c7a32d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1564 microversion: 2.1 time: 0.220801 Aug 30 04:40:05.837960 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3713/7306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:05 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1564 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:27.101850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:27.104627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:27.107635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=7 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:27.108289 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=36 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:27.115816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.116312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.116761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.117503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.117970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.118415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.171735 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-189bf3a8-9dce-42f4-827a-99d619269a78 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16/action" status: 200 len: 24569 microversion: 2.1 time: 0.073996 Aug 30 04:40:27.172406 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3594/7307] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:27 2022] POST /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16/action => generated 24569 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:40:38.239306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:38.241593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.244245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=13 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:38.244903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=38 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:38.251619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.252101 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.252534 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.253223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.253704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.254129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.328160 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-92acdf53-4291-4966-9d66-b50393503700 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16/action" status: 202 len: 0 microversion: 2.1 time: 0.092908 Aug 30 04:40:38.328869 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3714/7308] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:38 2022] POST /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:38.338178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:38.338831 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.341442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:38.342613 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:38.350035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.350476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.350937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.351648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.352115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.352581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.498229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:38.506808 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-468afbb4-d1ee-49a6-9826-6f3cdc131cc1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1674 microversion: 2.1 time: 0.173027 Aug 30 04:40:38.507498 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3595/7309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:38 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:39.531255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:39.533439 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:39.538608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.539159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.539663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.540976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.541428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.541851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.683029 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:39.691398 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1142a354-c1e9-4320-bcb0-0c46aa67edd0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.165422 Aug 30 04:40:39.691999 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3715/7310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:39 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:40.714416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:40.715037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:40.723185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.723693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.724147 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.724852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.725318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.725779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.863255 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:40.871675 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f3972052-3e4a-45ce-9fb9-ae8369daed9b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.161187 Aug 30 04:40:40.872266 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3596/7311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:40 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:41.894517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:41.895162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:41.901801 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.902289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.902728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.903424 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.903875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.904301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.053431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:42.062551 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c8ecbdef-0d68-4157-8667-44e66137d570 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.171432 Aug 30 04:40:42.062551 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3716/7312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:41 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:43.083424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:43.084072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:43.091684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.092214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.092676 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.093414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.093883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.094320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.230755 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:43.239044 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bab66d37-62ab-4b51-bbf6-5ab94b34e0e9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.159491 Aug 30 04:40:43.239814 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3597/7313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:43 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:44.262629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:44.263244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:44.271668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:44.271668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:44.271668 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:44.277594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:44.277594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:44.277594 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:44.432545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:44.442667 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fee30608-b251-4390-a6fd-4b568c5f82ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.184539 Aug 30 04:40:44.443356 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3717/7314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:44 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:45.465674 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:45.466311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:45.473575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.474087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.474538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.475256 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.475729 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.476171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.627150 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:45.637163 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-104ae72a-fe0b-48a0-a8e2-ff2775b8619e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.175698 Aug 30 04:40:45.637842 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3598/7315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:45 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:46.659866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.660491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.668204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.668696 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.669138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.669874 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.670341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.670852 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.809758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:46.817541 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f07fc8fc-92b7-4080-858e-a64a2be87ece tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.161652 Aug 30 04:40:46.818153 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3718/7316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:46 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:47.841441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:47.841992 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:47.849955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.850456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.850990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:47.851864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.852343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.853272 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:48.018343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:48.026820 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e91bf1de-f621-4406-a90e-aa6d9acd206d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.191652 Aug 30 04:40:48.027389 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3599/7317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:47 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:49.050280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:49.050894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:49.058985 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:49.059475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:49.059909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:49.060601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:49.061050 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:49.061529 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:49.221106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:49.229323 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33787348-6b39-4d17-b10d-5809cc6025e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.183870 Aug 30 04:40:49.229915 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3719/7318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:49 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:50.251811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:50.252437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:50.260593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:50.261096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:50.261584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:50.262303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:50.262770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:50.263208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:50.403208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:50.411101 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d2913e4e-503f-48ad-959c-1bd75a526e11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.163252 Aug 30 04:40:50.411675 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3600/7319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:50 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:51.432948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:51.433586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:51.440684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:51.441174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:51.441648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:51.442357 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:51.442809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:51.443234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:51.576259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:51.584143 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5435b8c6-194a-4c06-a39e-316755954e88 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.155663 Aug 30 04:40:51.584717 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3720/7320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:51 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:52.606119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:52.606693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:52.613944 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:52.614449 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:52.614908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:52.615631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:52.616105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:52.616569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:52.751186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:52.759425 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3166b039-316c-431d-9be4-041af5665964 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.157970 Aug 30 04:40:52.760007 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3601/7321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:52 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:53.786828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:53.787515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:53.795139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:53.795627 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:53.796070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:53.796768 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:53.797220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:53.797674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:53.937117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:53.944911 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2e892142-89e5-438c-bf2c-05c54d7d4f3c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1679 microversion: 2.1 time: 0.162830 Aug 30 04:40:53.945512 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3721/7322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:53 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:54.967736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:54.968371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:54.975477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:54.975982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:54.976441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:54.977160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:54.978460 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:54.978789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:55.118719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:55.126658 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4eb9ac12-ddc4-4208-b02e-b559ba062178 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1682 microversion: 2.1 time: 0.162931 Aug 30 04:40:55.127256 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3602/7323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:54 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:19.328848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:19.331056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:19.333207 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=16 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:19.334091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:19.340649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.341128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.341583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.342275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.342725 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.343147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.398813 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0c42fc04-eb6e-4e45-9c04-22c37a9c856c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16/action" status: 200 len: 68740 microversion: 2.1 time: 0.073935 Aug 30 04:41:19.399917 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3722/7324] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:19 2022] POST /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16/action => generated 68740 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:41:26.963525 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:26.964054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:26.966407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=16 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:26.966857 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-982aeff1-c9aa-44f5-9b6e-ff455301683f req-7f1ae242-6296-40e0-8ca5-e32915476650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e190e3a8-31ed-4e7a-a721-92b0a1aa2a16", "tag": "4613cc53-5659-40e0-8e15-6c3dc5165cee"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:26.967300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=48 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:26.973154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:26.973685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:26.974133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:26.974848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:26.975313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:26.975932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:26.979586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-982aeff1-c9aa-44f5-9b6e-ff455301683f req-7f1ae242-6296-40e0-8ca5-e32915476650 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:26.980253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-982aeff1-c9aa-44f5-9b6e-ff455301683f req-7f1ae242-6296-40e0-8ca5-e32915476650 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:26.980688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-982aeff1-c9aa-44f5-9b6e-ff455301683f req-7f1ae242-6296-40e0-8ca5-e32915476650 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:26.994242 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-982aeff1-c9aa-44f5-9b6e-ff455301683f req-7f1ae242-6296-40e0-8ca5-e32915476650 service nova] Creating event network-changed:4613cc53-5659-40e0-8e15-6c3dc5165cee for instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 on n-h2-854924-5 Aug 30 04:41:26.999835 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-982aeff1-c9aa-44f5-9b6e-ff455301683f req-7f1ae242-6296-40e0-8ca5-e32915476650 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037757 Aug 30 04:41:27.000759 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3723/7325] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:27.011881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:41:27.104251 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-21b01d2a-aff6-497e-8dc2-4c18fd72b24b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 204 len: 0 microversion: 2.1 time: 0.144526 Aug 30 04:41:27.105531 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3603/7326] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:41:26 2022] DELETE /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:41:27.115245 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:27.116075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:27.123069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:27.123561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:27.123997 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:27.124700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:27.125157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:27.125609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:27.270758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:27.279378 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ebff5a55-9015-46df-bf94-b882e5b26613 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1688 microversion: 2.1 time: 0.169313 Aug 30 04:41:27.279956 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3724/7327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:27 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:28.302401 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:28.303045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:28.310624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:28.311133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:28.311584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:28.312286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:28.312754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:28.313197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:28.444818 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:28.452768 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8c7b2262-c13a-452d-9b2e-8cc19a51af8d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1688 microversion: 2.1 time: 0.154591 Aug 30 04:41:28.453375 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3604/7328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:28 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:29.153753 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1f096226-f57a-4b2b-8a45-19d675e0ffae req-27bff970-8e53-41a4-9735-0c715efd2a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e190e3a8-31ed-4e7a-a721-92b0a1aa2a16", "name": "network-vif-deleted", "tag": "4613cc53-5659-40e0-8e15-6c3dc5165cee"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:29.164858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1f096226-f57a-4b2b-8a45-19d675e0ffae req-27bff970-8e53-41a4-9735-0c715efd2a8a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:29.165330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1f096226-f57a-4b2b-8a45-19d675e0ffae req-27bff970-8e53-41a4-9735-0c715efd2a8a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:29.165816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1f096226-f57a-4b2b-8a45-19d675e0ffae req-27bff970-8e53-41a4-9735-0c715efd2a8a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:29.180930 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1f096226-f57a-4b2b-8a45-19d675e0ffae req-27bff970-8e53-41a4-9735-0c715efd2a8a service nova] Creating event network-vif-deleted:4613cc53-5659-40e0-8e15-6c3dc5165cee for instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 on n-h2-854924-5 Aug 30 04:41:29.185823 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1f096226-f57a-4b2b-8a45-19d675e0ffae req-27bff970-8e53-41a4-9735-0c715efd2a8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036536 Aug 30 04:41:29.186426 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3725/7329] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:29.473531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:29.474162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:29.483843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:29.484360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:29.484811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:29.485608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:29.486078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:29.486521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:29.522484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:29.523404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:29.523949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:29.524624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lazy-loading 'fault' on Instance uuid e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:29.570187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:29.581752 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e937e27b-fadb-4c49-bb57-f59f1a682567 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 200 len: 1355 microversion: 2.1 time: 0.111955 Aug 30 04:41:29.582684 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3605/7330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:29 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:30.605509 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:30.606200 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: e190e3a8-31ed-4e7a-a721-92b0a1aa2a16] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:30.612402 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:30.612880 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:30.613313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:30.614007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:30.614455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:30.614872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:30.628441 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] HTTP exception thrown: Instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 could not be found. Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Request method failure captured: Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 HTTP/1.1 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZRL22nVBzbm3CobZJc6yka_o5v-67PC-bWX0Fv7oU6SBha3R5SoSBS-zaO48OkKbzZhhyF1rtO0jR2TNTLib9REZlLAkAbE4-kBKQUs2eElp5XzenzW-HvhpKy9SE2bNeMbKQgncyE9qMUa5h7K8l7n35Ab1ySzv9fPOzJoR8XlcSU Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6fb4d23dbd2412da3453aa9224e08ce", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}] Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a85abcae77c2416f80f9a0c00551e528 Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 could not be found. Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'e190e3a8-31ed-4e7a-a721-92b0a1aa2a16'} Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 could not be found. Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 could not be found. Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:41:30.630114 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 could not be found. Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Returning 404 to user: Instance e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-57e9eff8-6584-4b21-9e71-eb170db52a41 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16" status: 404 len: 111 microversion: 2.1 time: 0.031383 Aug 30 04:41:30.635988 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3726/7331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:30 2022] GET /compute/v2.1/servers/e190e3a8-31ed-4e7a-a721-92b0a1aa2a16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:33.621052 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-af97d2cd-0cdd-458c-b34c-a377ea3c9314 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '.version_select at 0x7f897adc5e50>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:33.654762 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-af97d2cd-0cdd-458c-b34c-a377ea3c9314 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-413603656" status: 202 len: 0 microversion: 2.1 time: 0.037495 Aug 30 04:41:33.655682 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3606/7332] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 04:41:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-413603656 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:41:33.683561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca30897b-0089-4069-98c6-f69f0dfafe4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: .version_select at 0x7f897a9ce8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1196484147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgsgF40MQ56p7yyz+Z+QoMyIQMpQWppSG5nvKdb7M1NH9jX35HlsDtP/IHTYgT7MpEOVpw8y2/vCQJ5mGXttsv8u/GvV2UGGRFLwEYUUs7b2qDv3U54S20AuA21tLRm0Q=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:33.702820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ca30897b-0089-4069-98c6-f69f0dfafe4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:41:33.708837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-ca30897b-0089-4069-98c6-f69f0dfafe4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:41:33.732574 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca30897b-0089-4069-98c6-f69f0dfafe4b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053347 Aug 30 04:41:33.733184 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3727/7333] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:41:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:41:39.495214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1005252341", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "f4761f92-0c18-4d29-a55c-602abeb557ab"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1196484147", "security_groups": [{"name": "tempest-secgroup-smoke-879622803"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:39.576714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:39.612246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] validate_networks() for [('f4761f92-0c18-4d29-a55c-602abeb557ab', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:41:40.050394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:41:40.050945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:41:40.051554 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:41:40.052248 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:41:40.052784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:41:40.064127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:40.064698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:40.065409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:40.066214 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:40.066777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:40.067304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:40.086247 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:41:40.092597 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:41:40.109143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:41:40.111569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:41:40.175890 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b648ffc-4a5e-4b97-98be-2abd3485973a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684988 Aug 30 04:41:40.184587 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3607/7334] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:41:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:41:40.195020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31d5c76f-c47a-4274-a3e0-26b210c2d09a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:40.197153 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31d5c76f-c47a-4274-a3e0-26b210c2d09a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:40.279622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31d5c76f-c47a-4274-a3e0-26b210c2d09a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:40.288015 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31d5c76f-c47a-4274-a3e0-26b210c2d09a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1267 microversion: 2.1 time: 0.102347 Aug 30 04:41:40.288738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3728/7335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:40 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:41.310433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:41.311402 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:41.318766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:41.319400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:41.319957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:41.321309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:41.321956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:41.322637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:41.394661 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:41.405820 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b93afa70-6305-4771-ab6c-a7e3cbec460d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1319 microversion: 2.1 time: 0.099020 Aug 30 04:41:41.406496 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3608/7336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:41 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:42.428996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:42.432038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:42.433327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=16 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:42.443126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:42.443560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:42.444011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:42.444709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:42.445209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:42.445860 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:42.658551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:42.668902 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3cb8d18-ab81-4e4f-a6e1-9ffb28ef28fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.245428 Aug 30 04:41:42.669570 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3729/7337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:42 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:43.067472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b62cc3b5-0ed5-468b-bc9d-3f0aa012c56b req-03895054-30a5-43f6-81a2-8bb4b5fe2ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:43.082870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b62cc3b5-0ed5-468b-bc9d-3f0aa012c56b req-03895054-30a5-43f6-81a2-8bb4b5fe2ba1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.083475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b62cc3b5-0ed5-468b-bc9d-3f0aa012c56b req-03895054-30a5-43f6-81a2-8bb4b5fe2ba1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.083928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b62cc3b5-0ed5-468b-bc9d-3f0aa012c56b req-03895054-30a5-43f6-81a2-8bb4b5fe2ba1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.096498 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b62cc3b5-0ed5-468b-bc9d-3f0aa012c56b req-03895054-30a5-43f6-81a2-8bb4b5fe2ba1 service nova] Creating event network-changed:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h1-854924-5 Aug 30 04:41:43.101678 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b62cc3b5-0ed5-468b-bc9d-3f0aa012c56b req-03895054-30a5-43f6-81a2-8bb4b5fe2ba1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043316 Aug 30 04:41:43.103408 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3609/7338] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:43.691411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:43.692030 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:43.699948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.700429 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.700865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.701586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.702038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.702459 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.834224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:43.842457 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d400d54d-a651-40cb-942e-29c484109fad tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.154975 Aug 30 04:41:43.843019 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3730/7339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:43 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:44.865480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:44.866223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:44.873060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:44.873587 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:44.874037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:44.874735 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:44.875204 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:44.875639 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.013238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:45.021065 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-465141d1-5557-4054-b821-edf64856d7e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.160853 Aug 30 04:41:45.021689 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3610/7340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:44 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:46.041975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:46.042588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:46.049992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.050476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.050913 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.051598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.052048 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.052469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.184840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:46.193312 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e75f4e3a-23c7-4b4d-b98b-e126902bb282 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.156047 Aug 30 04:41:46.193943 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3731/7341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:46 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:47.216343 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:47.216975 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:47.223962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:47.224467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:47.224917 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:47.225720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:47.226194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:47.226635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:47.356515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:47.364182 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-49bad8dd-e87c-45ef-94a6-e93ebed9d9c0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.151795 Aug 30 04:41:47.364759 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3611/7342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:47 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:48.384965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:48.385861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:48.392898 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.393400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.393839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.394525 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.394974 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.395394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.532367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:48.540860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9f9f96b9-9f0f-4cf9-8194-38b4b5708f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.159905 Aug 30 04:41:48.541454 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3732/7343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:48 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:48.876545 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6109720a-2ab8-423d-bd82-a96af843f96d req-23e5b5fa-8711-4d4f-8bc8-7c652d6b5db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "name": "network-vif-plugged", "status": "completed", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:48.887578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6109720a-2ab8-423d-bd82-a96af843f96d req-23e5b5fa-8711-4d4f-8bc8-7c652d6b5db4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.888076 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6109720a-2ab8-423d-bd82-a96af843f96d req-23e5b5fa-8711-4d4f-8bc8-7c652d6b5db4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.888526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6109720a-2ab8-423d-bd82-a96af843f96d req-23e5b5fa-8711-4d4f-8bc8-7c652d6b5db4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.900399 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6109720a-2ab8-423d-bd82-a96af843f96d req-23e5b5fa-8711-4d4f-8bc8-7c652d6b5db4 service nova] Creating event network-vif-plugged:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h1-854924-5 Aug 30 04:41:48.905515 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6109720a-2ab8-423d-bd82-a96af843f96d req-23e5b5fa-8711-4d4f-8bc8-7c652d6b5db4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089848 Aug 30 04:41:48.906144 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3612/7344] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:49.563437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:49.564045 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:49.566723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:49.572019 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:49.572500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:49.572935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:49.573654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:49.574120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:49.574588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:49.711333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:49.719056 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4b1725cf-6c0a-4c17-9132-a2094860284b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1392 microversion: 2.1 time: 0.161183 Aug 30 04:41:49.719642 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3733/7345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:49 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:50.738474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:50.739332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:50.743851 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:50.744578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:50.751916 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.752421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.752876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.753614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.754108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.754538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.901388 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:50.909227 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ad51a6b-6116-4685-857b-5173b7e53218 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1564 microversion: 2.1 time: 0.172662 Aug 30 04:41:50.909843 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3613/7346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:50 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:50.929163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:50.929805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:50.931712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:50.937887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.938368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.938803 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.939491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.939939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.940360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.070707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:51.078894 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-02f959e6-09cd-4d73-8d70-8a87250d50e2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1564 microversion: 2.1 time: 0.153644 Aug 30 04:41:51.079462 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3734/7347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:50 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:53.143828 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:53.144745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:53.147843 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-86e3175b-a2b6-406c-8cad-33c233c688ff req-e736cc6e-f560-4243-bb40-6989f45c9c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:53.153165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.154030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.154581 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.155593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.156194 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.156743 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.160318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-86e3175b-a2b6-406c-8cad-33c233c688ff req-e736cc6e-f560-4243-bb40-6989f45c9c7f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.160849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-86e3175b-a2b6-406c-8cad-33c233c688ff req-e736cc6e-f560-4243-bb40-6989f45c9c7f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.162142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-86e3175b-a2b6-406c-8cad-33c233c688ff req-e736cc6e-f560-4243-bb40-6989f45c9c7f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.174103 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-86e3175b-a2b6-406c-8cad-33c233c688ff req-e736cc6e-f560-4243-bb40-6989f45c9c7f service nova] Creating event network-changed:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h1-854924-5 Aug 30 04:41:53.180826 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-86e3175b-a2b6-406c-8cad-33c233c688ff req-e736cc6e-f560-4243-bb40-6989f45c9c7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038724 Aug 30 04:41:53.181876 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3735/7348] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:41:53.336408 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:53.345730 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6298386b-fff4-479d-a410-30082f695b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1564 microversion: 2.1 time: 0.206261 Aug 30 04:41:53.346469 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3614/7349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:53 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:32.649120 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=5 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:32.649885 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=38 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:32.650940 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:42:32.651077 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action (ip 10.222.0.30) !!! Aug 30 04:42:32.656055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:32.658350 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:32.667793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:32.668216 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:32.668651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:32.669360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:32.669811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:32.670236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:32.740280 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6920c005-ad39-44da-a74b-aa923b7c6705 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action" status: 200 len: 24566 microversion: 2.1 time: 0.093840 Aug 30 04:42:32.740928 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3736/7350] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:42:32 2022] POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action => generated 24566 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:43:21.109428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.110195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=36 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.115165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:21.117485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:21.124987 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:21.125524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:21.125976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:21.126679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:21.127144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:21.127589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:21.170738 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:21.177220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Old instance type m1.heat2, new instance type m1.heat {{(pid=122167) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:43:21.185262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:43:21.185731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:43:21.186223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:43:21.186683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:43:21.187151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:43:21.250108 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5962561c-5aa9-49d1-b955-50a2be97ca95 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action" status: 202 len: 0 microversion: 2.1 time: 0.142604 Aug 30 04:43:21.250729 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3615/7351] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:43:21 2022] POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:43:21.259705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:21.260491 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:21.263285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.264075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.272492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:21.273110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:21.273649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:21.274387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:21.274952 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:21.275428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:21.515918 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:21.523779 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-42c0be35-e4a4-4dfd-8261-7068a8db45e4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1691 microversion: 2.1 time: 0.268510 Aug 30 04:43:21.524353 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3737/7352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:21 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:22.548179 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:22.548853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:22.562366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:22.563117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:22.563821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:22.564880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:22.565634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:22.566285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:22.769691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:22.778795 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f57645b0-de36-475c-9f54-2c2eeec802e0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1691 microversion: 2.1 time: 0.235712 Aug 30 04:43:22.779380 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3616/7353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:22 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:23.800641 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:23.801291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:23.808385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:23.808875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:23.809361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:23.810065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:23.810520 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:23.810948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:23.944833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:23.953484 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab69f9ae-7663-4966-937f-1f7707cba38c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.156757 Aug 30 04:43:23.954065 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3738/7354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:23 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:24.980512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:24.981123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:24.994580 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:24.995018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:24.995474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:24.996229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:24.996699 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:24.997140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:25.129887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:25.138020 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-35573619-fb5c-4b9d-beac-4f3f1269957a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.161595 Aug 30 04:43:25.138588 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3617/7355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:24 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:26.161879 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:26.162523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:26.169486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:26.169980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:26.170422 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:26.171700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:26.172159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:26.172588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:26.313556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:26.321481 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cb70477b-483c-454b-bd7b-bd25bc7d0b48 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.163585 Aug 30 04:43:26.322054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3739/7356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:26 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:27.344009 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:27.344664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:27.351692 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:27.352134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:27.352594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:27.353302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:27.353800 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:27.354243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:27.484138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:27.491845 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc080961-f628-4dde-b075-22a5f22d30a7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.152325 Aug 30 04:43:27.492423 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3618/7357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:27 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:28.513794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:28.514415 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:28.521448 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:28.521938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:28.522377 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:28.523094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:28.523550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:28.523976 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:28.658621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:28.666491 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-499d71e1-4463-498d-a911-5188d1d9a193 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.156861 Aug 30 04:43:28.667078 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3740/7358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:28 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:29.688565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:29.689192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:29.696392 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:29.696893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:29.697371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:29.698104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:29.698577 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:29.699020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:29.831288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:29.838997 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27a98acb-7f82-4667-80da-81c06482623a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.154939 Aug 30 04:43:29.839578 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3619/7359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:29 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:30.859692 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:30.860246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:30.867186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:30.867677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:30.868117 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:30.868816 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:30.869301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:30.869754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:31.010272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:31.019089 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5685f80-ca23-4650-b571-b6dc86cd1853 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.163410 Aug 30 04:43:31.019658 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3741/7360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:30 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:32.046759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:32.047397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:32.054461 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:32.054967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:32.055421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:32.056129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:32.056603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:32.057091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:32.518378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:32.526254 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80a530ae-9312-4182-bd0c-9cc6f5b57c19 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.485987 Aug 30 04:43:32.526832 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3620/7361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:32 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:33.547827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:33.548504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:33.556012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:33.556501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:33.556938 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:33.557656 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:33.558366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:33.558793 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:33.707298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:33.715126 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e5a7d1f4-5a55-404e-8d4a-1b457ca3a612 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.171255 Aug 30 04:43:33.715693 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3742/7362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:33 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:34.782167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:34.782799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:34.788868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:34.789403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:34.789863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:34.790571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:34.791042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:34.791487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:34.924472 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:34.932259 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ccd46e36-1b93-4252-a2cb-95b06881df20 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1696 microversion: 2.1 time: 0.200007 Aug 30 04:43:34.932838 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3621/7363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:34 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:35.954194 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:35.954797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:35.961851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:35.962353 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:35.962790 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:35.963485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:35.963936 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:35.964358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:36.169384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:36.177655 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-96efd50b-fea9-4916-9878-6098b1657cae tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1695 microversion: 2.1 time: 0.227901 Aug 30 04:43:36.178248 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3743/7364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:35 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1695 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:36.228889 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "name": "network-vif-unplugged", "status": "completed", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:36.240225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:36.240723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:36.241175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:36.257936 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] Creating event network-vif-unplugged:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h2-854924-5 Aug 30 04:43:36.265542 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] Instance ccc17f15-acb3-40bf-8890-960d02d787be is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:43:36.277521 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e89160b7-da6d-4bc2-b62a-f3bb8b62f27b req-781e40f0-0e26-4d5b-8968-1ebcb0374245 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052511 Aug 30 04:43:36.278116 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3622/7365] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:37.200981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:37.202581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:37.209908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:37.210390 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:37.210826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:37.211523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:37.211980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:37.212401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:37.360955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:37.368778 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f59fa71c-5b7f-42b3-acea-2ce4a75658cf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1695 microversion: 2.1 time: 0.173297 Aug 30 04:43:37.369458 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3744/7366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:37 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:38.316534 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:38.326358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:38.326856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:38.327301 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:38.339951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] Creating event network-changed:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h2-854924-5 Aug 30 04:43:38.345952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] Instance ccc17f15-acb3-40bf-8890-960d02d787be is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:43:38.357473 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e00f90b7-5c45-46a4-8f3b-b83ef63073b2 req-596a15a8-fd4d-49a0-b6e1-c520f97cec90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046422 Aug 30 04:43:38.358773 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3623/7367] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:38.391049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:38.392526 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:38.400826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:38.401715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:38.402517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:38.403485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:38.404158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:38.404788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:38.664475 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:38.673074 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-bfa87078-3afb-41f7-8fe6-b5f7e35eb425 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1693 microversion: 2.1 time: 0.286169 Aug 30 04:43:38.673737 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3745/7368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:38 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1693 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:39.699849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:39.700562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:39.707415 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.708268 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.708726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.709466 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.709935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.710371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.882953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:39.891694 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3a29e00f-2a69-424d-9a29-de908e0d70f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1690 microversion: 2.1 time: 0.196976 Aug 30 04:43:39.892275 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3624/7369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:39 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1690 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:39.913020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:39.913587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:39.920565 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.921061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.921555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.922257 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.922719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.923147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.984839 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0109faa6-c793-4dfb-a04a-4b22e686b7d0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action" status: 204 len: 0 microversion: 2.1 time: 0.075485 Aug 30 04:43:39.985518 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3746/7370] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:43:39 2022] POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:43:39.994951 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:39.995571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:40.001619 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.002190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.002777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.003515 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.004017 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.004496 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.144114 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:40.152526 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2c737877-f9b5-4245-b75c-8ec25c427b11 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1690 microversion: 2.1 time: 0.162500 Aug 30 04:43:40.153111 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3625/7371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:39 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:40.174142 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:40.174845 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:40.181094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.181620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.182061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.182761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.183215 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.183639 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.332710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:40.340929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77f36fce-d018-42ff-9080-4fc8ec6c2ff9 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1690 microversion: 2.1 time: 0.170972 Aug 30 04:43:40.341751 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3747/7372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:40 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:43:40.393727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "name": "network-vif-plugged", "status": "completed", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:40.405557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.406107 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.406614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.420626 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] Creating event network-vif-plugged:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h2-854924-5 Aug 30 04:43:40.426606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] Instance ccc17f15-acb3-40bf-8890-960d02d787be is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854924-5', 'n-h1-854924-5'} {{(pid=122167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:43:40.438170 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-2bb32868-ae44-4ee4-8528-3d66d9a51376 req-417a90a3-0ab8-429a-a9fc-5239025359e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050366 Aug 30 04:43:40.439115 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3626/7373] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:43:41.362895 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:41.363503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:41.370000 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:41.370566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:41.370923 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:41.371602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:41.372049 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:41.372469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:41.515337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:41.525321 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-33351a3a-6566-44c9-91fc-7729c668c97b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1682 microversion: 2.1 time: 0.166625 Aug 30 04:43:41.525928 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3748/7374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:41 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:03.720305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=28 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:03.721104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:03.725604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:03.727904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:03.735725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:03.736228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:03.736682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:03.737480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:03.737974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:03.738778 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:03.793841 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dba520ef-6496-4e9e-b8dd-be46cb112f2b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action" status: 200 len: 24574 microversion: 2.1 time: 0.075768 Aug 30 04:44:03.794697 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3627/7375] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:44:03 2022] POST /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:44:10.784401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:10.784954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:10.788164 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=24 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:10.788917 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:10.790227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-6d4be9c2-047f-4935-995a-cbd75b986eb0 req-e7df7ea3-9063-48ec-a331-2a4738fe113b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:10.795786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:10.796358 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:10.797289 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:10.798026 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:10.798470 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:10.798890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:10.805467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6d4be9c2-047f-4935-995a-cbd75b986eb0 req-e7df7ea3-9063-48ec-a331-2a4738fe113b service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:10.806212 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6d4be9c2-047f-4935-995a-cbd75b986eb0 req-e7df7ea3-9063-48ec-a331-2a4738fe113b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:10.806691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-6d4be9c2-047f-4935-995a-cbd75b986eb0 req-e7df7ea3-9063-48ec-a331-2a4738fe113b service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:10.819498 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-6d4be9c2-047f-4935-995a-cbd75b986eb0 req-e7df7ea3-9063-48ec-a331-2a4738fe113b service nova] Creating event network-changed:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h2-854924-5 Aug 30 04:44:10.824629 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-6d4be9c2-047f-4935-995a-cbd75b986eb0 req-e7df7ea3-9063-48ec-a331-2a4738fe113b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040048 Aug 30 04:44:10.825453 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3628/7376] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:44:10.829751 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:44:10.925127 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2a79fd2-4d5f-433e-87ba-d5d2bcd89507 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 204 len: 0 microversion: 2.1 time: 0.144402 Aug 30 04:44:10.926194 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3749/7377] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:44:10 2022] DELETE /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:44:10.936312 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:10.937508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:10.943752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:10.944264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:10.944891 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:10.945532 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:10.946002 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:10.946447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:11.111055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:11.119499 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-39b0f281-3842-4f48-a383-5c478ef7c674 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1688 microversion: 2.1 time: 0.188038 Aug 30 04:44:11.120097 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3629/7378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:10 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:12.144825 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:12.145554 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:12.151740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:12.152232 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:12.152670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:12.153383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:12.153903 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:12.154328 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:12.662104 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:44:12.662375 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be (ip 10.222.0.30) !!! Aug 30 04:44:12.690892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:12.699896 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d76a925c-0b20-4d9d-a035-43ac1ae34b50 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 200 len: 1688 microversion: 2.1 time: 0.559410 Aug 30 04:44:12.700710 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3750/7379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:12 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 1688 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:13.077538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9eacd278-913a-4d6e-b6a6-ba6d936cf45b req-cffc39ac-93be-439b-906e-07fc7c1f37cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc17f15-acb3-40bf-8890-960d02d787be", "name": "network-vif-deleted", "tag": "2d3cca85-f01f-40d7-a152-2dfa82058249"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:13.090932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9eacd278-913a-4d6e-b6a6-ba6d936cf45b req-cffc39ac-93be-439b-906e-07fc7c1f37cc service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:13.091454 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9eacd278-913a-4d6e-b6a6-ba6d936cf45b req-cffc39ac-93be-439b-906e-07fc7c1f37cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:13.091909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9eacd278-913a-4d6e-b6a6-ba6d936cf45b req-cffc39ac-93be-439b-906e-07fc7c1f37cc service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:13.105765 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9eacd278-913a-4d6e-b6a6-ba6d936cf45b req-cffc39ac-93be-439b-906e-07fc7c1f37cc service nova] Creating event network-vif-deleted:2d3cca85-f01f-40d7-a152-2dfa82058249 for instance ccc17f15-acb3-40bf-8890-960d02d787be on n-h2-854924-5 Aug 30 04:44:13.112029 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9eacd278-913a-4d6e-b6a6-ba6d936cf45b req-cffc39ac-93be-439b-906e-07fc7c1f37cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038554 Aug 30 04:44:13.112841 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3630/7380] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:13.723994 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:13.724620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: ccc17f15-acb3-40bf-8890-960d02d787be] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:13.731482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:13.731970 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:13.732413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:13.733103 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:13.733585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:13.734666 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:13.748212 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] HTTP exception thrown: Instance ccc17f15-acb3-40bf-8890-960d02d787be could not be found. Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Request method failure captured: Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be HTTP/1.1 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZRL22nVBzbm3CobZJc6yka_o5v-67PC-bWX0Fv7oU6SBha3R5SoSBS-zaO48OkKbzZhhyF1rtO0jR2TNTLib9REZlLAkAbE4-kBKQUs2eElp5XzenzW-HvhpKy9SE2bNeMbKQgncyE9qMUa5h7K8l7n35Ab1ySzv9fPOzJoR8XlcSU Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6fb4d23dbd2412da3453aa9224e08ce", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}] Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a85abcae77c2416f80f9a0c00551e528 Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance ccc17f15-acb3-40bf-8890-960d02d787be could not be found. Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'ccc17f15-acb3-40bf-8890-960d02d787be'} Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc17f15-acb3-40bf-8890-960d02d787be could not be found. Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc17f15-acb3-40bf-8890-960d02d787be could not be found. Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:44:13.749899 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc17f15-acb3-40bf-8890-960d02d787be could not be found. Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Returning 404 to user: Instance ccc17f15-acb3-40bf-8890-960d02d787be could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81140abb-0937-4ef2-beab-80024dd8f244 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be" status: 404 len: 111 microversion: 2.1 time: 0.031259 Aug 30 04:44:13.754911 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3751/7381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:13 2022] GET /compute/v2.1/servers/ccc17f15-acb3-40bf-8890-960d02d787be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:44:16.786361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f1d9693f-641c-4db6-b3b4-fe367a9b8dee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '.version_select at 0x7f897adc5160>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:16.808352 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f1d9693f-641c-4db6-b3b4-fe367a9b8dee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1196484147" status: 202 len: 0 microversion: 2.1 time: 0.027660 Aug 30 04:44:16.808963 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3631/7382] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Aug 30 04:44:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1196484147 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:44:16.836454 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c68ccee8-a7a6-4707-b3f6-29b0559a4da2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: .version_select at 0x7f897a983c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1058606301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmVpOltgk89IoDWiv4RsXqI2fE47dQc/emQXL7AGb3G1Pcl6NEkJPMj84RIBF6fYL1MnUEQ5mZ0bDDBUlsfHValmclEls+/8vhFrtMSZ+OKINb6s2QcSeYdq7EcQ4+qGg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:16.854319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c68ccee8-a7a6-4707-b3f6-29b0559a4da2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:44:16.861015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-c68ccee8-a7a6-4707-b3f6-29b0559a4da2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:44:16.894669 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c68ccee8-a7a6-4707-b3f6-29b0559a4da2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062086 Aug 30 04:44:16.895438 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3752/7383] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:44:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:22.475591 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1635644416", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "f72205d6-d29a-46b6-a371-ae3eec3278b3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1058606301", "security_groups": [{"name": "tempest-secgroup-smoke-685065573"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:22.642275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] validate_networks() for [('f72205d6-d29a-46b6-a371-ae3eec3278b3', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:44:23.083680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:44:23.084215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:44:23.084717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:44:23.085180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:44:23.086367 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:44:23.096599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:23.099414 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:23.100378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:23.101274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:23.102508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:23.102862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:23.103380 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:23.123283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:44:23.129497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:44:23.144047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:44:23.146604 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:44:23.197655 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78cb5a16-6e34-45a6-807a-d0800e1fe932 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727140 Aug 30 04:44:23.198507 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3632/7384] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:44:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:44:23.211062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9297338e-f9ee-444b-a64f-4b6c0860a37d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:23.211964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9297338e-f9ee-444b-a64f-4b6c0860a37d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:23.293303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9297338e-f9ee-444b-a64f-4b6c0860a37d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:23.301044 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9297338e-f9ee-444b-a64f-4b6c0860a37d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1267 microversion: 2.1 time: 0.094449 Aug 30 04:44:23.301652 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3753/7385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:23 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:44:24.323262 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:24.324706 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:24.333083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:24.333720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:24.334241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:24.337974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:24.338709 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:24.339370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:24.416949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:24.427959 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-25708de9-1003-4c11-9995-f6b898fa89ec tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1327 microversion: 2.1 time: 0.108686 Aug 30 04:44:24.434376 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3633/7386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:24 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:25.450607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:25.451227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:25.453654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:25.475099 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:25.476252 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:25.476965 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:25.482172 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:25.482665 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:25.483112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:25.631851 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:25.641199 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-34f7c1a4-9408-4e83-9073-55f23f87544c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1392 microversion: 2.1 time: 0.194370 Aug 30 04:44:25.642314 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3754/7387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:25 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:25.807092 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1de112c1-5f73-4b01-9700-873592ea8e57 req-0954b804-8603-4722-a5ac-45e10308f9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b90844-e3ad-4384-83b6-b6ee78da5967", "tag": "3cbaca31-caea-4945-a683-1a7e0093375f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:25.819476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1de112c1-5f73-4b01-9700-873592ea8e57 req-0954b804-8603-4722-a5ac-45e10308f9e7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:25.819980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1de112c1-5f73-4b01-9700-873592ea8e57 req-0954b804-8603-4722-a5ac-45e10308f9e7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:25.820428 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1de112c1-5f73-4b01-9700-873592ea8e57 req-0954b804-8603-4722-a5ac-45e10308f9e7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:25.831992 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1de112c1-5f73-4b01-9700-873592ea8e57 req-0954b804-8603-4722-a5ac-45e10308f9e7 service nova] Creating event network-changed:3cbaca31-caea-4945-a683-1a7e0093375f for instance a8b90844-e3ad-4384-83b6-b6ee78da5967 on n-h2-854924-5 Aug 30 04:44:25.836864 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1de112c1-5f73-4b01-9700-873592ea8e57 req-0954b804-8603-4722-a5ac-45e10308f9e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033637 Aug 30 04:44:25.837736 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3634/7388] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:26.662791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:26.664203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:26.672024 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:26.672519 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:26.672961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:26.673754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:26.674219 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:26.674648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:26.805368 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:26.813765 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab62d4ec-a589-47d0-bffa-e021a4268e81 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1392 microversion: 2.1 time: 0.154932 Aug 30 04:44:26.814573 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3755/7389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:26 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:27.839666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:27.840375 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:27.847245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:27.847744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:27.848201 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:27.848907 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:27.849451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:27.849898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:27.991905 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:27.999827 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b7d7e8aa-f0d2-457f-b472-e1a76e37eaa1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1392 microversion: 2.1 time: 0.165283 Aug 30 04:44:28.000410 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3635/7390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:27 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:44:29.021102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:29.021760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:29.028606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:29.029096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:29.029570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:29.030269 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:29.030726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:29.031387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:29.161785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:29.169477 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8150d72a-d528-4b9d-9760-8657b6262b56 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1392 microversion: 2.1 time: 0.152350 Aug 30 04:44:29.170047 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3756/7391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:29 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:30.190939 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:30.191588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:30.198593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:30.199099 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:30.199552 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:30.200258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:30.200730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:30.201171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:30.339744 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:30.348325 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c189ac8f-bebf-4bc9-93d5-dc73b5d898f3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1392 microversion: 2.1 time: 0.161251 Aug 30 04:44:30.348915 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3636/7392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:30 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:30.557009 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b3d317cf-80ed-41fa-83da-b1eff12dd20f req-1503b971-e017-4e6b-b74e-7c3187ff07ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b90844-e3ad-4384-83b6-b6ee78da5967", "name": "network-vif-plugged", "status": "completed", "tag": "3cbaca31-caea-4945-a683-1a7e0093375f"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:30.567028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b3d317cf-80ed-41fa-83da-b1eff12dd20f req-1503b971-e017-4e6b-b74e-7c3187ff07ce service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:30.567510 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b3d317cf-80ed-41fa-83da-b1eff12dd20f req-1503b971-e017-4e6b-b74e-7c3187ff07ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:30.567944 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b3d317cf-80ed-41fa-83da-b1eff12dd20f req-1503b971-e017-4e6b-b74e-7c3187ff07ce service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:30.579665 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b3d317cf-80ed-41fa-83da-b1eff12dd20f req-1503b971-e017-4e6b-b74e-7c3187ff07ce service nova] Creating event network-vif-plugged:3cbaca31-caea-4945-a683-1a7e0093375f for instance a8b90844-e3ad-4384-83b6-b6ee78da5967 on n-h2-854924-5 Aug 30 04:44:30.584810 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b3d317cf-80ed-41fa-83da-b1eff12dd20f req-1503b971-e017-4e6b-b74e-7c3187ff07ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Aug 30 04:44:30.585453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3757/7393] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:31.369655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:31.370203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:31.376929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:31.377444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:31.377895 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:31.378598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:31.379063 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:31.379499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:31.508802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:31.517388 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fdb0bdb4-b4df-4c81-8087-977fc5de46d5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1392 microversion: 2.1 time: 0.151730 Aug 30 04:44:31.517972 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3637/7394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:31 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:32.538646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:32.539346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:32.545535 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.546622 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.547059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.547742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.548199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.548623 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.678787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:32.686742 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc7a8945-3603-4f99-a9dd-bf942f4e914c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1565 microversion: 2.1 time: 0.153135 Aug 30 04:44:32.687319 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3758/7395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:32 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:32.709036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:32.709707 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:32.716716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.717249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.718384 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.719152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.719633 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.720080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.859431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:32.867400 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fa6230ea-527a-4135-acf7-2ae7b8e78ff2 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1565 microversion: 2.1 time: 0.163029 Aug 30 04:44:32.868021 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3638/7396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:32 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:34.855129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:34.855759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:34.858214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.859790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-42a52bfd-1631-45dd-aa28-805ea8be81cc req-8855cd27-8991-4df0-91b4-995af5bbd2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b90844-e3ad-4384-83b6-b6ee78da5967", "tag": "3cbaca31-caea-4945-a683-1a7e0093375f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:34.865036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:34.865464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:34.866005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:34.866947 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:34.867569 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:34.867919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:34.868045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.868759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.869614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.872276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-42a52bfd-1631-45dd-aa28-805ea8be81cc req-8855cd27-8991-4df0-91b4-995af5bbd2a4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:34.872276 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-42a52bfd-1631-45dd-aa28-805ea8be81cc req-8855cd27-8991-4df0-91b4-995af5bbd2a4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:34.873030 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-42a52bfd-1631-45dd-aa28-805ea8be81cc req-8855cd27-8991-4df0-91b4-995af5bbd2a4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:34.885693 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-42a52bfd-1631-45dd-aa28-805ea8be81cc req-8855cd27-8991-4df0-91b4-995af5bbd2a4 service nova] Creating event network-changed:3cbaca31-caea-4945-a683-1a7e0093375f for instance a8b90844-e3ad-4384-83b6-b6ee78da5967 on n-h2-854924-5 Aug 30 04:44:34.891881 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-42a52bfd-1631-45dd-aa28-805ea8be81cc req-8855cd27-8991-4df0-91b4-995af5bbd2a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036234 Aug 30 04:44:34.893002 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3639/7397] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:44:35.020403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:35.029741 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5a160175-0bb6-4a2d-a180-6921142cd590 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1565 microversion: 2.1 time: 0.178993 Aug 30 04:44:35.030680 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3759/7398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:34 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:56.283844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=36 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:56.288536 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:56.290935 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:56.299158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:56.299658 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:56.300112 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:56.300821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:56.301290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:56.301764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:56.354345 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2ff70e92-c7d1-4e79-9e65-11d479fb5713 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action" status: 200 len: 24569 microversion: 2.1 time: 0.072970 Aug 30 04:44:56.362377 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3640/7399] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:44:56 2022] POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:45:07.368287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-860403dd-b4eb-4a13-99b5-569db38f6b5c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:07.370607 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.371399 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=32 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.379163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-860403dd-b4eb-4a13-99b5-569db38f6b5c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:07.379684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-860403dd-b4eb-4a13-99b5-569db38f6b5c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:07.380236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-860403dd-b4eb-4a13-99b5-569db38f6b5c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:07.403827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-860403dd-b4eb-4a13-99b5-569db38f6b5c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Going to try to stop instance {{(pid=122168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:45:07.449969 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-860403dd-b4eb-4a13-99b5-569db38f6b5c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action" status: 202 len: 0 microversion: 2.1 time: 0.085457 Aug 30 04:45:07.450569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3760/7400] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:07 2022] POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:45:07.460339 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:07.461071 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:07.464407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.465078 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=4 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.471956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:07.472480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:07.472947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:07.473657 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:07.474123 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:07.474564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:07.621006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:07.631615 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3ced8e08-0a21-4c05-86a4-559330f0acfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.175529 Aug 30 04:45:07.632252 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3641/7401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:07 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:45:08.660642 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:08.661334 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:08.667503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:08.667981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:08.668411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:08.669085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:08.670055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:08.670482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:08.812849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:08.823860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d1597705-4940-46bb-ba40-4e3fc31c218c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.168295 Aug 30 04:45:08.824435 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3761/7402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:08 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:09.847898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:09.848528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:09.855512 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:09.856013 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:09.856463 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:09.857782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:09.858253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:09.858740 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:09.989584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:09.997421 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2e4ed033-bd78-4cef-945e-926afcba3bfe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.153589 Aug 30 04:45:09.998030 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3642/7403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:09 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:11.019323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:11.020221 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:11.027163 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:11.027643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:11.028076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:11.028766 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:11.029826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:11.030254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:11.165301 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:11.173182 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-71810199-6d9d-4c9b-933b-c9b60ac15032 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.157831 Aug 30 04:45:11.173788 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3762/7404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:11 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:12.195551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:12.196173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:12.203219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:12.203716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:12.204163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:12.204868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:12.205333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:12.205796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:12.340749 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:12.349267 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4930bdd-2e9c-4dd7-853e-1afff24c1cda tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.157743 Aug 30 04:45:12.349879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3643/7405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:12 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:13.370798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:13.371343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:13.378228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:13.378730 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:13.379158 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:13.379850 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:13.380318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:13.380765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:13.530840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:13.539169 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-77f6d6eb-4cfa-4556-ab3d-418cbded3595 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.172290 Aug 30 04:45:13.539975 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3763/7406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:13 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:14.563163 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:14.563785 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:14.570835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:14.571338 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:14.571795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:14.572514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:14.572974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:14.573455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:14.714960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:14.722986 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6335b4e0-d5e0-422a-a872-3789359870ee tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.164412 Aug 30 04:45:14.723564 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3644/7407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:14 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:15.744647 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:15.745270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:15.753237 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:15.753758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:15.754204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:15.754904 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:15.755360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:15.755788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:15.889677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:15.897757 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2318523d-1d10-46d4-ad56-f56b81d6be79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.156893 Aug 30 04:45:15.898343 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3764/7408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:15 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:16.921783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:16.922417 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:16.929766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:16.930278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:16.930731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:16.931453 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:16.931929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:16.932373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:17.073499 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:17.082067 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ffff33e9-a021-4a07-a3b6-27e3cd774fa7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.166719 Aug 30 04:45:17.083039 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3645/7409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:16 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:18.104827 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:18.105479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:18.114246 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:18.114736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:18.115178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:18.115862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:18.116309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:18.116731 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:18.251051 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:18.258929 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31b3ba95-f727-4a32-a5e1-b8ce30eb4fac tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.157945 Aug 30 04:45:18.259500 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3765/7410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:18 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:19.280340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:19.280964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:19.287887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:19.288385 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:19.288833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:19.289638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:19.290108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:19.290546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:19.423223 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:19.431036 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-43a9f9d0-92fd-4406-8c68-002310098f79 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.154605 Aug 30 04:45:19.431608 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3646/7411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:19 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:20.452664 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:20.453316 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:20.460268 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:20.460821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:20.461259 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:20.462036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:20.462568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:20.463041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:20.598176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:20.605970 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-906c7b4c-f4ff-4c98-9007-7230b2ff1b03 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.157852 Aug 30 04:45:20.606549 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3766/7412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:20 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:21.629876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:21.630540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:21.637717 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:21.638224 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:21.638684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:21.639390 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:21.639863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:21.640308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:21.771609 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:21.779819 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c88ac550-b3cb-4f7b-9e62-8c74fa30ed7f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1693 microversion: 2.1 time: 0.153974 Aug 30 04:45:21.780409 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3647/7413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:21 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:22.801506 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:22.802087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:22.808703 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:22.809186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:22.809643 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:22.811022 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:22.811472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:22.811896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:22.948327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:22.956122 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b162f655-ddd9-47db-b6f8-bdae6dfca6c8 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1670 microversion: 2.1 time: 0.158704 Aug 30 04:45:22.956700 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3767/7414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:22 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:24.050457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:24.052641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:24.059588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.060606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.061054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:24.061782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.062245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.062679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:24.119370 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c19e69f1-eec2-44bc-9939-cb5245f0d085 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action" status: 200 len: 38352 microversion: 2.1 time: 0.072813 Aug 30 04:45:24.120079 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3648/7415] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:24 2022] POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action => generated 38352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:45:24.132560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4e3f14d7-6043-4350-ac69-1e00812c0f5f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:24.140468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e3f14d7-6043-4350-ac69-1e00812c0f5f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.140949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e3f14d7-6043-4350-ac69-1e00812c0f5f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.141409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4e3f14d7-6043-4350-ac69-1e00812c0f5f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:24.164254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4e3f14d7-6043-4350-ac69-1e00812c0f5f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Going to try to start instance {{(pid=122168) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:45:24.212382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4e3f14d7-6043-4350-ac69-1e00812c0f5f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action" status: 202 len: 0 microversion: 2.1 time: 0.083577 Aug 30 04:45:24.213013 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3768/7416] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:24 2022] POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:45:24.222064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:24.222780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:24.229925 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.230424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.230880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:24.231608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.232090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.232653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:24.381572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:24.389861 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-db2b341c-6f78-483e-b726-b64bc4c7c6db tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1679 microversion: 2.1 time: 0.171967 Aug 30 04:45:24.390442 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3649/7417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:24 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:25.413603 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:25.414320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:25.420420 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:25.420896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:25.421322 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:25.422017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:25.422462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:25.422881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:25.557136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:25.566410 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f0cb6c01-6bb2-4193-9e5a-f20fa0f02cfc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1683 microversion: 2.1 time: 0.157939 Aug 30 04:45:25.566997 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3769/7418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:25 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:51.763561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:51.765903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:51.768760 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=18 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:51.769462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=52 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:51.776090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:51.776590 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:51.777044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:51.778316 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:51.778786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:51.779225 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:51.834403 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-10e48f6e-7cfa-4739-84e4-84fbc010b2da tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action" status: 200 len: 62897 microversion: 2.1 time: 0.075019 Aug 30 04:45:51.835073 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3650/7419] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:51 2022] POST /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967/action => generated 62897 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:45:58.961890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:58.962807 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:58.966003 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=20 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:58.968633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:58.969983 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:45:58.970184 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:45:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 (ip 10.222.0.30) !!! Aug 30 04:45:58.977093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:58.977854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:58.978303 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:58.979020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:58.979479 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:58.979909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:59.010504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:45:59.023821 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-d3584959-addf-4e7d-aa52-8066400d25fe req-71489f15-2201-4640-9663-86291222b83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b90844-e3ad-4384-83b6-b6ee78da5967", "tag": "3cbaca31-caea-4945-a683-1a7e0093375f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:59.036299 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d3584959-addf-4e7d-aa52-8066400d25fe req-71489f15-2201-4640-9663-86291222b83a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:59.037148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d3584959-addf-4e7d-aa52-8066400d25fe req-71489f15-2201-4640-9663-86291222b83a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:59.037852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-d3584959-addf-4e7d-aa52-8066400d25fe req-71489f15-2201-4640-9663-86291222b83a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:59.049786 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-d3584959-addf-4e7d-aa52-8066400d25fe req-71489f15-2201-4640-9663-86291222b83a service nova] Creating event network-changed:3cbaca31-caea-4945-a683-1a7e0093375f for instance a8b90844-e3ad-4384-83b6-b6ee78da5967 on n-h2-854924-5 Aug 30 04:45:59.055749 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-d3584959-addf-4e7d-aa52-8066400d25fe req-71489f15-2201-4640-9663-86291222b83a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095999 Aug 30 04:45:59.056525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3651/7420] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:45:59.105671 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-924b3be9-d68c-44b6-95ea-e30f3fc81984 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 204 len: 0 microversion: 2.1 time: 0.147779 Aug 30 04:45:59.106542 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3770/7421] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:45:58 2022] DELETE /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:45:59.116361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:59.117122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:59.123695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:59.124320 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:59.124782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:59.125565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:59.126035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:59.126483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:59.280331 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:59.288447 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5c55835b-a748-4227-b67f-58f7e4c082f4 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1689 microversion: 2.1 time: 0.176876 Aug 30 04:45:59.289319 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3652/7422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:59 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:46:00.315877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:00.317798 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:00.330180 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:00.331072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:00.331846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:00.333108 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:00.333955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:00.334734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:00.473542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:00.481304 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9925ce0-10d6-4cac-ac26-07b8847d43fc tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 200 len: 1689 microversion: 2.1 time: 0.174097 Aug 30 04:46:00.481907 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3771/7423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:00 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:01.066054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-4ff91f71-8440-4245-bf8a-9f27f04fe0d9 req-80864b27-5e07-4146-9876-6b3f367427a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b90844-e3ad-4384-83b6-b6ee78da5967", "name": "network-vif-deleted", "tag": "3cbaca31-caea-4945-a683-1a7e0093375f"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:01.075516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4ff91f71-8440-4245-bf8a-9f27f04fe0d9 req-80864b27-5e07-4146-9876-6b3f367427a1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:01.076018 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4ff91f71-8440-4245-bf8a-9f27f04fe0d9 req-80864b27-5e07-4146-9876-6b3f367427a1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:01.076465 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-4ff91f71-8440-4245-bf8a-9f27f04fe0d9 req-80864b27-5e07-4146-9876-6b3f367427a1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:01.088604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-4ff91f71-8440-4245-bf8a-9f27f04fe0d9 req-80864b27-5e07-4146-9876-6b3f367427a1 service nova] Creating event network-vif-deleted:3cbaca31-caea-4945-a683-1a7e0093375f for instance a8b90844-e3ad-4384-83b6-b6ee78da5967 on n-h2-854924-5 Aug 30 04:46:01.093963 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-4ff91f71-8440-4245-bf8a-9f27f04fe0d9 req-80864b27-5e07-4146-9876-6b3f367427a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086348 Aug 30 04:46:01.094924 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3653/7424] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:01.502370 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:01.502990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: a8b90844-e3ad-4384-83b6-b6ee78da5967] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:01.510203 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:01.510740 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:01.511250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:01.512378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:01.513083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:01.513672 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:01.528930 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] HTTP exception thrown: Instance a8b90844-e3ad-4384-83b6-b6ee78da5967 could not be found. Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Request method failure captured: Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 HTTP/1.1 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZRL22nVBzbm3CobZJc6yka_o5v-67PC-bWX0Fv7oU6SBha3R5SoSBS-zaO48OkKbzZhhyF1rtO0jR2TNTLib9REZlLAkAbE4-kBKQUs2eElp5XzenzW-HvhpKy9SE2bNeMbKQgncyE9qMUa5h7K8l7n35Ab1ySzv9fPOzJoR8XlcSU Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6fb4d23dbd2412da3453aa9224e08ce", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}] Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a85abcae77c2416f80f9a0c00551e528 Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance a8b90844-e3ad-4384-83b6-b6ee78da5967 could not be found. Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'a8b90844-e3ad-4384-83b6-b6ee78da5967'} Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b90844-e3ad-4384-83b6-b6ee78da5967 could not be found. Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b90844-e3ad-4384-83b6-b6ee78da5967 could not be found. Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:46:01.530539 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b90844-e3ad-4384-83b6-b6ee78da5967 could not be found. Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Returning 404 to user: Instance a8b90844-e3ad-4384-83b6-b6ee78da5967 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d14d7009-43bc-4b0a-a8eb-b22552e74eb5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967" status: 404 len: 111 microversion: 2.1 time: 0.033458 Aug 30 04:46:01.535382 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3772/7425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:01 2022] GET /compute/v2.1/servers/a8b90844-e3ad-4384-83b6-b6ee78da5967 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:46:04.876146 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b4fd0f1-8c72-47c7-b876-94a99b575623 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '.version_select at 0x7f897ba9f940>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:04.897268 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b4fd0f1-8c72-47c7-b876-94a99b575623 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1058606301" status: 202 len: 0 microversion: 2.1 time: 0.026503 Aug 30 04:46:04.897984 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3654/7426] 10.222.0.30 () {58 vars in 1284 bytes} [Tue Aug 30 04:46:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1058606301 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:46:04.931111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-354f850d-b13b-430e-a22c-687723ac2b6a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: .version_select at 0x7f897b165dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-794495673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI4qVR6CwB5Ln2/h5y7HdBQ/Kzmb9koFFA603BU0c1j1waJ3YCtkmW/ygO6N5ttNfDxVmlXBfOIKujXItXi6n78WIhxtcbNjv7qtLM/oVrWGzWRDDyCVAeCl9+nspqKPA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:04.951791 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-354f850d-b13b-430e-a22c-687723ac2b6a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:46:04.957521 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-354f850d-b13b-430e-a22c-687723ac2b6a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:46:04.979923 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-354f850d-b13b-430e-a22c-687723ac2b6a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052619 Aug 30 04:46:04.980977 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3773/7427] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:46:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:10.549611 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1763907330", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "networks": [{"uuid": "ad571709-b77c-47fe-a69a-bc32e9aa5bca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-794495673", "security_groups": [{"name": "tempest-secgroup-smoke-584375458"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:10.711222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] validate_networks() for [('ad571709-b77c-47fe-a69a-bc32e9aa5bca', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:46:11.082072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:11.216291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:46:11.217158 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:46:11.217941 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:46:11.218603 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:46:11.219243 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:46:11.230180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:11.231516 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:11.236374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:11.237492 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:11.238174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:11.238830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:11.260663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:46:11.267508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Getting quotas for user a85abcae77c2416f80f9a0c00551e528 and project d6fb4d23dbd2412da3453aa9224e08ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:46:11.283176 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:46:11.286004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:46:11.350893 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e1793e56-3897-403c-9a13-94ada3662fcf tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805526 Aug 30 04:46:11.351983 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3655/7428] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:46:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:46:11.363829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2cde289b-3714-4d59-9dcd-7a4393593de3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:11.364457 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2cde289b-3714-4d59-9dcd-7a4393593de3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:11.431484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2cde289b-3714-4d59-9dcd-7a4393593de3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:11.446672 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2cde289b-3714-4d59-9dcd-7a4393593de3 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1266 microversion: 2.1 time: 0.087754 Aug 30 04:46:11.447266 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3774/7429] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:11 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:12.472867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:12.473867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:12.484550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:12.485105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:12.485599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:12.486333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:12.487025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:12.487510 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:12.580528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:12.597878 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-78b75c05-3d88-4b93-a796-bfcbe53dbb9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1326 microversion: 2.1 time: 0.133209 Aug 30 04:46:12.604893 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3656/7430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:12 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1326 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:13.621144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:13.621785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:13.629140 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:13.632038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:13.632547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:13.632971 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:13.633785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:13.634192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:13.634614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:13.780277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:13.788605 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7a1c7d31-9cc4-41a0-aa5b-d8bc1e461150 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.171231 Aug 30 04:46:13.789201 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3775/7431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:13 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:13.987514 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-e3b406e9-5440-4fb1-b738-f9d7978c6c7b req-c88fed30-733e-4667-ac71-86693a7a5e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277a0fb6-b3be-4422-b1b7-16cec5e0ea43", "tag": "3a2df9d0-dc01-46a8-b2a3-ced452ac5edf"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:13.999282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e3b406e9-5440-4fb1-b738-f9d7978c6c7b req-c88fed30-733e-4667-ac71-86693a7a5e55 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:13.999282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e3b406e9-5440-4fb1-b738-f9d7978c6c7b req-c88fed30-733e-4667-ac71-86693a7a5e55 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:13.999616 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-e3b406e9-5440-4fb1-b738-f9d7978c6c7b req-c88fed30-733e-4667-ac71-86693a7a5e55 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:14.010873 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-e3b406e9-5440-4fb1-b738-f9d7978c6c7b req-c88fed30-733e-4667-ac71-86693a7a5e55 service nova] Creating event network-changed:3a2df9d0-dc01-46a8-b2a3-ced452ac5edf for instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 on n-h1-854924-5 Aug 30 04:46:14.016592 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-e3b406e9-5440-4fb1-b738-f9d7978c6c7b req-c88fed30-733e-4667-ac71-86693a7a5e55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033022 Aug 30 04:46:14.017194 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3657/7432] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:14.812038 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:14.812806 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:14.820567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:14.821176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:14.821705 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:14.822413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:14.822867 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:14.823280 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:14.962937 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:14.971249 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aec26a73-4fe2-48bb-9885-b6d88199df9d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.164041 Aug 30 04:46:14.971828 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3776/7433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:14 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:15.994238 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:15.994979 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:16.001752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:16.002250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:16.002698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:16.003391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:16.003859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:16.004292 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:16.140108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:16.147870 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-81bc83df-1403-4a32-9048-38ae315a8592 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.158899 Aug 30 04:46:16.148468 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3658/7434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:15 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:17.168241 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:17.168872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:17.175637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:17.176116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:17.176547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:17.177223 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:17.177784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:17.178205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:17.316486 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:17.324952 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-563577a3-72f1-4d11-ae07-8b9845bac59e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.160469 Aug 30 04:46:17.326436 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3777/7435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:17 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:18.347189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:18.347730 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:18.354836 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:18.355345 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:18.355849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:18.356610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:18.357083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:18.357570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:18.491808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:18.499614 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dac8d16f-7d06-4e88-9075-8c99516ee648 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.156503 Aug 30 04:46:18.500184 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3659/7436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:18 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:19.520062 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:19.520679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:19.527560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:19.528044 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:19.528485 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:19.530366 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:19.530911 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:19.531347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:19.675830 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:19.683795 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17ece9b8-000f-44a3-8eb7-edde9bde388a tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.167604 Aug 30 04:46:19.684361 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3778/7437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:19 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:20.704751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:20.706168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:20.712993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:20.713538 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:20.713993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:20.714711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:20.715180 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:20.715622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:20.851579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:20.859474 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef7776f3-f867-481d-a1a0-3a440695e7a5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.159271 Aug 30 04:46:20.860074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3660/7438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:20 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:21.881636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:21.882263 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:21.885075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:21.891631 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:21.892591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:21.893713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:21.894930 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:21.895562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:21.896130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:22.034640 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-1872f9c5-1d29-49c5-a54a-f22f79335c06 req-f6a6d322-cbed-489f-886b-f4e6f4e61cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277a0fb6-b3be-4422-b1b7-16cec5e0ea43", "name": "network-vif-plugged", "status": "completed", "tag": "3a2df9d0-dc01-46a8-b2a3-ced452ac5edf"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:22.042323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:22.047761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:22.048517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:22.050090 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:22.056870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-613a5547-5c97-4299-8a58-652879424cf0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.179202 Aug 30 04:46:22.057487 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3779/7439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:21 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:22.062943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1872f9c5-1d29-49c5-a54a-f22f79335c06 req-f6a6d322-cbed-489f-886b-f4e6f4e61cdb service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:22.063431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1872f9c5-1d29-49c5-a54a-f22f79335c06 req-f6a6d322-cbed-489f-886b-f4e6f4e61cdb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:22.063872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-1872f9c5-1d29-49c5-a54a-f22f79335c06 req-f6a6d322-cbed-489f-886b-f4e6f4e61cdb service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:22.077584 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-1872f9c5-1d29-49c5-a54a-f22f79335c06 req-f6a6d322-cbed-489f-886b-f4e6f4e61cdb service nova] Creating event network-vif-plugged:3a2df9d0-dc01-46a8-b2a3-ced452ac5edf for instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 on n-h1-854924-5 Aug 30 04:46:22.083428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-1872f9c5-1d29-49c5-a54a-f22f79335c06 req-f6a6d322-cbed-489f-886b-f4e6f4e61cdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052403 Aug 30 04:46:22.083637 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3661/7440] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:46:23.078978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:23.079600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:23.086715 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:23.087220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:23.087660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:23.088391 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:23.088846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:23.089274 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:23.228059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:23.235796 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f4ca140c-668c-4d33-a62c-1e689119f714 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1391 microversion: 2.1 time: 0.161163 Aug 30 04:46:23.236391 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3780/7441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:23 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:24.259250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:24.259993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:24.266435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:24.266937 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:24.267391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:24.268108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:24.268565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:24.269005 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:24.405065 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:24.412896 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8d6c3bfb-c74f-4a1a-8cf0-039a0c9d6da1 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1564 microversion: 2.1 time: 0.159913 Aug 30 04:46:24.413743 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3662/7442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:24 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:24.433700 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:24.434315 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:24.441628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:24.442112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:24.442550 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:24.443266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:24.443721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:24.444152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:24.577786 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:24.585556 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-416af67d-ef9a-465b-8a91-d8d3775de7fe tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1564 microversion: 2.1 time: 0.155630 Aug 30 04:46:24.586137 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3781/7443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:24 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:26.165759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:26.166483 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:26.167991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-e2eacf09-3387-44f3-9395-50482c9b181f req-2d359acb-4068-4544-a9cb-554c9d6da7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277a0fb6-b3be-4422-b1b7-16cec5e0ea43", "tag": "3a2df9d0-dc01-46a8-b2a3-ced452ac5edf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:26.175093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:26.175934 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:26.176645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:26.177631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:26.178340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:26.178791 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:26.183862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e2eacf09-3387-44f3-9395-50482c9b181f req-2d359acb-4068-4544-a9cb-554c9d6da7e1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:26.184541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e2eacf09-3387-44f3-9395-50482c9b181f req-2d359acb-4068-4544-a9cb-554c9d6da7e1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:26.185466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-e2eacf09-3387-44f3-9395-50482c9b181f req-2d359acb-4068-4544-a9cb-554c9d6da7e1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:26.201129 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-e2eacf09-3387-44f3-9395-50482c9b181f req-2d359acb-4068-4544-a9cb-554c9d6da7e1 service nova] Creating event network-changed:3a2df9d0-dc01-46a8-b2a3-ced452ac5edf for instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 on n-h1-854924-5 Aug 30 04:46:26.208806 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-e2eacf09-3387-44f3-9395-50482c9b181f req-2d359acb-4068-4544-a9cb-554c9d6da7e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044382 Aug 30 04:46:26.213632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3782/7444] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:46:26.335419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:26.344481 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-27d23768-b18f-426b-bf33-fc7c2d5298f0 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1564 microversion: 2.1 time: 0.183062 Aug 30 04:46:26.345074 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3663/7445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:26 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:09.708276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.709096 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=44 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.713924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:09.716655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:09.724084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:09.724563 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:09.724995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:09.725707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:09.726160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:09.726580 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:09.798532 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8bcb4847-bc2b-455a-9fee-3f92bb5da751 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action" status: 200 len: 24568 microversion: 2.1 time: 0.092058 Aug 30 04:47:09.799205 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3783/7446] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:47:09 2022] POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action => generated 24568 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:47:48.591105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=5 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:48.591857 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=42 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:48.597246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:48.597826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:48.605544 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:48.606056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:48.606517 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:48.607227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:48.607701 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:48.608144 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:48.633391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lazy-loading 'flavor' on Instance uuid 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:47:48.709031 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-928565d9-e009-4079-87ef-98eec2b7333d tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action" status: 202 len: 0 microversion: 2.1 time: 0.119873 Aug 30 04:47:48.709910 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3664/7447] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:47:48 2022] POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:47:48.719367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:48.720084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:48.728821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:48.730244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:48.738784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:48.739266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:48.739699 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:48.740400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:48.740988 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:48.741433 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:48.883148 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:48.892071 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6a1a03c7-0255-4dde-b272-da74c816205c tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1691 microversion: 2.1 time: 0.177248 Aug 30 04:47:48.892582 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3784/7448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:48 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:49.916602 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:49.917319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:49.923527 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:49.924025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:49.924474 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:49.925171 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:49.925664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:49.926102 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:50.057160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:50.065026 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-724c70a4-1e4e-4a5d-88d9-e2a3176f1267 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1691 microversion: 2.1 time: 0.153842 Aug 30 04:47:50.065627 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3665/7449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:49 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:51.087132 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:51.087756 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:51.095277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:51.095763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:51.096197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:51.096894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:51.097362 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:51.097797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:51.231562 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:51.239469 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a352674b-4001-4a88-895f-2dfe08c7ca8e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1674 microversion: 2.1 time: 0.156309 Aug 30 04:47:51.240030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3785/7450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:51 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:52.332197 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:52.334455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:52.341932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:52.342433 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:52.342883 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:52.343596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:52.344061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:52.344503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:52.413152 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2d4e549-5545-4f44-8664-64f53cc6cc8b tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action" status: 200 len: 38326 microversion: 2.1 time: 0.085142 Aug 30 04:47:52.413834 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3666/7451] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:47:52 2022] POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action => generated 38326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:47:52.425856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:52.426412 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:52.433757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:52.434251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:52.434689 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:52.435383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:52.435841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:52.436275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:52.508681 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e9dbd58-6a6f-4959-9506-412dd95f389e tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action" status: 202 len: 0 microversion: 2.1 time: 0.086471 Aug 30 04:47:52.509626 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3786/7452] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:47:52 2022] POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:47:52.519877 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:52.520614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:52.528044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:52.529213 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:52.529409 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:52.530151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:52.530636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:52.531087 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:52.672371 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:52.680273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bdac5ae6-1f68-466f-92f1-1cdbd028e942 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1680 microversion: 2.1 time: 0.164892 Aug 30 04:47:52.680861 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3667/7453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:52 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:53.703856 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:53.704557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:53.711537 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:53.712017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:53.712452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:53.713129 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:53.714411 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:53.715111 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:53.849186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:53.857048 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d831b9fb-f4e0-4f81-ba3d-4381d85bd2b7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1680 microversion: 2.1 time: 0.157458 Aug 30 04:47:53.857649 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3787/7454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:53 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:54.879275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:54.879899 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:54.888175 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:54.888683 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:54.889134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:54.889911 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:54.890378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:54.890846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:55.024521 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:55.032355 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9b9ab4fe-dd65-4e06-8b61-9d77c3c52d04 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1683 microversion: 2.1 time: 0.157166 Aug 30 04:47:55.032938 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3668/7455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:54 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:55.127599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:55.129787 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:55.136527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:55.137004 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:55.137713 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:55.138398 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:55.138848 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:55.139266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:55.202900 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cd499dec-505d-4c0d-8845-f413f7cb4278 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action" status: 200 len: 38326 microversion: 2.1 time: 0.079029 Aug 30 04:47:55.203532 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3788/7456] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:47:55 2022] POST /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43/action => generated 38326 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:47:56.566687 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:56.567221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:56.574928 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c7b4eeb1-57b4-4785-97c0-50b555069a38 req-206c5484-5dc5-4495-9d10-e5a0ea3bf9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277a0fb6-b3be-4422-b1b7-16cec5e0ea43", "tag": "3a2df9d0-dc01-46a8-b2a3-ced452ac5edf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:56.584652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:56.585253 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:56.585879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:56.586011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c7b4eeb1-57b4-4785-97c0-50b555069a38 req-206c5484-5dc5-4495-9d10-e5a0ea3bf9b4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:56.586441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c7b4eeb1-57b4-4785-97c0-50b555069a38 req-206c5484-5dc5-4495-9d10-e5a0ea3bf9b4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:56.586630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:56.586882 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c7b4eeb1-57b4-4785-97c0-50b555069a38 req-206c5484-5dc5-4495-9d10-e5a0ea3bf9b4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:56.587080 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:56.587588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:56.599713 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c7b4eeb1-57b4-4785-97c0-50b555069a38 req-206c5484-5dc5-4495-9d10-e5a0ea3bf9b4 service nova] Creating event network-changed:3a2df9d0-dc01-46a8-b2a3-ced452ac5edf for instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 on n-h1-854924-5 Aug 30 04:47:56.605529 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c7b4eeb1-57b4-4785-97c0-50b555069a38 req-206c5484-5dc5-4495-9d10-e5a0ea3bf9b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034499 Aug 30 04:47:56.606494 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3789/7457] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:47:56.617558 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:47:56.714535 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f404cc56-f87e-4da6-acd3-d57bc7d3992f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 204 len: 0 microversion: 2.1 time: 0.151470 Aug 30 04:47:56.715281 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3669/7458] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:47:56 2022] DELETE /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:47:56.724318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:56.725177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:56.732794 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:56.733462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:56.733999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:56.734788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:56.735360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:56.735878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:56.874829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:56.882572 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2ea03c42-0175-43c0-92b4-f85e47d184e5 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1689 microversion: 2.1 time: 0.162668 Aug 30 04:47:56.883148 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3790/7459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:56 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:57.906376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:57.907095 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:57.913894 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:57.914389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:57.914837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:57.915531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:57.915996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:57.916436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:58.046403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:58.054253 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cc2d801d-7f2c-4db4-b076-13278dd6b2dd tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1689 microversion: 2.1 time: 0.152249 Aug 30 04:47:58.054830 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3670/7460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:57 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:59.049742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-dc6c7da8-0d00-4e06-b8e7-997d5d36e76e req-96e7c0d2-e234-44f2-bf0f-9e6a162bc088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277a0fb6-b3be-4422-b1b7-16cec5e0ea43", "name": "network-vif-deleted", "tag": "3a2df9d0-dc01-46a8-b2a3-ced452ac5edf"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:59.060461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dc6c7da8-0d00-4e06-b8e7-997d5d36e76e req-96e7c0d2-e234-44f2-bf0f-9e6a162bc088 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:59.060869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dc6c7da8-0d00-4e06-b8e7-997d5d36e76e req-96e7c0d2-e234-44f2-bf0f-9e6a162bc088 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:59.061298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-dc6c7da8-0d00-4e06-b8e7-997d5d36e76e req-96e7c0d2-e234-44f2-bf0f-9e6a162bc088 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:59.073329 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-dc6c7da8-0d00-4e06-b8e7-997d5d36e76e req-96e7c0d2-e234-44f2-bf0f-9e6a162bc088 service nova] Creating event network-vif-deleted:3a2df9d0-dc01-46a8-b2a3-ced452ac5edf for instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 on n-h1-854924-5 Aug 30 04:47:59.076216 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:59.076913 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:59.078909 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-dc6c7da8-0d00-4e06-b8e7-997d5d36e76e req-96e7c0d2-e234-44f2-bf0f-9e6a162bc088 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Aug 30 04:47:59.080191 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3791/7461] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:47:59.084067 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:59.084576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:59.085034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:59.085799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:59.086284 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:59.086734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:59.155269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85abcae77c2416f80f9a0c00551e528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fb4d23dbd2412da3453aa9224e08ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:59.164005 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a7d77d03-e803-401a-890c-4aa150a5b0fa tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 200 len: 1351 microversion: 2.1 time: 0.092463 Aug 30 04:47:59.164582 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3671/7462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:59 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:00.187635 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:00.188342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] [instance: 277a0fb6-b3be-4422-b1b7-16cec5e0ea43] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:00.195304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:00.195792 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:00.196231 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:00.196927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:00.197413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:00.197842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:00.211182 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] HTTP exception thrown: Instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 could not be found. Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Request method failure captured: Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 HTTP/1.1 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZRL22nVBzbm3CobZJc6yka_o5v-67PC-bWX0Fv7oU6SBha3R5SoSBS-zaO48OkKbzZhhyF1rtO0jR2TNTLib9REZlLAkAbE4-kBKQUs2eElp5XzenzW-HvhpKy9SE2bNeMbKQgncyE9qMUa5h7K8l7n35Ab1ySzv9fPOzJoR8XlcSU Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6fb4d23dbd2412da3453aa9224e08ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6fb4d23dbd2412da3453aa9224e08ce", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6fb4d23dbd2412da3453aa9224e08ce"}]}] Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: d6fb4d23dbd2412da3453aa9224e08ce Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-407307905 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: a85abcae77c2416f80f9a0c00551e528 Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-407307905-project Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 could not be found. Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '277a0fb6-b3be-4422-b1b7-16cec5e0ea43'} Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 could not be found. Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 could not be found. Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:48:00.212805 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 could not be found. Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Returning 404 to user: Instance 277a0fb6-b3be-4422-b1b7-16cec5e0ea43 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-4c280d4b-0dfb-4281-9b56-31ec67cd8b1f tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43" status: 404 len: 111 microversion: 2.1 time: 0.033309 Aug 30 04:48:00.218205 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3792/7463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:00 2022] GET /compute/v2.1/servers/277a0fb6-b3be-4422-b1b7-16cec5e0ea43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:48:03.231688 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1260c0f3-378e-4884-9b7a-bb4ad42ed6e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] Calling method '.version_select at 0x7f897ab551f0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:03.273857 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1260c0f3-378e-4884-9b7a-bb4ad42ed6e7 tempest-TestNetworkAdvancedServerOps-407307905 tempest-TestNetworkAdvancedServerOps-407307905-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-794495673" status: 202 len: 0 microversion: 2.1 time: 0.036050 Aug 30 04:48:03.274867 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3672/7464] 10.222.0.30 () {58 vars in 1281 bytes} [Tue Aug 30 04:48:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-794495673 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:48:14.997023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=18 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:14.998116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:15.210440 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-12ae6111-8736-4e7a-a6da-82398b2714d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'create', calling method: .version_select at 0x7f897b485af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1023569275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTutkZtRLkhMSRCo0QCMDFsqO/M56wUtYQmlWdui1aO/H4uyhQcoA8W0HkKSpPv+7OpHwBh7SzSvM2TmKpOhrovsE6cM38sLgG/AQ4oNKPAaVdnZUNXDU3Eo2Sk0IHRWA=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:15.230092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-12ae6111-8736-4e7a-a6da-82398b2714d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for project ce12662c74d7469c88edf845bf6a8a21. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:48:15.236294 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-12ae6111-8736-4e7a-a6da-82398b2714d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for user 5dc6730a5b01446aa7b2bd8b4f3b6078 and project ce12662c74d7469c88edf845bf6a8a21. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:48:15.254007 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-12ae6111-8736-4e7a-a6da-82398b2714d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [8f6bc19c-1bbb-4ce9-81d6-6d733f230772] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:48:16.261684 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [None req-12ae6111-8736-4e7a-a6da-82398b2714d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [8f6bc19c-1bbb-4ce9-81d6-6d733f230772] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41924. Aug 30 04:48:16.278996 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-12ae6111-8736-4e7a-a6da-82398b2714d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.291724 Aug 30 04:48:16.279598 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3793/7465] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:48:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:17.456768 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:17.458003 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:17.463865 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-32372302", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1023569275", "security_groups": [{"name": "tempest-secgroup-smoke-1190013071"}], "networks": [{"uuid": "67d87c49-884c-45ff-9d92-38fb50f98514"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:17.582835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] validate_networks() for [('67d87c49-884c-45ff-9d92-38fb50f98514', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:48:17.966361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:48:17.966795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:48:17.967281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:48:17.967700 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:48:17.968334 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:48:17.977607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:17.978135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:17.978555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:17.979288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:17.979751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:17.980185 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.000858 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for project ce12662c74d7469c88edf845bf6a8a21. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:48:18.006652 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for user 5dc6730a5b01446aa7b2bd8b4f3b6078 and project ce12662c74d7469c88edf845bf6a8a21. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:48:18.032757 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:48:18.035550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:48:18.090609 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-581cb0c0-130c-4307-9482-f9632c092c72 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.632774 Aug 30 04:48:18.090609 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3673/7466] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:48:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:48:18.101057 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f118886a-3084-4c1f-ae64-2c019ea712dd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:18.101677 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f118886a-3084-4c1f-ae64-2c019ea712dd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:18.161579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f118886a-3084-4c1f-ae64-2c019ea712dd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:18.170024 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f118886a-3084-4c1f-ae64-2c019ea712dd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1245 microversion: 2.1 time: 0.074066 Aug 30 04:48:18.170728 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3794/7467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:18 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:19.192742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:19.193459 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:19.202154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:19.202680 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:19.203122 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:19.203866 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:19.204332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:19.204771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:19.281887 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:19.289787 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fcaba4f5-000a-4cf5-89b1-d4f1275a531e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1305 microversion: 2.1 time: 0.101838 Aug 30 04:48:19.290397 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3674/7468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:19 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:20.313183 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:20.313955 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:20.324396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:20.325116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:20.325690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:20.326484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:20.327015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:20.328085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:20.529296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:20.537679 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a98732fd-cfb7-4413-a134-b7a7d761d4b6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.229371 Aug 30 04:48:20.538404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3795/7469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:20 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:20.834327 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-b45bdc8e-9195-4a32-8560-3ccedbe0bd63 req-bcc982f8-89f9-4cea-b3f1-8dbc95d61561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:20.850133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b45bdc8e-9195-4a32-8560-3ccedbe0bd63 req-bcc982f8-89f9-4cea-b3f1-8dbc95d61561 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:20.851555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b45bdc8e-9195-4a32-8560-3ccedbe0bd63 req-bcc982f8-89f9-4cea-b3f1-8dbc95d61561 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:20.852976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-b45bdc8e-9195-4a32-8560-3ccedbe0bd63 req-bcc982f8-89f9-4cea-b3f1-8dbc95d61561 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:20.867345 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-b45bdc8e-9195-4a32-8560-3ccedbe0bd63 req-bcc982f8-89f9-4cea-b3f1-8dbc95d61561 service nova] Creating event network-changed:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h2-854924-5 Aug 30 04:48:20.873155 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-b45bdc8e-9195-4a32-8560-3ccedbe0bd63 req-bcc982f8-89f9-4cea-b3f1-8dbc95d61561 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047324 Aug 30 04:48:20.873801 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3675/7470] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:21.559802 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:21.561100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:21.568441 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:21.568929 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:21.569388 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:21.570080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:21.570536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:21.570960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:21.808701 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:21.816784 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-31aafbc8-436c-43c1-9a46-48aa97b0a21b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.260844 Aug 30 04:48:21.817490 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3796/7471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:21 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:22.839470 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:22.840186 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:22.847203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:22.847705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:22.848152 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:22.848843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:22.849310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:22.849765 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.040310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:23.048110 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8011e60-d0e4-4b52-83d9-aff37451e5aa tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.213651 Aug 30 04:48:23.048688 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3676/7472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:22 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:24.068107 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:24.068691 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:24.075432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:24.075909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:24.076339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:24.077016 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:24.077483 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:24.077906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:24.209561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:24.218070 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dbc3bbb1-39ea-4e0a-b69a-fda41898beb0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.153880 Aug 30 04:48:24.218648 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3797/7473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:24 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:25.239727 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:25.240407 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:25.247360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:25.247854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:25.248305 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:25.249000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:25.249494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:25.249943 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:25.382808 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:25.391595 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3067187b-d50d-4e97-be2b-a2fb26bdd49d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.155836 Aug 30 04:48:25.392165 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3677/7474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:25 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:26.412680 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:26.413313 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:26.420967 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.421502 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.421939 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.422637 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.423088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.423518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.562427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:26.570525 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fee1dca1-390c-4c00-af0e-b3f044a73422 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.161764 Aug 30 04:48:26.571099 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3798/7475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:26 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:27.593354 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:27.594435 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:27.605508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.606672 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.607335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.608340 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.609044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.610780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.661676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-1ef5d1fc-aee6-4fbb-9304-4e1bff26d35f req-f560093c-24e9-4a67-a6f6-eb9e1f53e916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "name": "network-vif-plugged", "status": "completed", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:27.672467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1ef5d1fc-aee6-4fbb-9304-4e1bff26d35f req-f560093c-24e9-4a67-a6f6-eb9e1f53e916 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.672948 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1ef5d1fc-aee6-4fbb-9304-4e1bff26d35f req-f560093c-24e9-4a67-a6f6-eb9e1f53e916 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.673466 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-1ef5d1fc-aee6-4fbb-9304-4e1bff26d35f req-f560093c-24e9-4a67-a6f6-eb9e1f53e916 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.686553 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-1ef5d1fc-aee6-4fbb-9304-4e1bff26d35f req-f560093c-24e9-4a67-a6f6-eb9e1f53e916 service nova] Creating event network-vif-plugged:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h2-854924-5 Aug 30 04:48:27.694419 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-1ef5d1fc-aee6-4fbb-9304-4e1bff26d35f req-f560093c-24e9-4a67-a6f6-eb9e1f53e916 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100096 Aug 30 04:48:27.694638 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3799/7476] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:27.860127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:27.868298 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e859ddb2-e813-4b22-b2df-23185a4648b3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.280713 Aug 30 04:48:27.869493 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3678/7477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:27 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:28.892244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=6 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:28.897254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:28.897981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:28.904743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:28.905224 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:28.905695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:28.906387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:28.906839 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:28.907262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:29.056210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:29.064719 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c5957b00-310d-4934-ac5c-492c65d34311 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1371 microversion: 2.1 time: 0.173354 Aug 30 04:48:29.065430 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3800/7478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:28 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:30.086068 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:30.086636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:30.088565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:30.089313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:30.096550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.097046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.097522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.098232 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.098698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.099133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.233748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:30.241567 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c38a1443-0021-4524-9d02-7f52e1f4aadd tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1554 microversion: 2.1 time: 0.159622 Aug 30 04:48:30.242141 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3679/7479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:30 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:30.262177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:30.263046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:30.269909 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.270400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.270842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.271530 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.271986 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.272414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.411015 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:30.419703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5cc5628a-4a64-4be6-86a0-24a44fc718f3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1554 microversion: 2.1 time: 0.161549 Aug 30 04:48:30.420281 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3801/7480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:30 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:32.079423 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-0b9a8457-9532-42df-86e4-1d28ef10e0c7 req-ae01a152-33ec-47c0-adc5-50630638fe32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:32.090355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0b9a8457-9532-42df-86e4-1d28ef10e0c7 req-ae01a152-33ec-47c0-adc5-50630638fe32 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:32.090850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0b9a8457-9532-42df-86e4-1d28ef10e0c7 req-ae01a152-33ec-47c0-adc5-50630638fe32 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:32.091291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-0b9a8457-9532-42df-86e4-1d28ef10e0c7 req-ae01a152-33ec-47c0-adc5-50630638fe32 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:32.106897 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-0b9a8457-9532-42df-86e4-1d28ef10e0c7 req-ae01a152-33ec-47c0-adc5-50630638fe32 service nova] Creating event network-changed:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h2-854924-5 Aug 30 04:48:32.112191 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-0b9a8457-9532-42df-86e4-1d28ef10e0c7 req-ae01a152-33ec-47c0-adc5-50630638fe32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036462 Aug 30 04:48:32.113221 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3680/7481] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:27.453930 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:50:27.454769 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:50:27.455593 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:27.456326 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=38 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:27.457923 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:50:27.458167 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91/action (ip 10.222.0.30) !!! Aug 30 04:50:27.463394 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:27.463920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:27.472935 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:27.473425 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:27.473964 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:27.474655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:27.475102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:27.475628 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:27.502586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lazy-loading 'flavor' on Instance uuid 14d0556d-c3cf-4422-ae31-933364400d91 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:50:27.686014 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-06186eb1-9b26-4fd4-868b-653be80a86bb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91/action" status: 202 len: 0 microversion: 2.1 time: 0.233626 Aug 30 04:50:27.686632 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3802/7482] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:50:27 2022] POST /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:50:27.694932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:27.695696 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=36 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:27.697547 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 04:50:27.697702 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 (ip 10.222.0.30) !!! Aug 30 04:50:27.705373 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:27.706091 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:27.721572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:27.722073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:27.722520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:27.723227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:27.724376 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:27.724830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:27.861436 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:27.870199 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-95c8617b-5bdf-4a9a-9d05-2e6101cc13ee tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.178433 Aug 30 04:50:27.870769 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3681/7483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:27 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:28.893924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:28.894629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:28.906875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:28.907364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:28.907795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:28.908481 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:28.908932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:28.909363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:28.914215 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42058. Aug 30 04:50:28.916562 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42060. Aug 30 04:50:29.046698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:29.054692 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c72e1d2c-36c6-4a0b-b8b0-2a0a536abf38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.166934 Aug 30 04:50:29.055278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3803/7484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:28 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:30.076097 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:30.076643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:30.084159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:30.084649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:30.085627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:30.086332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:30.086799 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:30.087234 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:30.218990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:30.226846 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6dbf830b-9457-4fc1-aeec-0ff5545a0a9d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.154812 Aug 30 04:50:30.227420 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3682/7485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:30 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:31.248559 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:31.249167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:31.256063 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:31.256542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:31.256975 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:31.257690 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:31.258137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:31.258582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:31.390458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:31.398838 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d7dd532c-be2c-4a84-b005-3f12cd97200e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.154201 Aug 30 04:50:31.399404 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3804/7486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:31 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:32.420648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:32.421308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:32.428257 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:32.429189 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:32.429713 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:32.430444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:32.430914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:32.431353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:32.566394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:32.574273 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-59b6a520-a53e-4daf-b960-7593c41f2218 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.157694 Aug 30 04:50:32.574896 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3683/7487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:32 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:33.595640 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:33.596256 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:33.604126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:33.604621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:33.605083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:33.605809 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:33.606260 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:33.606684 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:33.741091 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:33.749444 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e34d6250-f38d-4b87-ab0f-5d295deba767 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.157712 Aug 30 04:50:33.750017 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3805/7488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:33 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:34.770864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:34.771493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:34.777795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:34.778309 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:34.778758 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:34.779450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:34.779912 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:34.780346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:34.915549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:34.923981 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-24c914d4-7f9e-4ff7-80dc-62a9ad1d49c8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.157207 Aug 30 04:50:34.924553 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3684/7489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:34 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:35.946270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:35.946877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:35.954125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:35.954608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:35.955040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:35.955741 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:35.956248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:35.956667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:36.087712 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:36.095587 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e9c5e86f-cb12-4e22-9077-a73013fcbf5e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.153546 Aug 30 04:50:36.096156 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3806/7490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:35 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:37.118296 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:37.118932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:37.125878 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:37.126382 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:37.126843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:37.127556 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:37.128040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:37.128487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:37.264843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:37.272874 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7803dccb-7eb9-474f-9ca2-9e64b07ed236 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.159257 Aug 30 04:50:37.273666 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3685/7491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:37 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:38.294145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:38.294732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:38.301687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:38.302167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:38.302597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:38.303276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:38.304255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:38.304676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:38.436461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:38.445262 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d13692cc-b994-44aa-bbcb-8b0a9512f5e7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1700 microversion: 2.1 time: 0.154187 Aug 30 04:50:38.445724 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3807/7492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:38 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:39.466915 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:39.467546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:39.474529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:39.475025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:39.476240 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:39.476948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:39.477441 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:39.477885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:39.622288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:39.630669 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ecda6189-310f-4177-820c-e15a9f28763a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1700 microversion: 2.1 time: 0.167607 Aug 30 04:50:39.631263 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3686/7493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:39 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:40.652352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:40.653584 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:40.660784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:40.661270 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:40.661742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:40.662469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:40.663130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:40.663553 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:40.819922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:40.829038 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-17342f26-a736-471b-abc1-3435356d64e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.180620 Aug 30 04:50:40.842017 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3808/7494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:40 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:41.852275 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:41.853736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:41.862841 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:41.863503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:41.863963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:41.864881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:41.865553 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:41.866659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:42.022549 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:42.031049 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ba2f5d6c-2f63-4f33-b31a-c7073ef456c0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.182180 Aug 30 04:50:42.031525 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3687/7495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:41 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:42.236185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4d2fc202-8ac6-4b2b-ba93-adf4c631dc3c req-520b9bea-e686-449f-a2ab-5a6496b4bf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "name": "network-vif-plugged", "status": "completed", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:42.250719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d2fc202-8ac6-4b2b-ba93-adf4c631dc3c req-520b9bea-e686-449f-a2ab-5a6496b4bf82 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:42.251281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d2fc202-8ac6-4b2b-ba93-adf4c631dc3c req-520b9bea-e686-449f-a2ab-5a6496b4bf82 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:42.251921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4d2fc202-8ac6-4b2b-ba93-adf4c631dc3c req-520b9bea-e686-449f-a2ab-5a6496b4bf82 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:42.269028 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4d2fc202-8ac6-4b2b-ba93-adf4c631dc3c req-520b9bea-e686-449f-a2ab-5a6496b4bf82 service nova] Creating event network-vif-plugged:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h2-854924-5 Aug 30 04:50:42.276504 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4d2fc202-8ac6-4b2b-ba93-adf4c631dc3c req-520b9bea-e686-449f-a2ab-5a6496b4bf82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043464 Aug 30 04:50:42.277315 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3809/7496] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:50:43.059896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:43.060487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:43.068136 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:43.068648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:43.069100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:43.070032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:43.070353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:43.070794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:43.235813 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:43.243604 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8cd8cb4f-11a2-408d-ac11-d7ed25507bfc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.188247 Aug 30 04:50:43.244179 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3688/7497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:43 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:44.267649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:44.268478 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:44.275932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:44.276527 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:44.277073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:44.277896 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:44.278352 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:44.278811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:44.446367 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:44.455535 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b4bf6aab-9ba9-40cd-83cb-7ee39b9dfba7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.193647 Aug 30 04:50:44.456334 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3810/7498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:44 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:45.477566 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:45.478881 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:45.486575 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:45.487061 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:45.487689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:45.488405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:45.488869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:45.489306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:45.642562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:45.650882 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-05598b8b-e9d2-46af-ad1b-b43193b9f541 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.177289 Aug 30 04:50:45.665392 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3689/7499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:45 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:46.673039 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:46.673726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:46.681406 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:46.682285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:46.682894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:46.683820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:46.684468 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:46.685079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:46.852723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:46.861091 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c3174470-f60e-4b8b-a0fe-e5effe765a11 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.192739 Aug 30 04:50:46.867646 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3811/7500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:46 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:50:47.886551 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:47.887596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:47.895816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:47.896328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:47.896789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:47.897900 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:47.898381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:47.899096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:48.060667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:48.068357 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5bc18d43-f10d-4433-9eb2-785f3072f6b0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.186633 Aug 30 04:50:48.068975 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3690/7501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:47 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:50:49.101797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:49.102916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:49.112438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:49.113228 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:49.113685 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:49.114385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:49.114834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:49.115254 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:49.276614 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:49.293498 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-53ae4d5d-b4cd-4a52-8aae-7a4c49e70e9e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1695 microversion: 2.1 time: 0.207288 Aug 30 04:50:49.294092 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3812/7502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:49 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:50.316264 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:50.317043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:50.325042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:50.325595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:50.326086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:50.326809 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:50.327279 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:50.327716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:50.537059 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:50.545023 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9d522dec-3245-4f90-8920-4943545ae29a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1677 microversion: 2.1 time: 0.232997 Aug 30 04:50:50.545663 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3691/7503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:50 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:51.567093 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:51.567688 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:51.576225 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:51.576702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:51.577144 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.577854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:51.578360 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:51.578785 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.719585 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:51.728010 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eccfcb1d-dffa-431c-8c4c-fc1ddbe0265a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1677 microversion: 2.1 time: 0.164991 Aug 30 04:50:51.728585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3813/7504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:51 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:52.749042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:52.749704 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:52.756795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:52.757287 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:52.757762 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:52.758462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:52.758928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:52.759365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:52.890282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:52.898722 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-3117fea0-9936-4e2e-84e6-17150a4df04b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1620 microversion: 2.1 time: 0.153973 Aug 30 04:50:52.899296 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3692/7505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:52 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1620 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:52.919833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:52.920431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:52.927306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:52.927770 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:52.928160 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:52.928837 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:52.929282 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:52.929728 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:53.015267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122168) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:50:53.081979 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c2feac34-7cce-44a7-b0df-14b8604a75f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91/action" status: 202 len: 0 microversion: 2.1 time: 0.165864 Aug 30 04:50:53.082791 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3814/7506] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:50:52 2022] POST /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:50:53.091675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:53.092952 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:53.099250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:53.100341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:53.100450 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:53.101125 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:53.101830 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:53.102386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:53.246113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:53.253878 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b968dcde-2213-44d5-a513-923aee85a9cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1628 microversion: 2.1 time: 0.166830 Aug 30 04:50:53.254455 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3693/7507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:53 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1628 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:54.179229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-a9486d6e-30c3-40c0-a08c-843ac4fadc79 req-51c7d002-492c-4e9a-9892-0b3e77b6b67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "name": "network-vif-unplugged", "status": "completed", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:54.194978 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a9486d6e-30c3-40c0-a08c-843ac4fadc79 req-51c7d002-492c-4e9a-9892-0b3e77b6b67e service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:54.195460 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a9486d6e-30c3-40c0-a08c-843ac4fadc79 req-51c7d002-492c-4e9a-9892-0b3e77b6b67e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:54.195892 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-a9486d6e-30c3-40c0-a08c-843ac4fadc79 req-51c7d002-492c-4e9a-9892-0b3e77b6b67e service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:54.206789 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.compute.server_external_events [req-a9486d6e-30c3-40c0-a08c-843ac4fadc79 req-51c7d002-492c-4e9a-9892-0b3e77b6b67e service nova] Unable to find a host for instance 14d0556d-c3cf-4422-ae31-933364400d91. Dropping event network-vif-unplugged {{(pid=122168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 04:50:54.207690 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-a9486d6e-30c3-40c0-a08c-843ac4fadc79 req-51c7d002-492c-4e9a-9892-0b3e77b6b67e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033187 Aug 30 04:50:54.208463 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3815/7508] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 04:50:54.276000 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:54.276754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:54.284444 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:54.284986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:54.285467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:54.286187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:54.286663 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:54.287110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:54.419386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:54.427275 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1ef5dcb2-4028-4629-ada8-64e409d1fbef tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1628 microversion: 2.1 time: 0.155709 Aug 30 04:50:54.427847 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3694/7509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:54 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1628 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:55.449645 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:55.450284 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:55.457128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:55.457649 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:55.458085 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:55.458772 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:55.459222 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:55.460234 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:55.590484 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:55.594403 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:55.599749 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a9a17a11-6ad5-4473-b0ae-af2a0ad4a500 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1628 microversion: 2.1 time: 0.154138 Aug 30 04:50:55.600418 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3816/7510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:55 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1628 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:56.620520 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:56.621325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:56.628134 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:56.628636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:56.629088 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:56.629822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:56.630293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:56.630734 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:56.766501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:56.774776 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8dd8966a-4e4f-429b-8e30-6a03a2bed1ab tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1628 microversion: 2.1 time: 0.158269 Aug 30 04:50:56.775346 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3695/7511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:56 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:57.796067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:57.796658 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:57.799247 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:57.806018 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:57.806446 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:57.806858 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:57.807582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:57.808046 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:57.808465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:57.944524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:57.955932 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2cbada7a-d799-43e8-b69d-9d106c3ef271 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1628 microversion: 2.1 time: 0.163905 Aug 30 04:50:57.956569 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3817/7512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:57 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1628 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:58.979041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:58.979890 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:58.982723 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=31 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:58.988149 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:58.988759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:58.989195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:58.989964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:58.991154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:58.991607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:58.994705 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=91 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:59.155447 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:59.167869 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f5acb58f-6f40-4e14-8016-a76cd0bbe3d4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.193175 Aug 30 04:50:59.168618 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3696/7513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:58 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:59.369710 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-4a39aea2-baa0-448c-9074-81f32276491f req-c2cb5ebc-e3d5-4ded-9ecf-d4931f7c13d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:59.380599 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4a39aea2-baa0-448c-9074-81f32276491f req-c2cb5ebc-e3d5-4ded-9ecf-d4931f7c13d1 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:59.381145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4a39aea2-baa0-448c-9074-81f32276491f req-c2cb5ebc-e3d5-4ded-9ecf-d4931f7c13d1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:59.381884 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-4a39aea2-baa0-448c-9074-81f32276491f req-c2cb5ebc-e3d5-4ded-9ecf-d4931f7c13d1 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:59.394871 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-4a39aea2-baa0-448c-9074-81f32276491f req-c2cb5ebc-e3d5-4ded-9ecf-d4931f7c13d1 service nova] Creating event network-changed:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h1-854924-5 Aug 30 04:50:59.400901 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-4a39aea2-baa0-448c-9074-81f32276491f req-c2cb5ebc-e3d5-4ded-9ecf-d4931f7c13d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090694 Aug 30 04:50:59.401540 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3818/7514] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:00.192058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:00.192606 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:00.200956 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:00.201479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:00.201933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:00.202642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:00.203110 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:00.203546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:00.344763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:00.354699 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-dded9f87-505f-47a8-840b-f71d6a20347d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.166816 Aug 30 04:51:00.355497 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3697/7515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:00 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:01.378577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:01.379723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:01.388143 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:01.388961 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:01.389717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:01.390821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:01.391532 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:01.392065 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:01.554901 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:01.563703 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ff223028-001e-4238-8da7-384098b8c3f2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.190365 Aug 30 04:51:01.564746 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3819/7516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:01 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:02.586502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:02.587139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:02.594753 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:02.595261 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:02.595720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:02.596476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:02.596955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:02.597424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:02.765222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:02.775979 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a9ac5134-bfe6-43d9-8b2f-3d624ffc178e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.193465 Aug 30 04:51:02.776845 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3698/7517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:02 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:51:03.800582 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:03.801122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:03.826991 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:03.827663 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:03.828544 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:03.829980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:03.831482 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:03.832372 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:04.021138 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:04.029694 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dc633b7f-5986-4ea9-9cf6-e1f8e7affe71 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.233958 Aug 30 04:51:04.032044 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3820/7518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:03 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:05.052498 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:05.054479 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:05.062228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:05.062752 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:05.063653 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:05.065391 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:05.065610 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:05.067998 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:05.225308 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:05.233764 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8a813cf2-cef1-429b-b585-a39b29514504 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.185584 Aug 30 04:51:05.235762 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3699/7519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:05 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:06.256667 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:06.257321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:06.264990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:06.265514 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:06.266100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:06.266804 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:06.267253 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:06.267675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:06.424017 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:06.432789 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b7048f8b-0b9a-4335-92b7-c6a1c0d94d29 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.180305 Aug 30 04:51:06.433403 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3821/7520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:06 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:07.454389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:07.455494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:07.462506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:07.463021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:07.463478 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:07.464206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:07.464685 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:07.465132 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:07.632868 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:07.641386 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e618dc58-da3f-401d-a84a-3ead6f5571be tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.190832 Aug 30 04:51:07.642004 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3700/7521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:07 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:08.666836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:08.667489 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:08.674866 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:08.675345 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:08.675779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:08.676464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:08.676916 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:08.677355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:08.817054 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:08.825816 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-43742a84-e1d5-4c5f-8b1d-5a9f96c1c4f0 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.162802 Aug 30 04:51:08.826393 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3822/7522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:08 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:09.848208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:09.848849 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:09.856607 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:09.857104 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:09.857582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:09.858286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:09.858751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:09.859187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:09.998677 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:10.007294 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-8624015e-da2c-4cf8-8d90-a10ea691598f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.162499 Aug 30 04:51:10.007887 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3701/7523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:09 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:11.029924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:11.030523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:11.038969 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:11.039598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:11.040176 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:11.041020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:11.041555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:11.042186 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:11.185173 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:11.193451 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-df060590-889c-4341-aa7d-739853416a0a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.167519 Aug 30 04:51:11.194528 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3823/7524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:11 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:12.215879 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:12.216501 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:12.223711 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:12.224215 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:12.224665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:12.225394 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:12.225864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:12.226307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:12.403442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:12.418156 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52057e56-0941-45ef-9151-e6ed8b1403a7 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.206190 Aug 30 04:51:12.418759 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3702/7525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:12 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:13.444820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:13.445861 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:13.454449 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:13.454920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:13.455513 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:13.456355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:13.457005 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:13.457616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:13.621067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:13.632449 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fdc55091-7ddd-4076-aaa8-c5bbec97b226 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.195869 Aug 30 04:51:13.633061 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3824/7526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:13 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:14.655888 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:14.656596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:14.665041 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:14.665620 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:14.666135 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:14.667023 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:14.667584 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:14.668066 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:14.815167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:14.823768 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b8eb4ae6-bf56-4a5e-83d9-d92ee7f4c722 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.172213 Aug 30 04:51:14.824382 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3703/7527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:14 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:51:15.584385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-6217a82f-afdd-4b98-a440-6e1ebe591bac req-a84d0cad-53f8-4cac-b05f-4be1fd4e3daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "name": "network-vif-plugged", "status": "completed", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:15.595662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6217a82f-afdd-4b98-a440-6e1ebe591bac req-a84d0cad-53f8-4cac-b05f-4be1fd4e3daf service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:15.596197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6217a82f-afdd-4b98-a440-6e1ebe591bac req-a84d0cad-53f8-4cac-b05f-4be1fd4e3daf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:15.597159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-6217a82f-afdd-4b98-a440-6e1ebe591bac req-a84d0cad-53f8-4cac-b05f-4be1fd4e3daf service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:15.609126 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-6217a82f-afdd-4b98-a440-6e1ebe591bac req-a84d0cad-53f8-4cac-b05f-4be1fd4e3daf service nova] Creating event network-vif-plugged:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h1-854924-5 Aug 30 04:51:15.614128 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-6217a82f-afdd-4b98-a440-6e1ebe591bac req-a84d0cad-53f8-4cac-b05f-4be1fd4e3daf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 Aug 30 04:51:15.614725 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3825/7528] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:15.845101 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:15.845793 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:15.853021 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:15.853565 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:15.854027 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:15.854748 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:15.855221 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:15.855665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:15.996928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:16.004749 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-840dc7b4-ed95-4601-8a1d-853bb5ca3d19 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.163592 Aug 30 04:51:16.005325 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3704/7529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:15 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:17.029471 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:17.030100 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:17.036648 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:17.037139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:17.038152 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:17.038869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:17.039329 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:17.039759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:17.184338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:17.195442 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ca41207b-9b64-43e4-9e1a-93a46ad83e58 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1686 microversion: 2.1 time: 0.171483 Aug 30 04:51:17.196030 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3826/7530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:17 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:18.218366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:18.219282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:18.227064 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:18.227564 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:18.228015 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:18.228810 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:18.229395 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:18.229835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:18.367533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:18.375928 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-2f7d1469-a38a-4cb0-ab7b-36ccd4617901 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1673 microversion: 2.1 time: 0.161945 Aug 30 04:51:18.376526 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3705/7531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:18 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:03.733296 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=19 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:03.734761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=52 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:03.736513 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:53:03.736667 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 (ip 10.222.0.30) !!! Aug 30 04:53:03.736957 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-be07c0e7-3a4e-4ec6-bbbd-aee41a80f4c5 req-a0091bcd-34c5-4a1d-985d-3835e7d14d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:03.742560 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:03.742724 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99726791-41d9-4ddb-ab1a-77643d1de9ab] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:53:03.743838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:03.744099 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fc55d3c-812f-4698-b96a-6eee9a1778ca] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:53:03.744666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=19 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:03.745365 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=59 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:03.747010 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:53:03.747010 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Aug 30 04:53:03.748544 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:53:03.748544 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Aug 30 04:53:03.754940 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:03.755278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-be07c0e7-3a4e-4ec6-bbbd-aee41a80f4c5 req-a0091bcd-34c5-4a1d-985d-3835e7d14d77 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:03.755776 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-be07c0e7-3a4e-4ec6-bbbd-aee41a80f4c5 req-a0091bcd-34c5-4a1d-985d-3835e7d14d77 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:03.755900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:03.756222 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-be07c0e7-3a4e-4ec6-bbbd-aee41a80f4c5 req-a0091bcd-34c5-4a1d-985d-3835e7d14d77 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:03.756342 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:03.757122 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:03.757682 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:03.758177 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:03.775663 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-be07c0e7-3a4e-4ec6-bbbd-aee41a80f4c5 req-a0091bcd-34c5-4a1d-985d-3835e7d14d77 service nova] Creating event network-changed:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h1-854924-5 Aug 30 04:53:03.781823 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-be07c0e7-3a4e-4ec6-bbbd-aee41a80f4c5 req-a0091bcd-34c5-4a1d-985d-3835e7d14d77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049054 Aug 30 04:53:03.785637 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3706/7532] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:53:03.790181 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:53:03.880814 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ab27a658-c670-41db-adf4-9474504bcd61 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "DELETE /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 204 len: 0 microversion: 2.1 time: 0.149900 Aug 30 04:53:03.881779 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3827/7533] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:53:03 2022] DELETE /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:53:03.891714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:03.892747 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:03.901679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:03.902178 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:03.902642 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:03.903353 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:03.903824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:03.904263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:04.050505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:04.059165 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7a6c5c68-7c59-47b9-9dd1-ec08c4a71765 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.172180 Aug 30 04:53:04.059748 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3707/7534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:03 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:05.080621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:05.081387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:05.088602 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:05.089094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:05.089572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:05.090288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:05.090749 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:05.091577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:05.226995 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:05.234849 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-558e3afd-3b19-4e72-80c8-06ddcb59868e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1679 microversion: 2.1 time: 0.158522 Aug 30 04:53:05.235646 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3828/7535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:05 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:06.258016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:06.258786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:06.272567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-099ca82d-c697-4d8f-bfdb-0cea3df52512 req-7a00e7b6-a0f2-4b2f-8c49-e279cfa4a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d0556d-c3cf-4422-ae31-933364400d91", "name": "network-vif-deleted", "tag": "f0afa6d7-52e0-4391-87e4-7cce560728b6"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:06.277770 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] [99726791-41d9-4ddb-ab1a-77643d1de9ab] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42350. Aug 30 04:53:06.282467 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fc55d3c-812f-4698-b96a-6eee9a1778ca] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42352. Aug 30 04:53:06.284660 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:06.285168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:06.285655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:06.286378 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:06.286846 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:06.287283 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:06.287601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-099ca82d-c697-4d8f-bfdb-0cea3df52512 req-7a00e7b6-a0f2-4b2f-8c49-e279cfa4a243 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:06.288109 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-099ca82d-c697-4d8f-bfdb-0cea3df52512 req-7a00e7b6-a0f2-4b2f-8c49-e279cfa4a243 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:06.288539 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-099ca82d-c697-4d8f-bfdb-0cea3df52512 req-7a00e7b6-a0f2-4b2f-8c49-e279cfa4a243 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:06.300599 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-099ca82d-c697-4d8f-bfdb-0cea3df52512 req-7a00e7b6-a0f2-4b2f-8c49-e279cfa4a243 service nova] Creating event network-vif-deleted:f0afa6d7-52e0-4391-87e4-7cce560728b6 for instance 14d0556d-c3cf-4422-ae31-933364400d91 on n-h1-854924-5 Aug 30 04:53:06.305968 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-099ca82d-c697-4d8f-bfdb-0cea3df52512 req-7a00e7b6-a0f2-4b2f-8c49-e279cfa4a243 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037021 Aug 30 04:53:06.307000 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3829/7536] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:06.360151 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:06.368056 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-24319c3f-5e94-4cf7-9b49-5727710a9bf8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 200 len: 1492 microversion: 2.1 time: 0.113996 Aug 30 04:53:06.368635 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3708/7537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:06 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 1492 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:53:07.393933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:07.394604 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 14d0556d-c3cf-4422-ae31-933364400d91] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:07.400946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:07.401465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:07.401906 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:07.402566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:07.403012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:07.403432 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:07.416555 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] HTTP exception thrown: Instance 14d0556d-c3cf-4422-ae31-933364400d91 could not be found. Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Request method failure captured: Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 HTTP/1.1 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZaJ8z58R83Z4SqK2o0c9nBdhBjHKCTx6UO59_3eU-WXMYz7I1Ox5K_0YQYKsB6vr4iokW0t00eRmgvf1SfPrWQL3tfaXHvJg3kG12EruF_SIKA-jjwoc6Sl75zSXqg_TJ0U6kEr4jh6rT3Ygj1nBLcwVzijVys6Gmkw2gkKg99VaEE Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ce12662c74d7469c88edf845bf6a8a21 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestShelveInstance-265579176 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce12662c74d7469c88edf845bf6a8a21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ce12662c74d7469c88edf845bf6a8a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ce12662c74d7469c88edf845bf6a8a21", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce12662c74d7469c88edf845bf6a8a21"}]}] Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestShelveInstance-265579176 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ce12662c74d7469c88edf845bf6a8a21 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestShelveInstance-265579176 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestShelveInstance-265579176-project Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: 5dc6730a5b01446aa7b2bd8b4f3b6078 Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestShelveInstance-265579176-project Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance 14d0556d-c3cf-4422-ae31-933364400d91 could not be found. Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': '14d0556d-c3cf-4422-ae31-933364400d91'} Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d0556d-c3cf-4422-ae31-933364400d91 could not be found. Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d0556d-c3cf-4422-ae31-933364400d91 could not be found. Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:53:07.419387 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d0556d-c3cf-4422-ae31-933364400d91 could not be found. Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Returning 404 to user: Instance 14d0556d-c3cf-4422-ae31-933364400d91 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9df472cb-214b-49cd-911f-bfca3a228fdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91" status: 404 len: 111 microversion: 2.1 time: 0.032298 Aug 30 04:53:07.424734 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3830/7538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:07 2022] GET /compute/v2.1/servers/14d0556d-c3cf-4422-ae31-933364400d91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:53:07.584033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-85cb05bb-95b1-47b0-9242-bb40e6f3bd6f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '.version_select at 0x7f897b9adf70>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:07.624186 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-85cb05bb-95b1-47b0-9242-bb40e6f3bd6f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1023569275" status: 202 len: 0 microversion: 2.1 time: 0.044123 Aug 30 04:53:07.624783 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3709/7539] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 30 04:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1023569275 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:53:07.650523 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-28d1952e-8765-4878-aeec-8cd4c5f9cfdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'create', calling method: .version_select at 0x7f897b562940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1579847501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2dUN9FmjRIKXwhixEVeGqzoP7BWpFJnY/ikusMt3WbetcO6+beE0AD3nYKfEYYlgBHrhY08bxoJlWESPEelTlcnGHvXEwLRytPYKhnt/ik0fjUTj+6tdW3DmHPzf/Apg=="}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:07.665973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-28d1952e-8765-4878-aeec-8cd4c5f9cfdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for project ce12662c74d7469c88edf845bf6a8a21. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:53:07.671561 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-28d1952e-8765-4878-aeec-8cd4c5f9cfdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for user 5dc6730a5b01446aa7b2bd8b4f3b6078 and project ce12662c74d7469c88edf845bf6a8a21. Resources: {'key_pairs'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:53:07.698472 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-28d1952e-8765-4878-aeec-8cd4c5f9cfdb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051853 Aug 30 04:53:07.699070 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3831/7540] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:53:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:24.110543 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=14 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:24.111335 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:24.116116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-544801425", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1579847501", "security_groups": [{"name": "tempest-secgroup-smoke-286509995"}], "networks": [{"uuid": "67d87c49-884c-45ff-9d92-38fb50f98514"}], "block_device_mapping_v2": [{"uuid": "38e80ba2-c204-4782-bcbd-288aaaa92583", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:24.338001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] validate_networks() for [('67d87c49-884c-45ff-9d92-38fb50f98514', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:53:24.773039 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:53:24.773540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:53:24.774060 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:53:24.774491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:53:24.775582 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:53:24.784493 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:24.784971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:24.785455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:24.786187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:24.786651 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:24.787083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:24.804964 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for project ce12662c74d7469c88edf845bf6a8a21. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:53:24.810892 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Getting quotas for user 5dc6730a5b01446aa7b2bd8b4f3b6078 and project ce12662c74d7469c88edf845bf6a8a21. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:53:24.867947 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:53:24.870725 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38e80ba2-c204-4782-bcbd-288aaaa92583',volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:53:25.003629 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-174cfaeb-f0fe-49a7-b2c8-50bc8521fe95 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.894779 Aug 30 04:53:25.004300 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3710/7541] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:53:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:53:25.013102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:25.013981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:25.015094 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:25.019080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5d70126e-7643-4b44-a23e-4f1de621e641 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:25.019579 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5d70126e-7643-4b44-a23e-4f1de621e641 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:25.121927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5d70126e-7643-4b44-a23e-4f1de621e641 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:25.128885 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5d70126e-7643-4b44-a23e-4f1de621e641 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1088 microversion: 2.1 time: 0.117644 Aug 30 04:53:25.129465 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3832/7542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:25 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1088 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:26.152033 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7eab537d-af84-4451-9d3a-6ab4a5c47147 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:26.152993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7eab537d-af84-4451-9d3a-6ab4a5c47147 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:26.215529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7eab537d-af84-4451-9d3a-6ab4a5c47147 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:26.222784 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7eab537d-af84-4451-9d3a-6ab4a5c47147 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1088 microversion: 2.1 time: 0.075992 Aug 30 04:53:26.223362 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3711/7543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:26 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:27.244721 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-63e28f2e-2dcf-47ea-9ded-31f0cdb78a3e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:27.245633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-63e28f2e-2dcf-47ea-9ded-31f0cdb78a3e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:27.305323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-63e28f2e-2dcf-47ea-9ded-31f0cdb78a3e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:27.312803 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-63e28f2e-2dcf-47ea-9ded-31f0cdb78a3e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1088 microversion: 2.1 time: 0.072671 Aug 30 04:53:27.313397 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3833/7544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:27 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:28.335074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0f5abba3-aa99-437f-ae4d-ec0a93e8e5db tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:28.335719 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0f5abba3-aa99-437f-ae4d-ec0a93e8e5db tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:28.389919 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0f5abba3-aa99-437f-ae4d-ec0a93e8e5db tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:28.396932 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0f5abba3-aa99-437f-ae4d-ec0a93e8e5db tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1088 microversion: 2.1 time: 0.065755 Aug 30 04:53:28.397667 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3712/7545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:28 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:29.418309 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:29.418920 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:29.425757 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:29.426235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:29.426694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:29.427365 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:29.427811 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:29.428227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:29.491387 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:29.501730 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2bb36dca-b738-41b6-885d-e0ffbec01937 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1138 microversion: 2.1 time: 0.086693 Aug 30 04:53:29.502388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3834/7546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:29 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:30.523835 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:30.524374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:30.532442 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:30.532936 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:30.533404 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:30.534108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:30.534576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:30.535025 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:30.632806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:30.641801 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6db93217-9424-4d26-bd23-b13f41e02a92 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1204 microversion: 2.1 time: 0.122249 Aug 30 04:53:30.642512 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3713/7547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:30 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1204 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:31.514662 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-b7e7d464-dd85-49c6-a9c5-13c934970e0e req-dc3d3d2f-a4c7-4f2f-afc6-49872ec7b7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:31.524924 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b7e7d464-dd85-49c6-a9c5-13c934970e0e req-dc3d3d2f-a4c7-4f2f-afc6-49872ec7b7b4 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:31.525577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b7e7d464-dd85-49c6-a9c5-13c934970e0e req-dc3d3d2f-a4c7-4f2f-afc6-49872ec7b7b4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:31.526287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-b7e7d464-dd85-49c6-a9c5-13c934970e0e req-dc3d3d2f-a4c7-4f2f-afc6-49872ec7b7b4 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:31.538808 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-b7e7d464-dd85-49c6-a9c5-13c934970e0e req-dc3d3d2f-a4c7-4f2f-afc6-49872ec7b7b4 service nova] Creating event network-changed:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h2-854924-5 Aug 30 04:53:31.544396 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-b7e7d464-dd85-49c6-a9c5-13c934970e0e req-dc3d3d2f-a4c7-4f2f-afc6-49872ec7b7b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101260 Aug 30 04:53:31.545011 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3835/7548] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:31.663715 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:31.664573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:31.673020 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:31.673572 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:31.674032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:31.674780 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:31.675260 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:31.675710 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:32.235908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:32.243933 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5381e666-1af3-4210-9157-4c31915a1b1d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1271 microversion: 2.1 time: 0.584230 Aug 30 04:53:32.245413 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3714/7549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:31 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1271 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:33.267337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:33.268070 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:33.275081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:33.276067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:33.276503 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:33.277220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:33.277711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:33.278137 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:33.414363 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:33.422682 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0155f604-f4df-43ad-b6ec-293eb76a4d39 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1271 microversion: 2.1 time: 0.160908 Aug 30 04:53:33.423257 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3836/7550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:33 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:34.444446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:34.445242 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:34.452227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:34.452733 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:34.453195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:34.453991 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:34.454467 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:34.454909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:34.590573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:34.598972 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-70a70555-e53f-4d47-918b-946ba4d0e899 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1271 microversion: 2.1 time: 0.158555 Aug 30 04:53:34.599562 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3715/7551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:34 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:35.620214 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:35.620826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:35.628159 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:35.628636 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:35.629079 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:35.629788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:35.630244 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:35.630669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:35.764990 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:35.773509 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1fe24e77-b61e-4170-9a42-4779e7645053 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.156708 Aug 30 04:53:35.774072 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3837/7552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:35 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:36.792864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:36.797058 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:36.797850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:36.804140 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:36.804643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:36.805096 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:36.805847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:36.806318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:36.807405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:36.937008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:36.944890 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-fa0ae4b2-8969-43da-bfbe-a2a28923f1b8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.153594 Aug 30 04:53:36.945497 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3716/7553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:36 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:37.965890 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:37.966541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:37.969469 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=4 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:37.974815 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:37.975299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:37.975736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:37.976423 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:37.976878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:37.977308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:38.115606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:38.124103 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-eb3a51c5-3e60-4256-a77a-5c7b7a13b233 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.162127 Aug 30 04:53:38.124683 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3838/7554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:37 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:39.145870 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:39.146522 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:39.149361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=10 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:39.155646 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:39.156141 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:39.156593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:39.157293 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:39.157779 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:39.158217 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:39.290072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:39.298544 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-b4da9793-3fe5-47e6-b9f4-ff1cb0fa7d49 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.156984 Aug 30 04:53:39.299126 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3717/7555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:39 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:40.319651 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:40.320314 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:40.327175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:40.327655 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:40.328087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:40.328763 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:40.329209 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:40.329653 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:40.467908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:40.475737 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-6df7ce6d-5fb2-432a-9106-01bcf7fa8102 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.160004 Aug 30 04:53:40.476311 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3839/7556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:40 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:41.498561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:41.499523 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:41.508664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:41.510303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:41.511142 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:41.511763 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:41.512291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:41.513119 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:41.656671 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:41.664490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-91663ac3-004d-4e47-950f-fcb2803b22ba tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.171315 Aug 30 04:53:41.665072 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3718/7557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:41 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:42.685462 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:42.686076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:42.692878 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:42.693383 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:42.693822 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:42.694501 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:42.694951 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:42.695371 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:42.827833 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:42.835748 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-8692accf-617c-4d30-a0b2-3dd753fae495 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.154197 Aug 30 04:53:42.836325 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3840/7558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:42 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:43.857506 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:43.858139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:43.865160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:43.865703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:43.866156 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:43.866854 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:43.867325 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:43.867761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:44.003659 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:44.011939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77bf428e-6674-4fc9-ba16-fcc481dd233d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.159029 Aug 30 04:53:44.012513 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3719/7559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:43 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:45.013306 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-00cff1e3-96ac-4c29-8fcf-808849e16a12 req-b152bc50-24ae-4c65-b9d5-b3afba7034fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "name": "network-vif-plugged", "status": "completed", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:45.023706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-00cff1e3-96ac-4c29-8fcf-808849e16a12 req-b152bc50-24ae-4c65-b9d5-b3afba7034fa service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:45.024184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-00cff1e3-96ac-4c29-8fcf-808849e16a12 req-b152bc50-24ae-4c65-b9d5-b3afba7034fa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:45.024613 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-00cff1e3-96ac-4c29-8fcf-808849e16a12 req-b152bc50-24ae-4c65-b9d5-b3afba7034fa service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:45.033561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:45.034190 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:45.036800 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-00cff1e3-96ac-4c29-8fcf-808849e16a12 req-b152bc50-24ae-4c65-b9d5-b3afba7034fa service nova] Creating event network-vif-plugged:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h2-854924-5 Aug 30 04:53:45.041578 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:45.042089 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:45.042537 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:45.043304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:45.043771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:45.044052 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-00cff1e3-96ac-4c29-8fcf-808849e16a12 req-b152bc50-24ae-4c65-b9d5-b3afba7034fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092598 Aug 30 04:53:45.044208 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:45.044764 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3841/7560] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:45.242570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:45.251071 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-976a8fd0-4e71-48a1-b85e-0341f4fb95e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1259 microversion: 2.1 time: 0.221316 Aug 30 04:53:45.251681 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3720/7561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:45 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:53:46.274275 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:46.275012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:46.281726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:46.282217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:46.282862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:46.283747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:46.284204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:46.284630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:46.421327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:46.429256 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-1049bed7-6f14-4cae-b176-8279d7d16ad8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1442 microversion: 2.1 time: 0.160358 Aug 30 04:53:46.429856 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3842/7562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:46 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:46.450356 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:46.450973 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:46.459645 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:46.460145 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:46.460594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:46.461303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:46.461801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:46.462249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:46.595494 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:46.603794 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a82793e5-967c-4793-8d66-cec283368898 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1442 microversion: 2.1 time: 0.156914 Aug 30 04:53:46.604384 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3721/7563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:46 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:48.245040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-8b41d2d4-c838-436c-bd8f-0d20eb951232 req-d49df163-f283-42dc-9039-3d21187f20b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:48.257087 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8b41d2d4-c838-436c-bd8f-0d20eb951232 req-d49df163-f283-42dc-9039-3d21187f20b2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:48.257556 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8b41d2d4-c838-436c-bd8f-0d20eb951232 req-d49df163-f283-42dc-9039-3d21187f20b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:48.258212 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-8b41d2d4-c838-436c-bd8f-0d20eb951232 req-d49df163-f283-42dc-9039-3d21187f20b2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:48.272107 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-8b41d2d4-c838-436c-bd8f-0d20eb951232 req-d49df163-f283-42dc-9039-3d21187f20b2 service nova] Creating event network-changed:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h2-854924-5 Aug 30 04:53:48.277393 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-8b41d2d4-c838-436c-bd8f-0d20eb951232 req-d49df163-f283-42dc-9039-3d21187f20b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036872 Aug 30 04:53:48.278380 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3843/7564] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:55:44.446562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:44.447333 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=56 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:44.448321 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 04:55:44.448460 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 04:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d/action (ip 10.222.0.30) !!! Aug 30 04:55:44.453751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:44.454304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:44.463358 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:44.463853 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:44.464307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:44.465006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:44.465511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:44.465949 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:44.490086 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.objects.instance [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lazy-loading 'flavor' on Instance uuid 43271cb9-19d8-42b4-974d-d1ceafae996d {{(pid=122167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:55:44.561172 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-36edc0d0-7314-453d-8643-81e6acc7977f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d/action" status: 202 len: 0 microversion: 2.1 time: 0.116470 Aug 30 04:55:44.561815 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3722/7565] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:55:44 2022] POST /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:55:44.568403 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:55:44.569266 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:55:44.569894 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=28 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:44.570659 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=48 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:44.571731 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:55:44.571885 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d (ip 10.222.0.30) !!! Aug 30 04:55:44.577750 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:44.578455 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:44.589157 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:44.590052 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:44.590828 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:44.592067 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:44.592881 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:44.593762 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:44.738865 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:44.747000 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-d054892c-d23a-4548-82d6-c3f891f76ce4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.180509 Aug 30 04:55:44.747574 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3844/7566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:44 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:45.770773 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:45.771487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:45.777761 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:45.778258 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:45.778703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:45.779403 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:45.779863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:45.780300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:45.914561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:45.922349 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-bc2d63a6-bf76-4ca2-a8e1-d55da975e84c tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.157763 Aug 30 04:55:45.922933 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3723/7567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:45 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:46.944711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:46.945321 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:46.954733 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:46.955217 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:46.955650 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:46.956341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:46.956817 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:46.957235 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:46.967771 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42642. Aug 30 04:55:46.968599 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42644. Aug 30 04:55:47.096709 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:47.107255 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2cb9a168-ad3b-4e29-8528-eeaa47b64b70 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.167029 Aug 30 04:55:47.107938 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3845/7568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:46 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:48.128488 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:48.129115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:48.136043 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:48.136531 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:48.136976 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:48.137714 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:48.138173 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:48.138605 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:48.267634 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:48.276023 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c5f077fd-012b-442d-8740-b2c6e116ee46 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.151662 Aug 30 04:55:48.276601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3724/7569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:48 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:49.298518 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:49.299170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:49.306340 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:49.306821 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:49.307255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:49.307933 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:49.308492 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:49.308949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:49.445524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:49.453330 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cc7ede55-791e-48b0-b3c4-9295f9350dc9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.158609 Aug 30 04:55:49.453939 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3846/7570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:49 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:50.474771 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:50.475400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:50.482291 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:50.482816 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:50.483263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:50.483959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:50.484424 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:50.484859 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:50.618228 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:50.626360 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a1505e45-da31-41a5-9523-22245da4fcf2 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.155405 Aug 30 04:55:50.626955 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3725/7571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:50 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:51.648147 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:51.648779 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:51.655605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:51.656083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:51.656515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:51.657220 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:51.657707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:51.658127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:51.794102 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:51.802508 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-55ebaf31-a8a8-4d22-b75f-d48f885b75cf tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.158267 Aug 30 04:55:51.803112 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3847/7572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:51 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:52.824162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:52.825282 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:52.831948 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:52.832445 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:52.832896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:52.833630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:52.834108 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:52.834546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:52.966664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:52.974490 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e69b43f1-c2da-4409-89f1-8c9c0dbf4f66 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.154400 Aug 30 04:55:52.975069 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3726/7573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:52 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:53.995992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:53.996605 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:54.003499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:54.003979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:54.004591 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:54.005286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:54.005759 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:54.006179 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:54.140281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:54.148071 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58bb1c37-251a-4af1-81d4-3294c64cd7eb tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.155976 Aug 30 04:55:54.148645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3848/7574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:53 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:55.169786 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:55.170426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:55.178046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:55.178555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:55.179016 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:55.179731 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:55.180206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:55.180675 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:55.350782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:55.358553 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e4b56f16-a264-492d-ae6a-cd39c40a5222 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.192888 Aug 30 04:55:55.359131 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3727/7575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:55 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:56.380511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:56.381131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:56.388083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:56.388572 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:56.389012 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:56.389745 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:56.390451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:56.390877 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:56.523587 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:56.531393 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b274c7f4-df33-47ec-bea0-3c1649692bd6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.154975 Aug 30 04:55:56.531970 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3849/7576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:56 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:57.553695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:57.554328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:57.561555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:57.562077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:57.562508 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:57.563219 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:57.563678 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:57.564116 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:57.701281 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:57.709224 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-9988a4da-c75a-4a8e-965d-d3b51e1da79d tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.160008 Aug 30 04:55:57.709843 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3728/7577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:57 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:58.730233 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:58.730784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:58.737581 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:58.738072 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:58.738515 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:58.739810 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:58.740595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:58.741384 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:58.882299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:58.890560 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7902d27-7729-442c-b5dc-c799d90653a1 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1568 microversion: 2.1 time: 0.164276 Aug 30 04:55:58.891237 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3850/7578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:58 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:58.912303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:58.913028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:58.919452 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:58.920040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:58.920569 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:58.921271 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:58.921703 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:58.922226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:58.964405 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122167) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:55:59.028099 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f6b97966-486b-44fb-9cdf-10434ee7b1e3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "POST /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d/action" status: 202 len: 0 microversion: 2.1 time: 0.120648 Aug 30 04:55:59.028633 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3729/7579] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 04:55:58 2022] POST /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:55:59.036820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:59.037570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:59.044056 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:59.044549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:59.044987 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:59.045711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:59.046168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:59.046630 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:59.185620 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:59.193404 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fd91529b-f862-49fe-8031-362b9ba363a4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1516 microversion: 2.1 time: 0.160494 Aug 30 04:55:59.193985 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3851/7580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:59 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:59.522174 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-7fc48bd7-cbe8-46cc-bffb-46416e85be2f req-4ee60294-955a-4e67-a4ca-75e810cb1d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "name": "network-vif-unplugged", "status": "completed", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:59.533120 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7fc48bd7-cbe8-46cc-bffb-46416e85be2f req-4ee60294-955a-4e67-a4ca-75e810cb1d52 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:59.533644 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7fc48bd7-cbe8-46cc-bffb-46416e85be2f req-4ee60294-955a-4e67-a4ca-75e810cb1d52 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:59.535288 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-7fc48bd7-cbe8-46cc-bffb-46416e85be2f req-4ee60294-955a-4e67-a4ca-75e810cb1d52 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:59.546837 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.compute.server_external_events [req-7fc48bd7-cbe8-46cc-bffb-46416e85be2f req-4ee60294-955a-4e67-a4ca-75e810cb1d52 service nova] Unable to find a host for instance 43271cb9-19d8-42b4-974d-d1ceafae996d. Dropping event network-vif-unplugged {{(pid=122167) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 04:55:59.547738 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-7fc48bd7-cbe8-46cc-bffb-46416e85be2f req-4ee60294-955a-4e67-a4ca-75e810cb1d52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030118 Aug 30 04:55:59.548322 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3730/7581] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 04:56:00.215175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:00.215782 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:00.222754 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:00.223242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:00.223683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:00.224378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:00.224813 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:00.225230 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:00.366795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:00.374871 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0f5927ac-dda4-4786-8640-0cc6405d066b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1516 microversion: 2.1 time: 0.163777 Aug 30 04:56:00.375444 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3852/7582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:00 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:01.397314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:01.397884 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:01.404826 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:01.405318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:01.405794 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:01.406491 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:01.406953 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:01.407387 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:01.553440 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:01.564172 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-04dd0be8-70ec-4ca1-8efc-99e33df5a208 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1516 microversion: 2.1 time: 0.171595 Aug 30 04:56:01.577450 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3731/7583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:01 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:02.588304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:02.588932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:02.596126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:02.596616 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:02.597055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:02.597788 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:02.598949 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:02.599598 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:02.730227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:02.738048 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f5a3c1e5-e7de-48d2-87e2-bd2093b24426 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1516 microversion: 2.1 time: 0.153831 Aug 30 04:56:02.738619 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3853/7584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:02 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:03.762574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:03.763202 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:03.771598 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:03.772155 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:03.772622 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:03.773300 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:03.773848 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:03.774317 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:03.912958 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:03.921092 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1835fc93-22bf-4e32-8e35-4126870cf905 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1518 microversion: 2.1 time: 0.162234 Aug 30 04:56:03.921456 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3732/7585] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:03 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:56:04.943954 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:04.944601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:04.951573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:04.952053 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:04.952490 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:04.953185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:04.953694 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:04.954116 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:05.085080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:05.094427 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7cde5e84-1ea4-4f97-9cd0-8feaa4ad2d83 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1518 microversion: 2.1 time: 0.155010 Aug 30 04:56:05.105405 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3854/7586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:04 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:06.116203 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:06.116833 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:06.124168 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:06.124667 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:06.125115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:06.125843 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:06.126307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:06.126746 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:06.260056 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:06.268428 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-aa056ede-a482-4132-b172-1a4bc563176b tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1518 microversion: 2.1 time: 0.156219 Aug 30 04:56:06.269016 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3733/7587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:06 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:07.290156 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:07.290760 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:07.298167 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:07.298654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:07.299086 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:07.299781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:07.300227 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:07.300646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:07.437197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:07.445709 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7df0d4dc-3fa1-466a-b3f7-933711e060b5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1518 microversion: 2.1 time: 0.159998 Aug 30 04:56:07.446500 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3855/7588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:07 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:08.468332 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:08.469057 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:08.475589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:08.476093 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:08.476546 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:08.477297 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:08.477783 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:08.478226 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:08.620528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:08.630638 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4223f1df-03cc-480b-b4e4-3a92b868b0e6 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1518 microversion: 2.1 time: 0.167068 Aug 30 04:56:08.631131 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3734/7589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:08 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:09.652765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:09.653323 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:09.660285 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:09.661011 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:09.661704 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:09.662405 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:09.662855 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:09.663276 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:09.805775 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:09.813858 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7329ef9b-1275-409a-ae29-29f3995e4014 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.165071 Aug 30 04:56:09.814452 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3856/7590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:09 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:10.348955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-63c5b80d-20ea-40cc-85e8-61b227523b65 req-4541e7fe-9489-4fb4-85da-8de1add5f7af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:10.358967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-63c5b80d-20ea-40cc-85e8-61b227523b65 req-4541e7fe-9489-4fb4-85da-8de1add5f7af service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:10.359386 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-63c5b80d-20ea-40cc-85e8-61b227523b65 req-4541e7fe-9489-4fb4-85da-8de1add5f7af service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:10.359822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-63c5b80d-20ea-40cc-85e8-61b227523b65 req-4541e7fe-9489-4fb4-85da-8de1add5f7af service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:10.372423 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-63c5b80d-20ea-40cc-85e8-61b227523b65 req-4541e7fe-9489-4fb4-85da-8de1add5f7af service nova] Creating event network-changed:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h1-854924-5 Aug 30 04:56:10.377835 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-63c5b80d-20ea-40cc-85e8-61b227523b65 req-4541e7fe-9489-4fb4-85da-8de1add5f7af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089306 Aug 30 04:56:10.378442 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3735/7591] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:56:10.836097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:10.836720 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:10.843743 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:10.844346 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:10.844660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:10.845385 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:10.845840 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:10.846266 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:10.987037 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:10.995163 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-638abc3c-62e6-421b-abf7-aee6e7fc88b4 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.163401 Aug 30 04:56:10.995775 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3857/7592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:10 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:12.022481 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:12.023348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:12.029716 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:12.030206 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:12.030665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:12.031393 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:12.031862 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:12.032307 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:12.179162 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:12.182974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:12.189175 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d9837fdf-3792-414c-bbee-8369cdca29d3 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.171794 Aug 30 04:56:12.189798 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3736/7593] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:12 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:13.210676 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:13.211293 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:13.218199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:13.218687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:13.219125 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:13.219808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:13.220262 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:13.220687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:13.350737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:13.358880 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-81659538-8793-47c7-8b77-7bc44489ea04 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.152106 Aug 30 04:56:13.359449 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3858/7594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:13 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:14.380789 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:14.381583 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:14.390631 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:14.391143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:14.391599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:14.392311 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:14.392781 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:14.393220 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:14.531635 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:14.539721 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-1303ba1c-14ae-4640-83f6-1c033a5d3c76 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.163113 Aug 30 04:56:14.540311 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3737/7595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:14 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:15.560105 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:15.560698 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:15.563401 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=31 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.568670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:15.569154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:15.569615 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:15.570308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:15.571255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:15.571674 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:15.574477 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=91 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.714058 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:15.722023 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-fc26e3de-f061-432e-bd38-754391227a38 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.165729 Aug 30 04:56:15.722616 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3859/7596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:15 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:16.743593 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:16.744249 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:16.747048 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.752250 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:16.752742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:16.753184 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:16.753908 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:16.754374 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:16.754805 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:16.902986 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:16.911434 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0be92460-36ff-4567-abac-fcc83e7a813e tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.171742 Aug 30 04:56:16.914097 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3738/7597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:16 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:17.933695 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:17.934341 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:17.940836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:17.941264 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:17.941737 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:17.942430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:17.942888 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:17.943318 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.075168 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:18.082992 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-257d989b-11af-4dbb-ac29-760a4a6e41ce tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.153879 Aug 30 04:56:18.083556 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3860/7598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:17 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:19.104811 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:19.105503 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:19.112505 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:19.113006 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:19.113480 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:19.114187 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:19.114649 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:19.115082 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:19.256475 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:19.266356 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a15d7119-2acc-467a-811d-38ee3e07dea8 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.165433 Aug 30 04:56:19.266951 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3739/7599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:19 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:20.286887 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:20.287409 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:20.294499 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:20.294979 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:20.295413 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:20.296092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:20.296540 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:20.296960 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:20.428170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:20.437288 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-dd8829f9-2f52-4517-929a-ddc5d1fcbf59 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.154360 Aug 30 04:56:20.437903 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3861/7600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:20 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:21.459684 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:21.460341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:21.467286 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:21.467790 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:21.468246 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:21.468963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:21.469456 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:21.469898 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:21.608562 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:21.620101 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-561a8b59-2862-4d34-bb4f-53fccb369d60 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.164297 Aug 30 04:56:21.620705 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3740/7601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:21 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:22.641842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:22.642467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:22.649197 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:22.649711 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:22.650150 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:22.650842 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:22.651297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:22.651723 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:22.781191 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:22.789026 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a3c892c1-1d8c-4b94-854d-02d696ca4dd5 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.151352 Aug 30 04:56:22.789645 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3862/7602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:22 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:22.972511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-ce77a152-b00a-40cb-9093-75457e6efbbf req-24251ede-14d3-496d-aa6a-09715fddb739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "name": "network-vif-plugged", "status": "completed", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:22.985318 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ce77a152-b00a-40cb-9093-75457e6efbbf req-24251ede-14d3-496d-aa6a-09715fddb739 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:22.985867 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ce77a152-b00a-40cb-9093-75457e6efbbf req-24251ede-14d3-496d-aa6a-09715fddb739 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:22.986702 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-ce77a152-b00a-40cb-9093-75457e6efbbf req-24251ede-14d3-496d-aa6a-09715fddb739 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:23.001738 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-ce77a152-b00a-40cb-9093-75457e6efbbf req-24251ede-14d3-496d-aa6a-09715fddb739 service nova] Creating event network-vif-plugged:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h1-854924-5 Aug 30 04:56:23.007201 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-ce77a152-b00a-40cb-9093-75457e6efbbf req-24251ede-14d3-496d-aa6a-09715fddb739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038832 Aug 30 04:56:23.008294 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3741/7603] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:56:23.810472 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:23.811110 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:23.817968 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:23.818452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:23.818889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:23.819570 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:23.820020 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:23.820438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:23.954687 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:23.963101 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-5e9789dd-46e2-4717-948e-8ab90ab6093f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1574 microversion: 2.1 time: 0.156608 Aug 30 04:56:23.963670 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3863/7604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:23 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:24.987072 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:24.989398 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:24.994427 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:24.994928 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:24.995372 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:24.996077 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:24.996540 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:24.996971 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:25.130627 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:25.138541 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4c5f7fb-4c40-4765-be27-b6b9890b1468 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1561 microversion: 2.1 time: 0.157463 Aug 30 04:56:25.139118 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3742/7605] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:24 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:39.280578 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=9 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.281747 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=29 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.283058 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:57:39.283463 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d (ip 10.222.0.30) !!! Aug 30 04:57:39.283969 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=9 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.285008 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=32 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:39.285644 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:57:39.285981 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 04:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d (ip 10.222.0.30) !!! Aug 30 04:57:39.291288 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:39.292127 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:39.294579 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-441c1134-b6c4-4311-b497-25ad8dafdf02 req-298e7573-1e7f-4a2c-b5fb-0e9b3c88466f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:57:39.300542 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:39.301338 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:39.302036 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:39.302992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:39.303675 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:39.304320 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:39.312381 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-441c1134-b6c4-4311-b497-25ad8dafdf02 req-298e7573-1e7f-4a2c-b5fb-0e9b3c88466f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:39.312876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-441c1134-b6c4-4311-b497-25ad8dafdf02 req-298e7573-1e7f-4a2c-b5fb-0e9b3c88466f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:39.313630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-441c1134-b6c4-4311-b497-25ad8dafdf02 req-298e7573-1e7f-4a2c-b5fb-0e9b3c88466f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:39.334329 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-441c1134-b6c4-4311-b497-25ad8dafdf02 req-298e7573-1e7f-4a2c-b5fb-0e9b3c88466f service nova] Creating event network-changed:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h1-854924-5 Aug 30 04:57:39.338590 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:57:39.340121 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-441c1134-b6c4-4311-b497-25ad8dafdf02 req-298e7573-1e7f-4a2c-b5fb-0e9b3c88466f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058999 Aug 30 04:57:39.341576 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3743/7606] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:57:39.464186 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b8b92671-b690-4bcf-9a82-33d43d1a53ca tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 204 len: 0 microversion: 2.1 time: 0.184948 Aug 30 04:57:39.468585 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3864/7607] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 04:57:39 2022] DELETE /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:39.474571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:39.475824 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:39.482621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:39.483131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:39.483648 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:39.484484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:39.484784 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:39.485227 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:39.640133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:39.648692 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-00aeb146-8438-41ce-97ba-88c7e921e72a tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.178496 Aug 30 04:57:39.649285 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3744/7608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:39 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:57:40.670996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:40.671707 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:40.679210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:40.679693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:40.680131 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:40.680820 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:40.681272 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:40.681714 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:40.823719 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:40.832545 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-e2812a1d-8e99-47c8-9f40-90ad0386e83f tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1567 microversion: 2.1 time: 0.165110 Aug 30 04:57:40.833152 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3865/7609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:40 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:41.771668 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-bd64f1b0-abba-4ee9-bdcf-d49166429bd5 req-9d7b6940-052b-4feb-92c6-bb531e7b0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43271cb9-19d8-42b4-974d-d1ceafae996d", "name": "network-vif-deleted", "tag": "ff4d28ce-01a0-43d7-97be-2da3f4a8d702"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:57:41.785695 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bd64f1b0-abba-4ee9-bdcf-d49166429bd5 req-9d7b6940-052b-4feb-92c6-bb531e7b0b9f service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:41.786945 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bd64f1b0-abba-4ee9-bdcf-d49166429bd5 req-9d7b6940-052b-4feb-92c6-bb531e7b0b9f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:41.787772 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-bd64f1b0-abba-4ee9-bdcf-d49166429bd5 req-9d7b6940-052b-4feb-92c6-bb531e7b0b9f service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:41.799977 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-bd64f1b0-abba-4ee9-bdcf-d49166429bd5 req-9d7b6940-052b-4feb-92c6-bb531e7b0b9f service nova] Creating event network-vif-deleted:ff4d28ce-01a0-43d7-97be-2da3f4a8d702 for instance 43271cb9-19d8-42b4-974d-d1ceafae996d on n-h1-854924-5 Aug 30 04:57:41.806311 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-bd64f1b0-abba-4ee9-bdcf-d49166429bd5 req-9d7b6940-052b-4feb-92c6-bb531e7b0b9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038812 Aug 30 04:57:41.806957 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3745/7610] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:57:41.854324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:41.854942 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:41.861902 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:41.862396 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:41.862834 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:41.863541 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:41.863989 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:41.864601 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:41.928337 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:41.936479 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-ed0c6854-88c1-45d2-bae0-e0f1ccffd0ff tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1219 microversion: 2.1 time: 0.086030 Aug 30 04:57:41.937054 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3866/7611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:41 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:42.959361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:42.959974 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:42.966473 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:42.966980 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:42.967511 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:42.968231 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:42.968698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:42.969138 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:43.037143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:43.045074 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7b367f16-1adf-4ff6-8dcf-c66add2c3a87 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1219 microversion: 2.1 time: 0.091039 Aug 30 04:57:43.045691 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3746/7612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:42 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:44.067589 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:44.068204 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:44.075104 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:44.075586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:44.076021 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:44.076702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:44.077151 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:44.077595 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:44.143170 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:44.151686 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-c9746f4b-1b58-433d-aa30-e714729e14da tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1219 microversion: 2.1 time: 0.088966 Aug 30 04:57:44.152278 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3867/7613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:44 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:57:45.171636 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:45.172397 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:45.179469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:45.179960 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:45.180416 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:45.181133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:45.181628 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:45.182069 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:45.248679 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:45.263895 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4301e31b-561b-4746-845e-1b9e210f1363 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1219 microversion: 2.1 time: 0.095868 Aug 30 04:57:45.264966 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3747/7614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:45 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:46.288088 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:46.288717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:46.295652 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:46.296421 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:46.297083 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:46.297910 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:46.298551 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:46.299064 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:46.332255 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:46.332732 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:46.333161 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:46.333629 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lazy-loading 'fault' on Instance uuid 43271cb9-19d8-42b4-974d-d1ceafae996d {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:57:46.381934 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dc6730a5b01446aa7b2bd8b4f3b6078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce12662c74d7469c88edf845bf6a8a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:46.390870 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-50966e43-1ff2-4844-a476-e09ae86f7f81 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 200 len: 1224 microversion: 2.1 time: 0.107848 Aug 30 04:57:46.391455 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3868/7615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:46 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:47.413159 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:47.413852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] [instance: 43271cb9-19d8-42b4-974d-d1ceafae996d] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:47.421037 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:47.421682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:47.422143 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:47.422880 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:47.423355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:47.423795 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:47.440912 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] HTTP exception thrown: Instance 43271cb9-19d8-42b4-974d-d1ceafae996d could not be found. Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Request method failure captured: Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d HTTP/1.1 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZaJ8z58R83Z4SqK2o0c9nBdhBjHKCTx6UO59_3eU-WXMYz7I1Ox5K_0YQYKsB6vr4iokW0t00eRmgvf1SfPrWQL3tfaXHvJg3kG12EruF_SIKA-jjwoc6Sl75zSXqg_TJ0U6kEr4jh6rT3Ygj1nBLcwVzijVys6Gmkw2gkKg99VaEE Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ce12662c74d7469c88edf845bf6a8a21 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestShelveInstance-265579176 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce12662c74d7469c88edf845bf6a8a21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ce12662c74d7469c88edf845bf6a8a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ce12662c74d7469c88edf845bf6a8a21", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce12662c74d7469c88edf845bf6a8a21"}]}] Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestShelveInstance-265579176 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ce12662c74d7469c88edf845bf6a8a21 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestShelveInstance-265579176 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestShelveInstance-265579176-project Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: 5dc6730a5b01446aa7b2bd8b4f3b6078 Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestShelveInstance-265579176-project Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance 43271cb9-19d8-42b4-974d-d1ceafae996d could not be found. Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': '43271cb9-19d8-42b4-974d-d1ceafae996d'} Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43271cb9-19d8-42b4-974d-d1ceafae996d could not be found. Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43271cb9-19d8-42b4-974d-d1ceafae996d could not be found. Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:47.442885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43271cb9-19d8-42b4-974d-d1ceafae996d could not be found. Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Returning 404 to user: Instance 43271cb9-19d8-42b4-974d-d1ceafae996d could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77f8fb7d-b9a5-4756-8c35-e12deecb51dc tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d" status: 404 len: 111 microversion: 2.1 time: 0.036775 Aug 30 04:57:47.447885 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3748/7616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:47 2022] GET /compute/v2.1/servers/43271cb9-19d8-42b4-974d-d1ceafae996d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:57:47.611996 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-a034c269-74f7-4985-9c78-a26bfa7159e9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] Calling method '.version_select at 0x7f897a47cf70>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:47.661797 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-a034c269-74f7-4985-9c78-a26bfa7159e9 tempest-TestShelveInstance-265579176 tempest-TestShelveInstance-265579176-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1579847501" status: 202 len: 0 microversion: 2.1 time: 0.043413 Aug 30 04:57:47.667388 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3869/7617] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 30 04:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1579847501 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:58:05.148673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=12 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:05.149962 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=24 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:05.360004 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e2227ade-2456-4cc9-a3d6-2c777c24c9ce tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Action: 'create', calling method: .version_select at 0x7f897a67e8b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-967004566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8cciwnpMmTZlTvBd51UJ1LEqU8OCNSGB0Htxdk+JPdn9GsHQKQTy8QHwCo+WWgGkQM4I3GokYKFN7w1c344AYteRGM+ijIrCQE6iG7/GMjSq2U7W/wBjFjjvsI6lixzw=="}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:58:05.391576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e2227ade-2456-4cc9-a3d6-2c777c24c9ce tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Getting quotas for project ecab34f704d542b3a140de4d2047fabd. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:58:05.402469 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-e2227ade-2456-4cc9-a3d6-2c777c24c9ce tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Getting quotas for user bc76a911e7894653b5c4ace2bef8b945 and project ecab34f704d542b3a140de4d2047fabd. Resources: {'key_pairs'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:58:05.438018 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e2227ade-2456-4cc9-a3d6-2c777c24c9ce tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.291899 Aug 30 04:58:05.444844 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3749/7618] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 04:58:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:58:06.445654 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-551049823", "imageRef": "b40a5c3f-7379-4565-a6da-58a9aabde37c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-967004566", "security_groups": [{"name": "tempest-secgroup-smoke-783826856"}], "networks": [{"uuid": "55928ffc-402b-4717-994d-8f6e79f3e74e"}]}} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:58:06.455814 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:06.456545 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:06.554427 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.network.neutron [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] validate_networks() for [('55928ffc-402b-4717-994d-8f6e79f3e74e', None, None, None, None, None)] {{(pid=122168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:58:07.409547 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Flavor limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:58:07.409981 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Image limits 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:58:07.410458 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Flavor pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:58:07.410872 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Image pref 0:0:0 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:58:07.411287 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.virt.hardware [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:58:07.420291 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:07.420777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:07.421210 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:07.421980 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:07.422438 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:07.422869 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:07.440055 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Getting quotas for project ecab34f704d542b3a140de4d2047fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:58:07.446041 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.quota [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Getting quotas for user bc76a911e7894653b5c4ace2bef8b945 and project ecab34f704d542b3a140de4d2047fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:58:07.459236 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Going to run 1 instances... {{(pid=122168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:58:07.461597 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b40a5c3f-7379-4565-a6da-58a9aabde37c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:58:07.516025 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-7860e3a4-ec2e-45c1-8bc1-152ed6ab7469 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.074036 Aug 30 04:58:07.522730 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3870/7619] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 04:58:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:58:07.530389 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5aec6dc1-9e45-425d-ae6f-d590b84be5cf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:07.531085 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5aec6dc1-9e45-425d-ae6f-d590b84be5cf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:07.590770 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5aec6dc1-9e45-425d-ae6f-d590b84be5cf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:07.599008 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5aec6dc1-9e45-425d-ae6f-d590b84be5cf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1247 microversion: 2.1 time: 0.074883 Aug 30 04:58:07.600127 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3750/7620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:07 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:08.621805 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cde86c4c-2742-4d0c-9de7-c889877fd25e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:08.623092 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cde86c4c-2742-4d0c-9de7-c889877fd25e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:08.682185 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cde86c4c-2742-4d0c-9de7-c889877fd25e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:08.689939 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cde86c4c-2742-4d0c-9de7-c889877fd25e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1247 microversion: 2.1 time: 0.073300 Aug 30 04:58:08.703890 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3871/7621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:08 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:09.711643 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-f4b5385c-1288-4144-81e0-3ba01667d815 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:09.712270 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-f4b5385c-1288-4144-81e0-3ba01667d815 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:09.765850 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-f4b5385c-1288-4144-81e0-3ba01667d815 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:09.773206 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-f4b5385c-1288-4144-81e0-3ba01667d815 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1247 microversion: 2.1 time: 0.065521 Aug 30 04:58:09.773810 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3751/7622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:09 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1247 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:10.794568 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:10.795184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:10.803251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:10.803734 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:10.804174 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:10.804862 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:10.805317 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:10.805769 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:10.870178 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:10.878026 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-aae21d6e-8cfa-4252-98c5-783a2187ff94 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1251 microversion: 2.1 time: 0.087323 Aug 30 04:58:10.878593 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3872/7623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:10 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1251 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:11.899034 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:11.899664 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:11.906914 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:11.907421 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:11.907876 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:11.908777 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:11.909263 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:11.910028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:12.004420 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:12.012252 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-90ca1a73-5ac7-496c-b639-c1621c8cedf4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1305 microversion: 2.1 time: 0.117337 Aug 30 04:58:12.012834 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3752/7624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:11 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:12.903742 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-d931cdf4-04a4-44ee-92e0-c2addf527524 req-1a4749bf-6a94-4d23-b7ec-ecc90fcdad24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:58:12.917999 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d931cdf4-04a4-44ee-92e0-c2addf527524 req-1a4749bf-6a94-4d23-b7ec-ecc90fcdad24 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:12.918476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d931cdf4-04a4-44ee-92e0-c2addf527524 req-1a4749bf-6a94-4d23-b7ec-ecc90fcdad24 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:12.918900 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-d931cdf4-04a4-44ee-92e0-c2addf527524 req-1a4749bf-6a94-4d23-b7ec-ecc90fcdad24 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:12.931200 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-d931cdf4-04a4-44ee-92e0-c2addf527524 req-1a4749bf-6a94-4d23-b7ec-ecc90fcdad24 service nova] Creating event network-changed:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 04:58:12.936793 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-d931cdf4-04a4-44ee-92e0-c2addf527524 req-1a4749bf-6a94-4d23-b7ec-ecc90fcdad24 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037721 Aug 30 04:58:12.937817 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3873/7625] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:58:13.034827 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:13.035464 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:13.042555 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:13.042990 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:13.043446 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:13.044193 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:13.044666 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:13.045105 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:13.265036 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:13.274138 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-cb74b928-2ccd-4108-a38f-15e6ee32019a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1372 microversion: 2.1 time: 0.243826 Aug 30 04:58:13.274905 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3753/7626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:13 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:14.298500 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:14.299361 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:14.306428 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:14.306922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:14.307364 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:14.308059 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:14.308522 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:14.308945 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:14.525192 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:14.532884 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-edee889d-047e-411e-97b7-90ba00042566 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1372 microversion: 2.1 time: 0.239180 Aug 30 04:58:14.537394 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3874/7627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:14 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:15.554074 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:15.554767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:15.561726 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:15.562229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:15.562682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:15.563426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:15.563903 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:15.564346 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:15.697589 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:15.705475 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a700271c-f1e4-4ff6-9557-eee676714a92 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1372 microversion: 2.1 time: 0.155289 Aug 30 04:58:15.706579 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3754/7628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:15 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:58:16.727536 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:16.728175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:16.735347 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:16.735841 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:16.736286 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:16.737702 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:16.738162 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:16.738588 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:16.875310 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:16.883284 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-68f83788-ea51-489c-b2db-df5c21443042 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1372 microversion: 2.1 time: 0.159754 Aug 30 04:58:16.883865 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3875/7629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:16 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:17.904245 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:17.904872 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:17.911817 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:17.912319 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:17.912863 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:17.913608 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:17.914083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:17.914529 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:18.046920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:18.055601 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-80f8a5da-5b9d-4f48-94c9-03924a01d32c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1372 microversion: 2.1 time: 0.155295 Aug 30 04:58:18.056167 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3755/7630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:17 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:18.337950 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-3da720b8-6c74-4333-a4f7-c8c1445ba80e req-086d1f6a-7a29-4f44-8adf-010b763f4da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:58:18.343739 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:18.354836 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3da720b8-6c74-4333-a4f7-c8c1445ba80e req-086d1f6a-7a29-4f44-8adf-010b763f4da5 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:18.355325 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3da720b8-6c74-4333-a4f7-c8c1445ba80e req-086d1f6a-7a29-4f44-8adf-010b763f4da5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:18.355758 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-3da720b8-6c74-4333-a4f7-c8c1445ba80e req-086d1f6a-7a29-4f44-8adf-010b763f4da5 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:18.367942 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-3da720b8-6c74-4333-a4f7-c8c1445ba80e req-086d1f6a-7a29-4f44-8adf-010b763f4da5 service nova] Creating event network-vif-plugged:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 04:58:18.373100 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-3da720b8-6c74-4333-a4f7-c8c1445ba80e req-086d1f6a-7a29-4f44-8adf-010b763f4da5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039224 Aug 30 04:58:18.373772 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3876/7631] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:58:19.077191 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:19.077782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:19.085497 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:19.086126 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:19.086574 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:19.087290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:19.087759 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:19.088198 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:19.225624 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:19.236641 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-a539e160-f0f4-485c-bcb9-e5f1eac7bfbd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1372 microversion: 2.1 time: 0.163666 Aug 30 04:58:19.237629 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3756/7632] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:19 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:20.256080 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=8 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:20.261452 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:20.262154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:20.269330 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:20.269826 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:20.270258 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:20.270932 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:20.271379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:20.271795 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:20.405407 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:20.413950 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-9eba3bb5-c9a5-40e4-84f1-a133dac4bf05 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1557 microversion: 2.1 time: 0.158816 Aug 30 04:58:20.414529 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3877/7633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:20 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:20.433972 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:58:20.434595 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:58:20.436486 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=8 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:20.443129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:20.443621 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:20.444166 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:20.444766 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:20.445229 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:20.445691 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:20.582967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:58:20.590909 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-31c9e59d-6dd8-44f5-8b58-8f5698777f40 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1557 microversion: 2.1 time: 0.160875 Aug 30 04:58:20.591508 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3757/7634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 04:58:20 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:58:22.452128 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-f58e6297-8657-4658-ac06-5ff4b0e548bc req-fb82fd5c-fca5-457d-a1d7-23e058f1811a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:58:22.462717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f58e6297-8657-4658-ac06-5ff4b0e548bc req-fb82fd5c-fca5-457d-a1d7-23e058f1811a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:58:22.463199 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f58e6297-8657-4658-ac06-5ff4b0e548bc req-fb82fd5c-fca5-457d-a1d7-23e058f1811a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:58:22.463632 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-f58e6297-8657-4658-ac06-5ff4b0e548bc req-fb82fd5c-fca5-457d-a1d7-23e058f1811a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:58:22.475511 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-f58e6297-8657-4658-ac06-5ff4b0e548bc req-fb82fd5c-fca5-457d-a1d7-23e058f1811a service nova] Creating event network-changed:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 04:58:22.480540 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-f58e6297-8657-4658-ac06-5ff4b0e548bc req-fb82fd5c-fca5-457d-a1d7-23e058f1811a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032770 Aug 30 04:58:22.481138 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3878/7635] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 04:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:00:17.594061 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99726791-41d9-4ddb-ab1a-77643d1de9ab] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 05:00:17.595232 n-d-854924-5 devstack@n-api.service[122167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fc55d3c-812f-4698-b96a-6eee9a1778ca] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 05:00:17.595767 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:17.596693 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=36 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:17.598156 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 05:00:17.599647 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 05:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309/action (ip 10.222.0.30) !!! Aug 30 05:00:17.599647 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:00:17.599647 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 05:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309/action (ip 10.222.0.30) !!! Aug 30 05:00:17.606055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1150030138"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:17.608451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:17.619042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:17.619541 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:17.619989 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:17.620698 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:17.621165 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:17.621632 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:17.922965 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-50e43ce4-5247-4695-b1ff-2cbeed01d60f tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "POST /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309/action" status: 202 len: 0 microversion: 2.1 time: 0.330617 Aug 30 05:00:17.923638 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3758/7636] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 05:00:17 2022] POST /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 05:00:22.903309 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:00:22.904823 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:00:22.905693 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:22.907414 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=32 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:22.988007 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-7f0551b1-1363-4a0a-987b-e77bcdd2e97b req-644157ca-d073-416b-a901-c1650ecf680c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "name": "network-vif-plugged", "status": "completed", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:23.002028 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7f0551b1-1363-4a0a-987b-e77bcdd2e97b req-644157ca-d073-416b-a901-c1650ecf680c service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:23.002727 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7f0551b1-1363-4a0a-987b-e77bcdd2e97b req-644157ca-d073-416b-a901-c1650ecf680c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:23.003171 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-7f0551b1-1363-4a0a-987b-e77bcdd2e97b req-644157ca-d073-416b-a901-c1650ecf680c service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:23.014663 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-7f0551b1-1363-4a0a-987b-e77bcdd2e97b req-644157ca-d073-416b-a901-c1650ecf680c service nova] Creating event network-vif-plugged:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 05:00:23.020785 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-7f0551b1-1363-4a0a-987b-e77bcdd2e97b req-644157ca-d073-416b-a901-c1650ecf680c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119231 Aug 30 05:00:23.021769 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3879/7637] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:00:31.491869 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:31.492665 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:31.501251 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] [99726791-41d9-4ddb-ab1a-77643d1de9ab] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43168. Aug 30 05:00:31.506045 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1961097688", "imageRef": "ca130641-eedf-40e2-8779-28b75269e0c4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-967004566", "security_groups": [{"name": "tempest-secgroup-smoke-783826856"}], "networks": [{"uuid": "55928ffc-402b-4717-994d-8f6e79f3e74e"}]}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:31.530243 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fc55d3c-812f-4698-b96a-6eee9a1778ca] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43170. Aug 30 05:00:31.620285 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.network.neutron [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] validate_networks() for [('55928ffc-402b-4717-994d-8f6e79f3e74e', None, None, None, None, None)] {{(pid=122167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:00:32.047594 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Flavor limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:00:32.048028 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Image limits 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:00:32.048507 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Flavor pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:00:32.048924 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Image pref 0:0:0 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:00:32.049360 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.virt.hardware [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:00:32.058885 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:32.059310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:32.059751 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:32.060485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:32.060946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:32.061458 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:32.078614 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Getting quotas for project ecab34f704d542b3a140de4d2047fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:00:32.083896 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.quota [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Getting quotas for user bc76a911e7894653b5c4ace2bef8b945 and project ecab34f704d542b3a140de4d2047fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:00:32.097904 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Going to run 1 instances... {{(pid=122167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:00:32.100437 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca130641-eedf-40e2-8779-28b75269e0c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:00:32.148988 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-7d771cd6-6a25-4c87-b618-05f29f8ad40e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.660200 Aug 30 05:00:32.149680 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3759/7638] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 05:00:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:00:32.162327 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-0d94fa0f-007d-418c-8498-4a1b55265c75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:32.163032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-0d94fa0f-007d-418c-8498-4a1b55265c75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:32.195670 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43184. Aug 30 05:00:32.196490 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43186. Aug 30 05:00:32.277298 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-0d94fa0f-007d-418c-8498-4a1b55265c75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:32.284324 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-0d94fa0f-007d-418c-8498-4a1b55265c75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1248 microversion: 2.1 time: 0.127412 Aug 30 05:00:32.285545 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3880/7639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:32 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1248 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:33.307032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:33.307739 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:33.316267 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:33.317055 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:33.317756 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:33.318485 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:33.319115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:33.319557 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:33.387117 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:33.396263 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4c2a6f41-6423-4d42-b929-0f1e36b975e0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1318 microversion: 2.1 time: 0.094142 Aug 30 05:00:33.396853 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3760/7640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:33 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:34.417678 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:34.418308 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:34.420297 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:34.443829 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:34.445467 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:34.446106 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:34.447075 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:34.447717 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:34.448333 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:34.600126 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:34.608365 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-cfcee529-1a4b-4bb9-9b74-91781af53558 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.194413 Aug 30 05:00:34.608958 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3881/7641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:34 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:34.921073 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-9968a623-1599-4fef-9fef-87204d851ba6 req-2215e852-3f90-43dc-a133-84098c4599d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:34.939154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9968a623-1599-4fef-9fef-87204d851ba6 req-2215e852-3f90-43dc-a133-84098c4599d0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:34.940533 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9968a623-1599-4fef-9fef-87204d851ba6 req-2215e852-3f90-43dc-a133-84098c4599d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:34.941100 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-9968a623-1599-4fef-9fef-87204d851ba6 req-2215e852-3f90-43dc-a133-84098c4599d0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:34.956309 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-9968a623-1599-4fef-9fef-87204d851ba6 req-2215e852-3f90-43dc-a133-84098c4599d0 service nova] Creating event network-vif-unplugged:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 05:00:34.970407 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-9968a623-1599-4fef-9fef-87204d851ba6 req-2215e852-3f90-43dc-a133-84098c4599d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052954 Aug 30 05:00:34.971089 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3761/7642] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:00:35.630609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:35.631378 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:35.638577 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:35.639076 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:35.639517 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:35.640430 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:35.641081 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:35.641998 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:35.798451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:35.807645 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-627dc9e6-ff78-412a-bb15-9129406e7316 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.181327 Aug 30 05:00:35.808217 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3882/7643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:35 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:36.832241 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:36.833054 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:36.839852 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:36.840368 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:36.841001 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:36.841655 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:36.842131 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:36.842571 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:37.006933 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:37.014983 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-c9e64e87-762a-4ac7-9d39-e71dbca34236 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.188742 Aug 30 05:00:37.015567 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3762/7644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:36 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:38.036849 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:38.037681 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:38.044946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:38.045476 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:38.045922 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:38.046633 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:38.047097 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:38.047524 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:38.205379 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:38.215455 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-26a303ba-61bc-46b9-b697-4ede6666e728 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.182998 Aug 30 05:00:38.216308 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3883/7645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:38 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:39.239570 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:39.240115 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:39.248019 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:39.248996 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:39.249596 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:39.250370 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:39.250984 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:39.251742 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:39.422630 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:39.432210 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-303b1554-92aa-48f0-9ed0-bc893157bf87 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.197709 Aug 30 05:00:39.432991 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3763/7646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:39 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:40.452089 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:40.452765 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:40.459619 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:40.460136 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:40.460573 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:40.461273 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:40.461748 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:40.462169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:40.608669 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:40.617608 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-72da8867-0f69-4e74-be6a-d67131bd6f75 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.169327 Aug 30 05:00:40.618214 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3884/7647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:40 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:41.639550 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:41.640303 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:41.647694 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:41.648192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:41.648637 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:41.649369 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:41.649932 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:41.650366 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:41.792290 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:41.800148 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-4aaf153f-218f-421e-9458-58b2885bde07 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.165077 Aug 30 05:00:41.801206 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3764/7648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:41 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:42.823670 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:42.824251 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:42.826870 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell0:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:42.833069 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:42.833576 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:42.834010 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:42.834697 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:42.835145 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:42.835566 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:42.965033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:42.972823 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3a25a96-f0ff-45e1-8202-ca3b232a11c2 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.153089 Aug 30 05:00:42.973472 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3885/7649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:42 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:00:43.992977 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:43.993561 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:43.995568 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:43.996269 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell0:SELECT=6 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:44.002802 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:44.003302 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:44.003745 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:44.004451 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:44.004909 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:44.005361 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:44.145959 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:44.154345 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ef475a9c-22cf-4ff5-ae6f-4bcea5de2269 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.165454 Aug 30 05:00:44.155152 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3765/7650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:43 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:44.312921 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0e7974f4-e032-4f2d-ac6c-81493fda6f91 req-7c118b3a-e2bf-4ab4-afd0-d63eebed6967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a992f545-acd2-4bf4-998e-fb7444a4110f", "tag": "d1a03cb9-8b2a-4d7f-8b52-f90de610c73d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:44.324304 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0e7974f4-e032-4f2d-ac6c-81493fda6f91 req-7c118b3a-e2bf-4ab4-afd0-d63eebed6967 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:44.324777 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0e7974f4-e032-4f2d-ac6c-81493fda6f91 req-7c118b3a-e2bf-4ab4-afd0-d63eebed6967 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:44.325431 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0e7974f4-e032-4f2d-ac6c-81493fda6f91 req-7c118b3a-e2bf-4ab4-afd0-d63eebed6967 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:44.337163 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0e7974f4-e032-4f2d-ac6c-81493fda6f91 req-7c118b3a-e2bf-4ab4-afd0-d63eebed6967 service nova] Creating event network-changed:d1a03cb9-8b2a-4d7f-8b52-f90de610c73d for instance a992f545-acd2-4bf4-998e-fb7444a4110f on n-h1-854924-5 Aug 30 05:00:44.342043 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0e7974f4-e032-4f2d-ac6c-81493fda6f91 req-7c118b3a-e2bf-4ab4-afd0-d63eebed6967 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033002 Aug 30 05:00:44.342642 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3886/7651] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:00:45.176310 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:45.176929 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:45.183782 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:45.184278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:45.184728 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:45.185455 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:45.185920 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:45.186355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:45.317046 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:45.324832 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d5900226-f4f4-425b-bfb8-5f084066e8e6 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.153067 Aug 30 05:00:45.325425 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3766/7652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:45 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:46.346919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:46.347646 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:46.353973 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:46.354400 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:46.354838 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:46.355555 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:46.356008 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:46.356434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:46.501752 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:46.511302 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2860eed0-6e09-4681-bb53-d465ca3cddaf tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.169605 Aug 30 05:00:46.511896 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3887/7653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:46 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:47.532673 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:47.533314 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:47.540195 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:47.540689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:47.541139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:47.541856 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:47.542322 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:47.542754 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:47.672682 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:47.680949 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-52379208-9209-409d-b26e-0659145330a4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.152234 Aug 30 05:00:47.681558 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3767/7654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:47 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:48.702781 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:48.703397 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:48.710767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:48.711250 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:48.711683 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:48.712395 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:48.712846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:48.713267 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:48.849736 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:48.857377 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-b3cc3d00-c6f1-47db-8119-b238644729b0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.158421 Aug 30 05:00:48.857939 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3888/7655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:48 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:49.879822 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:49.880484 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:49.887448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:49.887950 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:49.888400 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:49.889103 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:49.889599 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:49.890042 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:50.022278 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:50.029901 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d4ebc952-1cf4-4c32-9e88-0eab95357807 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.154649 Aug 30 05:00:50.030471 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3768/7656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:49 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:50.278464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-9f7acc4a-3c93-419a-a170-2ace9935e767 req-d64982db-68ac-4ef5-8257-a8c852df8a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a992f545-acd2-4bf4-998e-fb7444a4110f", "name": "network-vif-plugged", "status": "completed", "tag": "d1a03cb9-8b2a-4d7f-8b52-f90de610c73d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:50.291073 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9f7acc4a-3c93-419a-a170-2ace9935e767 req-d64982db-68ac-4ef5-8257-a8c852df8a95 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:50.291557 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9f7acc4a-3c93-419a-a170-2ace9935e767 req-d64982db-68ac-4ef5-8257-a8c852df8a95 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:50.292023 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-9f7acc4a-3c93-419a-a170-2ace9935e767 req-d64982db-68ac-4ef5-8257-a8c852df8a95 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:50.303433 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-9f7acc4a-3c93-419a-a170-2ace9935e767 req-d64982db-68ac-4ef5-8257-a8c852df8a95 service nova] Creating event network-vif-plugged:d1a03cb9-8b2a-4d7f-8b52-f90de610c73d for instance a992f545-acd2-4bf4-998e-fb7444a4110f on n-h1-854924-5 Aug 30 05:00:50.308575 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-9f7acc4a-3c93-419a-a170-2ace9935e767 req-d64982db-68ac-4ef5-8257-a8c852df8a95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033869 Aug 30 05:00:50.309217 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3889/7657] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:00:51.051844 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:51.052462 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:51.059304 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:51.059796 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:51.060239 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:51.061032 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:51.061528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:51.061963 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:51.194906 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:51.202553 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-96d108b4-05bf-49d9-a511-692132e53ca4 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1373 microversion: 2.1 time: 0.155272 Aug 30 05:00:51.203135 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3769/7658] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:51 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:52.225437 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:52.226184 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:52.232504 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:52.232992 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:52.233464 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:52.234154 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:52.234608 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:52.235032 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:52.382660 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:52.390490 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-27b9032f-04d3-4782-83aa-a9b904e22d60 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1557 microversion: 2.1 time: 0.171008 Aug 30 05:00:52.391097 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3890/7659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:52 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:52.412429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:00:52.413044 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:00:52.419861 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:52.420355 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:52.420801 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:52.421528 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:52.421993 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:52.422431 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:52.551855 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:00:52.560025 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-e6a7366a-9601-496b-8d45-57c431585653 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1557 microversion: 2.1 time: 0.152173 Aug 30 05:00:52.560601 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3770/7660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:00:52 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:00:54.382558 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-0bc5b740-a434-4cf2-a91e-32ae89e4ed0f req-345ac9f6-5f5f-46cd-8128-f2e3b6ba28d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a992f545-acd2-4bf4-998e-fb7444a4110f", "tag": "d1a03cb9-8b2a-4d7f-8b52-f90de610c73d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:00:54.388549 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=27 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:54.394767 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0bc5b740-a434-4cf2-a91e-32ae89e4ed0f req-345ac9f6-5f5f-46cd-8128-f2e3b6ba28d2 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:00:54.395248 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0bc5b740-a434-4cf2-a91e-32ae89e4ed0f req-345ac9f6-5f5f-46cd-8128-f2e3b6ba28d2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:00:54.395679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-0bc5b740-a434-4cf2-a91e-32ae89e4ed0f req-345ac9f6-5f5f-46cd-8128-f2e3b6ba28d2 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:00:54.406914 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-0bc5b740-a434-4cf2-a91e-32ae89e4ed0f req-345ac9f6-5f5f-46cd-8128-f2e3b6ba28d2 service nova] Creating event network-changed:d1a03cb9-8b2a-4d7f-8b52-f90de610c73d for instance a992f545-acd2-4bf4-998e-fb7444a4110f on n-h1-854924-5 Aug 30 05:00:54.411860 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-0bc5b740-a434-4cf2-a91e-32ae89e4ed0f req-345ac9f6-5f5f-46cd-8128-f2e3b6ba28d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033928 Aug 30 05:00:54.412453 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3891/7661] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:05.042600 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2135518423"}} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:05.045736 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:05.048443 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:05.049113 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=64 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:05.050095 n-d-854924-5 devstack@n-api.service[122167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:03:05.050237 n-d-854924-5 devstack@n-api.service[122167]: Tue Aug 30 05:03:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f/action (ip 10.222.0.30) !!! Aug 30 05:03:05.059430 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:05.059967 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:05.060419 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:05.061139 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:05.061638 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:05.062083 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:05.259947 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-6272af2e-cc2f-4539-a4d8-4fc4651d9c4b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "POST /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f/action" status: 202 len: 0 microversion: 2.1 time: 0.221933 Aug 30 05:03:05.260594 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3771/7662] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 05:03:05 2022] POST /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 05:03:12.957604 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:03:12.959517 n-d-854924-5 devstack@n-api.service[122168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:03:12.960311 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=1 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:12.961434 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=54 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:12.962325 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:03:12.962494 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 05:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Aug 30 05:03:12.964820 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:03:12.964820 n-d-854924-5 devstack@n-api.service[122168]: Tue Aug 30 05:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Aug 30 05:03:12.971277 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c02d88ff-e7b7-4227-bc2c-825b3446ab65 req-2afcd972-e993-41d0-8393-6a66d83f63c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a992f545-acd2-4bf4-998e-fb7444a4110f", "name": "network-vif-plugged", "status": "completed", "tag": "d1a03cb9-8b2a-4d7f-8b52-f90de610c73d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:12.986211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c02d88ff-e7b7-4227-bc2c-825b3446ab65 req-2afcd972-e993-41d0-8393-6a66d83f63c7 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:12.986761 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c02d88ff-e7b7-4227-bc2c-825b3446ab65 req-2afcd972-e993-41d0-8393-6a66d83f63c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:12.987211 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c02d88ff-e7b7-4227-bc2c-825b3446ab65 req-2afcd972-e993-41d0-8393-6a66d83f63c7 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:12.999837 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c02d88ff-e7b7-4227-bc2c-825b3446ab65 req-2afcd972-e993-41d0-8393-6a66d83f63c7 service nova] Creating event network-vif-plugged:d1a03cb9-8b2a-4d7f-8b52-f90de610c73d for instance a992f545-acd2-4bf4-998e-fb7444a4110f on n-h1-854924-5 Aug 30 05:03:13.004885 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c02d88ff-e7b7-4227-bc2c-825b3446ab65 req-2afcd972-e993-41d0-8393-6a66d83f63c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049897 Aug 30 05:03:13.006104 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3892/7663] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:03:24.399196 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_api:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:24.401448 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_api:SELECT=2 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:24.402343 n-d-854924-5 devstack@n-api.service[122168]: DEBUG dbcounter [-] [122168] Writing DB stats nova_cell1:SELECT=2 {{(pid=122168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:24.406133 n-d-854924-5 devstack@n-api.service[122167]: DEBUG dbcounter [-] [122167] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:24.416834 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e8b8785-915f-454f-8534-f4cd2850c306] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43512. Aug 30 05:03:24.424965 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:24.425641 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:24.434129 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:24.434901 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:24.435524 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:24.435656 n-d-854924-5 devstack@n-api.service[122168]: INFO oslo.messaging._drivers.impl_rabbit [-] [b55ce021-019a-4c53-a69b-2894f0981e38] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43510. Aug 30 05:03:24.436274 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:24.436769 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:24.437209 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:24.468567 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Going to try to terminate instance {{(pid=122167) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:03:24.566380 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-0b473400-dcf8-4fe1-8196-ffd720020490 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 204 len: 0 microversion: 2.1 time: 0.175304 Aug 30 05:03:24.567150 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3772/7664] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 05:03:24 2022] DELETE /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:03:24.576148 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:24.577192 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:24.583539 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:24.583893 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:24.584341 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:24.585047 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:24.585573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:24.586011 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:24.600706 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-c3335a1f-83fe-49a2-a134-df97242887af req-d7660bf7-32b1-410d-a96c-2bbf76e718a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a992f545-acd2-4bf4-998e-fb7444a4110f", "tag": "d1a03cb9-8b2a-4d7f-8b52-f90de610c73d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:24.615242 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c3335a1f-83fe-49a2-a134-df97242887af req-d7660bf7-32b1-410d-a96c-2bbf76e718a0 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:24.615854 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c3335a1f-83fe-49a2-a134-df97242887af req-d7660bf7-32b1-410d-a96c-2bbf76e718a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:24.616302 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-c3335a1f-83fe-49a2-a134-df97242887af req-d7660bf7-32b1-410d-a96c-2bbf76e718a0 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:24.630626 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-c3335a1f-83fe-49a2-a134-df97242887af req-d7660bf7-32b1-410d-a96c-2bbf76e718a0 service nova] Creating event network-changed:d1a03cb9-8b2a-4d7f-8b52-f90de610c73d for instance a992f545-acd2-4bf4-998e-fb7444a4110f on n-h1-854924-5 Aug 30 05:03:24.636228 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-c3335a1f-83fe-49a2-a134-df97242887af req-d7660bf7-32b1-410d-a96c-2bbf76e718a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243675 Aug 30 05:03:24.636948 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3893/7665] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:24.733961 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:24.743119 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-5f0fc0ae-0191-41e7-822d-ee670281313c tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1681 microversion: 2.1 time: 0.171490 Aug 30 05:03:24.743704 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3773/7666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:24 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:03:25.764583 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:25.765281 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:25.772846 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:25.773324 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:25.773784 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:25.774461 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:25.775299 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:25.775726 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:25.912875 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:25.921295 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-2db37a55-0595-4c5a-a07b-4e9b766fce8a tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1681 microversion: 2.1 time: 0.160900 Aug 30 05:03:25.921898 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3894/7667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:25 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:26.944573 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:26.945160 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:26.953313 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.953847 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.954306 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:26.955154 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.955477 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.956429 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:27.038600 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [req-78478281-4541-46b7-af54-2cd293251506 req-0d07afaf-47a5-4492-8ef7-017c759f4a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a992f545-acd2-4bf4-998e-fb7444a4110f", "name": "network-vif-deleted", "tag": "d1a03cb9-8b2a-4d7f-8b52-f90de610c73d"}]} {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:27.040764 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:27.050339 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-78478281-4541-46b7-af54-2cd293251506 req-0d07afaf-47a5-4492-8ef7-017c759f4a50 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:27.050859 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-78478281-4541-46b7-af54-2cd293251506 req-0d07afaf-47a5-4492-8ef7-017c759f4a50 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:27.051290 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [req-78478281-4541-46b7-af54-2cd293251506 req-0d07afaf-47a5-4492-8ef7-017c759f4a50 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:27.054779 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-ec29400c-6b88-4b35-9a33-466d29fb6e9e tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 200 len: 1496 microversion: 2.1 time: 0.114595 Aug 30 05:03:27.060879 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3774/7668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:26 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 1496 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:27.067168 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.compute.server_external_events [req-78478281-4541-46b7-af54-2cd293251506 req-0d07afaf-47a5-4492-8ef7-017c759f4a50 service nova] Creating event network-vif-deleted:d1a03cb9-8b2a-4d7f-8b52-f90de610c73d for instance a992f545-acd2-4bf4-998e-fb7444a4110f on n-h1-854924-5 Aug 30 05:03:27.072974 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [req-78478281-4541-46b7-af54-2cd293251506 req-0d07afaf-47a5-4492-8ef7-017c759f4a50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037758 Aug 30 05:03:27.076655 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3895/7669] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:03:28.076348 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:28.077167 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: a992f545-acd2-4bf4-998e-fb7444a4110f] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:28.084035 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:28.084526 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:28.084970 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:28.085689 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:28.086153 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:28.086588 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:28.101116 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.wsgi [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] HTTP exception thrown: Instance a992f545-acd2-4bf4-998e-fb7444a4110f could not be found. Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Request method failure captured: Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: request: GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f HTTP/1.1 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Accept: application/json Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Accept-Encoding: identity Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Connection: close Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Content-Length: 0 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Content-Type: application/json Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Host: 10.222.0.30 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: Openstack-System-Scope: None Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: User-Agent: python-urllib3/1.26.12 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Auth-Token: gAAAAABjDZjYC2Ap07FC-Gf-tVcYpsBLnZcApNlcF3Ak8dmJReQkau9K31xLry1IOobXwgdphNbbfFCcXVqtYMQKDB0RHU5Dy6unlXNI3aJQu3bTP5dcDbvGO1VfvfBeH-RU8PRtdyIduoqY3jpduhObINolP_vOfvW70q6kNVhiOepFPF5uvVU Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Id: None Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Domain-Name: None Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Identity-Status: Confirmed Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Is-Admin-Project: True Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Id: default Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Domain-Name: Default Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Id: ecab34f704d542b3a140de4d2047fabd Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Project-Name: tempest-TestSnapshotPattern-1801484602 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Role: member,reader Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Roles: member,reader Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ecab34f704d542b3a140de4d2047fabd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ecab34f704d542b3a140de4d2047fabd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ecab34f704d542b3a140de4d2047fabd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ecab34f704d542b3a140de4d2047fabd"}]}] Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant: tempest-TestSnapshotPattern-1801484602 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Id: ecab34f704d542b3a140de4d2047fabd Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-Tenant-Name: tempest-TestSnapshotPattern-1801484602 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-User: tempest-TestSnapshotPattern-1801484602-project Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Id: default Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-User-Domain-Name: Default Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-User-Id: bc76a911e7894653b5c4ace2bef8b945 Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: X-User-Name: tempest-TestSnapshotPattern-1801484602-project Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: method: > Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: exception: Instance a992f545-acd2-4bf4-998e-fb7444a4110f could not be found. Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: action_args: {'id': 'a992f545-acd2-4bf4-998e-fb7444a4110f'} Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a992f545-acd2-4bf4-998e-fb7444a4110f could not be found. Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a992f545-acd2-4bf4-998e-fb7444a4110f could not be found. Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:28.102825 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a992f545-acd2-4bf4-998e-fb7444a4110f could not be found. Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: ERROR nova.api.openstack.wsgi Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Returning 404 to user: Instance a992f545-acd2-4bf4-998e-fb7444a4110f could not be found. {{(pid=122167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-77a16795-b5dd-425c-8865-1a26ba64d95b tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f" status: 404 len: 111 microversion: 2.1 time: 0.031986 Aug 30 05:03:28.108502 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3775/7670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:28 2022] GET /compute/v2.1/servers/a992f545-acd2-4bf4-998e-fb7444a4110f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:03:29.457919 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:29.458511 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:29.466864 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-5c68978d-55b4-44da-be88-a655f7dcd9e6 req-5694ae7b-c4ec-423f-b2f7-d7f904e1395a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:29.478487 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5c68978d-55b4-44da-be88-a655f7dcd9e6 req-5694ae7b-c4ec-423f-b2f7-d7f904e1395a service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.478982 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5c68978d-55b4-44da-be88-a655f7dcd9e6 req-5694ae7b-c4ec-423f-b2f7-d7f904e1395a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.479426 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-5c68978d-55b4-44da-be88-a655f7dcd9e6 req-5694ae7b-c4ec-423f-b2f7-d7f904e1395a service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.487621 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.488112 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.488738 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.489474 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.490139 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.490567 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.491366 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-5c68978d-55b4-44da-be88-a655f7dcd9e6 req-5694ae7b-c4ec-423f-b2f7-d7f904e1395a service nova] Creating event network-changed:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 05:03:29.496926 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-5c68978d-55b4-44da-be88-a655f7dcd9e6 req-5694ae7b-c4ec-423f-b2f7-d7f904e1395a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034260 Aug 30 05:03:29.498056 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3776/7671] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:29.518130 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Going to try to terminate instance {{(pid=122168) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:03:29.605568 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-512de6e9-76d6-457f-ace6-2189ad029388 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 204 len: 0 microversion: 2.1 time: 0.152150 Aug 30 05:03:29.606924 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3896/7672] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 05:03:29 2022] DELETE /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:03:29.617328 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:29.618576 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.compute.api [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122167) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:29.626476 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.627259 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.628040 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.628955 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.629806 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.630681 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.794137 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.policy [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:29.802097 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d745eb7a-e0b8-49c5-91c6-75c2f57eb764 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1682 microversion: 2.1 time: 0.189025 Aug 30 05:03:29.802681 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3777/7673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:29 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:30.824946 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:30.825609 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:30.832927 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:30.833465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:30.833889 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:30.834586 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:30.835040 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:30.835465 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:30.867679 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:30.868169 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:30.868606 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:30.869061 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.objects.instance [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lazy-loading 'fault' on Instance uuid f8ce6ebf-c168-4123-b982-7aa8ab6cd309 {{(pid=122168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:03:30.914175 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.policy [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc76a911e7894653b5c4ace2bef8b945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecab34f704d542b3a140de4d2047fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:30.925332 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-f7079022-e8ec-4e99-9d09-d5d7c2b5d033 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 200 len: 1337 microversion: 2.1 time: 0.104668 Aug 30 05:03:30.928738 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3897/7674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:30 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:03:31.512127 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [req-fe19d910-7727-412b-a7e8-05d75439cbd4 req-2ad7f2b3-0656-43bb-95ee-1be9b9b1e560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ce6ebf-c168-4123-b982-7aa8ab6cd309", "name": "network-vif-deleted", "tag": "e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d"}]} {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:31.522457 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fe19d910-7727-412b-a7e8-05d75439cbd4 req-2ad7f2b3-0656-43bb-95ee-1be9b9b1e560 service nova] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:31.522946 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fe19d910-7727-412b-a7e8-05d75439cbd4 req-2ad7f2b3-0656-43bb-95ee-1be9b9b1e560 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:31.523383 n-d-854924-5 devstack@n-api.service[122167]: DEBUG oslo_concurrency.lockutils [req-fe19d910-7727-412b-a7e8-05d75439cbd4 req-2ad7f2b3-0656-43bb-95ee-1be9b9b1e560 service nova] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:31.534202 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.compute.server_external_events [req-fe19d910-7727-412b-a7e8-05d75439cbd4 req-2ad7f2b3-0656-43bb-95ee-1be9b9b1e560 service nova] Creating event network-vif-deleted:e9e1773e-7990-4d8a-a58e-0a0dca0e5f6d for instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 on n-h2-854924-5 Aug 30 05:03:31.538939 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [req-fe19d910-7727-412b-a7e8-05d75439cbd4 req-2ad7f2b3-0656-43bb-95ee-1be9b9b1e560 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030547 Aug 30 05:03:31.539519 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3778/7675] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:03:31.946808 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '>' {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:31.947451 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.compute.api [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] [instance: f8ce6ebf-c168-4123-b982-7aa8ab6cd309] Fetching instance by UUID {{(pid=122168) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:31.954319 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:31.954797 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:31.955229 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:31.955908 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Acquiring lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:31.956355 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:31.956771 n-d-854924-5 devstack@n-api.service[122168]: DEBUG oslo_concurrency.lockutils [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Lock "381d13c5-c82a-413a-b812-f2cf3864a4b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:31.970407 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.wsgi [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] HTTP exception thrown: Instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 could not be found. Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Request method failure captured: Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: request: GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 HTTP/1.1 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Accept: application/json Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Accept-Encoding: identity Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Connection: close Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Content-Length: 0 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Content-Type: application/json Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Host: 10.222.0.30 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: Openstack-System-Scope: None Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: User-Agent: python-urllib3/1.26.12 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Auth-Token: gAAAAABjDZjYC2Ap07FC-Gf-tVcYpsBLnZcApNlcF3Ak8dmJReQkau9K31xLry1IOobXwgdphNbbfFCcXVqtYMQKDB0RHU5Dy6unlXNI3aJQu3bTP5dcDbvGO1VfvfBeH-RU8PRtdyIduoqY3jpduhObINolP_vOfvW70q6kNVhiOepFPF5uvVU Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Id: None Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Domain-Name: None Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Identity-Status: Confirmed Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Is-Admin-Project: True Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Id: default Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Domain-Name: Default Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Id: ecab34f704d542b3a140de4d2047fabd Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Project-Name: tempest-TestSnapshotPattern-1801484602 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Role: member,reader Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Roles: member,reader Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ecab34f704d542b3a140de4d2047fabd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ecab34f704d542b3a140de4d2047fabd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ecab34f704d542b3a140de4d2047fabd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ecab34f704d542b3a140de4d2047fabd"}]}] Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant: tempest-TestSnapshotPattern-1801484602 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Id: ecab34f704d542b3a140de4d2047fabd Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-Tenant-Name: tempest-TestSnapshotPattern-1801484602 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-User: tempest-TestSnapshotPattern-1801484602-project Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Id: default Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Domain-Name: Default Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Id: bc76a911e7894653b5c4ace2bef8b945 Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: X-User-Name: tempest-TestSnapshotPattern-1801484602-project Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: method: > Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: exception: Instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 could not be found. Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: action_args: {'id': 'f8ce6ebf-c168-4123-b982-7aa8ab6cd309'} Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: {{(pid=122168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 could not be found. Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 could not be found. Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:31.972033 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 could not be found. Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: ERROR nova.api.openstack.wsgi Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: DEBUG nova.api.openstack.wsgi [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Returning 404 to user: Instance f8ce6ebf-c168-4123-b982-7aa8ab6cd309 could not be found. {{(pid=122168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: INFO nova.api.openstack.requestlog [None req-58a847b2-8914-4c07-9850-6473de4d54cd tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309" status: 404 len: 111 microversion: 2.1 time: 0.030521 Aug 30 05:03:31.977084 n-d-854924-5 devstack@n-api.service[122168]: [pid: 122168|app: 0|req: 3898/7676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:31 2022] GET /compute/v2.1/servers/f8ce6ebf-c168-4123-b982-7aa8ab6cd309 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:03:32.138720 n-d-854924-5 devstack@n-api.service[122167]: DEBUG nova.api.openstack.wsgi [None req-d66b03e4-430f-4fb8-b02c-c64c1524e7f0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] Calling method '.version_select at 0x7f8983cc4ca0>' {{(pid=122167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:32.163951 n-d-854924-5 devstack@n-api.service[122167]: INFO nova.api.openstack.requestlog [None req-d66b03e4-430f-4fb8-b02c-c64c1524e7f0 tempest-TestSnapshotPattern-1801484602 tempest-TestSnapshotPattern-1801484602-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-967004566" status: 202 len: 0 microversion: 2.1 time: 0.029328 Aug 30 05:03:32.164486 n-d-854924-5 devstack@n-api.service[122167]: [pid: 122167|app: 0|req: 3779/7677] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 30 05:03:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-967004566 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)